JP5186561B2 - 拡張現実感の非写実的レンダリング - Google Patents

拡張現実感の非写実的レンダリング Download PDF

Info

Publication number
JP5186561B2
JP5186561B2 JP2010514098A JP2010514098A JP5186561B2 JP 5186561 B2 JP5186561 B2 JP 5186561B2 JP 2010514098 A JP2010514098 A JP 2010514098A JP 2010514098 A JP2010514098 A JP 2010514098A JP 5186561 B2 JP5186561 B2 JP 5186561B2
Authority
JP
Japan
Prior art keywords
image
npr
transparency
window
processing unit
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2010514098A
Other languages
English (en)
Japanese (ja)
Other versions
JP2010532035A (ja
Inventor
グァング‐ゾング、ヤング
ミルナ、レロティック
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Ip2ipo Innovations Ltd
Original Assignee
Ip2ipo Innovations Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Ip2ipo Innovations Ltd filed Critical Ip2ipo Innovations Ltd
Publication of JP2010532035A publication Critical patent/JP2010532035A/ja
Application granted granted Critical
Publication of JP5186561B2 publication Critical patent/JP5186561B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G06T15/50—Lighting effects
    • G06T15/503—Blending, e.g. for anti-aliasing
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G06T15/02—Non-photorealistic rendering
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/006—Mixed reality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2210/00—Indexing scheme for image generation or computer graphics
    • G06T2210/62—Semi-transparency

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Graphics (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Processing Or Creating Images (AREA)
  • Image Generation (AREA)
  • Image Processing (AREA)
JP2010514098A 2007-06-29 2008-06-23 拡張現実感の非写実的レンダリング Active JP5186561B2 (ja)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
GB0712690.7 2007-06-29
GBGB0712690.7A GB0712690D0 (en) 2007-06-29 2007-06-29 Imagee processing
PCT/GB2008/002139 WO2009004296A1 (fr) 2007-06-29 2008-06-23 Rendu non photoréaliste d'une réalité accrue

Publications (2)

Publication Number Publication Date
JP2010532035A JP2010532035A (ja) 2010-09-30
JP5186561B2 true JP5186561B2 (ja) 2013-04-17

Family

ID=38420978

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2010514098A Active JP5186561B2 (ja) 2007-06-29 2008-06-23 拡張現実感の非写実的レンダリング

Country Status (10)

Country Link
US (1) US8878900B2 (fr)
EP (1) EP2174297B1 (fr)
JP (1) JP5186561B2 (fr)
KR (1) KR20100051798A (fr)
CN (1) CN101802873B (fr)
AT (1) ATE500578T1 (fr)
DE (1) DE602008005312D1 (fr)
ES (1) ES2361228T3 (fr)
GB (1) GB0712690D0 (fr)
WO (1) WO2009004296A1 (fr)

Families Citing this family (71)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5859441B2 (ja) * 2009-10-02 2016-02-10 コーニンクレッカ フィリップス エヌ ヴェＫｏｎｉｎｋｌｉｊｋｅ Ｐｈｉｌｉｐｓ Ｎ．Ｖ． ３ｄビデオにおける追加のビューを生成するための視点の選択
SG183408A1 (en) * 2010-04-08 2012-09-27 Univ Nanyang Tech Image generating devices, graphics boards, and image generating methods
US20110287811A1 (en) * 2010-05-21 2011-11-24 Nokia Corporation Method and apparatus for an augmented reality x-ray
CN102271262B (zh) * 2010-06-04 2015-05-13 三星电子株式会社 用于3d显示的基于多线索的视频处理方法
KR20110137634A (ko) * 2010-06-17 2011-12-23 삼성전자주식회사 스케치 영상 생성방법 및 이를 적용한 디스플레이 장치
KR101188715B1 (ko) * 2010-10-04 2012-10-09 한국과학기술연구원 수술 도구의 3차원 추적 시스템 및 이를 이용한 위치 감지 방법
JP5738569B2 (ja) * 2010-10-15 2015-06-24 任天堂株式会社 画像処理プログラム、装置、システムおよび方法
US8514295B2 (en) * 2010-12-17 2013-08-20 Qualcomm Incorporated Augmented reality processing based on eye capture in handheld device
WO2012135545A1 (fr) * 2011-03-29 2012-10-04 Qualcomm Incorporated Pico-projecteurs modulaires connectés à des dispositifs mobiles pour une collaboration multi-utilisateur locale
KR20120117165A (ko) * 2011-04-14 2012-10-24 삼성전자주식회사 3차원 영상의 생성 방법 및 이를 이용하는 내시경 장치
EP2521097B1 (fr) * 2011-04-15 2020-01-22 Sony Interactive Entertainment Europe Limited Système et procédé pour traitement des entrées avec réalité améliorée
US8970693B1 (en) * 2011-12-15 2015-03-03 Rawles Llc Surface modeling with structured light
DE102011089233A1 (de) * 2011-12-20 2013-06-20 Siemens Aktiengesellschaft Texturadaption in zumindest einem aus mindestens zwei Bildern überlagerten, medizinischen Bild
US9734633B2 (en) 2012-01-27 2017-08-15 Microsoft Technology Licensing, Llc Virtual environment generating system
WO2013118065A1 (fr) * 2012-02-06 2013-08-15 Biooptico Ab Disposition de caméra et procédé de traitement d'image pour quantifier la structure et la dégénérescence de tissu
CN102663788B (zh) * 2012-04-12 2014-09-10 云南大学 一种基于非真实感的钢笔淡彩艺术效果绘制方法
EP2706508B1 (fr) * 2012-09-10 2019-08-28 BlackBerry Limited Réduction de la latence dans un affichage à réalité augmentée
US9576397B2 (en) 2012-09-10 2017-02-21 Blackberry Limited Reducing latency in an augmented-reality display
US9265458B2 (en) 2012-12-04 2016-02-23 Sync-Think, Inc. Application of smooth pursuit cognitive testing paradigms to clinical drug development
US9380976B2 (en) 2013-03-11 2016-07-05 Sync-Think, Inc. Optical neuroinformatics
CN104346777B (zh) * 2013-08-09 2017-08-29 联想(北京)有限公司 一种添加现实增强信息的方法及装置
CN103489214A (zh) * 2013-09-10 2014-01-01 北京邮电大学 增强现实系统中基于虚拟模型预处理的虚实遮挡处理方法
CN110363840A (zh) 2014-05-13 2019-10-22 河谷控股Ip有限责任公司 通过反照率模型、系统和方法的增强现实内容渲染
KR101652888B1 (ko) * 2014-08-20 2016-09-01 재단법인 아산사회복지재단 수술 내비게이션에 의해 수술도구를 표시하는 방법
JP2017532847A (ja) * 2014-09-09 2017-11-02 ノキア テクノロジーズ オーユー 立体録画及び再生
US10013808B2 (en) 2015-02-03 2018-07-03 Globus Medical, Inc. Surgeon head-mounted display apparatuses
GB2536650A (en) 2015-03-24 2016-09-28 Augmedics Ltd Method and system for combining video-based and optic-based augmented reality in a near eye display
US10445860B2 (en) * 2015-12-08 2019-10-15 Facebook Technologies, Llc Autofocus virtual reality headset
US10241569B2 (en) 2015-12-08 2019-03-26 Facebook Technologies, Llc Focus adjustment method for a virtual reality headset
CN108472095B (zh) 2015-12-29 2021-11-02 皇家飞利浦有限公司 用于机器人外科手术的使用虚拟现实设备的系统、控制器和方法
EP3211599A1 (fr) 2016-02-29 2017-08-30 Thomson Licensing Procédé de rendu de photo non réaliste à guidage de profondeur adaptatif, produit de programme d'ordinateur correspondant, dispositif et support lisible par ordinateur
US11106276B2 (en) 2016-03-11 2021-08-31 Facebook Technologies, Llc Focus adjusting headset
JP6493885B2 (ja) 2016-03-15 2019-04-03 富士フイルム株式会社 画像位置合せ装置、画像位置合せ装置の作動方法および画像位置合せプログラム
JP6932135B2 (ja) * 2016-03-16 2021-09-08 コーニンクレッカ フィリップス エヌ ヴェＫｏｎｉｎｋｌｉｊｋｅ Ｐｈｉｌｉｐｓ Ｎ．Ｖ． 腹腔鏡画像及び超音波画像を重畳するための計算装置
WO2017165566A1 (fr) * 2016-03-25 2017-09-28 The Regents Of The University Of California Images, animations et vidéos en couleurs à haute définition pour des applications d'imagerie personnelle et de diagnostic
US10379356B2 (en) 2016-04-07 2019-08-13 Facebook Technologies, Llc Accommodation based optical correction
JP6698824B2 (ja) 2016-04-11 2020-05-27 富士フイルム株式会社 画像表示制御装置および方法並びにプログラム
US10429647B2 (en) 2016-06-10 2019-10-01 Facebook Technologies, Llc Focus adjusting virtual reality headset
CN106780760A (zh) * 2016-12-12 2017-05-31 大连文森特软件科技有限公司 一种基于ar虚拟现实技术的整形手术观摩系统
US10310598B2 (en) 2017-01-17 2019-06-04 Facebook Technologies, Llc Varifocal head-mounted display including modular air spaced optical assembly
US10628995B2 (en) 2017-04-17 2020-04-21 Microsoft Technology Licensing, Llc Anti-aliasing of graphical elements defined based on functions
WO2019139935A1 (fr) 2018-01-10 2019-07-18 Covidien Lp Guidage pour positionner un patient et un robot chirurgical
US20190254753A1 (en) 2018-02-19 2019-08-22 Globus Medical, Inc. Augmented reality navigation systems for use with robotic surgical systems and methods of their use
US11980507B2 (en) 2018-05-02 2024-05-14 Augmedics Ltd. Registration of a fiducial marker for an augmented reality system
WO2020106299A1 (fr) 2018-11-21 2020-05-28 Hewlett-Packard Development Company, L.P. Augmentation d'images en direct d'une scène pour une occlusion
US11766296B2 (en) 2018-11-26 2023-09-26 Augmedics Ltd. Tracking system for image-guided surgery
US10818028B2 (en) * 2018-12-17 2020-10-27 Microsoft Technology Licensing, Llc Detecting objects in crowds using geometric context
CN110009720B (zh) * 2019-04-02 2023-04-07 阿波罗智联(北京)科技有限公司 Ar场景中的图像处理方法、装置、电子设备及存储介质
US10881353B2 (en) * 2019-06-03 2021-01-05 General Electric Company Machine-guided imaging techniques
US11980506B2 (en) 2019-07-29 2024-05-14 Augmedics Ltd. Fiducial marker
US12178666B2 (en) 2019-07-29 2024-12-31 Augmedics Ltd. Fiducial marker
KR102216587B1 (ko) * 2019-10-24 2021-02-17 주식회사 레티널 고스트 이미지 차단 기능을 갖는 증강 현실용 광학 장치
US12133772B2 (en) 2019-12-10 2024-11-05 Globus Medical, Inc. Augmented reality headset for navigated robotic surgery
US11992373B2 (en) 2019-12-10 2024-05-28 Globus Medical, Inc Augmented reality headset with varied opacity for navigated robotic surgery
US11382712B2 (en) 2019-12-22 2022-07-12 Augmedics Ltd. Mirroring in image guided surgery
WO2021149056A1 (fr) 2020-01-22 2021-07-29 Beyeonics Surgical Ltd. Système et procédé pour actes médicaux assistés électroniquement améliorés
US11464581B2 (en) 2020-01-28 2022-10-11 Globus Medical, Inc. Pose measurement chaining for extended reality surgical navigation in visible and near infrared spectrums
US11382699B2 (en) 2020-02-10 2022-07-12 Globus Medical Inc. Extended reality visualization of optical tool tracking volume for computer assisted navigation in surgery
US11207150B2 (en) 2020-02-19 2021-12-28 Globus Medical, Inc. Displaying a virtual model of a planned instrument attachment to ensure correct selection of physical instrument attachment
US11607277B2 (en) 2020-04-29 2023-03-21 Globus Medical, Inc. Registration of surgical tool with reference array tracked by cameras of an extended reality headset for assisted navigation during surgery
US11382700B2 (en) 2020-05-08 2022-07-12 Globus Medical Inc. Extended reality headset tool tracking and control
US11510750B2 (en) 2020-05-08 2022-11-29 Globus Medical, Inc. Leveraging two-dimensional digital imaging and communication in medicine imagery in three-dimensional extended reality applications
US11153555B1 (en) 2020-05-08 2021-10-19 Globus Medical Inc. Extended reality headset camera system for computer assisted navigation in surgery
US11389252B2 (en) 2020-06-15 2022-07-19 Augmedics Ltd. Rotating marker for image guided surgery
US11737831B2 (en) 2020-09-02 2023-08-29 Globus Medical Inc. Surgical object tracking template generation for computer assisted navigation during surgical procedure
US11896445B2 (en) 2021-07-07 2024-02-13 Augmedics Ltd. Iliac pin and adapter
US12150821B2 (en) 2021-07-29 2024-11-26 Augmedics Ltd. Rotating marker and adapter for image-guided surgery
US20230078857A1 (en) * 2021-09-10 2023-03-16 Boston Scientific Scimed, Inc. Method of robust surface and depth estimation
WO2024057210A1 (fr) 2022-09-13 2024-03-21 Augmedics Ltd. Lunettes à réalité augmentée pour intervention médicale guidée par image
CN116540872B (zh) * 2023-04-28 2024-06-04 中广电广播电影电视设计研究院有限公司 Vr数据处理方法、装置、设备、介质及产品
CN117041511B (zh) * 2023-09-28 2024-01-02 青岛欧亚丰科技发展有限公司 一种展厅视觉交互增强的视频图像处理方法

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6151009A (en) * 1996-08-21 2000-11-21 Carnegie Mellon University Method and apparatus for merging real and synthetic images
US7355597B2 (en) * 2002-05-06 2008-04-08 Brown University Research Foundation Method, apparatus and computer program product for the interactive rendering of multivalued volume data with layered complementary values
US7295720B2 (en) * 2003-03-19 2007-11-13 Mitsubishi Electric Research Laboratories Non-photorealistic camera
JP2005108108A (ja) * 2003-10-01 2005-04-21 Canon Inc 三次元ｃｇ操作装置および方法、並びに位置姿勢センサのキャリブレーション装置
WO2006099490A1 (fr) * 2005-03-15 2006-09-21 The University Of North Carolina At Chapel Hill Methodes, systemes, et produits informatiques pour traiter des donnees d'images tridimensionnelles pour rendre une image, a partir d'un point de vue, a l'interieur d'une zone d'occlusion ou au-dela d'une zone d'occlusion des donnees d'images
US20070070063A1 (en) * 2005-09-29 2007-03-29 Siemens Medical Solutions Usa, Inc. Non-photorealistic volume rendering of ultrasonic data
EP2034442A1 (fr) * 2007-09-06 2009-03-11 Thomson Licensing Procédé de rendu non photoréaliste d'une séquence de cadres d'images

Also Published As

Publication number Publication date
DE602008005312D1 (de) 2011-04-14
WO2009004296A1 (fr) 2009-01-08
JP2010532035A (ja) 2010-09-30
KR20100051798A (ko) 2010-05-18
US20100177163A1 (en) 2010-07-15
EP2174297B1 (fr) 2011-03-02
CN101802873A (zh) 2010-08-11
ATE500578T1 (de) 2011-03-15
ES2361228T3 (es) 2011-06-15
GB0712690D0 (en) 2007-08-08
EP2174297A1 (fr) 2010-04-14
CN101802873B (zh) 2012-11-28
US8878900B2 (en) 2014-11-04

Similar Documents

Publication Publication Date Title
JP5186561B2 (ja) 拡張現実感の非写実的レンダリング
Chen et al. SLAM-based dense surface reconstruction in monocular minimally invasive surgery and its application to augmented reality
Lerotic et al. Pq-space based non-photorealistic rendering for augmented reality
US11961193B2 (en) Method for controlling a display, computer program and mixed reality display device
US8090174B2 (en) Virtual penetrating mirror device for visualizing virtual objects in angiographic applications
US9681925B2 (en) Method for augmented reality instrument placement using an image based navigation system
CN108778143B (zh) 用于将腹腔镜图像与超声图像进行叠加的计算设备
CN113906479A (zh) 从局部深度图生成合成三维成像
Kutter et al. Real-time volume rendering for high quality visualization in augmented reality
WO2010081094A2 (fr) Système de calage et de superposition d'information sur des surfaces déformables à partir de données vidéo
Kim et al. Designing a new endoscope for panoramic-view with focus-area 3D-vision in minimally invasive surgery
Macedo et al. A semi-automatic markerless augmented reality approach for on-patient volumetric medical data visualization
Fischer et al. A hybrid tracking method for surgical augmented reality
JP7504942B2 (ja) 拡張現実のグラフィック表現を表示するための表現装置
Reichard et al. Intraoperative on-the-fly organ-mosaicking for laparoscopic surgery
US11972531B2 (en) Multi-modal visualization in computer-assisted tele-operated surgery
Özgür et al. [POSTER] visualizing in-organ tumors in augmented monocular laparoscopy
Wieczorek et al. GPU-accelerated rendering for medical augmented reality in minimally-invasive procedures.
JP6770655B2 (ja) ライブ２次元ｘ線画像において介入装置の空間情報を提供する装置及び対応する方法
Singh et al. A novel enhanced hybrid recursive algorithm: image processing based augmented reality for gallbladder and uterus visualisation
Rahman et al. A framework to visualize 3d breast tumor using x-ray vision technique in mobile augmented reality
Habert et al. Multi-layer visualization for medical mixed reality
Habert et al. [POSTER] Augmenting Mobile C-arm Fluoroscopes via Stereo-RGBD Sensors for Multimodal Visualization
Wang et al. Stereoscopic augmented reality for single camera endoscopy: a virtual study
Fischer Rendering methods for augmented reality

Legal Events

Date Code Title Description
A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20110425

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20120723

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20120731

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20121025

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20121221

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20130121

R150 Certificate of patent or registration of utility model

Ref document number: 5186561

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

Free format text: JAPANESE INTERMEDIATE CODE: R150

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20160125

Year of fee payment: 3

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

S531 Written request for registration of change of domicile

Free format text: JAPANESE INTERMEDIATE CODE: R313531

S533 Written request for registration of change of name

Free format text: JAPANESE INTERMEDIATE CODE: R313533

R350 Written notification of registration of transfer

Free format text: JAPANESE INTERMEDIATE CODE: R350

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250