CN111386511B - 基于自扩展的增强现实服务指令库 - Google Patents

基于自扩展的增强现实服务指令库 Download PDF

Info

Publication number
CN111386511B
CN111386511B CN201880075940.3A CN201880075940A CN111386511B CN 111386511 B CN111386511 B CN 111386511B CN 201880075940 A CN201880075940 A CN 201880075940A CN 111386511 B CN111386511 B CN 111386511B
Authority
CN
China
Prior art keywords
augmented reality
display
mobile device
reality content
live video
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201880075940.3A
Other languages
English (en)
Chinese (zh)
Other versions
CN111386511A (zh
Inventor
S·P·普雷弗尔哈尔
J·萨巴奇恩斯基
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Koninklijke Philips NV
Original Assignee
Koninklijke Philips NV
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Koninklijke Philips NV filed Critical Koninklijke Philips NV
Publication of CN111386511A publication Critical patent/CN111386511A/zh
Application granted granted Critical
Publication of CN111386511B publication Critical patent/CN111386511B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/20—Scenes; Scene-specific elements in augmented reality scenes
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F30/00—Computer-aided design [CAD]
    • G06F30/10—Geometric CAD
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/40—Scenes; Scene-specific elements in video content
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2111/00—Details relating to CAD techniques
    • G06F2111/18—Details relating to CAD techniques using virtual or augmented reality

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Geometry (AREA)
  • Multimedia (AREA)
  • Computational Mathematics (AREA)
  • Mathematical Analysis (AREA)
  • Mathematical Optimization (AREA)
  • Pure & Applied Mathematics (AREA)
  • Computer Hardware Design (AREA)
  • Evolutionary Computation (AREA)
  • Optics & Photonics (AREA)
  • Human Computer Interaction (AREA)
  • Processing Or Creating Images (AREA)
  • User Interface Of Digital Computer (AREA)
  • Image Analysis (AREA)
CN201880075940.3A 2017-10-23 2018-10-18 基于自扩展的增强现实服务指令库 Active CN111386511B (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201762575553P 2017-10-23 2017-10-23
US62/575,553 2017-10-23
PCT/EP2018/078635 WO2019081350A1 (en) 2017-10-23 2018-10-18 SERVICE INSTRUCTION LIBRARY BASED ON SELF-EXPANSION ENHANCED REALITY

Publications (2)

Publication Number Publication Date
CN111386511A CN111386511A (zh) 2020-07-07
CN111386511B true CN111386511B (zh) 2025-01-21

Family

ID=63921550

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201880075940.3A Active CN111386511B (zh) 2017-10-23 2018-10-18 基于自扩展的增强现实服务指令库

Country Status (5)

Country Link
US (1) US11861898B2 (https=)
EP (1) EP3701355A1 (https=)
JP (1) JP7558809B2 (https=)
CN (1) CN111386511B (https=)
WO (1) WO2019081350A1 (https=)

Families Citing this family (39)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111386511B (zh) * 2017-10-23 2025-01-21 皇家飞利浦有限公司 基于自扩展的增强现实服务指令库
US11923084B2 (en) 2018-09-07 2024-03-05 Cilag Gmbh International First and second communication protocol arrangement for driving primary and secondary devices through a single port
US11696789B2 (en) 2018-09-07 2023-07-11 Cilag Gmbh International Consolidated user interface for modular energy system
US11804679B2 (en) 2018-09-07 2023-10-31 Cilag Gmbh International Flexible hand-switch circuit
US11896279B2 (en) 2018-09-07 2024-02-13 Cilag Gmbh International Surgical modular energy system with footer module
US12144136B2 (en) 2018-09-07 2024-11-12 Cilag Gmbh International Modular surgical energy system with module positional awareness with digital logic
US11031128B2 (en) * 2019-01-25 2021-06-08 Fresenius Medical Care Holdings, Inc. Augmented reality-based training and troubleshooting for medical devices
USD939545S1 (en) 2019-09-05 2021-12-28 Cilag Gmbh International Display panel or portion thereof with graphical user interface for energy module
JP6997996B2 (ja) * 2020-05-14 2022-01-18 ダイキン工業株式会社 情報処理方法、情報処理装置、プログラム、及び情報処理システム
US12580072B2 (en) 2020-10-02 2026-03-17 Cilag Gmbh International Cloud analytics packages
US11963683B2 (en) 2020-10-02 2024-04-23 Cilag Gmbh International Method for operating tiered operation modes in a surgical system
US12064293B2 (en) 2020-10-02 2024-08-20 Cilag Gmbh International Field programmable surgical visualization system
US11877897B2 (en) 2020-10-02 2024-01-23 Cilag Gmbh International Situational awareness of instruments location and individualization of users to control displays
US12472032B2 (en) 2020-10-02 2025-11-18 Cilag Gmbh International Monitoring of user visual gaze to control which display system displays the primary information
US11672534B2 (en) 2020-10-02 2023-06-13 Cilag Gmbh International Communication capability of a smart stapler
US11992372B2 (en) 2020-10-02 2024-05-28 Cilag Gmbh International Cooperative surgical displays
US12213801B2 (en) 2020-10-02 2025-02-04 Cilag Gmbh International Surgical visualization and particle trend analysis system
US11830602B2 (en) 2020-10-02 2023-11-28 Cilag Gmbh International Surgical hub having variable interconnectivity capabilities
US12484897B2 (en) 2020-10-02 2025-12-02 Cilag Gmbh International Surgical instrument with adaptive configuration control
US11748924B2 (en) 2020-10-02 2023-09-05 Cilag Gmbh International Tiered system display control based on capacity and user operation
US11361515B2 (en) * 2020-10-18 2022-06-14 International Business Machines Corporation Automated generation of self-guided augmented reality session plans from remotely-guided augmented reality sessions
US12228987B2 (en) 2021-03-30 2025-02-18 Cilag Gmbh International Method for energy delivery for modular energy system
US11963727B2 (en) 2021-03-30 2024-04-23 Cilag Gmbh International Method for system architecture for modular energy system
US12369994B2 (en) 2021-03-30 2025-07-29 Cilag Gmbh International Modular energy system with multi-energy port splitter for multiple energy devices
US11980411B2 (en) 2021-03-30 2024-05-14 Cilag Gmbh International Header for modular energy system
US11857252B2 (en) 2021-03-30 2024-01-02 Cilag Gmbh International Bezel with light blocking features for modular energy system
US12235697B2 (en) 2021-03-30 2025-02-25 Cilag Gmbh International Backplane connector attachment mechanism for modular energy system
US11978554B2 (en) 2021-03-30 2024-05-07 Cilag Gmbh International Radio frequency identification token for wireless surgical instruments
US12004824B2 (en) 2021-03-30 2024-06-11 Cilag Gmbh International Architecture for modular energy system
US12040749B2 (en) 2021-03-30 2024-07-16 Cilag Gmbh International Modular energy system with dual amplifiers and techniques for updating parameters thereof
US11968776B2 (en) 2021-03-30 2024-04-23 Cilag Gmbh International Method for mechanical packaging for modular energy system
US11950860B2 (en) 2021-03-30 2024-04-09 Cilag Gmbh International User interface mitigation techniques for modular energy systems
US20220331050A1 (en) 2021-04-14 2022-10-20 Cilag Gmbh International Systems and methods for changing display overlay of surgical field view based on triggering events
DE102021206761A1 (de) * 2021-06-29 2022-12-29 Siemens Healthcare Gmbh Vorrichtung, System und Verfahren zur Unterstützung eines Vorgangs einer Bildgebungsuntersuchung
CN113404318A (zh) * 2021-07-06 2021-09-17 中建八局第三建设有限公司 基于bim、uwb和ar技术的临边洞口施工管控方法
US12079460B2 (en) 2022-06-28 2024-09-03 Cilag Gmbh International Profiles for modular energy system
US12487466B2 (en) 2022-07-28 2025-12-02 Snap Inc. Magnified overlays correlated with virtual markers
US12210667B2 (en) * 2022-08-05 2025-01-28 Snap Inc. Medical image overlays for augmented reality experiences
US12400650B2 (en) 2022-10-11 2025-08-26 Snap Inc. Media control tools for managing communications between devices

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2015093130A1 (ja) * 2013-12-17 2015-06-25 ソニー株式会社 情報処理装置、情報処理方法およびプログラム
CN105264572A (zh) * 2013-04-04 2016-01-20 索尼公司 信息处理设备、信息处理方法和程序

Family Cites Families (61)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1157316B1 (de) * 1999-03-02 2003-09-03 Siemens Aktiengesellschaft System und verfahren zur situationsgerechten unterstützung der interaktion mit hilfe von augmented-reality-technologien
CN100518647C (zh) * 2002-10-18 2009-07-29 株式会社东芝 预测医疗设备未来状况的医疗设备管理装置
DE102005061211B4 (de) * 2004-12-22 2023-04-06 Abb Schweiz Ag Verfahren zum Erzeugen einer Mensch-Maschine-Benutzer-Oberfläche
US10387612B2 (en) * 2006-06-14 2019-08-20 Koninklijke Philips N.V. Multi-modality medical image layout editor
US20080123910A1 (en) 2006-09-19 2008-05-29 Bracco Imaging Spa Method and system for providing accuracy evaluation of image guided surgery
WO2009049282A2 (en) * 2007-10-11 2009-04-16 University Of Florida Research Foundation, Inc. Mixed simulator and uses thereof
US20100257252A1 (en) * 2009-04-01 2010-10-07 Microsoft Corporation Augmented Reality Cloud Computing
US8400548B2 (en) * 2010-01-05 2013-03-19 Apple Inc. Synchronized, interactive augmented reality displays for multifunction devices
US20110316845A1 (en) * 2010-06-25 2011-12-29 Palo Alto Research Center Incorporated Spatial association between virtual and augmented reality
US9424371B2 (en) * 2010-11-05 2016-08-23 Autodesk, Inc. Click to accept as built modeling
JP2012108711A (ja) * 2010-11-17 2012-06-07 Nec Casio Mobile Communications Ltd 端末装置、端末装置の動作方法、及び拡張現実システム
US20120166462A1 (en) * 2010-12-28 2012-06-28 Microsoft Corporation Automated image data processing and visualization
US20130010068A1 (en) * 2011-04-12 2013-01-10 Radiation Monitoring Devices, Inc. Augmented reality system
US8893010B1 (en) * 2011-07-20 2014-11-18 Google Inc. Experience sharing in location-based social networking
EP2560145A3 (en) 2011-08-18 2017-03-15 Layar B.V. Methods and systems for enabling the creation of augmented reality content
US20150040074A1 (en) 2011-08-18 2015-02-05 Layar B.V. Methods and systems for enabling creation of augmented reality content
US9235819B2 (en) * 2011-11-04 2016-01-12 Canon Kabushiki Kaisha Printing system, image forming apparatus, and method
WO2013094366A1 (ja) * 2011-12-22 2013-06-27 村田機械株式会社 産業機械システムおよび産業機械システム用情報処理機器
US11397462B2 (en) * 2012-09-28 2022-07-26 Sri International Real-time human-machine collaboration using big data driven augmented reality technologies
US9953618B2 (en) * 2012-11-02 2018-04-24 Qualcomm Incorporated Using a plurality of sensors for mapping and localization
JP6016268B2 (ja) 2012-12-20 2016-10-26 Kddi株式会社 フィールド作業支援装置、方法及びプログラム
US20140320529A1 (en) 2013-04-26 2014-10-30 Palo Alto Research Center Incorporated View steering in a combined virtual augmented reality system
US9269003B2 (en) * 2013-04-30 2016-02-23 Qualcomm Incorporated Diminished and mediated reality effects from reconstruction
EP2992507B1 (en) * 2013-05-02 2018-07-25 Qualcomm Incorporated Methods for facilitating computer vision application initialization
US9495761B2 (en) * 2013-11-04 2016-11-15 The Regents Of The University Of California Environment mapping with automatic motion model selection
US9740935B2 (en) * 2013-11-26 2017-08-22 Honeywell International Inc. Maintenance assistant system
US20150219767A1 (en) * 2014-02-03 2015-08-06 Board Of Regents, The University Of Texas System System and method for using global navigation satellite system (gnss) navigation and visual navigation to recover absolute position and attitude without any prior association of visual features with known coordinates
US20150262412A1 (en) * 2014-03-17 2015-09-17 Qualcomm Incorporated Augmented reality lighting with dynamic geometry
US20150325047A1 (en) * 2014-05-06 2015-11-12 Honeywell International Inc. Apparatus and method for providing augmented reality for maintenance applications
US10504231B2 (en) * 2014-05-21 2019-12-10 Millennium Three Technologies, Inc. Fiducial marker patterns, their automatic detection in images, and applications thereof
US9723109B2 (en) * 2014-05-28 2017-08-01 Alexander Hertel Platform for constructing and consuming realm and object feature clouds
CN104274247A (zh) * 2014-10-20 2015-01-14 上海电机学院 医学手术导航方法
US20170243403A1 (en) * 2014-11-11 2017-08-24 Bent Image Lab, Llc Real-time shared augmented reality experience
US20160133230A1 (en) * 2014-11-11 2016-05-12 Bent Image Lab, Llc Real-time shared augmented reality experience
US20160140868A1 (en) * 2014-11-13 2016-05-19 Netapp, Inc. Techniques for using augmented reality for computer systems maintenance
US10154239B2 (en) * 2014-12-30 2018-12-11 Onpoint Medical, Inc. Image-guided surgery with surface reconstruction and augmented reality visualization
GB2534359A (en) * 2015-01-15 2016-07-27 Corin Ltd System and method for patient implant alignment
WO2016153628A2 (en) * 2015-02-25 2016-09-29 Brian Mullins Augmented reality content creation
WO2016164342A1 (en) * 2015-04-06 2016-10-13 Scope Technologies Us Inc. Methods and apparatus for augmented reality applications
US20160358383A1 (en) * 2015-06-05 2016-12-08 Steffen Gauglitz Systems and methods for augmented reality-based remote collaboration
US10037627B2 (en) * 2015-08-14 2018-07-31 Argis Technologies Llc Augmented visualization system for hidden structures
US10430040B2 (en) * 2016-01-18 2019-10-01 Microsoft Technology Licensing, Llc Method and an apparatus for providing a multitasking view
US10187686B2 (en) * 2016-03-24 2019-01-22 Daqri, Llc Recording remote expert sessions
CA3034314C (en) * 2016-08-17 2021-04-20 Synaptive Medical (Barbados) Inc. Methods and systems for registration of virtual space with real space in an augmented reality system
US20180082414A1 (en) * 2016-09-21 2018-03-22 Astralink Ltd. Methods Circuits Assemblies Devices Systems Platforms and Functionally Associated Machine Executable Code for Computer Vision Assisted Construction Site Inspection
US20210327303A1 (en) * 2017-01-24 2021-10-21 Tienovix, Llc System and method for augmented reality guidance for use of equipment systems
US10140773B2 (en) * 2017-02-01 2018-11-27 Accenture Global Solutions Limited Rendering virtual objects in 3D environments
US20180239313A1 (en) * 2017-02-22 2018-08-23 Stellar Vdc Residential, Llc Building model with virtual capture of as built features and objective performance tracking
US10659768B2 (en) * 2017-02-28 2020-05-19 Mitsubishi Electric Research Laboratories, Inc. System and method for virtually-augmented visual simultaneous localization and mapping
US9892564B1 (en) * 2017-03-30 2018-02-13 Novarad Corporation Augmenting real-time views of a patient with three-dimensional data
US10249095B2 (en) * 2017-04-07 2019-04-02 Microsoft Technology Licensing, Llc Context-based discovery of applications
US10692287B2 (en) * 2017-04-17 2020-06-23 Microsoft Technology Licensing, Llc Multi-step placement of virtual objects
US20180324229A1 (en) * 2017-05-05 2018-11-08 Tsunami VR, Inc. Systems and methods for providing expert assistance from a remote expert to a user operating an augmented reality device
US20190370544A1 (en) * 2017-05-30 2019-12-05 Ptc Inc. Object Initiated Communication
US10127290B1 (en) * 2017-07-19 2018-11-13 Facebook, Inc. Systems and methods for distributing augmented-reality effects
US10212000B1 (en) * 2017-07-25 2019-02-19 Daqri, Llc Computer vision based activation
EP3438859A1 (en) * 2017-08-01 2019-02-06 Predict Srl Method for providing remote assistance services using mixed and/or augmented reality visors and system for implementing it
CN111386511B (zh) * 2017-10-23 2025-01-21 皇家飞利浦有限公司 基于自扩展的增强现实服务指令库
US10699165B2 (en) * 2017-10-30 2020-06-30 Palo Alto Research Center Incorporated System and method using augmented reality for efficient collection of training data for machine learning
US10854006B2 (en) * 2018-11-15 2020-12-01 Palo Alto Research Center Incorporated AR-enabled labeling using aligned CAD models
US12450571B2 (en) * 2018-12-31 2025-10-21 Palo Alto Research Center Incorporated Method and system for rule-based augmentation of perceptions

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105264572A (zh) * 2013-04-04 2016-01-20 索尼公司 信息处理设备、信息处理方法和程序
WO2015093130A1 (ja) * 2013-12-17 2015-06-25 ソニー株式会社 情報処理装置、情報処理方法およびプログラム

Also Published As

Publication number Publication date
JP7558809B2 (ja) 2024-10-01
US20200342228A1 (en) 2020-10-29
CN111386511A (zh) 2020-07-07
US11861898B2 (en) 2024-01-02
EP3701355A1 (en) 2020-09-02
JP2021500690A (ja) 2021-01-07
WO2019081350A1 (en) 2019-05-02

Similar Documents

Publication Publication Date Title
CN111386511B (zh) 基于自扩展的增强现实服务指令库
US12399599B2 (en) Devices, methods, and graphical user interfaces for improving accessibility of interactions with three-dimensional environments
US11068531B2 (en) Visual search in real world using optical see-through head mounted display with augmented reality and user interaction tracking
US12002578B2 (en) Systems and methods for augmented reality-enhanced field services support
US20240404232A1 (en) Devices, methods, and graphical user interfaces for content applications
EP3717992B1 (en) Device for providing augmented reality service, and method of operating the same
US9165381B2 (en) Augmented books in a mixed reality environment
US20240402869A1 (en) Devices, methods, and graphical user interfaces for content collaboration and sharing
CN102668556A (zh) 医疗支援装置，医疗支援方法以及医疗支援系统
US10403048B2 (en) Storage medium, content providing apparatus, and control method for providing stereoscopic content based on viewing progression
WO2018174937A1 (en) Method and system for optimizing healthcare delivery
US20250341941A1 (en) Devices, Methods, and Graphical User Interfaces for Improving Accessibility of Interactions with Three-Dimensional Environments
CN110809187B (zh) 视频选择方法、视频选择装置、存储介质与电子设备
US20250069717A1 (en) Method and system for optimizing healthcare delivery
US20250258591A1 (en) Media library user interfaces
JP2017134575A (ja) 表示装置、表示装置の制御方法、及び、プログラム
US20250029686A1 (en) Methods, systems, apparatuses, and devices for facilitating presentation of medical data
US11080942B2 (en) Assistance method for assisting performance of a task on a product, comprising displaying a highlighting image highlighting a monitored part of the product
WO2024064380A1 (en) User interfaces for gaze tracking enrollment
EP4250193A1 (en) Ghost mode glasses for use in servicing medical devices and servicing workflows using same
US20250200847A1 (en) Ghost mode glasses for use in servicing medical devices and servicing workflows using same
JP7780597B1 (ja) 情報処理装置、眼鏡型デバイス及びプログラム
JP7717143B2 (ja) 情報処理装置、及びプログラム
WO2025171348A1 (en) Media library user interfaces
WO2024249046A1 (en) Devices, methods, and graphical user interfaces for content collaboration and sharing

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant