JP2010520559A - 閉ざされた構造内の人員およびセンサの位置を示し、状況認識の増進を提供する、拡張現実ベース型システムおよび方法 - Google Patents
閉ざされた構造内の人員およびセンサの位置を示し、状況認識の増進を提供する、拡張現実ベース型システムおよび方法 Download PDFInfo
- Publication number
- JP2010520559A JP2010520559A JP2009552743A JP2009552743A JP2010520559A JP 2010520559 A JP2010520559 A JP 2010520559A JP 2009552743 A JP2009552743 A JP 2009552743A JP 2009552743 A JP2009552743 A JP 2009552743A JP 2010520559 A JP2010520559 A JP 2010520559A
- Authority
- JP
- Japan
- Prior art keywords
- environment
- information
- personnel
- graphics
- display
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B25/00—Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems
- G08B25/01—Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems characterised by the transmission medium
- G08B25/016—Personal emergency signalling and security systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/012—Head tracking input arrangements
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B13/00—Burglar, theft or intruder alarms
- G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
- G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
- G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
- G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
- G08B13/19617—Surveillance camera constructional details
- G08B13/19621—Portable camera
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/02—Alarms for ensuring the safety of persons
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B25/00—Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems
- G08B25/14—Central alarm receiver or annunciator arrangements
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Emergency Management (AREA)
- Business, Economics & Management (AREA)
- Engineering & Computer Science (AREA)
- Computer Security & Cryptography (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Processing Or Creating Images (AREA)
- User Interface Of Digital Computer (AREA)
- Alarm Systems (AREA)
- Fire-Extinguishing By Fire Departments, And Fire-Extinguishing Equipment And Control Thereof (AREA)
Abstract
Description
本発明は次の同時係属中の米国特許出願に関し、該出願の各々の内容の全体が本明細書に参考として援用される。
2.2007年3月8日に出願された、名称が「Augmented Reality−Based System and Method Providing Status and Control of Unmanned Vehicles」である米国特許出願第11/715,339号。
本発明は、環境内の人員およびセンサについての位置および関連データを環境の視界の上に示すことに関する。
質の高い状況認識を第1の応答者に提供することが長い間望まれていた。例えば、第1の応答者に彼らの周囲の環境についてのより多くの情報を提供することは、救助活動を向上させ得る。先行技術の装置は、環境の仮想表現(例えば、マップまたは建物の3D表現)を第1の応答者から受信された状態情報と組み合わせ、ユーザに、該組み合わせとの関連性を解釈させ、該関連性を第1の応答者に通信させることによって、質の高い状況認識を第1の応答者に提供することを試みた。
添付の図面に関して与えられる次の説明は、図面の非限定の例を参照してより良く理解され得、図面は以下のように示す。
本明細書に説明される状況認識システムは、拡張現実感(AR)技術を利用し、必要な視界をユーザに提供する。ARは、仮想現実感に似ているが、完全に人工の画像(例えば、マップまたは3Dモデル)を用いる代わりに、ARは、現実の世界の図に3Dのグラフィックスを重ねる。ARの非常に単純な例は、黄色の線によってファーストダウンを示すフットボールゲームに用いられる。用いられ得るARシステムの例は、本開示と組み合せて米国特許出願第11/441,241号の例に説明されるシステムである。
Claims (18)
- 環境内に位置する人員に質の高い状況情報を提供する方法であって、
該環境内に位置する1つ以上のセンサから情報を受信するステップであって、該情報は該環境および該環境内にいる人員についてのセンサ位置情報および状態情報を含む、ステップと、
該環境の外からのリアルタイムの視界に対応する視点情報を得るステップと、
該センサ位置情報および視点情報を用いてグラフィックスを生成するステップであって、該グラフィックスは該状態情報の視覚的表現を含む、ステップと、
該生成されたグラフィックスが該リアルタイムの視界に重ねられるように、該環境の外にある管理者ステーションのディスプレイに該生成されたグラフィックスを表示する、ステップと
を包含する、方法。 - 前記ディスプレイに視覚的に表現された情報に基づき、前記管理者ステーションから前記人員に状況情報を通信するステップをさらに包含する、請求項1に記載の方法。
- 環境内に位置する前記人員は、前記外からのリアルタイムの眺めから閉ざされる、請求項1に記載の方法。
- 前記人員は消防士であり、前記環境は建物である、請求項1に記載の方法。
- 前記人員は兵士であり、前記環境は戦闘区域である、請求項1に記載の方法。
- 前記状況情報を通信するステップは、管理者ステーションの前記ディスプレイ上の映像を前記環境内に位置する前記人員に送ることを含む、請求項2に記載の方法。
- 前記視覚的表現は、前記人員を表す記号を含む、請求項1に記載の方法。
- 環境内に位置する人員に質の高い状況情報を提供する拡張現実システムであって、
該環境内に位置する1つ以上のセンサと、
該環境のリアルタイムの視界に対応する視点情報を得る追跡システムと、
該1つ以上のセンサから情報を受信する処理システムであって、該情報は、該環境および該環境内の人員についてのセンサ位置情報および状態情報を含み、該センサ位置情報および該視点情報を用いてグラフィックスを生成し、該グラフィックスは該状態情報の視覚的表現を含む、処理システムと、
該環境の外にある管理者ステーションに、該生成されたグラフィックスが該リアルタイムの視界に重ねられるように、該生成されたグラフィックスを表示する、ディスプレイと
を備えている、システム。 - 前記ディスプレイに視覚的に表現された情報に基づき、前記管理者ステーションから前記人員に状況情報を通信する通信装置をさらに備えている、請求項8に記載の拡張現実システム。
- 前記人員は消防士であり、前記環境は建物である、請求項8に記載の方法。
- 前記人員は兵士であり、前記環境は戦闘区域である、請求項8に記載の方法。
- 前記状況情報は、前記環境内に位置する前記人員への管理者ステーションの前記ディスプレイ上の映像を含む、請求項8に記載の拡張現実システム。
- 前記視覚的表現は、前記人員を表す記号を含む、請求項8に記載の方法。
- 環境内に位置する人員に質の高い状況情報を提供する方法であって、
該環境内に位置する1つ以上のセンサから情報を受信するステップであって、該情報は該環境および該環境内にいる人員についてのセンサ位置情報および状態情報を含む、ステップと、
該環境のリアルタイムの視界に対応する視点情報を得るステップと、
該センサ位置情報および視点情報を用いてグラフィックスを生成するステップであって、該グラフィックスは該状態情報の視覚的表現を含む、ステップと、
該生成されたグラフィックスが該リアルタイムの視界に重ねられるように、ディスプレイに該生成されたグラフィックスを表示する、ステップと
を包含する、方法。 - 前記人員は消防士であり、前記環境は建物である、請求項14に記載の方法。
- 前記人員は兵士であり、前記環境は戦闘区域である、請求項14に記載の方法。
- 環境ついての質の高い状況情報を提供する方法であって、
該環境内に位置する1つ以上のセンサから情報を受信するステップであって、該情報は該環境についてのセンサ位置情報および状態情報を含む、ステップと、
該環境のリアルタイムの視界に対応する視点情報を得るステップと、
該センサ位置情報および視点情報を用いてグラフィックスを生成するステップであって、該グラフィックスは該状態情報の視覚的表現を含む、ステップと、
該生成されたグラフィックスが該リアルタイムの視界に重ねられるように、ディスプレイに該生成されたグラフィックスを表示する、ステップと
を包含する、方法。 - 前記環境は建物であり、前記1つ以上のセンサは、該建物内の1つ以上のアラームに対応し、前記状態情報はアラームが駆動されたかどうかを示す、請求項17に記載の方法。
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US11/715,338 US20080218331A1 (en) | 2007-03-08 | 2007-03-08 | Augmented reality-based system and method to show the location of personnel and sensors inside occluded structures and provide increased situation awareness |
US11/715,338 | 2007-03-08 | ||
PCT/US2008/003038 WO2008112149A2 (en) | 2007-03-08 | 2008-03-07 | Augmented reality-based system and method to show the location of personnel and sensors inside occluded structures and provide increased situation awareness |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
JP2014061266A Division JP2014123406A (ja) | 2007-03-08 | 2014-03-25 | 閉ざされた構造内の人員およびセンサの位置を示し、状況認識の増進を提供する、拡張現実ベース型システムおよび方法 |
Publications (2)
Publication Number | Publication Date |
---|---|
JP2010520559A true JP2010520559A (ja) | 2010-06-10 |
JP5553405B2 JP5553405B2 (ja) | 2014-07-16 |
Family
ID=39741080
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
JP2009552743A Expired - Fee Related JP5553405B2 (ja) | 2007-03-08 | 2008-03-07 | 閉ざされた構造内の人員およびセンサの位置を示し、状況認識の増進を提供する、拡張現実ベース型システムおよび方法 |
JP2014061266A Withdrawn JP2014123406A (ja) | 2007-03-08 | 2014-03-25 | 閉ざされた構造内の人員およびセンサの位置を示し、状況認識の増進を提供する、拡張現実ベース型システムおよび方法 |
Family Applications After (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
JP2014061266A Withdrawn JP2014123406A (ja) | 2007-03-08 | 2014-03-25 | 閉ざされた構造内の人員およびセンサの位置を示し、状況認識の増進を提供する、拡張現実ベース型システムおよび方法 |
Country Status (6)
Country | Link |
---|---|
US (2) | US20080218331A1 (ja) |
EP (1) | EP2126866A4 (ja) |
JP (2) | JP5553405B2 (ja) |
AU (1) | AU2008226932B2 (ja) |
CA (1) | CA2679427A1 (ja) |
WO (1) | WO2008112149A2 (ja) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP7040827B1 (ja) | 2021-01-14 | 2022-03-23 | 株式会社ロックガレッジ | 捜索支援システムおよび救助支援プログラム |
Families Citing this family (100)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7503007B2 (en) * | 2006-05-16 | 2009-03-10 | International Business Machines Corporation | Context enhanced messaging and collaboration system |
US8185101B1 (en) | 2008-04-10 | 2012-05-22 | Sandia Corporation | Handheld portable real-time tracking and communications device |
US8732592B2 (en) * | 2009-06-08 | 2014-05-20 | Battelle Energy Alliance, Llc | Methods and systems relating to an augmented virtuality environment |
US8723666B2 (en) | 2010-08-16 | 2014-05-13 | Stuart Graham Edwards | Building having an emergency information facility |
DE102011009952A1 (de) * | 2011-02-01 | 2012-08-02 | Deutsches Zentrum für Luft- und Raumfahrt e.V. | Verfahren zum Bestimmen der Position und Lage eines Astronauten |
US10114451B2 (en) | 2011-03-22 | 2018-10-30 | Fmr Llc | Augmented reality in a virtual tour through a financial portfolio |
US10455089B2 (en) | 2011-03-22 | 2019-10-22 | Fmr Llc | Augmented reality system for product selection |
US8644673B2 (en) | 2011-03-22 | 2014-02-04 | Fmr Llc | Augmented reality system for re-casting a seminar with private calculations |
US9600933B2 (en) * | 2011-07-01 | 2017-03-21 | Intel Corporation | Mobile augmented reality system |
US10307104B2 (en) | 2011-07-05 | 2019-06-04 | Saudi Arabian Oil Company | Chair pad system and associated, computer medium and computer-implemented methods for monitoring and improving health and productivity of employees |
US9256711B2 (en) * | 2011-07-05 | 2016-02-09 | Saudi Arabian Oil Company | Systems, computer medium and computer-implemented methods for providing health information to employees via augmented reality display |
US9710788B2 (en) | 2011-07-05 | 2017-07-18 | Saudi Arabian Oil Company | Computer mouse system and associated, computer medium and computer-implemented methods for monitoring and improving health and productivity of employees |
US8872640B2 (en) | 2011-07-05 | 2014-10-28 | Saudi Arabian Oil Company | Systems, computer medium and computer-implemented methods for monitoring health and ergonomic status of drivers of vehicles |
US9844344B2 (en) | 2011-07-05 | 2017-12-19 | Saudi Arabian Oil Company | Systems and method to monitor health of employee when positioned in association with a workstation |
EP2729058B1 (en) | 2011-07-05 | 2019-03-13 | Saudi Arabian Oil Company | Floor mat system and associated, computer medium and computer-implemented methods for monitoring and improving health and productivity of employees |
US9526455B2 (en) | 2011-07-05 | 2016-12-27 | Saudi Arabian Oil Company | Systems, computer medium and computer-implemented methods for monitoring and improving health and productivity of employees |
US9833142B2 (en) | 2011-07-05 | 2017-12-05 | Saudi Arabian Oil Company | Systems, computer medium and computer-implemented methods for coaching employees based upon monitored health conditions using an avatar |
US9492120B2 (en) | 2011-07-05 | 2016-11-15 | Saudi Arabian Oil Company | Workstation for monitoring and improving health and productivity of employees |
US10108783B2 (en) | 2011-07-05 | 2018-10-23 | Saudi Arabian Oil Company | Systems, computer medium and computer-implemented methods for monitoring health of employees using mobile devices |
US20150150641A1 (en) * | 2011-10-28 | 2015-06-04 | Navigate Surgical Technologies, Inc. | System and method for determining the three-dimensional location and orientation of identification markers |
US20130137076A1 (en) * | 2011-11-30 | 2013-05-30 | Kathryn Stone Perez | Head-mounted display based education and instruction |
US9096920B1 (en) | 2012-03-22 | 2015-08-04 | Google Inc. | User interface method |
FR2990286B1 (fr) * | 2012-05-07 | 2019-09-06 | Schneider Electric Industries Sas | Procede d'affichage en realite augmentee d'une information relative a un equipement cible sur un ecran d'un dispositif electronique, produit programme d'ordinateur, dispositif electronique et equipement electrique associes |
WO2013181749A1 (en) * | 2012-06-08 | 2013-12-12 | Thales Canada Inc. | Integrated combat resource management system |
US9087403B2 (en) | 2012-07-26 | 2015-07-21 | Qualcomm Incorporated | Maintaining continuity of augmentations |
US9129429B2 (en) | 2012-10-24 | 2015-09-08 | Exelis, Inc. | Augmented reality on wireless mobile devices |
TWI486629B (zh) | 2012-11-21 | 2015-06-01 | Ind Tech Res Inst | 穿透型頭部穿戴式顯示系統與互動操作方法 |
US9483875B2 (en) | 2013-02-14 | 2016-11-01 | Blackberry Limited | Augmented reality system with encoding beacons |
WO2014142881A1 (en) * | 2013-03-14 | 2014-09-18 | Intel Corporation | Asynchronous representation of alternate reality characters |
US9460561B1 (en) | 2013-03-15 | 2016-10-04 | Bentley Systems, Incorporated | Hypermodel-based panorama augmentation |
US9607584B2 (en) * | 2013-03-15 | 2017-03-28 | Daqri, Llc | Real world analytics visualization |
US9761045B1 (en) | 2013-03-15 | 2017-09-12 | Bentley Systems, Incorporated | Dynamic and selective model clipping for enhanced augmented hypermodel visualization |
US10262462B2 (en) | 2014-04-18 | 2019-04-16 | Magic Leap, Inc. | Systems and methods for augmented and virtual reality |
US9129430B2 (en) | 2013-06-25 | 2015-09-08 | Microsoft Technology Licensing, Llc | Indicating out-of-view augmented reality images |
US9892489B1 (en) * | 2013-08-20 | 2018-02-13 | Rockwell Collins, Inc. | System for and method of providing a virtual cockpit, control panel, or dashboard using augmented reality |
US9286791B2 (en) * | 2013-10-08 | 2016-03-15 | HYPERION S.r.l. | Protection and security system including three-dimensional virtual reality |
US9740935B2 (en) | 2013-11-26 | 2017-08-22 | Honeywell International Inc. | Maintenance assistant system |
US9530057B2 (en) * | 2013-11-26 | 2016-12-27 | Honeywell International Inc. | Maintenance assistant system |
US9722472B2 (en) | 2013-12-11 | 2017-08-01 | Saudi Arabian Oil Company | Systems, computer medium and computer-implemented methods for harvesting human energy in the workplace |
US20160342839A1 (en) * | 2014-03-20 | 2016-11-24 | Hewlett Packard Enterprise Development Lp | Identifying electronic components for augmented reality |
US10802582B1 (en) * | 2014-04-22 | 2020-10-13 | sigmund lindsay clements | Eye tracker in an augmented reality glasses for eye gaze to input displayed input icons |
US9826297B2 (en) | 2014-10-29 | 2017-11-21 | At&T Intellectual Property I, L.P. | Accessory device that provides sensor input to a media device |
US9955059B2 (en) * | 2014-10-29 | 2018-04-24 | Kabushiki Kaisha Toshiba | Electronic device, method, and computer program product |
US9508248B2 (en) | 2014-12-12 | 2016-11-29 | Motorola Solutions, Inc. | Method and system for information management for an incident response |
US10065750B2 (en) * | 2015-02-10 | 2018-09-04 | Honeywell International Inc. | Aircraft maintenance systems and methods using wearable device |
US10382746B1 (en) | 2015-09-22 | 2019-08-13 | Rockwell Collins, Inc. | Stereoscopic augmented reality head-worn display with indicator conforming to a real-world object |
US10528021B2 (en) | 2015-10-30 | 2020-01-07 | Rockwell Automation Technologies, Inc. | Automated creation of industrial dashboards and widgets |
WO2017083420A1 (en) * | 2015-11-10 | 2017-05-18 | Thales Visionix, Inc. | Robust vision-inertial pedestrian tracking with heading auto-alignment |
US9889311B2 (en) | 2015-12-04 | 2018-02-13 | Saudi Arabian Oil Company | Systems, protective casings for smartphones, and associated methods to enhance use of an automated external defibrillator (AED) device |
US10642955B2 (en) | 2015-12-04 | 2020-05-05 | Saudi Arabian Oil Company | Devices, methods, and computer medium to provide real time 3D visualization bio-feedback |
DE102015015695A1 (de) * | 2015-12-04 | 2017-06-08 | Audi Ag | Anzeigesystem und Verfahren zum Betreiben eines Anzeigesystems |
US10475351B2 (en) | 2015-12-04 | 2019-11-12 | Saudi Arabian Oil Company | Systems, computer medium and methods for management training systems |
US10628770B2 (en) | 2015-12-14 | 2020-04-21 | Saudi Arabian Oil Company | Systems and methods for acquiring and employing resiliency data for leadership development |
US10313281B2 (en) | 2016-01-04 | 2019-06-04 | Rockwell Automation Technologies, Inc. | Delivery of automated notifications by an industrial asset |
US20170344121A1 (en) * | 2016-05-26 | 2017-11-30 | Motorola Solutions, Inc | System and method for completing a call utilizing a head-mounted display and a communication device |
US10318570B2 (en) | 2016-08-18 | 2019-06-11 | Rockwell Automation Technologies, Inc. | Multimodal search input for an industrial search platform |
US10401839B2 (en) | 2016-09-26 | 2019-09-03 | Rockwell Automation Technologies, Inc. | Workflow tracking and identification using an industrial monitoring system |
US10545492B2 (en) | 2016-09-26 | 2020-01-28 | Rockwell Automation Technologies, Inc. | Selective online and offline access to searchable industrial automation data |
US10319128B2 (en) | 2016-09-26 | 2019-06-11 | Rockwell Automation Technologies, Inc. | Augmented reality presentation of an industrial environment |
US10354350B2 (en) | 2016-10-18 | 2019-07-16 | Motorola Solutions, Inc. | Method and system for information management for an incident response |
DE102016120081A1 (de) * | 2016-10-21 | 2018-04-26 | Minimax Gmbh & Co. Kg | Verfahren zur Inbetriebnahme und/oder Wartung einer Brandmelder- und/oder Löschsteuerzentrale sowie Vorrichtung dafür |
WO2018080552A1 (en) | 2016-10-24 | 2018-05-03 | Carrington Charles C | System for generating virtual building plan data based upon stored and scanned building data and related methods |
US10735691B2 (en) | 2016-11-08 | 2020-08-04 | Rockwell Automation Technologies, Inc. | Virtual reality and augmented reality for industrial automation |
US10388075B2 (en) | 2016-11-08 | 2019-08-20 | Rockwell Automation Technologies, Inc. | Virtual reality and augmented reality for industrial automation |
US10866631B2 (en) | 2016-11-09 | 2020-12-15 | Rockwell Automation Technologies, Inc. | Methods, systems, apparatuses, and techniques for employing augmented reality and virtual reality |
US10942252B2 (en) * | 2016-12-26 | 2021-03-09 | Htc Corporation | Tracking system and tracking method |
TWI659221B (zh) * | 2016-12-29 | 2019-05-11 | 宏達國際電子股份有限公司 | 追蹤系統、追蹤裝置及追蹤方法 |
US10410422B2 (en) * | 2017-01-09 | 2019-09-10 | Samsung Electronics Co., Ltd. | System and method for augmented reality control |
WO2018162079A1 (en) * | 2017-03-10 | 2018-09-13 | Brainlab Ag | Augmented reality pre-registration |
US20180357922A1 (en) | 2017-06-08 | 2018-12-13 | Honeywell International Inc. | Apparatus and method for assessing and tracking user competency in augmented/virtual reality-based training in industrial automation systems and other systems |
US10902536B2 (en) | 2017-06-14 | 2021-01-26 | International Business Machines Corporation | Cognitive emergency task coordination |
US10325409B2 (en) * | 2017-06-16 | 2019-06-18 | Microsoft Technology Licensing, Llc | Object holographic augmentation |
US10930709B2 (en) | 2017-10-03 | 2021-02-23 | Lockheed Martin Corporation | Stacked transparent pixel structures for image sensors |
US10510812B2 (en) | 2017-11-09 | 2019-12-17 | Lockheed Martin Corporation | Display-integrated infrared emitter and sensor structures |
US10445944B2 (en) | 2017-11-13 | 2019-10-15 | Rockwell Automation Technologies, Inc. | Augmented reality safety automation zone system and method |
US10824132B2 (en) | 2017-12-07 | 2020-11-03 | Saudi Arabian Oil Company | Intelligent personal protective equipment |
DE102017222534B3 (de) | 2017-12-12 | 2019-06-13 | Volkswagen Aktiengesellschaft | Verfahren, computerlesbares Speichermedium mit Instruktionen, Vorrichtung und System zum Einmessen einer Augmented-Reality-Brille in einem Fahrzeug, für das Verfahren geeignetes Fahrzeug und für das Verfahren geeignete Augmented-Reality-Brille |
US10678238B2 (en) * | 2017-12-20 | 2020-06-09 | Intel IP Corporation | Modified-reality device and method for operating a modified-reality device |
US11616941B2 (en) | 2018-02-07 | 2023-03-28 | Lockheed Martin Corporation | Direct camera-to-display system |
US10690910B2 (en) | 2018-02-07 | 2020-06-23 | Lockheed Martin Corporation | Plenoptic cellular vision correction |
US10979699B2 (en) | 2018-02-07 | 2021-04-13 | Lockheed Martin Corporation | Plenoptic cellular imaging system |
US10594951B2 (en) | 2018-02-07 | 2020-03-17 | Lockheed Martin Corporation | Distributed multi-aperture camera array |
US10951883B2 (en) | 2018-02-07 | 2021-03-16 | Lockheed Martin Corporation | Distributed multi-screen array for high density display |
US10652529B2 (en) | 2018-02-07 | 2020-05-12 | Lockheed Martin Corporation | In-layer Signal processing |
US10838250B2 (en) | 2018-02-07 | 2020-11-17 | Lockheed Martin Corporation | Display assemblies with electronically emulated transparency |
US20190042843A1 (en) * | 2018-04-05 | 2019-02-07 | Intel Corporation | Cable detection for ar/vr computing method and apparatus |
US10853014B2 (en) | 2018-04-17 | 2020-12-01 | Rockwell Collins, Inc. | Head wearable device, system, and method |
US10922881B2 (en) * | 2018-11-02 | 2021-02-16 | Star Global Expert Solutions Joint Stock Company | Three dimensional/360 degree (3D/360°) real-time full information smart management integrated mapping system (SMIMS) and process of generating the same |
US10866413B2 (en) | 2018-12-03 | 2020-12-15 | Lockheed Martin Corporation | Eccentric incident luminance pupil tracking |
FR3089672B1 (fr) * | 2018-12-05 | 2021-12-03 | Thales Sa | Procédé et système d’affichage et d’interaction embarqué dans une cabine de pilotage |
US10698201B1 (en) | 2019-04-02 | 2020-06-30 | Lockheed Martin Corporation | Plenoptic cellular axis redirection |
US10461421B1 (en) * | 2019-05-07 | 2019-10-29 | Bao Tran | Cellular system |
US10498029B1 (en) * | 2019-07-15 | 2019-12-03 | Bao Tran | Cellular system |
US11486961B2 (en) * | 2019-06-14 | 2022-11-01 | Chirp Microsystems | Object-localization and tracking using ultrasonic pulses with reflection rejection |
US11991263B2 (en) | 2019-09-17 | 2024-05-21 | Hewlett-Packard Development Company, L.P. | Notification delivery in a virtual space based on a user being in a flow state |
DE102020105196A1 (de) * | 2020-02-27 | 2021-09-02 | Audi Aktiengesellschaft | Verfahren zum Betreiben einer Datenbrille in einem Kraftfahrzeug sowie System mit einem Kraftfahrzeug und einer Datenbrille |
EP3885818A1 (de) * | 2020-03-25 | 2021-09-29 | Siemens Aktiengesellschaft | Vorrichtung und verfahren zur spektroskopischen oberflächenanalyse |
US20220060877A1 (en) * | 2020-08-19 | 2022-02-24 | Cade Robertson | Emergency gps signal system |
US11892624B2 (en) | 2021-04-27 | 2024-02-06 | Microsoft Technology Licensing, Llc | Indicating an off-screen target |
US11994675B2 (en) | 2022-05-16 | 2024-05-28 | Google Llc | Head-mounted device for tracking screen time |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH09504120A (ja) * | 1993-10-22 | 1997-04-22 | コピン・コーポレーシヨン | 頭部装着形表示システム |
JP2002278670A (ja) * | 2001-01-30 | 2002-09-27 | Physoptics Opto-Electronic Gmbh | 情報システム |
JP2005524901A (ja) * | 2002-05-08 | 2005-08-18 | ネッタロン セキュリティー システムズ, インコーポレイテッド | 遠隔地を監視するための方法および装置 |
Family Cites Families (81)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US706214A (en) * | 1894-09-08 | 1902-08-05 | Avery Mfg Company | Straw-stacker. |
US5381446A (en) * | 1993-06-25 | 1995-01-10 | Digital Wireless Corp. | Digital implementation of spread spectrum communications system |
JP3208939B2 (ja) | 1993-08-09 | 2001-09-17 | 日産自動車株式会社 | 頭部搭載型ディスプレイ装置を備えたモニタリング装置 |
US7310072B2 (en) * | 1993-10-22 | 2007-12-18 | Kopin Corporation | Portable communication display device |
JPH0923449A (ja) * | 1995-07-05 | 1997-01-21 | Hitachi Ltd | 実写映像及び3次元モデル合成装置 |
DE19639615C5 (de) | 1996-09-26 | 2008-11-06 | Brainlab Ag | Reflektorenreferenzierungssystem für chirurgische und medizinische Instrumente |
US5739642A (en) * | 1995-12-04 | 1998-04-14 | Industrial Technology Research Institute | Low power consumption driving method for field emitter displays |
US6317127B1 (en) * | 1996-10-16 | 2001-11-13 | Hughes Electronics Corporation | Multi-user real-time augmented reality system and method |
US6112015A (en) * | 1996-12-06 | 2000-08-29 | Northern Telecom Limited | Network management graphical user interface |
JPH10207394A (ja) * | 1997-01-16 | 1998-08-07 | Shimadzu Corp | 頭部装着型表示システム |
US6064335A (en) * | 1997-07-21 | 2000-05-16 | Trimble Navigation Limited | GPS based augmented reality collision avoidance system |
AU9068698A (en) | 1997-07-23 | 1999-02-16 | Horst Jurgen Duschek | Method for controlling an unmanned transport vehicle and unmanned transport vehicle system therefor |
US6522312B2 (en) | 1997-09-01 | 2003-02-18 | Canon Kabushiki Kaisha | Apparatus for presenting mixed reality shared among operators |
US6166744A (en) * | 1997-11-26 | 2000-12-26 | Pathfinder Systems, Inc. | System for combining virtual images with real-world scenes |
FR2775814B1 (fr) * | 1998-03-06 | 2001-01-19 | Rasterland Sa | Systeme de visualisation d'images tridimensionnelles realistes virtuelles en temps reel |
US6697103B1 (en) * | 1998-03-19 | 2004-02-24 | Dennis Sunga Fernandez | Integrated network for monitoring remote objects |
US6215498B1 (en) * | 1998-09-10 | 2001-04-10 | Lionhearth Technologies, Inc. | Virtual command post |
JP2000102036A (ja) | 1998-09-22 | 2000-04-07 | Mr System Kenkyusho:Kk | 複合現実感提示システム、複合現実感提示方法、マン・マシーンインタフェース装置、およびマン・マシーンインタフェース方法 |
JP4101951B2 (ja) * | 1998-11-10 | 2008-06-18 | オリンパス株式会社 | 手術用顕微鏡 |
US6466232B1 (en) * | 1998-12-18 | 2002-10-15 | Tangis Corporation | Method and system for controlling presentation of information to a user based on the user's condition |
US6708142B1 (en) | 1999-01-14 | 2004-03-16 | University Of Central Florida | Automatic motion modeling of rigid bodies using collision detection |
JP4550184B2 (ja) * | 1999-07-02 | 2010-09-22 | オリンパス株式会社 | 観察光学系 |
DE50007901D1 (de) * | 1999-03-02 | 2004-10-28 | Siemens Ag | Nutzung von augmented reality-basistechnologien zur situationsgerechten unterstützung des facharbeiters durch entfernte experten |
US7324081B2 (en) * | 1999-03-02 | 2008-01-29 | Siemens Aktiengesellschaft | Augmented-reality system for situation-related support of the interaction between a user and an engineering apparatus |
US6500008B1 (en) * | 1999-03-15 | 2002-12-31 | Information Decision Technologies, Llc | Augmented reality-based firefighter training system and method |
US6348877B1 (en) * | 1999-06-17 | 2002-02-19 | International Business Machines Corporation | Method and system for alerting a pilot to the location of other aircraft |
GB2352289B (en) * | 1999-07-14 | 2003-09-17 | Dennis Majoe | Position and orientation detection system |
US6453168B1 (en) * | 1999-08-02 | 2002-09-17 | Itt Manufacturing Enterprises, Inc | Method and apparatus for determining the position of a mobile communication device using low accuracy clocks |
US6281790B1 (en) * | 1999-09-01 | 2001-08-28 | Net Talon Security Systems, Inc. | Method and apparatus for remotely monitoring a site |
WO2001056018A1 (de) * | 2000-01-27 | 2001-08-02 | Siemens Aktiengesellschaft | System und verfahren zur blickfokussierten sprachverarbeitung mit erzeugung eines visuellen feedbacksignals |
ES2231448T3 (es) * | 2000-01-27 | 2005-05-16 | Siemens Aktiengesellschaft | Sistema y procedimiento para el procesamiento de voz enfocado a la vision. |
AU2001233019A1 (en) * | 2000-01-28 | 2001-08-07 | Intersense, Inc. | Self-referenced tracking |
US6607038B2 (en) * | 2000-03-15 | 2003-08-19 | Information Decision Technologies, Llc | Instrumented firefighter's nozzle and method |
US6616454B2 (en) * | 2000-03-15 | 2003-09-09 | Information Decision Technologies, Llc | Method of simulating nozzle spray interaction with fire, smoke and other aerosols and gases |
US7110013B2 (en) * | 2000-03-15 | 2006-09-19 | Information Decision Technology | Augmented reality display integrated with self-contained breathing apparatus |
US7000469B2 (en) * | 2000-04-21 | 2006-02-21 | Intersense, Inc. | Motion-tracking |
US6474159B1 (en) * | 2000-04-21 | 2002-11-05 | Intersense, Inc. | Motion-tracking |
JP3423676B2 (ja) | 2000-07-19 | 2003-07-07 | キヤノン株式会社 | 仮想対象物操作装置および仮想対象物操作方法 |
US6903707B2 (en) * | 2000-08-09 | 2005-06-07 | Information Decision Technologies, Llc | Method for using a motorized camera mount for tracking in augmented reality |
DE10041104C1 (de) * | 2000-08-22 | 2002-03-07 | Siemens Ag | Einrichtung und Verfahren zur Kommunikation zwischen einer mobilen Datenverarbeitungsvorrichtung und einer stationären Datenverarbeitungsvorrichtung |
JP2004538538A (ja) | 2000-10-05 | 2004-12-24 | シーメンス コーポレイト リサーチ インコーポレイテツド | 強化現実可視化付きの、手術中にイメージガイドされる神経外科手術法及び手術用装置 |
US6962277B2 (en) * | 2000-12-18 | 2005-11-08 | Bath Iron Works Corporation | Apparatus and method for using a wearable computer in testing and diagnostic applications |
US7605826B2 (en) * | 2001-03-27 | 2009-10-20 | Siemens Corporate Research, Inc. | Augmented reality guided instrument positioning with depth determining graphics |
US6856324B2 (en) * | 2001-03-27 | 2005-02-15 | Siemens Corporate Research, Inc. | Augmented reality guided instrument positioning with guiding graphics |
US7176936B2 (en) * | 2001-03-27 | 2007-02-13 | Siemens Corporate Research, Inc. | Augmented reality guided instrument positioning with modulated guiding graphics |
US6822648B2 (en) * | 2001-04-17 | 2004-11-23 | Information Decision Technologies, Llc | Method for occlusion of movable objects and people in augmented reality scenes |
US7215322B2 (en) * | 2001-05-31 | 2007-05-08 | Siemens Corporate Research, Inc. | Input devices for augmented reality applications |
US6673243B2 (en) * | 2001-08-01 | 2004-01-06 | Board Of Supervisors Of Louisiana State University And Agricultural And Mechanical College | Plug flow anaerobic digester |
US7071898B2 (en) * | 2002-07-18 | 2006-07-04 | Information Decision Technologies, Llc | Method for using a wireless motorized camera mount for tracking in augmented reality |
US7262747B2 (en) * | 2001-08-09 | 2007-08-28 | Information Decision Technologies, Llc | Method and apparatus for using thermal imaging and augmented reality |
US7046214B2 (en) * | 2003-12-17 | 2006-05-16 | Information Decision Technologies, Llc | Method and system for accomplishing a scalable, multi-user, extended range, distributed, augmented reality environment |
US7379077B2 (en) * | 2001-08-23 | 2008-05-27 | Siemens Corporate Research, Inc. | Augmented and virtual reality guided instrument positioning using along-the-line-of-sight alignment |
US7126558B1 (en) * | 2001-10-19 | 2006-10-24 | Accenture Global Services Gmbh | Industrial augmented reality |
US6675091B2 (en) * | 2001-11-20 | 2004-01-06 | Siemens Corporate Research, Inc. | System and method for tracking, locating, and guiding within buildings |
AU2003220185B2 (en) | 2002-03-12 | 2007-05-10 | Menache, Llc | Motion tracking system and method |
JP2003337963A (ja) | 2002-05-17 | 2003-11-28 | Seiko Epson Corp | 画像処理装置および画像処理方法、ならびに、画像処理プログラムおよびその記録媒体 |
US6873256B2 (en) * | 2002-06-21 | 2005-03-29 | Dorothy Lemelson | Intelligent building alarm |
US7138963B2 (en) * | 2002-07-18 | 2006-11-21 | Metamersion, Llc | Method for automatically tracking objects in augmented reality |
US6922632B2 (en) * | 2002-08-09 | 2005-07-26 | Intersense, Inc. | Tracking, auto-calibration, and map-building system |
US7002551B2 (en) * | 2002-09-25 | 2006-02-21 | Hrl Laboratories, Llc | Optical see-through augmented reality modified-scale display |
US6867753B2 (en) * | 2002-10-28 | 2005-03-15 | University Of Washington | Virtual image registration in augmented display field |
JP4381767B2 (ja) * | 2003-10-10 | 2009-12-09 | 能美防災株式会社 | 防災総合システム |
US7774044B2 (en) * | 2004-02-17 | 2010-08-10 | Siemens Medical Solutions Usa, Inc. | System and method for augmented reality navigation in a medical intervention procedure |
JP4566786B2 (ja) | 2004-05-14 | 2010-10-20 | キヤノン株式会社 | 位置姿勢計測方法および情報処理装置 |
JP4367926B2 (ja) * | 2004-05-17 | 2009-11-18 | キヤノン株式会社 | 画像合成システムおよび画像合成方法、および画像合成装置 |
JP2006000999A (ja) * | 2004-06-21 | 2006-01-05 | Nec Fielding Ltd | 監視システム、その方法、監視ロボットおよびプログラム |
US7439524B2 (en) * | 2004-09-02 | 2008-10-21 | Abraham Katzir | Thermoluminescence measurements and dosimetry with temperature control of the thermoluminescence element |
US7397368B2 (en) * | 2004-09-22 | 2008-07-08 | Kevin L Otto | Remote field command post |
WO2006041937A2 (en) * | 2004-10-04 | 2006-04-20 | Solid Terrain Modeling | Three-dimensional cartographic user interface system |
CA2624946A1 (en) * | 2004-11-10 | 2006-05-18 | Bae Systems Information And Electronic Systems Integration Inc. | Wearable portable device for establishing communications interoperability at an incident site |
DE102005061211B4 (de) * | 2004-12-22 | 2023-04-06 | Abb Schweiz Ag | Verfahren zum Erzeugen einer Mensch-Maschine-Benutzer-Oberfläche |
KR100687737B1 (ko) * | 2005-03-19 | 2007-02-27 | 한국전자통신연구원 | 양손 제스쳐에 기반한 가상 마우스 장치 및 방법 |
JP2007018173A (ja) * | 2005-07-06 | 2007-01-25 | Canon Inc | 画像処理方法、画像処理装置 |
US7855638B2 (en) * | 2005-07-14 | 2010-12-21 | Huston Charles D | GPS based spectator and participant sport system and method |
WO2007011522A2 (en) * | 2005-07-14 | 2007-01-25 | Gm Global Technology Operations, Inc. | Remote perspective vehicle environment observation system |
EP1772110B1 (de) | 2005-10-07 | 2010-03-17 | BrainLAB AG | Medizintechnische Markereinrichtung |
US20070098238A1 (en) * | 2005-10-31 | 2007-05-03 | Pere Obrador | Imaging methods, imaging systems, and articles of manufacture |
US7599789B2 (en) * | 2006-05-24 | 2009-10-06 | Raytheon Company | Beacon-augmented pose estimation |
US9323055B2 (en) * | 2006-05-26 | 2016-04-26 | Exelis, Inc. | System and method to display maintenance and operational instructions of an apparatus using augmented reality |
US9229230B2 (en) * | 2007-02-28 | 2016-01-05 | Science Applications International Corporation | System and method for video image registration and/or providing supplemental data in a heads up display |
US8217856B1 (en) * | 2011-07-27 | 2012-07-10 | Google Inc. | Head-mounted display that displays a visual representation of physical interaction with an input interface located outside of the field of view |
-
2007
- 2007-03-08 US US11/715,338 patent/US20080218331A1/en not_active Abandoned
-
2008
- 2008-03-07 CA CA002679427A patent/CA2679427A1/en not_active Abandoned
- 2008-03-07 EP EP08726549A patent/EP2126866A4/en not_active Withdrawn
- 2008-03-07 JP JP2009552743A patent/JP5553405B2/ja not_active Expired - Fee Related
- 2008-03-07 WO PCT/US2008/003038 patent/WO2008112149A2/en active Application Filing
- 2008-03-07 AU AU2008226932A patent/AU2008226932B2/en not_active Ceased
-
2012
- 2012-01-19 US US13/354,167 patent/US9324229B2/en active Active
-
2014
- 2014-03-25 JP JP2014061266A patent/JP2014123406A/ja not_active Withdrawn
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH09504120A (ja) * | 1993-10-22 | 1997-04-22 | コピン・コーポレーシヨン | 頭部装着形表示システム |
JP2002278670A (ja) * | 2001-01-30 | 2002-09-27 | Physoptics Opto-Electronic Gmbh | 情報システム |
JP2005524901A (ja) * | 2002-05-08 | 2005-08-18 | ネッタロン セキュリティー システムズ, インコーポレイテッド | 遠隔地を監視するための方法および装置 |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP7040827B1 (ja) | 2021-01-14 | 2022-03-23 | 株式会社ロックガレッジ | 捜索支援システムおよび救助支援プログラム |
JP2022108823A (ja) * | 2021-01-14 | 2022-07-27 | 株式会社ロックガレッジ | 捜索支援システムおよび救助支援プログラム |
Also Published As
Publication number | Publication date |
---|---|
AU2008226932B2 (en) | 2011-09-22 |
WO2008112149A2 (en) | 2008-09-18 |
US20120120070A1 (en) | 2012-05-17 |
EP2126866A2 (en) | 2009-12-02 |
JP2014123406A (ja) | 2014-07-03 |
CA2679427A1 (en) | 2008-09-18 |
AU2008226932A2 (en) | 2009-11-19 |
JP5553405B2 (ja) | 2014-07-16 |
WO2008112149A3 (en) | 2009-12-23 |
AU2008226932A1 (en) | 2008-09-18 |
EP2126866A4 (en) | 2011-06-01 |
US20080218331A1 (en) | 2008-09-11 |
US9324229B2 (en) | 2016-04-26 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP5553405B2 (ja) | 閉ざされた構造内の人員およびセンサの位置を示し、状況認識の増進を提供する、拡張現実ベース型システムおよび方法 | |
US11282248B2 (en) | Information display by overlay on an object | |
US20020196202A1 (en) | Method for displaying emergency first responder command, control, and safety information using augmented reality | |
CN104660995B (zh) | 一种救灾救援可视系统 | |
US7262747B2 (en) | Method and apparatus for using thermal imaging and augmented reality | |
US20200020161A1 (en) | Virtual Barrier Objects | |
US20030210228A1 (en) | Augmented reality situational awareness system and method | |
TWI755834B (zh) | 視覺圖資定位系統 | |
KR20160070503A (ko) | 무선 통신을 이용한 협업 소방관의 위치 제공 방법 및 그 시스템과, 협업 소방관의 위치 표시 방법 및 이를 수행하기 위한 소방 헬멧 | |
CN109358754B (zh) | 一种混合现实头戴显示系统 | |
EP2492859A2 (en) | System for representing locations of persons in a structure | |
CN108765872B (zh) | 一种受困对象环境参数的推测方法、系统和智能穿戴设备 | |
CN211705663U (zh) | 一种消防用ar单兵可视化面罩及智能作战指挥面罩系统 | |
US20110248847A1 (en) | Mobile asset location in structure | |
GB2535723A (en) | Emergency guidance system and method | |
KR101513949B1 (ko) | 재난 구조 네비게이션 제공 방법 및 이를 실행하는 서버 | |
Steingart et al. | Augmented cognition for fire emergency response: An iterative user study | |
WO2016135448A1 (en) | Emergency guidance system and method | |
Bretschneider et al. | Head mounted displays for fire fighters | |
Streefkerk et al. | Evaluating a multimodal interface for firefighting rescue tasks | |
Mitsuhara et al. | Why Don't You Evacuate Speedily? Augmented Reality-based Evacuee Visualisation in ICT-based Evacuation Drill | |
WO2023286115A1 (ja) | 表示制御装置、表示システム、表示方法及びコンピュータ可読媒体 | |
CN219515404U (zh) | Ar智能消防头盔 | |
CN211323223U (zh) | 基于分布式网络的ar消防头盔 | |
KR102700093B1 (ko) | 증강현실을 활용한 재난 대피 훈련 시스템 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
A621 | Written request for application examination |
Free format text: JAPANESE INTERMEDIATE CODE: A621 Effective date: 20110210 |
|
A521 | Written amendment |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20120131 |
|
A711 | Notification of change in applicant |
Free format text: JAPANESE INTERMEDIATE CODE: A711 Effective date: 20120628 |
|
A977 | Report on retrieval |
Free format text: JAPANESE INTERMEDIATE CODE: A971007 Effective date: 20130207 |
|
A131 | Notification of reasons for refusal |
Free format text: JAPANESE INTERMEDIATE CODE: A131 Effective date: 20130215 |
|
A02 | Decision of refusal |
Free format text: JAPANESE INTERMEDIATE CODE: A02 Effective date: 20131129 |
|
A521 | Written amendment |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20140325 |
|
A911 | Transfer of reconsideration by examiner before appeal (zenchi) |
Free format text: JAPANESE INTERMEDIATE CODE: A911 Effective date: 20140403 |
|
TRDD | Decision of grant or rejection written | ||
A01 | Written decision to grant a patent or to grant a registration (utility model) |
Free format text: JAPANESE INTERMEDIATE CODE: A01 Effective date: 20140522 |
|
A61 | First payment of annual fees (during grant procedure) |
Free format text: JAPANESE INTERMEDIATE CODE: A61 Effective date: 20140523 |
|
R150 | Certificate of patent or registration of utility model |
Ref document number: 5553405 Country of ref document: JP Free format text: JAPANESE INTERMEDIATE CODE: R150 |
|
LAPS | Cancellation because of no payment of annual fees |