EP3676809A1 - Balise lumineuse à réalité augmentée - Google Patents

Balise lumineuse à réalité augmentée

Info

Publication number
EP3676809A1
EP3676809A1 EP18866991.5A EP18866991A EP3676809A1 EP 3676809 A1 EP3676809 A1 EP 3676809A1 EP 18866991 A EP18866991 A EP 18866991A EP 3676809 A1 EP3676809 A1 EP 3676809A1
Authority
EP
European Patent Office
Prior art keywords
sensor
beacon
pattern
images
sensor data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
EP18866991.5A
Other languages
German (de)
English (en)
Other versions
EP3676809A4 (fr
Inventor
Alyssa Tham
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Schneider Electric Systems USA Inc
Original Assignee
Schneider Electric Systems USA Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Schneider Electric Systems USA Inc filed Critical Schneider Electric Systems USA Inc
Publication of EP3676809A1 publication Critical patent/EP3676809A1/fr
Publication of EP3676809A4 publication Critical patent/EP3676809A4/fr
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/00—2D [Two Dimensional] image generation
    • G06T11/60—Editing figures and text; Combining figures or text
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/00—2D [Two Dimensional] image generation
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B19/00—Programme-control systems
    • G05B19/02—Programme-control systems electric
    • G05B19/418—Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS], computer integrated manufacturing [CIM]
    • G05B19/4183—Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS], computer integrated manufacturing [CIM] characterised by data acquisition, e.g. workpiece identification
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/006—Mixed reality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/0002—Inspection of images, e.g. flaw detection
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04B—TRANSMISSION
    • H04B10/00—Transmission systems employing electromagnetic waves other than radio-waves, e.g. infrared, visible or ultraviolet light, or employing corpuscular radiation, e.g. quantum communication
    • H04B10/11—Arrangements specific to free-space transmission, i.e. transmission through air or vacuum
    • H04B10/114—Indoor or close-range type systems
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S1/00—Beacons or beacon systems transmitting signals having a characteristic or characteristics capable of being detected by non-directional receivers and defining directions, positions, or position lines fixed relatively to the beacon transmitters; Receivers co-operating therewith
    • G01S1/70—Beacons or beacon systems transmitting signals having a characteristic or characteristics capable of being detected by non-directional receivers and defining directions, positions, or position lines fixed relatively to the beacon transmitters; Receivers co-operating therewith using electromagnetic waves other than radio waves
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00—Program-control systems
    • G05B2219/30—Nc systems
    • G05B2219/32—Operator till task planning
    • G05B2219/32014—Augmented reality assists operator in maintenance, repair, programming, assembly, use of head mounted display with 2-D 3-D display and voice feedback, voice and gesture command
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
    • Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
    • Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]

Abstract

La présente invention concerne un système et un procédé permettant d'avoir accès à des informations en temps réel à partir d'un système de capteur dans un environnement de réalité augmentée. Le système et le procédé impliquent la capture d'images d'une zone comprenant une balise pour un système de capteur et un motif transmis par la balise. Le motif correspond à des informations comportant des données de capteur en temps réel d'une ou de plusieurs conditions surveillées par le système de capteur dans la zone. Le système et le procédé impliquent en outre l'identification du motif à partir des images capturées par le dispositif de détection d'image ; la translation du motif pour obtenir les données de capteur ; la superposition des données de capteur sur les images capturées en relation avec la balise ou le système de capteur dans les images capturées ; et l'affichage des images superposées avec les données de capteur sur un dispositif d'affichage.
EP18866991.5A 2017-10-13 2018-10-08 Balise lumineuse à réalité augmentée Pending EP3676809A4 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US15/783,137 US10593086B2 (en) 2017-10-13 2017-10-13 Augmented reality light beacon
PCT/US2018/054812 WO2019074820A1 (fr) 2017-10-13 2018-10-08 Balise lumineuse à réalité augmentée

Publications (2)

Publication Number Publication Date
EP3676809A1 true EP3676809A1 (fr) 2020-07-08
EP3676809A4 EP3676809A4 (fr) 2021-06-02

Family

ID=66096490

Family Applications (1)

Application Number Title Priority Date Filing Date
EP18866991.5A Pending EP3676809A4 (fr) 2017-10-13 2018-10-08 Balise lumineuse à réalité augmentée

Country Status (4)

Country Link
US (1) US10593086B2 (fr)
EP (1) EP3676809A4 (fr)
CN (1) CN111344748B (fr)
WO (1) WO2019074820A1 (fr)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11094220B2 (en) * 2018-10-23 2021-08-17 International Business Machines Corporation Intelligent augmented reality for technical support engineers
KR102122974B1 (ko) * 2018-12-14 2020-06-15 한국전력기술 주식회사 발전소 플랜트 제어방법 및 단말기
WO2020240691A1 (fr) * 2019-05-28 2020-12-03 ソニー株式会社 Terminal de communication sans fil et procédé de contrôle de communication
US11587294B2 (en) * 2019-08-22 2023-02-21 Carrier Corporation System and a method for applying augmented reality technique to audits
US11374808B2 (en) 2020-05-29 2022-06-28 Corning Research & Development Corporation Automated logging of patching operations via mixed reality based labeling
US11295135B2 (en) * 2020-05-29 2022-04-05 Corning Research & Development Corporation Asset tracking of communication equipment via mixed reality based labeling
US20220188545A1 (en) * 2020-12-10 2022-06-16 International Business Machines Corporation Augmented reality enhanced situational awareness

Family Cites Families (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7268700B1 (en) * 1998-01-27 2007-09-11 Hoffberg Steven M Mobile communication device
US20040001074A1 (en) * 2002-05-29 2004-01-01 Hideki Oyaizu Image display apparatus and method, transmitting apparatus and method, image display system, recording medium, and program
US7599789B2 (en) 2006-05-24 2009-10-06 Raytheon Company Beacon-augmented pose estimation
US8446470B2 (en) * 2007-10-04 2013-05-21 Magna Electronics, Inc. Combined RGB and IR imaging sensor
WO2012116112A1 (fr) * 2011-02-25 2012-08-30 Flir Systems, Inc. Systèmes et procédés de caméras infrarouges modulaires
US8330611B1 (en) 2009-01-15 2012-12-11 AvidaSports, LLC Positional locating system and method
WO2011150054A1 (fr) * 2010-05-25 2011-12-01 Rf Code, Inc. Système de localisation de bien pour enceintes à base de râteliers
FR2961055B1 (fr) * 2010-06-04 2012-06-22 Michel Picariello Reseau de balises lumineuses autonomes synchrones
US10096161B2 (en) * 2010-06-15 2018-10-09 Live Nation Entertainment, Inc. Generating augmented reality images using sensor and location data
WO2012115878A1 (fr) * 2011-02-22 2012-08-30 Flir Systems, Inc. Procédés et systèmes à capteurs infrarouges
US8401343B2 (en) 2011-03-27 2013-03-19 Edwin Braun System and method for defining an augmented reality character in computer generated virtual reality using coded stickers
US8791901B2 (en) 2011-04-12 2014-07-29 Sony Computer Entertainment, Inc. Object tracking with projected reference patterns
US9245051B2 (en) * 2011-09-20 2016-01-26 Nokia Technologies Oy Method and apparatus for conducting a search based on available data modes
GB2501921B (en) * 2012-05-11 2017-05-03 Sony Computer Entertainment Europe Ltd Augmented reality system
US9571816B2 (en) * 2012-11-16 2017-02-14 Microsoft Technology Licensing, Llc Associating an object with a subject
KR101936355B1 (ko) 2012-11-22 2019-01-08 에스케이하이닉스 주식회사 멀티-칩 시스템 및 반도체 패키지
EP2767845B1 (fr) * 2013-02-14 2019-06-26 BlackBerry Limited Système à réalité amplifiée avec balises de codage
US9483875B2 (en) 2013-02-14 2016-11-01 Blackberry Limited Augmented reality system with encoding beacons
KR102094017B1 (ko) * 2013-08-06 2020-03-26 삼성전자주식회사 데이터 송신 방법 및 그 전자 장치
CN103752010B (zh) * 2013-12-18 2017-07-11 微软技术许可有限责任公司 用于控制设备的增强现实覆盖
WO2015142334A1 (fr) 2014-03-20 2015-09-24 Hewlett-Packard Development Company, L.P. Identification d'éléments électroniques de réalité augmentée
US20160117908A1 (en) * 2014-10-28 2016-04-28 Astec International Limited Systems and methods for communicating data via light pulses
US20160379410A1 (en) * 2015-06-25 2016-12-29 Stmicroelectronics International N.V. Enhanced augmented reality multimedia system
US20180182025A1 (en) * 2016-12-22 2018-06-28 Capital One Services, Llc Systems and methods for visualizing in-budget products and services
US10878240B2 (en) * 2017-06-19 2020-12-29 Honeywell International Inc. Augmented reality user interface on mobile device for presentation of information related to industrial process, control and automation system, or other system

Also Published As

Publication number Publication date
US20190114816A1 (en) 2019-04-18
CN111344748B (zh) 2024-02-20
US10593086B2 (en) 2020-03-17
CN111344748A (zh) 2020-06-26
WO2019074820A1 (fr) 2019-04-18
EP3676809A4 (fr) 2021-06-02

Similar Documents

Publication Publication Date Title
US10593086B2 (en) Augmented reality light beacon
US10878240B2 (en) Augmented reality user interface on mobile device for presentation of information related to industrial process, control and automation system, or other system
EP2966617B1 (fr) Dispositif comprenant dispositif de génération de données d'image et dispositif de terminal portable
CN102809950B (zh) 用于基金会现场总线告警的系统和方法
EP3076253B1 (fr) Systèmes et procédés de présentation d'une réalité augmentée
CN203275968U (zh) 用于控制过程的过程控制系统和无线输出设备
CN104100754B (zh) 智能致动器以及用于监视致动器健康性和完整性的方法
US20180345557A1 (en) Remote control system for injection molding machine
KR20190077898A (ko) 관리 대상 설비 이상 상태 모니터링 시스템
JP2018520416A (ja) 統合資産保全性管理システム
US20220083032A1 (en) Smart factory monitoring system
US20150198945A1 (en) Remote monitoring system for distant location robot
US10430041B2 (en) Information collection system, information collection terminal device, information collection server, and information collection method
US20190113898A1 (en) Setting system, setting device, setting method, and setting program
KR101779827B1 (ko) 제조 장비 및 설비에 대한 원격 모니터링 및 제어 시스템 및 이에 관한 컴퓨터 판독가능 저장 매체
CN107493377B (zh) 一种基于移动终端应用的热工参数采集装置与方法
CN112910944B (zh) 在分散控制系统集成可视化数字工厂技术的安全网络结构
US20200264592A1 (en) Smartwatch and method for the maintenance operating an automation technology facility
CN102809951B (zh) 用于基金会现场总线告警的系统和方法
CN117043825A (zh) 一种实时控制的可视化孪生工厂系统
US20210278943A1 (en) Optical workspace link
KR101276856B1 (ko) 영상 정보 기반의 원방 감시 제어시스템
KR101058349B1 (ko) 그래픽 유저 인터페이스와 연동하는 실시간 동영상 관리 시스템
CN116997871A (zh) 一种嵌入分散控制系统的工厂服务器及其安全网络结构
CN112711228A (zh) 用于工业环境中的过程自动化的现场设备

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20200331

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
RAP3 Party data changed (applicant data changed or rights of an application transferred)

Owner name: SCHNEIDER ELECTRIC SYSTEMS USA, INC.

A4 Supplementary search report drawn up and despatched

Effective date: 20210503

RIC1 Information provided on ipc code assigned before grant

Ipc: G06T 11/00 20060101AFI20210427BHEP

Ipc: G06T 19/00 20110101ALI20210427BHEP

Ipc: G05B 19/418 20060101ALI20210427BHEP

Ipc: H04B 10/114 20130101ALI20210427BHEP