JP6882147B2 - 操作案内システム - Google Patents

操作案内システム Download PDF

Info

Publication number
JP6882147B2
JP6882147B2 JP2017228079A JP2017228079A JP6882147B2 JP 6882147 B2 JP6882147 B2 JP 6882147B2 JP 2017228079 A JP2017228079 A JP 2017228079A JP 2017228079 A JP2017228079 A JP 2017228079A JP 6882147 B2 JP6882147 B2 JP 6882147B2
Authority
JP
Japan
Prior art keywords
operator
image
unit
machine
guidance system
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2017228079A
Other languages
English (en)
Japanese (ja)
Other versions
JP2019101476A5 (https=
JP2019101476A (ja
Inventor
徹 寺田
徹 寺田
聡一 戎野
聡一 戎野
賢治 岩野
賢治 岩野
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Schneider Electric Japan Holdings Ltd
Original Assignee
Schneider Electric Japan Holdings Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Schneider Electric Japan Holdings Ltd filed Critical Schneider Electric Japan Holdings Ltd
Priority to JP2017228079A priority Critical patent/JP6882147B2/ja
Priority to US16/767,382 priority patent/US11475606B2/en
Priority to CN201880076541.9A priority patent/CN111565898B/zh
Priority to EP18882638.2A priority patent/EP3718708A4/en
Priority to PCT/JP2018/018684 priority patent/WO2019106862A1/ja
Publication of JP2019101476A publication Critical patent/JP2019101476A/ja
Publication of JP2019101476A5 publication Critical patent/JP2019101476A5/ja
Application granted granted Critical
Publication of JP6882147B2 publication Critical patent/JP6882147B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/00—Two-dimensional [2D] image generation
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00—Program-controlled manipulators
    • B25J9/16—Program controls
    • B25J9/1656—Program controls characterised by programming, planning systems for manipulators
    • B25J9/1671—Program controls characterised by programming, planning systems for manipulators characterised by simulation, either to verify existing program or to create and verify new program, CAD/CAM oriented, graphic oriented programming systems
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J13/00—Controls for manipulators
    • B25J13/02—Hand grip control means
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J19/00—Accessories fitted to manipulators, e.g. for monitoring, for viewing; Safety devices combined with or specially adapted for use in connection with manipulators
    • B25J19/02—Sensing devices
    • B25J19/021—Optical sensing devices
    • B25J19/023—Optical sensing devices including video camera means
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B19/00—Program-control systems
    • G05B19/02—Program-control systems electric
    • G05B19/18—Numerical control [NC], i.e. automatically operating machines, in particular machine tools, e.g. in a manufacturing environment, so as to execute positioning, movement or co-ordinated operations by means of program data in numerical form
    • G05B19/409—Numerical control [NC], i.e. automatically operating machines, in particular machine tools, e.g. in a manufacturing environment, so as to execute positioning, movement or co-ordinated operations by means of program data in numerical form characterised by using manual data input [MDI] or by using control panel, e.g. controlling functions with the panel; characterised by control panel details or by setting parameters
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00—Program-control systems
    • G05B2219/30—Nc systems
    • G05B2219/36—Nc in input of data, input key till input tape
    • G05B2219/36167—Use camera of handheld device, pda, pendant, head mounted display
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00—Program-control systems
    • G05B2219/30—Nc systems
    • G05B2219/39—Robotics, robotics to robotics hand
    • G05B2219/39451—Augmented reality for robot programming
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/044—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by capacitive means
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10004—Still image; Photographic image
    • G06T2207/10012—Stereo images

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Robotics (AREA)
  • Mechanical Engineering (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Manufacturing & Machinery (AREA)
  • Automation & Control Theory (AREA)
  • User Interface Of Digital Computer (AREA)
  • Numerical Control (AREA)
  • Manipulator (AREA)
JP2017228079A 2017-11-28 2017-11-28 操作案内システム Active JP6882147B2 (ja)

Priority Applications (5)

Application Number Priority Date Filing Date Title
JP2017228079A JP6882147B2 (ja) 2017-11-28 2017-11-28 操作案内システム
US16/767,382 US11475606B2 (en) 2017-11-28 2018-05-15 Operation guiding system for operation of a movable device
CN201880076541.9A CN111565898B (zh) 2017-11-28 2018-05-15 操作引导系统
EP18882638.2A EP3718708A4 (en) 2017-11-28 2018-05-15 ACTION GUIDANCE SYSTEM
PCT/JP2018/018684 WO2019106862A1 (ja) 2017-11-28 2018-05-15 操作案内システム

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2017228079A JP6882147B2 (ja) 2017-11-28 2017-11-28 操作案内システム

Publications (3)

Publication Number Publication Date
JP2019101476A JP2019101476A (ja) 2019-06-24
JP2019101476A5 JP2019101476A5 (https=) 2020-12-17
JP6882147B2 true JP6882147B2 (ja) 2021-06-02

Family

ID=66664763

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2017228079A Active JP6882147B2 (ja) 2017-11-28 2017-11-28 操作案内システム

Country Status (5)

Country Link
US (1) US11475606B2 (https=)
EP (1) EP3718708A4 (https=)
JP (1) JP6882147B2 (https=)
CN (1) CN111565898B (https=)
WO (1) WO2019106862A1 (https=)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2023017440A (ja) * 2021-07-26 2023-02-07 株式会社ダイヘン 画像処理装置
JP7149440B1 (ja) 2022-04-21 2022-10-06 三菱製鋼株式会社 操作装置
WO2023248439A1 (ja) * 2022-06-23 2023-12-28 ファナック株式会社 ロボットシステム、ロボット制御装置およびロボット制御プログラム
WO2025052590A1 (ja) * 2023-09-06 2025-03-13 株式会社Fuji ロボットシステム

Family Cites Families (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
BRPI0508748B1 (pt) * 2004-03-26 2018-05-02 Takahashi Atsushi Sistema tridimensional para orientação e instruções visuais remotas, dotado de visor tridimensional com câmeras.
JP5023632B2 (ja) 2006-09-15 2012-09-12 ブラザー工業株式会社 ヘッドマウントディスプレイ
JP4019200B2 (ja) * 2007-06-18 2007-12-12 富士フイルム株式会社 画像表示器付きカメラ
JP5022868B2 (ja) * 2007-11-16 2012-09-12 キヤノン株式会社 情報処理装置、情報処理方法
JP5422430B2 (ja) 2010-02-12 2014-02-19 株式会社タダノ 作業用装置
JP2012218120A (ja) * 2011-04-12 2012-11-12 Seiko Epson Corp マニピュレーター動作予告装置、ロボットシステム及びマニピュレーター動作予告方法
JP5784388B2 (ja) * 2011-06-29 2015-09-24 オリンパス株式会社 医療用マニピュレータシステム
JP5800616B2 (ja) 2011-07-15 2015-10-28 オリンパス株式会社 マニピュレータシステム
JP6021353B2 (ja) * 2011-08-04 2016-11-09 オリンパス株式会社 手術支援装置
JP2013184257A (ja) * 2012-03-08 2013-09-19 Sony Corp ロボット装置及びロボット装置の制御方法、並びにコンピューター・プログラム
JP6080697B2 (ja) * 2013-05-31 2017-02-15 三菱電機株式会社 誘導加熱調理器
JP6266268B2 (ja) * 2013-08-28 2018-01-24 Dmg森精機株式会社 表示装置
US9817396B1 (en) * 2014-06-09 2017-11-14 X Development Llc Supervisory control of an unmanned aerial vehicle
US9849981B1 (en) * 2014-08-28 2017-12-26 X Development Llc Payload-release device position tracking
US10179407B2 (en) * 2014-11-16 2019-01-15 Robologics Ltd. Dynamic multi-sensor and multi-robot interface system
JP2016107379A (ja) * 2014-12-08 2016-06-20 ファナック株式会社 拡張現実対応ディスプレイを備えたロボットシステム
US9836117B2 (en) * 2015-05-28 2017-12-05 Microsoft Technology Licensing, Llc Autonomous drones for tactile feedback in immersive virtual reality
JP6643843B2 (ja) * 2015-09-14 2020-02-12 オリンパス株式会社 撮像操作ガイド装置および撮像装置の操作ガイド方法
JP6657858B2 (ja) 2015-11-30 2020-03-04 株式会社デンソーウェーブ ロボット操作システム
US20180098052A1 (en) * 2016-09-30 2018-04-05 Sony Interactive Entertainment Inc. Translation of physical object viewed by unmanned aerial vehicle into virtual world object
CN107223082B (zh) * 2017-04-21 2020-05-12 深圳前海达闼云端智能科技有限公司 一种机器人控制方法、机器人装置及机器人设备
US10852847B2 (en) * 2017-07-26 2020-12-01 Google Llc Controller tracking for multiple degrees of freedom

Also Published As

Publication number Publication date
WO2019106862A1 (ja) 2019-06-06
EP3718708A1 (en) 2020-10-07
EP3718708A4 (en) 2021-12-22
US11475606B2 (en) 2022-10-18
CN111565898B (zh) 2023-04-21
CN111565898A (zh) 2020-08-21
JP2019101476A (ja) 2019-06-24
US20200394823A1 (en) 2020-12-17

Similar Documents

Publication Publication Date Title
US12450847B2 (en) Head-mounted information processing apparatus and head-mounted display system
TWI722280B (zh) 用於多個自由度之控制器追蹤
JP5472056B2 (ja) 表示システム、表示処理装置、表示方法、および表示プログラム
JP6057396B2 (ja) ３次元ユーザインタフェース装置及び３次元操作処理方法
JP5843340B2 (ja) ３次元環境共有システム及び３次元環境共有方法
JP6970858B2 (ja) 保守支援システム、保守支援方法、プログラム及び加工画像の生成方法
JP2013206322A (ja) 情報処理装置、情報処理システム及び情報処理方法
WO2014016987A1 (ja) ３次元ユーザインタフェース装置及び３次元操作方法
JP6882147B2 (ja) 操作案内システム
JP6748793B1 (ja) 保守支援システム、保守支援方法、プログラム及び加工画像の生成方法
JP2015118442A (ja) 情報処理装置、情報処理方法およびプログラム
JP2024056455A (ja) 情報処理システム、情報処理方法、プログラム
JP2021135776A (ja) 情報処理装置、情報処理方法、およびプログラム
JP6164177B2 (ja) 情報処理装置、情報処理システム、その制御方法及びプログラム
JP6685742B2 (ja) 操作装置、移動装置、およびその制御システム
JP2019045997A (ja) 情報処理装置及びその方法、プログラム
US9760180B2 (en) User interface device and user interface method
JP2020120388A (ja) 操作装置、移動装置、およびその制御システム
CN117707332A (zh) 信息处理设备、控制方法和非暂态计算机存储介质
JP5830899B2 (ja) 投影システム、投影装置、投影方法及びプログラム
US20250013418A1 (en) Work assistance system
CN121753074A (zh) 信息处理设备、信息处理系统、信息处理方法和程序
JP2025162718A (ja) 情報処理装置、情報処理装置の制御方法、及びプログラム
JP2023021808A (ja) 支援システム、支援側装置、支援方法、およびプログラム
WO2022172335A1 (ja) 仮想ガイド表示装置、仮想ガイド表示システム、及び仮想ガイド表示方法

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20201102

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20201102

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20210427

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20210506

R150 Certificate of patent or registration of utility model

Ref document number: 6882147

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250