JP6882147B2 - 操作案内システム - Google Patents

操作案内システム Download PDF

Info

Publication number
JP6882147B2
JP6882147B2 JP2017228079A JP2017228079A JP6882147B2 JP 6882147 B2 JP6882147 B2 JP 6882147B2 JP 2017228079 A JP2017228079 A JP 2017228079A JP 2017228079 A JP2017228079 A JP 2017228079A JP 6882147 B2 JP6882147 B2 JP 6882147B2
Authority
JP
Japan
Prior art keywords
operator
image
unit
machine
guidance system
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2017228079A
Other languages
English (en)
Japanese (ja)
Other versions
JP2019101476A5 (enExample
JP2019101476A (ja
Inventor
徹 寺田
徹 寺田
聡一 戎野
聡一 戎野
賢治 岩野
賢治 岩野
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Schneider Electric Japan Holdings Ltd
Original Assignee
Schneider Electric Japan Holdings Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Schneider Electric Japan Holdings Ltd filed Critical Schneider Electric Japan Holdings Ltd
Priority to JP2017228079A priority Critical patent/JP6882147B2/ja
Priority to EP18882638.2A priority patent/EP3718708A4/en
Priority to CN201880076541.9A priority patent/CN111565898B/zh
Priority to PCT/JP2018/018684 priority patent/WO2019106862A1/ja
Priority to US16/767,382 priority patent/US11475606B2/en
Publication of JP2019101476A publication Critical patent/JP2019101476A/ja
Publication of JP2019101476A5 publication Critical patent/JP2019101476A5/ja
Application granted granted Critical
Publication of JP6882147B2 publication Critical patent/JP6882147B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/00—2D [Two Dimensional] image generation
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00—Programme-controlled manipulators
    • B25J9/16—Programme controls
    • B25J9/1656—Programme controls characterised by programming, planning systems for manipulators
    • B25J9/1671—Programme controls characterised by programming, planning systems for manipulators characterised by simulation, either to verify existing program or to create and verify new program, CAD/CAM oriented, graphic oriented programming systems
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J13/00—Controls for manipulators
    • B25J13/02—Hand grip control means
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J19/00—Accessories fitted to manipulators, e.g. for monitoring, for viewing; Safety devices combined with or specially adapted for use in connection with manipulators
    • B25J19/02—Sensing devices
    • B25J19/021—Optical sensing devices
    • B25J19/023—Optical sensing devices including video camera means
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B19/00—Programme-control systems
    • G05B19/02—Programme-control systems electric
    • G05B19/18—Numerical control [NC], i.e. automatically operating machines, in particular machine tools, e.g. in a manufacturing environment, so as to execute positioning, movement or co-ordinated operations by means of programme data in numerical form
    • G05B19/409—Numerical control [NC], i.e. automatically operating machines, in particular machine tools, e.g. in a manufacturing environment, so as to execute positioning, movement or co-ordinated operations by means of programme data in numerical form characterised by using manual data input [MDI] or by using control panel, e.g. controlling functions with the panel; characterised by control panel details or by setting parameters
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00—Program-control systems
    • G05B2219/30—Nc systems
    • G05B2219/36—Nc in input of data, input key till input tape
    • G05B2219/36167—Use camera of handheld device, pda, pendant, head mounted display
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00—Program-control systems
    • G05B2219/30—Nc systems
    • G05B2219/39—Robotics, robotics to robotics hand
    • G05B2219/39451—Augmented reality for robot programming
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/044—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by capacitive means
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10004—Still image; Photographic image
    • G06T2207/10012—Stereo images

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Mechanical Engineering (AREA)
  • Robotics (AREA)
  • Human Computer Interaction (AREA)
  • General Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Manufacturing & Machinery (AREA)
  • Automation & Control Theory (AREA)
  • User Interface Of Digital Computer (AREA)
  • Numerical Control (AREA)
  • Manipulator (AREA)
JP2017228079A 2017-11-28 2017-11-28 操作案内システム Active JP6882147B2 (ja)

Priority Applications (5)

Application Number Priority Date Filing Date Title
JP2017228079A JP6882147B2 (ja) 2017-11-28 2017-11-28 操作案内システム
EP18882638.2A EP3718708A4 (en) 2017-11-28 2018-05-15 ACTION GUIDANCE SYSTEM
CN201880076541.9A CN111565898B (zh) 2017-11-28 2018-05-15 操作引导系统
PCT/JP2018/018684 WO2019106862A1 (ja) 2017-11-28 2018-05-15 操作案内システム
US16/767,382 US11475606B2 (en) 2017-11-28 2018-05-15 Operation guiding system for operation of a movable device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2017228079A JP6882147B2 (ja) 2017-11-28 2017-11-28 操作案内システム

Publications (3)

Publication Number Publication Date
JP2019101476A JP2019101476A (ja) 2019-06-24
JP2019101476A5 JP2019101476A5 (enExample) 2020-12-17
JP6882147B2 true JP6882147B2 (ja) 2021-06-02

Family

ID=66664763

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2017228079A Active JP6882147B2 (ja) 2017-11-28 2017-11-28 操作案内システム

Country Status (5)

Country Link
US (1) US11475606B2 (enExample)
EP (1) EP3718708A4 (enExample)
JP (1) JP6882147B2 (enExample)
CN (1) CN111565898B (enExample)
WO (1) WO2019106862A1 (enExample)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2023017440A (ja) * 2021-07-26 2023-02-07 株式会社ダイヘン 画像処理装置
JP7149440B1 (ja) 2022-04-21 2022-10-06 三菱製鋼株式会社 操作装置
WO2023248439A1 (ja) * 2022-06-23 2023-12-28 ファナック株式会社 ロボットシステム、ロボット制御装置およびロボット制御プログラム
WO2025052590A1 (ja) * 2023-09-06 2025-03-13 株式会社Fuji ロボットシステム

Family Cites Families (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7367809B2 (en) * 2004-03-26 2008-05-06 Atsushi Takahashi Three-dimensional digital entity mesoscope system equipped with three-dimensional visual instruction functions
JP5023632B2 (ja) 2006-09-15 2012-09-12 ブラザー工業株式会社 ヘッドマウントディスプレイ
JP4019200B2 (ja) * 2007-06-18 2007-12-12 富士フイルム株式会社 画像表示器付きカメラ
JP5022868B2 (ja) * 2007-11-16 2012-09-12 キヤノン株式会社 情報処理装置、情報処理方法
JP5422430B2 (ja) 2010-02-12 2014-02-19 株式会社タダノ 作業用装置
JP2012218120A (ja) * 2011-04-12 2012-11-12 Seiko Epson Corp マニピュレーター動作予告装置、ロボットシステム及びマニピュレーター動作予告方法
JP5784388B2 (ja) * 2011-06-29 2015-09-24 オリンパス株式会社 医療用マニピュレータシステム
JP5800616B2 (ja) 2011-07-15 2015-10-28 オリンパス株式会社 マニピュレータシステム
JP6021353B2 (ja) * 2011-08-04 2016-11-09 オリンパス株式会社 手術支援装置
JP2013184257A (ja) * 2012-03-08 2013-09-19 Sony Corp ロボット装置及びロボット装置の制御方法、並びにコンピューター・プログラム
JP6080697B2 (ja) * 2013-05-31 2017-02-15 三菱電機株式会社 誘導加熱調理器
JP6266268B2 (ja) * 2013-08-28 2018-01-24 Dmg森精機株式会社 表示装置
US9817396B1 (en) * 2014-06-09 2017-11-14 X Development Llc Supervisory control of an unmanned aerial vehicle
US9849981B1 (en) * 2014-08-28 2017-12-26 X Development Llc Payload-release device position tracking
US10179407B2 (en) * 2014-11-16 2019-01-15 Robologics Ltd. Dynamic multi-sensor and multi-robot interface system
JP2016107379A (ja) * 2014-12-08 2016-06-20 ファナック株式会社 拡張現実対応ディスプレイを備えたロボットシステム
US9836117B2 (en) * 2015-05-28 2017-12-05 Microsoft Technology Licensing, Llc Autonomous drones for tactile feedback in immersive virtual reality
JP6643843B2 (ja) * 2015-09-14 2020-02-12 オリンパス株式会社 撮像操作ガイド装置および撮像装置の操作ガイド方法
JP6657858B2 (ja) 2015-11-30 2020-03-04 株式会社デンソーウェーブ ロボット操作システム
US20180098052A1 (en) * 2016-09-30 2018-04-05 Sony Interactive Entertainment Inc. Translation of physical object viewed by unmanned aerial vehicle into virtual world object
WO2018191970A1 (zh) * 2017-04-21 2018-10-25 深圳前海达闼云端智能科技有限公司 一种机器人控制方法、机器人装置及机器人设备
US10852847B2 (en) * 2017-07-26 2020-12-01 Google Llc Controller tracking for multiple degrees of freedom

Also Published As

Publication number Publication date
US11475606B2 (en) 2022-10-18
US20200394823A1 (en) 2020-12-17
CN111565898A (zh) 2020-08-21
EP3718708A1 (en) 2020-10-07
EP3718708A4 (en) 2021-12-22
JP2019101476A (ja) 2019-06-24
CN111565898B (zh) 2023-04-21
WO2019106862A1 (ja) 2019-06-06

Similar Documents

Publication Publication Date Title
JP5966510B2 (ja) 情報処理システム
TWI722280B (zh) 用於多個自由度之控制器追蹤
JP5936155B2 (ja) ３次元ユーザインタフェース装置及び３次元操作方法
JP5472056B2 (ja) 表示システム、表示処理装置、表示方法、および表示プログラム
JP5843340B2 (ja) ３次元環境共有システム及び３次元環境共有方法
US12056826B2 (en) Head-mounted information processing apparatus and head-mounted display system
JP6970858B2 (ja) 保守支援システム、保守支援方法、プログラム及び加工画像の生成方法
JP6882147B2 (ja) 操作案内システム
WO2014141504A1 (ja) ３次元ユーザインタフェース装置及び３次元操作処理方法
WO2014016992A1 (ja) ３次元ユーザインタフェース装置及び３次元操作方法
JP2015118442A (ja) 情報処理装置、情報処理方法およびプログラム
JP2012155678A (ja) 表示システム、表示処理装置、表示方法、および表示プログラム
JP6748793B1 (ja) 保守支援システム、保守支援方法、プログラム及び加工画像の生成方法
US9760180B2 (en) User interface device and user interface method
JP2019045997A (ja) 情報処理装置及びその方法、プログラム
JP2020120388A (ja) 操作装置、移動装置、およびその制御システム
JP2024056455A (ja) 情報処理システム、情報処理方法、プログラム
JP5830899B2 (ja) 投影システム、投影装置、投影方法及びプログラム
US20250013418A1 (en) Work assistance system
JP2025162718A (ja) 情報処理装置、情報処理装置の制御方法、及びプログラム
CN120371120A (zh) 控制图像显示的信息处理装置及其控制方法、信息处理系统、计算机程序产品和计算机可读存储介质
JP2023021808A (ja) 支援システム、支援側装置、支援方法、およびプログラム
WO2022172335A1 (ja) 仮想ガイド表示装置、仮想ガイド表示システム、及び仮想ガイド表示方法
JP2023021806A (ja) 支援システム、支援側装置、支援方法、およびプログラム
HK1205311B (en) Three-dimensional user-interface device, and three-dimensional operation method

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20201102

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20201102

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20210427

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20210506

R150 Certificate of patent or registration of utility model

Ref document number: 6882147

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250