CN111565898B - 操作引导系统 - Google Patents

操作引导系统 Download PDF

Info

Publication number
CN111565898B
CN111565898B CN201880076541.9A CN201880076541A CN111565898B CN 111565898 B CN111565898 B CN 111565898B CN 201880076541 A CN201880076541 A CN 201880076541A CN 111565898 B CN111565898 B CN 111565898B
Authority
CN
China
Prior art keywords
image
operator
unit
positional relationship
guidance system
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201880076541.9A
Other languages
English (en)
Chinese (zh)
Other versions
CN111565898A (zh
Inventor
寺田彻
戎野聪一
岩野贤治
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Schneider Electric Japan Holdings Ltd
Original Assignee
Schneider Electric Japan Holdings Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Schneider Electric Japan Holdings Ltd filed Critical Schneider Electric Japan Holdings Ltd
Publication of CN111565898A publication Critical patent/CN111565898A/zh
Application granted granted Critical
Publication of CN111565898B publication Critical patent/CN111565898B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B25HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25JMANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00Programme-controlled manipulators
    • B25J9/16Programme controls
    • B25J9/1656Programme controls characterised by programming, planning systems for manipulators
    • B25J9/1671Programme controls characterised by programming, planning systems for manipulators characterised by simulation, either to verify existing program or to create and verify new program, CAD/CAM oriented, graphic oriented programming systems
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/002D [Two Dimensional] image generation
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B25HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25JMANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J13/00Controls for manipulators
    • B25J13/02Hand grip control means
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B25HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25JMANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J19/00Accessories fitted to manipulators, e.g. for monitoring, for viewing; Safety devices combined with or specially adapted for use in connection with manipulators
    • B25J19/02Sensing devices
    • B25J19/021Optical sensing devices
    • B25J19/023Optical sensing devices including video camera means
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B19/00Programme-control systems
    • G05B19/02Programme-control systems electric
    • G05B19/18Numerical control [NC], i.e. automatically operating machines, in particular machine tools, e.g. in a manufacturing environment, so as to execute positioning, movement or co-ordinated operations by means of programme data in numerical form
    • G05B19/409Numerical control [NC], i.e. automatically operating machines, in particular machine tools, e.g. in a manufacturing environment, so as to execute positioning, movement or co-ordinated operations by means of programme data in numerical form characterised by using manual data input [MDI] or by using control panel, e.g. controlling functions with the panel; characterised by control panel details or by setting parameters
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/70Determining position or orientation of objects or cameras
    • G06T7/73Determining position or orientation of objects or cameras using feature-based methods
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00Program-control systems
    • G05B2219/30Nc systems
    • G05B2219/36Nc in input of data, input key till input tape
    • G05B2219/36167Use camera of handheld device, pda, pendant, head mounted display
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00Program-control systems
    • G05B2219/30Nc systems
    • G05B2219/39Robotics, robotics to robotics hand
    • G05B2219/39451Augmented reality for robot programming
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/044Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by capacitive means
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10004Still image; Photographic image
    • G06T2207/10012Stereo images

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Mechanical Engineering (AREA)
  • Robotics (AREA)
  • Human Computer Interaction (AREA)
  • General Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Manufacturing & Machinery (AREA)
  • Automation & Control Theory (AREA)
  • User Interface Of Digital Computer (AREA)
  • Numerical Control (AREA)
  • Manipulator (AREA)
CN201880076541.9A 2017-11-28 2018-05-15 操作引导系统 Active CN111565898B (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
JP2017228079A JP6882147B2 (ja) 2017-11-28 2017-11-28 操作案内システム
JP2017-228079 2017-11-28
PCT/JP2018/018684 WO2019106862A1 (ja) 2017-11-28 2018-05-15 操作案内システム

Publications (2)

Publication Number Publication Date
CN111565898A CN111565898A (zh) 2020-08-21
CN111565898B true CN111565898B (zh) 2023-04-21

Family

ID=66664763

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201880076541.9A Active CN111565898B (zh) 2017-11-28 2018-05-15 操作引导系统

Country Status (5)

Country Link
US (1) US11475606B2 (enExample)
EP (1) EP3718708A4 (enExample)
JP (1) JP6882147B2 (enExample)
CN (1) CN111565898B (enExample)
WO (1) WO2019106862A1 (enExample)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2023017440A (ja) * 2021-07-26 2023-02-07 株式会社ダイヘン 画像処理装置
JP7149440B1 (ja) 2022-04-21 2022-10-06 三菱製鋼株式会社 操作装置
WO2023248439A1 (ja) * 2022-06-23 2023-12-28 ファナック株式会社 ロボットシステム、ロボット制御装置およびロボット制御プログラム
WO2025052590A1 (ja) * 2023-09-06 2025-03-13 株式会社Fuji ロボットシステム

Family Cites Families (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7367809B2 (en) * 2004-03-26 2008-05-06 Atsushi Takahashi Three-dimensional digital entity mesoscope system equipped with three-dimensional visual instruction functions
JP5023632B2 (ja) 2006-09-15 2012-09-12 ブラザー工業株式会社 ヘッドマウントディスプレイ
JP4019200B2 (ja) * 2007-06-18 2007-12-12 富士フイルム株式会社 画像表示器付きカメラ
JP5022868B2 (ja) * 2007-11-16 2012-09-12 キヤノン株式会社 情報処理装置、情報処理方法
JP5422430B2 (ja) 2010-02-12 2014-02-19 株式会社タダノ 作業用装置
JP2012218120A (ja) * 2011-04-12 2012-11-12 Seiko Epson Corp マニピュレーター動作予告装置、ロボットシステム及びマニピュレーター動作予告方法
JP5784388B2 (ja) * 2011-06-29 2015-09-24 オリンパス株式会社 医療用マニピュレータシステム
JP5800616B2 (ja) 2011-07-15 2015-10-28 オリンパス株式会社 マニピュレータシステム
JP6021353B2 (ja) * 2011-08-04 2016-11-09 オリンパス株式会社 手術支援装置
JP2013184257A (ja) * 2012-03-08 2013-09-19 Sony Corp ロボット装置及びロボット装置の制御方法、並びにコンピューター・プログラム
JP6080697B2 (ja) * 2013-05-31 2017-02-15 三菱電機株式会社 誘導加熱調理器
JP6266268B2 (ja) * 2013-08-28 2018-01-24 Dmg森精機株式会社 表示装置
US9817396B1 (en) * 2014-06-09 2017-11-14 X Development Llc Supervisory control of an unmanned aerial vehicle
US9849981B1 (en) * 2014-08-28 2017-12-26 X Development Llc Payload-release device position tracking
US10179407B2 (en) * 2014-11-16 2019-01-15 Robologics Ltd. Dynamic multi-sensor and multi-robot interface system
JP2016107379A (ja) * 2014-12-08 2016-06-20 ファナック株式会社 拡張現実対応ディスプレイを備えたロボットシステム
US9836117B2 (en) * 2015-05-28 2017-12-05 Microsoft Technology Licensing, Llc Autonomous drones for tactile feedback in immersive virtual reality
JP6643843B2 (ja) * 2015-09-14 2020-02-12 オリンパス株式会社 撮像操作ガイド装置および撮像装置の操作ガイド方法
JP6657858B2 (ja) 2015-11-30 2020-03-04 株式会社デンソーウェーブ ロボット操作システム
US20180098052A1 (en) * 2016-09-30 2018-04-05 Sony Interactive Entertainment Inc. Translation of physical object viewed by unmanned aerial vehicle into virtual world object
WO2018191970A1 (zh) * 2017-04-21 2018-10-25 深圳前海达闼云端智能科技有限公司 一种机器人控制方法、机器人装置及机器人设备
US10852847B2 (en) * 2017-07-26 2020-12-01 Google Llc Controller tracking for multiple degrees of freedom

Also Published As

Publication number Publication date
US11475606B2 (en) 2022-10-18
US20200394823A1 (en) 2020-12-17
CN111565898A (zh) 2020-08-21
EP3718708A1 (en) 2020-10-07
EP3718708A4 (en) 2021-12-22
JP2019101476A (ja) 2019-06-24
JP6882147B2 (ja) 2021-06-02
WO2019106862A1 (ja) 2019-06-06

Similar Documents

Publication Publication Date Title
US12450847B2 (en) Head-mounted information processing apparatus and head-mounted display system
CN105074617B (zh) 三维用户界面装置和三维操作处理方法
WO2014016987A1 (ja) 3次元ユーザインタフェース装置及び3次元操作方法
WO2014016992A1 (ja) 3次元ユーザインタフェース装置及び3次元操作方法
CN111565898B (zh) 操作引导系统
JP6344530B2 (ja) 入力装置、入力方法、及びプログラム
JP2015118442A (ja) 情報処理装置、情報処理方法およびプログラム
JP2012108842A (ja) 表示システム、表示処理装置、表示方法、および表示プログラム
JP6409861B2 (ja) 情報処理装置、情報処理システム、その制御方法及びプログラム
EP3528024B1 (en) Information processing device, information processing method, and program
JP2016122392A (ja) 情報処理装置、情報処理システム、その制御方法及びプログラム
EP2947549A1 (en) Apparartus and method for navigating through volume image
JP2012155678A (ja) 表示システム、表示処理装置、表示方法、および表示プログラム
JP6685742B2 (ja) 操作装置、移動装置、およびその制御システム
KR20190048810A (ko) 증강현실용 컨텐츠 제공 장치 및 방법
US9760180B2 (en) User interface device and user interface method
JP2020120388A (ja) 操作装置、移動装置、およびその制御システム
CN117707332A (zh) 信息处理设备、控制方法和非暂态计算机存储介质
WO2022208612A1 (ja) ウェアラブル端末装置、プログラムおよび表示方法
US20250013418A1 (en) Work assistance system
JP2023021808A (ja) 支援システム、支援側装置、支援方法、およびプログラム
CN119784977A (zh) 信息处理装置、信息处理装置的控制方法、计算机程序产品及计算机可读存储介质
JP2023021806A (ja) 支援システム、支援側装置、支援方法、およびプログラム
HK1210858B (en) Three-dimensional user-interface device, and three-dimensional operation method
HK1205311B (en) Three-dimensional user-interface device, and three-dimensional operation method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant