JP5606241B2 - 人間型ロボットのための視覚認知システムおよび方法 - Google Patents

人間型ロボットのための視覚認知システムおよび方法 Download PDF

Info

Publication number
JP5606241B2
JP5606241B2 JP2010212052A JP2010212052A JP5606241B2 JP 5606241 B2 JP5606241 B2 JP 5606241B2 JP 2010212052 A JP2010212052 A JP 2010212052A JP 2010212052 A JP2010212052 A JP 2010212052A JP 5606241 B2 JP5606241 B2 JP 5606241B2
Authority
JP
Japan
Prior art keywords
interest
robot
image
vpm
area
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2010212052A
Other languages
English (en)
Japanese (ja)
Other versions
JP2011067941A (ja
JP2011067941A5 (enExample
Inventor
ジェームズ・ダブリュー・ウェルズ
ニール・デーヴィッド・マッケイ
スハス・イー・チェリアン
ダグラス・マーティン・リン
チャールズ・ダブリュー・ワンプラー，ザ・セカンド
リンドン・ブリッジウォーター
Original Assignee
ジーエム・グローバル・テクノロジー・オペレーションズ・インコーポレーテッド
ザ・ユナイテッド・ステイツ・オブ・アメリカ・アズ・リプレゼンテッド・バイ・ジ・アドミニストレーター・オブ・ザ・ナショナル・エアロノーティクス・アンド・スペース・アドミニストレーション
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ジーエム・グローバル・テクノロジー・オペレーションズ・インコーポレーテッド, ザ・ユナイテッド・ステイツ・オブ・アメリカ・アズ・リプレゼンテッド・バイ・ジ・アドミニストレーター・オブ・ザ・ナショナル・エアロノーティクス・アンド・スペース・アドミニストレーション filed Critical ジーエム・グローバル・テクノロジー・オペレーションズ・インコーポレーテッド
Publication of JP2011067941A publication Critical patent/JP2011067941A/ja
Publication of JP2011067941A5 publication Critical patent/JP2011067941A5/ja
Application granted granted Critical
Publication of JP5606241B2 publication Critical patent/JP5606241B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/246—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/20—Image preprocessing
    • G06V10/24—Aligning, centring, orientation detection or correction of the image
    • G06V10/245—Aligning, centring, orientation detection or correction of the image by locating a pattern; Special marks for positioning
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/90—Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10016—Video; Image sequence
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10028—Range image; Depth image; 3D point clouds
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10048—Infrared image
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20081—Training; Learning

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Signal Processing (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Manipulator (AREA)
  • Image Analysis (AREA)
  • Image Processing (AREA)
JP2010212052A 2009-09-22 2010-09-22 人間型ロボットのための視覚認知システムおよび方法 Active JP5606241B2 (ja)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US12/564,074 2009-09-22
US12/564,074 US8244402B2 (en) 2009-09-22 2009-09-22 Visual perception system and method for a humanoid robot

Publications (3)

Publication Number Publication Date
JP2011067941A JP2011067941A (ja) 2011-04-07
JP2011067941A5 JP2011067941A5 (enExample) 2014-08-14
JP5606241B2 true JP5606241B2 (ja) 2014-10-15

Family

ID=43757332

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2010212052A Active JP5606241B2 (ja) 2009-09-22 2010-09-22 人間型ロボットのための視覚認知システムおよび方法

Country Status (3)

Country Link
US (1) US8244402B2 (enExample)
JP (1) JP5606241B2 (enExample)
DE (1) DE102010045752B4 (enExample)

Families Citing this family (158)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8944070B2 (en) 1999-04-07 2015-02-03 Intuitive Surgical Operations, Inc. Non-force reflecting method for providing tool force information to a user of a telesurgical system
US20040162637A1 (en) 2002-07-25 2004-08-19 Yulun Wang Medical tele-robotic system with a master remote station with an arbitrator
US7813836B2 (en) 2003-12-09 2010-10-12 Intouch Technologies, Inc. Protocol for a remotely controlled videoconferencing robot
US8077963B2 (en) 2004-07-13 2011-12-13 Yulun Wang Mobile robot with a head-based movement mapping scheme
US9789608B2 (en) * 2006-06-29 2017-10-17 Intuitive Surgical Operations, Inc. Synthetic representation of a surgical robot
US9198728B2 (en) 2005-09-30 2015-12-01 Intouch Technologies, Inc. Multi-camera mobile teleconferencing platform
SE529849C2 (sv) * 2006-04-28 2007-12-11 Sics Swedish Inst Of Comp Scie Accesstyrsystem och förfarande för att driva systemet
US9549663B2 (en) 2006-06-13 2017-01-24 Intuitive Surgical Operations, Inc. Teleoperated surgical retractor system
US8849679B2 (en) 2006-06-15 2014-09-30 Intouch Technologies, Inc. Remote controlled robot system that provides medical images
US10258425B2 (en) * 2008-06-27 2019-04-16 Intuitive Surgical Operations, Inc. Medical robotic system providing an auxiliary view of articulatable instruments extending out of a distal end of an entry guide
US9718190B2 (en) 2006-06-29 2017-08-01 Intuitive Surgical Operations, Inc. Tool position and identification indicator displayed in a boundary area of a computer display screen
US20090192523A1 (en) 2006-06-29 2009-07-30 Intuitive Surgical, Inc. Synthetic representation of a surgical instrument
US12357400B2 (en) 2006-06-29 2025-07-15 Intuitive Surgical Operations, Inc. Synthetic representation of a surgical robot
US10008017B2 (en) 2006-06-29 2018-06-26 Intuitive Surgical Operations, Inc. Rendering tool information as graphic overlays on displayed images of tools
US9160783B2 (en) 2007-05-09 2015-10-13 Intouch Technologies, Inc. Robot system that operates through a network firewall
US8903546B2 (en) * 2009-08-15 2014-12-02 Intuitive Surgical Operations, Inc. Smooth control of an articulated instrument across areas with different work space conditions
US9089256B2 (en) 2008-06-27 2015-07-28 Intuitive Surgical Operations, Inc. Medical robotic system providing an auxiliary view including range of motion limitations for articulatable instruments extending out of a distal end of an entry guide
US8620473B2 (en) 2007-06-13 2013-12-31 Intuitive Surgical Operations, Inc. Medical robotic system with coupled control modes
US9084623B2 (en) 2009-08-15 2015-07-21 Intuitive Surgical Operations, Inc. Controller assisted reconfiguration of an articulated instrument during movement into and out of an entry guide
US9138129B2 (en) 2007-06-13 2015-09-22 Intuitive Surgical Operations, Inc. Method and system for moving a plurality of articulated instruments in tandem back towards an entry guide
US9469034B2 (en) 2007-06-13 2016-10-18 Intuitive Surgical Operations, Inc. Method and system for switching modes of a robotic system
US10875182B2 (en) 2008-03-20 2020-12-29 Teladoc Health, Inc. Remote presence system mounted to operating room hardware
US8179418B2 (en) 2008-04-14 2012-05-15 Intouch Technologies, Inc. Robotic based health care system
US8170241B2 (en) 2008-04-17 2012-05-01 Intouch Technologies, Inc. Mobile tele-presence system with a microphone system
US12239396B2 (en) 2008-06-27 2025-03-04 Intuitive Surgical Operations, Inc. Medical robotic system providing an auxiliary view including range of motion limitations for articulatable instruments extending out of a distal end of an entry guide
US8864652B2 (en) 2008-06-27 2014-10-21 Intuitive Surgical Operations, Inc. Medical robotic system providing computer generated auxiliary views of a camera instrument for controlling the positioning and orienting of its tip
US9193065B2 (en) 2008-07-10 2015-11-24 Intouch Technologies, Inc. Docking system for a tele-presence robot
US9842192B2 (en) 2008-07-11 2017-12-12 Intouch Technologies, Inc. Tele-presence robot system with multi-cast features
US8340819B2 (en) 2008-09-18 2012-12-25 Intouch Technologies, Inc. Mobile videoconferencing robot system with network adaptive driving
US8996165B2 (en) 2008-10-21 2015-03-31 Intouch Technologies, Inc. Telepresence robot with a camera boom
US9138891B2 (en) 2008-11-25 2015-09-22 Intouch Technologies, Inc. Server connectivity control for tele-presence robot
US8463435B2 (en) 2008-11-25 2013-06-11 Intouch Technologies, Inc. Server connectivity control for tele-presence robot
US8849680B2 (en) 2009-01-29 2014-09-30 Intouch Technologies, Inc. Documentation through a remote presence robot
US12266040B2 (en) 2009-03-31 2025-04-01 Intuitive Surgical Operations, Inc. Rendering tool information as graphic overlays on displayed images of tools
US8897920B2 (en) 2009-04-17 2014-11-25 Intouch Technologies, Inc. Tele-presence robot system with software modularity, projector and laser pointer
US8918211B2 (en) 2010-02-12 2014-12-23 Intuitive Surgical Operations, Inc. Medical robotic system providing sensory feedback indicating a difference between a commanded state and a preferred pose of an articulated instrument
US9492927B2 (en) 2009-08-15 2016-11-15 Intuitive Surgical Operations, Inc. Application of force feedback on an input device to urge its operator to command an articulated instrument to a preferred pose
US11399153B2 (en) 2009-08-26 2022-07-26 Teladoc Health, Inc. Portable telepresence apparatus
US8384755B2 (en) 2009-08-26 2013-02-26 Intouch Technologies, Inc. Portable remote presence robot
KR20110033679A (ko) * 2009-09-25 2011-03-31 삼성전자주식회사 네트워크 기반 로봇의 영상 전송 시스템 및 그 방법
US8941726B2 (en) * 2009-12-10 2015-01-27 Mitsubishi Electric Research Laboratories, Inc. Method and system for segmenting moving objects from images using foreground extraction
US11154981B2 (en) 2010-02-04 2021-10-26 Teladoc Health, Inc. Robot user interface for telepresence robot system
US8670017B2 (en) 2010-03-04 2014-03-11 Intouch Technologies, Inc. Remote presence system including a cart that supports a robot face and an overhead camera
US10343283B2 (en) 2010-05-24 2019-07-09 Intouch Technologies, Inc. Telepresence robot system that can be accessed by a cellular phone
US10808882B2 (en) 2010-05-26 2020-10-20 Intouch Technologies, Inc. Tele-robotic system with a robot face placed on a chair
JP5671281B2 (ja) * 2010-08-20 2015-02-18 キヤノン株式会社 位置姿勢計測装置、位置姿勢計測装置の制御方法及びプログラム
JP5573537B2 (ja) * 2010-09-17 2014-08-20 株式会社デンソーウェーブ ロボットのティーチングシステム
KR101743926B1 (ko) * 2010-09-20 2017-06-08 삼성전자주식회사 로봇 및 그 제어방법
US9172913B1 (en) * 2010-09-24 2015-10-27 Jetprotect Corporation Automatic counter-surveillance detection camera and software
KR101778030B1 (ko) * 2010-09-27 2017-09-26 삼성전자주식회사 로봇 및 그 제어방법
KR101761314B1 (ko) * 2010-12-03 2017-07-26 삼성전자주식회사 생체 신호 측정 로봇 및 그 제어방법
US9264664B2 (en) 2010-12-03 2016-02-16 Intouch Technologies, Inc. Systems and methods for dynamic bandwidth allocation
US8777818B1 (en) * 2010-12-22 2014-07-15 Larry E. Tate, Jr. Training device
US12093036B2 (en) 2011-01-21 2024-09-17 Teladoc Health, Inc. Telerobotic system with a dual application screen presentation
EP2668008B1 (en) 2011-01-28 2025-06-11 Teladoc Health, Inc. Interfacing with a mobile telepresence robot
US9323250B2 (en) 2011-01-28 2016-04-26 Intouch Technologies, Inc. Time-dependent navigation of telepresence robots
US11482326B2 (en) 2011-02-16 2022-10-25 Teladog Health, Inc. Systems and methods for network-based counseling
US9665767B2 (en) * 2011-02-28 2017-05-30 Aic Innovations Group, Inc. Method and apparatus for pattern tracking
US8965563B2 (en) * 2011-04-04 2015-02-24 Palo Alto Research Incorporated High throughput parcel handling
US10769739B2 (en) 2011-04-25 2020-09-08 Intouch Technologies, Inc. Systems and methods for management of information among medical providers and facilities
US20140139616A1 (en) 2012-01-27 2014-05-22 Intouch Technologies, Inc. Enhanced Diagnostics for a Telepresence Robot
US9098611B2 (en) 2012-11-26 2015-08-04 Intouch Technologies, Inc. Enhanced video interaction for a user interface of a telepresence network
DE102011084976A1 (de) 2011-10-21 2013-04-25 Robert Bosch Gmbh Vorrichtung und Verfahren zum optimalen Belichten von Pixeln bei einer indirekten Time-of-flight-Messung
US8836751B2 (en) 2011-11-08 2014-09-16 Intouch Technologies, Inc. Tele-presence system with a user interface that displays different communication links
US9072929B1 (en) * 2011-12-01 2015-07-07 Nebraska Global Investment Company, LLC Image capture system
US9498401B2 (en) 2011-12-20 2016-11-22 Massachusetts Institute Of Technology Robotic system for simulating a wearable device and method of use
CN102514011A (zh) * 2011-12-28 2012-06-27 王鹏勃 一种精确生物感知控制的多自由度机器人及其实现方法
US9014857B2 (en) * 2012-01-13 2015-04-21 Toyota Motor Engineering & Manufacturing North America, Inc. Methods and computer-program products for generating grasp patterns for use by a robot
US9014850B2 (en) * 2012-01-13 2015-04-21 Toyota Motor Engineering & Manufacturing North America, Inc. Methods and computer-program products for evaluating grasp patterns, and robots incorporating the same
US9682005B2 (en) * 2012-02-24 2017-06-20 Massachusetts Institute Of Technology Elastic element exoskeleton and method of using same
US8902278B2 (en) 2012-04-11 2014-12-02 Intouch Technologies, Inc. Systems and methods for visualizing and managing telepresence devices in healthcare networks
US9251313B2 (en) 2012-04-11 2016-02-02 Intouch Technologies, Inc. Systems and methods for visualizing and managing telepresence devices in healthcare networks
EP2852475A4 (en) 2012-05-22 2016-01-20 Intouch Technologies Inc SOCIAL BEHAVIOR OF A MEDICAL TELEPRESCENT ROBOT
US9361021B2 (en) 2012-05-22 2016-06-07 Irobot Corporation Graphical user interfaces including touchpad driving interfaces for telemedicine devices
US9321173B2 (en) 2012-06-22 2016-04-26 Microsoft Technology Licensing, Llc Tracking and following people with a mobile robotic device
US9753453B2 (en) 2012-07-09 2017-09-05 Deep Learning Robotics Ltd. Natural machine interface system
US8798357B2 (en) 2012-07-09 2014-08-05 Microsoft Corporation Image-based localization
JP6051021B2 (ja) * 2012-08-09 2016-12-21 日本電産サンキョー株式会社 産業用ロボットおよび産業用ロボットの制御方法
US9186793B1 (en) 2012-08-31 2015-11-17 Brain Corporation Apparatus and methods for controlling attention of a robot
CN104919272B (zh) 2012-10-29 2018-08-03 7D外科有限公司 集成照明及光学表面拓扑检测系统及其使用方法
US10507066B2 (en) 2013-02-15 2019-12-17 Intuitive Surgical Operations, Inc. Providing information of tools by filtering image areas adjacent to or on displayed images of the tools
JP5776716B2 (ja) * 2013-03-15 2015-09-09 株式会社安川電機 ロボットシステム及び被作業物の製造方法
US9605950B2 (en) 2013-05-22 2017-03-28 Cognex Corporation System and method for efficient surface measurement using a laser displacement sensor
DE102014107143B4 (de) * 2013-05-22 2021-03-04 Cognex Corp. System und Verfahren zur Messung der Verschiebung einer Objektoberfläche
JP2016536150A (ja) * 2013-10-11 2016-11-24 リシンク ロボティクス インコーポレイテッド 向上した正確度を伴うロボット配置および操作
EP3067746B1 (en) 2013-12-06 2019-08-21 Huawei Device Co., Ltd. Photographing method for dual-camera device and dual-camera device
CN105339840B (zh) 2013-12-06 2019-06-14 华为终端有限公司 双镜头设备的拍照方法及双镜头设备
US9505133B2 (en) * 2013-12-13 2016-11-29 Canon Kabushiki Kaisha Robot apparatus, robot controlling method, program and recording medium
WO2015095211A2 (en) 2013-12-16 2015-06-25 Massachusetts Institute Of Technology Optimal design of a lower limb exoskeleton or orthosis
CN104797033A (zh) * 2014-01-17 2015-07-22 苏州宝时得电动工具有限公司 自动工作设备
US10759634B2 (en) * 2014-08-08 2020-09-01 GM Global Technology Operations LLC Electromechanical system for interaction with an operator
JP6572535B2 (ja) * 2014-12-10 2019-09-11 株式会社リコー 画像認識システム、サーバ装置及び画像認識方法
US11747135B2 (en) * 2015-02-13 2023-09-05 Carnegie Mellon University Energy optimized imaging system with synchronized dynamic control of directable beam light source and reconfigurably masked photo-sensor
US11972586B2 (en) 2015-02-13 2024-04-30 Carnegie Mellon University Agile depth sensing using triangulation light curtains
US9555846B1 (en) 2015-03-20 2017-01-31 Google Inc. Pelvis structure for humanoid robot
DE112016002431T8 (de) 2015-05-29 2018-04-05 Abb Schweiz Ag Verfahren und System zur robotischen adaptiven Produktion
US9390346B1 (en) * 2015-06-10 2016-07-12 Robert Edwin Sheets, Jr. Object location using a mobile device
US11935256B1 (en) * 2015-08-23 2024-03-19 AI Incorporated Remote distance estimation system and method
US9616568B1 (en) * 2015-08-25 2017-04-11 X Development Llc Generating a grasp affordance for an object based on a thermal image of the object that is captured following human manipulation of the object
JP6652292B2 (ja) * 2015-09-24 2020-02-19 キヤノン株式会社 制御方法、制御プログラム、ロボットシステム、回転駆動装置の制御方法、およびロボット装置
US10589428B1 (en) 2015-10-01 2020-03-17 Verily Life Sciences Llc Automatic distribution of control functions between multiple knob controllers based on proximity and relative positioning of the knobs
CN108605402B (zh) 2015-12-11 2020-09-18 路创技术有限责任公司 具有可见光传感器的负载控制系统
US11006856B2 (en) * 2016-05-17 2021-05-18 Harshavardhana Narayana Kikkeri Method and program product for multi-joint tracking combining embedded sensors and an external sensor
JP6689974B2 (ja) * 2016-07-06 2020-04-28 株式会社Ｆｕｊｉ 撮像装置及び撮像システム
US10131053B1 (en) * 2016-09-14 2018-11-20 X Development Llc Real time robot collision avoidance
US11166770B2 (en) * 2016-09-19 2021-11-09 Intuitive Surgical Operations, Inc. Base positioning system for a controllable arm and related methods
US10821614B2 (en) 2016-11-11 2020-11-03 Sarcos Corp. Clutched joint modules having a quasi-passive elastic actuator for a robotic assembly
US10796608B2 (en) * 2016-11-18 2020-10-06 Gaumard Scientific Comapny, Inc. Interactive education system
CA3046635A1 (en) 2016-12-09 2018-06-14 Lutron Technology Company Llc Load control system having a visible light sensor
CN106863302B (zh) * 2017-02-28 2023-07-25 广东工业大学 一种机器人充电装置及其实现方法
JP6850639B2 (ja) * 2017-03-09 2021-03-31 本田技研工業株式会社 ロボット
US10664993B1 (en) 2017-03-13 2020-05-26 Occipital, Inc. System for determining a pose of an object
US10319109B2 (en) * 2017-03-31 2019-06-11 Honda Motor Co., Ltd. Interaction with physical objects as proxy objects representing virtual objects
US11862302B2 (en) 2017-04-24 2024-01-02 Teladoc Health, Inc. Automated transcription and documentation of tele-health encounters
DE102017209838A1 (de) * 2017-06-12 2018-12-13 Krones Ag Behälterbehandlungsanlage zum Behandeln von Behältern
US10483007B2 (en) 2017-07-25 2019-11-19 Intouch Technologies, Inc. Modular telehealth cart with thermal imaging and touch screen user interface
US11316865B2 (en) 2017-08-10 2022-04-26 Nuance Communications, Inc. Ambient cooperative intelligence system and method
US10978187B2 (en) 2017-08-10 2021-04-13 Nuance Communications, Inc. Automated clinical documentation system and method
US11636944B2 (en) 2017-08-25 2023-04-25 Teladoc Health, Inc. Connectivity infrastructure for a telehealth platform
US11847841B2 (en) 2017-10-18 2023-12-19 Brown University Probabilistic object models for robust, repeatable pick-and-place
CN109754425B (zh) * 2017-11-01 2023-07-28 浙江舜宇智能光学技术有限公司 Tof摄像模组的标定设备及其标定方法
US10792809B2 (en) * 2017-12-12 2020-10-06 X Development Llc Robot grip detection using non-contact sensors
DE102018101162B4 (de) * 2018-01-19 2023-09-21 Hochschule Reutlingen Messsystem und Verfahren zur extrinsischen Kalibrierung
US11250383B2 (en) 2018-03-05 2022-02-15 Nuance Communications, Inc. Automated clinical documentation system and method
WO2019173333A1 (en) 2018-03-05 2019-09-12 Nuance Communications, Inc. Automated clinical documentation system and method
EP3762806A4 (en) 2018-03-05 2022-05-04 Nuance Communications, Inc. System and method for review of automated clinical documentation
US11162241B2 (en) * 2018-03-27 2021-11-02 Deere & Company Controlling mobile machines with a robotic attachment
JP6888580B2 (ja) * 2018-04-05 2021-06-16 オムロン株式会社 情報処理装置、情報処理方法、及びプログラム
US10617299B2 (en) 2018-04-27 2020-04-14 Intouch Technologies, Inc. Telehealth cart that supports a removable tablet with seamless audio/video switching
GB2573164B (en) * 2018-04-27 2023-01-04 Sony Interactive Entertainment Inc Apparatus control system and method
US10926416B2 (en) * 2018-11-21 2021-02-23 Ford Global Technologies, Llc Robotic manipulation using an independently actuated vision system, an adversarial control scheme, and a multi-tasking deep learning architecture
CN110033487A (zh) * 2019-02-25 2019-07-19 上海交通大学 基于深度联想感知算法的受遮挡蔬果采收方法
US11227679B2 (en) 2019-06-14 2022-01-18 Nuance Communications, Inc. Ambient clinical intelligence system and method
US11043207B2 (en) 2019-06-14 2021-06-22 Nuance Communications, Inc. System and method for array data simulation and customized acoustic modeling for ambient ASR
US11216480B2 (en) 2019-06-14 2022-01-04 Nuance Communications, Inc. System and method for querying data points from graph data structures
US11531807B2 (en) 2019-06-28 2022-12-20 Nuance Communications, Inc. System and method for customized text macros
CN110328648A (zh) * 2019-08-06 2019-10-15 米召礼 一种人机同步运动的工作机
US11670408B2 (en) 2019-09-30 2023-06-06 Nuance Communications, Inc. System and method for review of automated clinical documentation
US11440198B2 (en) * 2020-04-28 2022-09-13 Ubtech Robotics Corp Ltd Control system and method for movement of neck mechanism for robot
JP7448648B2 (ja) * 2020-05-19 2024-03-12 ファナック株式会社 追随ロボットおよび制御装置
US11222103B1 (en) 2020-10-29 2022-01-11 Nuance Communications, Inc. Ambient cooperative intelligence system and method
US11833676B2 (en) 2020-12-07 2023-12-05 Sarcos Corp. Combining sensor output data to prevent unsafe operation of an exoskeleton
DE112021005322T5 (de) * 2020-12-21 2023-09-07 Fanuc Corporation Trainingsdaten-Erzeugungsvorrichtung, Maschinen- Lernvorrichtung und Roboter-Gelenkwinkel-Schätzvorrichtung
CN113359461B (zh) * 2021-06-25 2022-12-27 北京理工大学 一种适用于仿生眼系统的运动学标定方法
CN113925742B (zh) * 2021-10-20 2022-06-21 南通大学 一种目标驱动式的上肢外骨骼康复机器人的控制方法及其控制系统
CN113954072B (zh) * 2021-11-05 2024-05-28 中国矿业大学 一种视觉引导的木门工件智能识别定位系统及方法
US11826907B1 (en) 2022-08-17 2023-11-28 Sarcos Corp. Robotic joint system with length adapter
US11717956B1 (en) 2022-08-29 2023-08-08 Sarcos Corp. Robotic joint system with integrated safety
CN115582835B (zh) * 2022-10-13 2025-02-28 同济大学 一种基于事件驱动的环境感知电子皮肤系统
WO2024098070A1 (en) 2022-11-04 2024-05-10 Sarcos Corp. Robotic end-effector having dynamic stiffening elements with resilient spacers for conforming object interaction
US11924023B1 (en) 2022-11-17 2024-03-05 Sarcos Corp. Systems and methods for redundant network communication in a robot
US11897132B1 (en) 2022-11-17 2024-02-13 Sarcos Corp. Systems and methods for redundant network communication in a robot
US12246441B1 (en) * 2022-11-18 2025-03-11 Agility Robotics, Inc. Torso protrusion for robotic manipulation of objects and related technology
US12440983B1 (en) * 2022-12-04 2025-10-14 Anyware Robotics Inc. Learning-embedded motion planning
CN118952165B (zh) * 2024-07-25 2025-12-09 三门通顺铆钉有限公司 仿生服务型人形机器人头部结构
CN119077798B (zh) * 2024-09-09 2025-11-07 武汉理工大学 位于人形机器人关节的感知系统及方法
CN120070589B (zh) * 2024-12-23 2025-11-18 优酷文化科技(北京)有限公司 手眼标定方法和装置、介质、计算机设备和程序产品
CN120862643B (zh) * 2025-09-29 2025-11-28 上海傅利叶智能科技股份有限公司 一种基于视觉的人形机器人的示教方法及系统

Family Cites Families (36)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0732994B2 (ja) * 1987-05-07 1995-04-12 ファナック株式会社 ロボットの環境教示方式
JPH05126521A (ja) * 1991-11-08 1993-05-21 Toshiba Corp 遠隔操作マニピユレータ用位置測定装置
JP3021202B2 (ja) * 1992-08-25 2000-03-15 三菱重工業株式会社 ロボットの位置姿勢の誘導方法
US5405337A (en) * 1993-02-24 1995-04-11 The Board Of Trustees Of The Leland Stanford Junior University Spatially distributed SMA actuator film providing unrestricted movement in three dimensional space
DE19826395A1 (de) 1998-06-12 1999-12-23 Amatec Gmbh Verfahren zum Erfassen und Kompensieren von kinematischen Veränderungen eines Roboters
JP2000153476A (ja) * 1998-09-14 2000-06-06 Honda Motor Co Ltd 脚式移動ロボット
JP4472165B2 (ja) * 1999-12-24 2010-06-02 本田技研工業株式会社 移動ロボットの制御装置
US6587835B1 (en) * 2000-02-09 2003-07-01 G. Victor Treyz Shopping assistance with handheld computing device
JP4476468B2 (ja) * 2000-11-13 2010-06-09 本田技研工業株式会社 脚式移動ロボット
US7206753B2 (en) * 2001-05-04 2007-04-17 Axxon Robotics, Llc Methods for facilitating a retail environment
JP2005515903A (ja) * 2001-11-28 2005-06-02 エヴォリューション ロボティクス インコーポレイテッド ロボット用センサおよびアクチュエータのハードウェア抽象化層内における抽象化および集合化
JP2003200377A (ja) * 2001-12-26 2003-07-15 Sony Corp ロボット，ロボットによる測距方法
JP2003274374A (ja) * 2002-03-18 2003-09-26 Sony Corp 画像伝送装置及び方法、送信装置及び方法、受信装置及び方法、並びにロボット装置
US7127326B2 (en) * 2002-11-15 2006-10-24 Iguana Robotics, Inc. Certain principles of biomorphic robots including foot placement selection using non-geometric visual properties
JP2004299025A (ja) * 2003-04-01 2004-10-28 Honda Motor Co Ltd 移動ロボット制御装置、移動ロボット制御方法及び移動ロボット制御プログラム
US7372977B2 (en) * 2003-05-29 2008-05-13 Honda Motor Co., Ltd. Visual tracking using depth data
US7336299B2 (en) * 2003-07-03 2008-02-26 Physical Optics Corporation Panoramic video system with real-time distortion-free imaging
JP2005028468A (ja) * 2003-07-08 2005-02-03 National Institute Of Advanced Industrial & Technology ロボットの視覚座標系位置姿勢同定方法、座標変換方法および装置
US7428997B2 (en) * 2003-07-29 2008-09-30 Microvision, Inc. Method and apparatus for illuminating a field-of-view and capturing an image
WO2006006624A1 (ja) * 2004-07-13 2006-01-19 Matsushita Electric Industrial Co., Ltd. 物品保持システム、ロボット及びロボット制御方法
JP4086024B2 (ja) * 2004-09-14 2008-05-14 ソニー株式会社 ロボット装置及びその行動制御方法
JP4198676B2 (ja) * 2004-12-28 2008-12-17 株式会社東芝 ロボット装置、ロボット装置の移動追従方法、および、プログラム
JP2006289508A (ja) * 2005-04-05 2006-10-26 Sony Corp ロボット装置及びその表情制御方法
JP2007160482A (ja) * 2005-12-16 2007-06-28 Ixs Research:Kk 首部関節機構及びそれを具備するロボット
WO2008013568A2 (en) * 2005-12-30 2008-01-31 Irobot Corporation Autonomous mobile robot
US7438451B2 (en) * 2006-02-07 2008-10-21 Nissan Technical Center North America, Inc. Ambient light based illumination control
US8014047B2 (en) * 2006-02-17 2011-09-06 Marvell International Technology Ltd. Sheet media stack imaging system
JP4325627B2 (ja) * 2006-02-21 2009-09-02 ソニー株式会社 画像表示方法および画像表示装置並びに撮像装置
JP2007319938A (ja) * 2006-05-30 2007-12-13 Toyota Motor Corp ロボット装置及び物体の三次元形状の取得方法
JP4658891B2 (ja) * 2006-10-02 2011-03-23 本田技研工業株式会社 ロボットの制御装置
JP2008112349A (ja) * 2006-10-31 2008-05-15 Alpine Electronics Inc 移動物体検知装置
JP2008148180A (ja) * 2006-12-13 2008-06-26 Sony Corp 撮像装置、画像処理装置、および方法、並びにコンピュータ・プログラム
JP4847420B2 (ja) * 2007-08-30 2011-12-28 本田技研工業株式会社 脚式移動ロボット
US8026955B2 (en) 2007-08-30 2011-09-27 Honda Motor Co., Ltd. Camera exposure controller including imaging devices for capturing an image using stereo-imaging
JP2009056529A (ja) * 2007-08-30 2009-03-19 Honda Motor Co Ltd 脚式移動ロボット
JP2009113190A (ja) * 2007-11-09 2009-05-28 Toyota Motor Corp 自律動作型ロボットおよび自律動作型ロボットの動作制御方法

Also Published As

Publication number Publication date
JP2011067941A (ja) 2011-04-07
DE102010045752B4 (de) 2018-10-31
US20110071675A1 (en) 2011-03-24
DE102010045752A1 (de) 2011-06-01
US8244402B2 (en) 2012-08-14

Similar Documents

Publication Publication Date Title
JP5606241B2 (ja) 人間型ロボットのための視覚認知システムおよび方法
Kofman et al. Teleoperation of a robot manipulator using a vision-based human-robot interface
JP2022028672A (ja) ロボットモーション用のビジョンシステムの自動ハンドアイ校正のためのシステム及び方法
JP7111114B2 (ja) 情報処理装置、情報処理方法及び情報処理システム
CN106239516B (zh) 机器人控制装置、机器人以及机器人系统
Hebert et al. Combined shape, appearance and silhouette for simultaneous manipulator and object tracking
EP4101604A1 (en) System and method for improving accuracy of 3d eye-to-hand coordination of a robotic system
JP7062911B2 (ja) ロボットシステム
JPWO2018043525A1 (ja) ロボットシステム、ロボットシステム制御装置、およびロボットシステム制御方法
US20230339118A1 (en) Reliable robotic manipulation in a cluttered environment
JP2015042437A (ja) ロボットシステム及びロボットシステムの校正方法
Melchiorre et al. Collison avoidance using point cloud data fusion from multiple depth sensors: a practical approach
JP2019014030A (ja) ロボットの制御装置、ロボット、ロボットシステム、並びに、カメラの校正方法
JP2013036988A (ja) 情報処理装置及び情報処理方法
JP2022163719A (ja) 対象物を挿入部に挿入するようにロボットを制御するための装置及び方法
US20190376860A1 (en) Visuo-haptic sensor
CN106003036A (zh) 一种基于双目视觉引导的物体抓取与放置系统
US12131483B2 (en) Device and method for training a neural network for controlling a robot for an inserting task
US20230123629A1 (en) 3d computer-vision system with variable spatial resolution
CN109900251A (zh) 一种基于视觉技术的机器人定位装置及方法
Yang et al. Visual servoing control of baxter robot arms with obstacle avoidance using kinematic redundancy
Hvilshøj et al. Calibration techniques for industrial mobile manipulators: Theoretical configurations and best practices
Ranjan et al. Identification and control of NAO humanoid robot to grasp an object using monocular vision
NL2035240B1 (en) Method and systems for compensating for a deviation in a plurality of workingposes of a manipulator of an autonomous charging device
Taylor et al. Hybrid position-based visual servoing with online calibration for a humanoid robot

Legal Events

Date Code Title Description
A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20120524

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20120605

A601 Written request for extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A601

Effective date: 20120905

A602 Written permission of extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A602

Effective date: 20120910

A601 Written request for extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A601

Effective date: 20121005

A602 Written permission of extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A602

Effective date: 20121011

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20121105

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20130626

A601 Written request for extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A601

Effective date: 20130926

A602 Written permission of extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A602

Effective date: 20131001

A601 Written request for extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A601

Effective date: 20131028

A602 Written permission of extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A602

Effective date: 20131031

A601 Written request for extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A601

Effective date: 20131126

A602 Written permission of extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A602

Effective date: 20131129

A524 Written submission of copy of amendment under article 19 pct

Free format text: JAPANESE INTERMEDIATE CODE: A524

Effective date: 20131226

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20140402

A524 Written submission of copy of amendment under article 19 pct

Free format text: JAPANESE INTERMEDIATE CODE: A524

Effective date: 20140702

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20140728

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20140826

R150 Certificate of patent or registration of utility model

Ref document number: 5606241

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250