GB2502213A - Mobile Human Interface Robot - Google Patents

Mobile Human Interface Robot Download PDF

Info

Publication number
GB2502213A
GB2502213A GB1313410.1A GB201313410A GB2502213A GB 2502213 A GB2502213 A GB 2502213A GB 201313410 A GB201313410 A GB 201313410A GB 2502213 A GB2502213 A GB 2502213A
Authority
GB
United Kingdom
Prior art keywords
point cloud
drive system
imaging device
human interface
drive
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
GB1313410.1A
Other versions
GB201313410D0 (en
Inventor
Cheuk Wah Wong
Eben Rauhut
Brian C Benson Jr
Peter J Lydon
Michael T Rosenstein
Michael Halloran
Steven V Shamlian
Chikyung Won
Mark Chiappetta
Justin H Kearns
Orjeta Taka
Robert Todd Pack
Timothy S Farlow
Jasper Fourways Vicenti
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
iRobot Corp
Original Assignee
iRobot Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US13/032,228 external-priority patent/US9400503B2/en
Application filed by iRobot Corp filed Critical iRobot Corp
Publication of GB201313410D0 publication Critical patent/GB201313410D0/en
Publication of GB2502213A publication Critical patent/GB2502213A/en
Withdrawn legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00—Control of position, course or altitude of land, water, air, or space vehicles, e.g. automatic pilot
    • G05D1/02—Control of position or course in two dimensions
    • G05D1/021—Control of position or course in two dimensions specially adapted to land vehicles
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J19/00—Accessories fitted to manipulators, e.g. for monitoring, for viewing; Safety devices combined with or specially adapted for use in connection with manipulators
    • B25J19/02—Sensing devices
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00—Control of position, course or altitude of land, water, air, or space vehicles, e.g. automatic pilot
    • G05D1/02—Control of position or course in two dimensions
    • G05D1/021—Control of position or course in two dimensions specially adapted to land vehicles
    • G05D1/0231—Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00—Control of position, course or altitude of land, water, air, or space vehicles, e.g. automatic pilot
    • G05D1/02—Control of position or course in two dimensions
    • G05D1/021—Control of position or course in two dimensions specially adapted to land vehicles
    • G05D1/0231—Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means
    • G05D1/0238—Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means using obstacle or wall sensors
    • G05D1/024—Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means using obstacle or wall sensors in combination with a laser
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B13/00—Optical objectives specially designed for the purposes specified below
    • G02B13/22—Telecentric objectives or lens systems
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00—Control of position, course or altitude of land, water, air, or space vehicles, e.g. automatic pilot
    • G05D1/02—Control of position or course in two dimensions
    • G05D1/021—Control of position or course in two dimensions specially adapted to land vehicles
    • G05D1/0231—Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means
    • G05D1/0242—Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means using non-visible light signals, e.g. IR or UV signals
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00—Control of position, course or altitude of land, water, air, or space vehicles, e.g. automatic pilot
    • G05D1/02—Control of position or course in two dimensions
    • G05D1/021—Control of position or course in two dimensions specially adapted to land vehicles
    • G05D1/0231—Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means
    • G05D1/0246—Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means using a video camera in combination with image processing means
    • G05D1/0251—Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means using a video camera in combination with image processing means extracting 3D information from a plurality of images taken from different locations, e.g. stereo vision
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00—Control of position, course or altitude of land, water, air, or space vehicles, e.g. automatic pilot
    • G05D1/02—Control of position or course in two dimensions
    • G05D1/021—Control of position or course in two dimensions specially adapted to land vehicles
    • G05D1/0255—Control of position or course in two dimensions specially adapted to land vehicles using acoustic signals, e.g. ultra-sonic singals
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00—Control of position, course or altitude of land, water, air, or space vehicles, e.g. automatic pilot
    • G05D1/02—Control of position or course in two dimensions
    • G05D1/021—Control of position or course in two dimensions specially adapted to land vehicles
    • G05D1/0268—Control of position or course in two dimensions specially adapted to land vehicles using internal positioning means
    • G05D1/0272—Control of position or course in two dimensions specially adapted to land vehicles using internal positioning means comprising means for registering the travel distance, e.g. revolutions of wheels
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00—Control of position, course or altitude of land, water, air, or space vehicles, e.g. automatic pilot
    • G05D1/02—Control of position or course in two dimensions
    • G05D1/021—Control of position or course in two dimensions specially adapted to land vehicles
    • G05D1/0268—Control of position or course in two dimensions specially adapted to land vehicles using internal positioning means
    • G05D1/0274—Control of position or course in two dimensions specially adapted to land vehicles using internal positioning means using mapping information stored in a memory device

Abstract

A mobile robot (100) including a drive system (200) having a forward drive direction (F), a controller (500) in communication with the drive system, and a volumetric point cloud imaging device (450) supported above the drive system and directed to be capable of obtaining a point cloud from a volume of space that includes a floor plane (5) in a direction of movement of the mobile robot. A dead zone sensor (490) has a detection field (492) arranged to detect an object in a volume of space (453) undetectable by the volumetric point cloud imaging device. The controller receives point cloud signals from the imaging device and detection signals from the dead zone sensor and issues drive commands to the drive system based at least in part on the received point cloud and detection signals.
GB1313410.1A 2010-12-30 2011-11-09 Mobile Human Interface Robot Withdrawn GB2502213A (en)

Applications Claiming Priority (9)

Application Number Priority Date Filing Date Title
US201061428717P 2010-12-30 2010-12-30
US201061428734P 2010-12-30 2010-12-30
US201061428759P 2010-12-30 2010-12-30
US201161429863P 2011-01-05 2011-01-05
US201161445408P 2011-02-22 2011-02-22
US13/032,228 US9400503B2 (en) 2010-05-20 2011-02-22 Mobile human interface robot
US13/032,312 US8918209B2 (en) 2010-05-20 2011-02-22 Mobile human interface robot
US201161478849P 2011-04-25 2011-04-25
PCT/US2011/059980 WO2012091807A2 (en) 2010-12-30 2011-11-09 Mobile human interface robot

Publications (2)

Publication Number Publication Date
GB201313410D0 GB201313410D0 (en) 2013-09-11
GB2502213A true GB2502213A (en) 2013-11-20

Family

ID=45375473

Family Applications (1)

Application Number Title Priority Date Filing Date
GB1313410.1A Withdrawn GB2502213A (en) 2010-12-30 2011-11-09 Mobile Human Interface Robot

Country Status (7)

Country Link
EP (1) EP2659320A2 (en)
JP (2) JP2014509417A (en)
AU (1) AU2011352997B2 (en)
CA (1) CA2824606A1 (en)
DE (1) DE112011104645T5 (en)
GB (1) GB2502213A (en)
WO (1) WO2012091807A2 (en)

Families Citing this family (42)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8958911B2 (en) * 2012-02-29 2015-02-17 Irobot Corporation Mobile robot
CN102880178B (en) * 2012-08-23 2015-06-10 群耀光电科技（苏州）有限公司 Virtual wall system
PT2898384T (en) * 2012-09-19 2020-01-21 Follow Inspiration Unipessoal Lda Self tracking system and its operation method
US9367065B2 (en) 2013-01-25 2016-06-14 Google Inc. Modifying behavior of autonomous vehicles based on sensor blind spots and limitations
US11172126B2 (en) 2013-03-15 2021-11-09 Occipital, Inc. Methods for reducing power consumption of a 3D image capture system
US9208566B2 (en) 2013-08-09 2015-12-08 Microsoft Technology Licensing, Llc Speckle sensing for motion tracking
DE102014206086A1 (en) 2014-03-31 2015-10-01 Robert Bosch Gmbh Method for operating a self-propelled mobile platform
EP3191264A4 (en) 2014-09-12 2018-04-25 University of Washington Integration of auxiliary sensors with point cloud-based haptic rendering and virtual fixtures
JP6377536B2 (en) * 2015-01-15 2018-08-22 株式会社東芝 Spatial information visualization device, program, and spatial information visualization method
US9630319B2 (en) * 2015-03-18 2017-04-25 Irobot Corporation Localization and mapping using physical features
US9625582B2 (en) * 2015-03-25 2017-04-18 Google Inc. Vehicle with multiple light detection and ranging devices (LIDARs)
EP3203412A1 (en) * 2016-02-05 2017-08-09 Delphi Technologies, Inc. System and method for detecting hand gestures in a 3d space
WO2017157421A1 (en) * 2016-03-15 2017-09-21 Aktiebolaget Electrolux Robotic cleaning device and a method at the robotic cleaning device of performing cliff detection
US10394244B2 (en) * 2016-05-26 2019-08-27 Korea University Research And Business Foundation Method for controlling mobile robot based on Bayesian network learning
JP6786912B2 (en) * 2016-07-05 2020-11-18 富士ゼロックス株式会社 Mobile robots and mobile control systems
JP6565853B2 (en) * 2016-09-29 2019-08-28 トヨタ自動車株式会社 Communication device
KR101865161B1 (en) * 2016-12-13 2018-06-07 주식회사 아프리카티비 Video recording method and apparatus for controlling the same
JP6974821B2 (en) * 2017-03-27 2021-12-01 地方独立行政法人東京都立産業技術研究センター Mobile robot and control circuit
KR102326077B1 (en) * 2017-06-15 2021-11-12 엘지전자 주식회사 Method of identifying movable obstacle in 3-dimensional space and robot implementing thereof
DE102017117545A1 (en) 2017-08-02 2019-02-07 Jungheinrich Aktiengesellschaft Method for monitoring the travel path of a truck and an industrial truck
CN107289967B (en) * 2017-08-17 2023-06-09 珠海一微半导体股份有限公司 Separable optical odometer and mobile robot
FR3070294B1 (en) 2017-08-28 2021-01-22 Fogale Nanotech MULTI-DISTANCE DETECTION DEVICE FOR A ROBOT, AND ROBOT EQUIPPED WITH SUCH DEVICE (S)
DE102017217844A1 (en) * 2017-10-06 2019-04-11 Robert Bosch Gmbh Method and a machine learning system for classifying objects
CN111630460A (en) * 2018-01-24 2020-09-04 福特全球技术公司 Path planning for autonomous mobile devices
US11879958B2 (en) 2018-06-06 2024-01-23 Honeywell International Inc. System and method for using an industrial manipulator for atmospheric characterization lidar optics positioning
KR102165352B1 (en) * 2018-06-25 2020-10-13 엘지전자 주식회사 Robot
JP7035886B2 (en) 2018-07-30 2022-03-15 トヨタ自動車株式会社 Image processing device, image processing method
JP7299642B2 (en) * 2018-08-30 2023-06-28 ヴェオ ロボティクス， インコーポレイテッド System and method for automatic sensor alignment and configuration
CN110967703A (en) * 2018-09-27 2020-04-07 广东美的生活电器制造有限公司 Indoor navigation method and indoor navigation device using laser radar and camera
US11921218B2 (en) * 2018-11-30 2024-03-05 Garmin Switzerland Gmbh Marine vessel LIDAR system
CN109828564B (en) * 2019-01-28 2022-06-17 广州杰赛科技股份有限公司 Optimization method and device for unmanned vehicle path planning and terminal equipment
US11607804B2 (en) * 2019-05-28 2023-03-21 X Development Llc Robot configuration with three-dimensional lidar
CN112338908B (en) * 2019-08-09 2022-07-22 科沃斯机器人股份有限公司 Autonomous mobile device
EP4037447A4 (en) * 2019-09-23 2022-09-21 Fuji Corporation Periphery monitoring device
RU2769921C2 (en) * 2019-11-21 2022-04-08 Общество с ограниченной ответственностью "Яндекс Беспилотные Технологии" Methods and systems for automated detection of the presence of objects
US11618167B2 (en) * 2019-12-24 2023-04-04 X Development Llc Pixelwise filterable depth maps for robots
CN111157996B (en) * 2020-01-06 2022-06-14 珠海丽亭智能科技有限公司 Parking robot running safety detection method
DE102021000600A1 (en) 2021-02-05 2022-08-11 Mercedes-Benz Group AG Method and device for detecting impairments in the optical path of a stereo camera
WO2023137552A1 (en) * 2022-01-21 2023-07-27 Kinova Inc. System for teaching a robotic arm
KR20240016707A (en) * 2022-07-29 2024-02-06 삼성전자주식회사 ROBOT COMPRISING LiDAR SENSOR AND CONTROLLING THE ROBOT
KR102479774B1 (en) * 2022-09-15 2022-12-21 주식회사 라스테크 Humanoid robot having robot arm
KR102631521B1 (en) * 2023-12-01 2024-01-31 주식회사세오 Autonomous robots with floor detection device

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050216126A1 (en) * 2004-03-27 2005-09-29 Vision Robotics Corporation Autonomous personal service robot
US20090055023A1 (en) * 2007-08-23 2009-02-26 Derek Walters Telepresence robot with a printer
US20090177323A1 (en) * 2005-09-30 2009-07-09 Andrew Ziegler Companion robot for personal interaction

Family Cites Families (28)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH06202732A (en) * 1993-01-06 1994-07-22 Amada Metrecs Co Ltd Moving body operating device and security robot using same
JPH0764631A (en) * 1993-08-27 1995-03-10 Nissan Motor Co Ltd Path searching method for mobile investigating machine
US20020195548A1 (en) 2001-06-06 2002-12-26 Dowski Edward Raymond Wavefront coding interference contrast imaging systems
JP3531268B2 (en) * 1995-04-05 2004-05-24 松下電器産業株式会社 Self-propelled vacuum cleaner
JPH09249908A (en) * 1996-03-14 1997-09-22 Kawasaki Steel Corp Method for controlling stopping position of truck for loading vertical type cylindrical vessel and device therefor
JP3601737B2 (en) * 1996-03-30 2004-12-15 技術研究組合医療福祉機器研究所 Transfer robot system
JP2000292538A (en) * 1999-04-07 2000-10-20 Mitsubishi Electric Corp Obstacle detector for vehicle
US6323942B1 (en) 1999-04-30 2001-11-27 Canesta, Inc. CMOS-compatible three-dimensional image sensor IC
US6515740B2 (en) 2000-11-09 2003-02-04 Canesta, Inc. Methods for CMOS-compatible three-dimensional image sensing using quantum efficiency modulation
AU2003209661A1 (en) 2002-03-14 2003-09-22 Ramot At Tel Aviv University Ltd. All optical extended depth-of-field imaging system
JP2003316438A (en) * 2002-04-22 2003-11-07 Fuji Heavy Ind Ltd Autonomous travelling service vehicle
JP2004034272A (en) * 2002-07-08 2004-02-05 Mitsubishi Heavy Ind Ltd Self-position identification device for movable body
JP2005216022A (en) * 2004-01-30 2005-08-11 Funai Electric Co Ltd Autonomous run robot cleaner
KR20060059006A (en) * 2004-11-26 2006-06-01 삼성전자주식회사 Method and apparatus of self-propelled mobile unit with obstacle avoidance during wall-following
WO2007043036A1 (en) 2005-10-11 2007-04-19 Prime Sense Ltd. Method and system for object reconstruction
WO2007105205A2 (en) 2006-03-14 2007-09-20 Prime Sense Ltd. Three-dimensional sensing using speckle patterns
KR101290367B1 (en) * 2005-12-02 2013-07-26 아이로보트 코퍼레이션 Autonomous coverage robot navigation system
JP4506685B2 (en) * 2006-02-17 2010-07-21 トヨタ自動車株式会社 Mobile robot
JP4917615B2 (en) * 2006-02-27 2012-04-18 プライム センス リミティド Range mapping using uncorrelated speckle
CN101957994B (en) 2006-03-14 2014-03-19 普莱姆传感有限公司 Depth-varying light fields for three dimensional sensing
JP5167248B2 (en) 2006-05-11 2013-03-21 プライムセンス リミテッド Modeling of humanoid shape by depth map
US8350847B2 (en) 2007-01-21 2013-01-08 Primesense Ltd Depth mapping using multi-beam illumination
US8150142B2 (en) 2007-04-02 2012-04-03 Prime Sense Ltd. Depth mapping using projected patterns
TWI433052B (en) 2007-04-02 2014-04-01 Primesense Ltd Depth mapping using projected patterns
JP2009070343A (en) * 2007-09-18 2009-04-02 Univ Of Electro-Communications Mobile body control apparatus
EP2235584B1 (en) 2008-01-21 2020-09-16 Apple Inc. Optical designs for zero order reduction
JP5081661B2 (en) * 2008-02-19 2012-11-28 株式会社Ｉｈｉ Puddle detection device, unmanned traveling vehicle, and puddle detection method
JP4788722B2 (en) * 2008-02-26 2011-10-05 トヨタ自動車株式会社 Autonomous mobile robot, self-position estimation method, environmental map generation method, environmental map generation device, and environmental map data structure

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050216126A1 (en) * 2004-03-27 2005-09-29 Vision Robotics Corporation Autonomous personal service robot
US20090177323A1 (en) * 2005-09-30 2009-07-09 Andrew Ziegler Companion robot for personal interaction
US20090055023A1 (en) * 2007-08-23 2009-02-26 Derek Walters Telepresence robot with a printer

Non-Patent Citations (6)

* Cited by examiner, † Cited by third party
Title
FREIRE E O ET AL PROTOTYPING A WHEELED MOBILE ROBOT EMBEDDING MULTIPLE SENSORS AND AGENT-BASED CONTROL SYSTEM *
HU GUANSHAN NEURAL NETWORKS BASED ON INFORMATION FUSION USING FOR AVOIDING OBSTACLE ROBOT *
LI XIAOPEN ET AL RESEARCH ON OPEN CONTROL ARCHITECTURE OF AUTONOMOUS MOBILE ROBOT WITH MULTI-LAYER AND MODULARIZATION *
PIL GYEOM KIM ET AL OBSTACLE AVOIDANCE OF A MOBILE ROBOT USING VISION SYSTEM AND ULTRASONIC SENSOR *
RUIFENG LI ET AL THE DEVELOPMENT OF A GENERAL TYPE OF SECURITY ROBOT *
SUNG-MIN HAN ET AL MOBILE ROBOT NAVIGATION BY CIRCULAR PATH PLANNING ALGORITHM USING CAMERA AND ULTRASONIC SENSOR *

Also Published As

Publication number Publication date
JP2015092348A (en) 2015-05-14
AU2011352997A8 (en) 2013-09-05
JP5946147B2 (en) 2016-07-05
JP2014509417A (en) 2014-04-17
WO2012091807A2 (en) 2012-07-05
DE112011104645T5 (en) 2013-10-10
AU2011352997A1 (en) 2013-07-11
EP2659320A2 (en) 2013-11-06
WO2012091807A3 (en) 2013-07-25
CA2824606A1 (en) 2012-07-05
AU2011352997B2 (en) 2015-06-18
GB201313410D0 (en) 2013-09-11

Similar Documents

Publication Publication Date Title
GB2502213A (en) Mobile Human Interface Robot
GB2494081A (en) Mobile human interface robot
EP2647475A3 (en) Mobile human interface robot
EP2790039A3 (en) System and Method for Detecting Scattered Signals
WO2012027599A3 (en) Touch sensing apparatus and method
WO2015200710A3 (en) Detecting gestures using antennas and/or reflections of signals transmitted by the detecting device
EP3065264A3 (en) Wireless charging transmitter using capacitive sensing for device detection
EP2740637A3 (en) Remote control device for vehicle
WO2013066327A3 (en) Presence and range detection of wireless power receiving devices and method thereof
MX340943B (en) Welding parameter control.
EP2492785A3 (en) Creative design systems and methods
EP2458484A3 (en) An improved input device and associated method
EP2749833A3 (en) Location-based small arms control system
EP2871590A3 (en) User interface control in portable system
GB201320085D0 (en) Six degree-of-freedom laser tracker that cooperates with a remote line scanner
WO2012135191A3 (en) System and method for leadwire location
EP2511800A3 (en) Position pointer
EP2783800A3 (en) Robot system and method for controlling robot system
WO2012158476A3 (en) Machine display system
EP2857834A3 (en) Ultrasonic pipe measurement apparatus
EP2369447A3 (en) Method and system for controlling functions in a mobile device by multi-inputs
WO2011104314A3 (en) Electromagnetic proximity detection method and unit
EP2731076A3 (en) Target point arrival detector, method of detecting target point arrival, carrier medium of program of detecting target point arrival and vehicle-mounted device control system
EP2757772A3 (en) Image pickup apparatus, remote control apparatus, and methods of controlling image pickup apparatus and remote control apparatus
EP2375081A3 (en) System and method for monitoring a compressor

Legal Events

Date Code Title Description
WAP Application withdrawn, taken to be withdrawn or refused ** after publication under section 16(1)