US11175672B2 - Autonomous moving system, autonomous moving body, charging dock, control method, and program - Google Patents

Autonomous moving system, autonomous moving body, charging dock, control method, and program Download PDF

Info

Publication number
US11175672B2
US11175672B2 US16/378,679 US201916378679A US11175672B2 US 11175672 B2 US11175672 B2 US 11175672B2 US 201916378679 A US201916378679 A US 201916378679A US 11175672 B2 US11175672 B2 US 11175672B2
Authority
US
United States
Prior art keywords
arithmetic processing
processing
arithmetic
autonomous moving
moving body
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active, expires
Application number
US16/378,679
Other versions
US20190346852A1 (en
Inventor
Yuta ITOZAWA
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Toyota Motor Corp
Original Assignee
Toyota Motor Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Toyota Motor Corp filed Critical Toyota Motor Corp
Assigned to TOYOTA JIDOSHA KABUSHIKI KAISHA reassignment TOYOTA JIDOSHA KABUSHIKI KAISHA ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: ITOZAWA, Yuta
Publication of US20190346852A1 publication Critical patent/US20190346852A1/en
Application granted granted Critical
Publication of US11175672B2 publication Critical patent/US11175672B2/en
Active legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course or altitude of land, water, air, or space vehicles, e.g. automatic pilot
    • G05D1/02Control of position or course in two dimensions
    • G05D1/021Control of position or course in two dimensions specially adapted to land vehicles
    • G05D1/0212Control of position or course in two dimensions specially adapted to land vehicles with means for defining a desired trajectory
    • G05D1/0221Control of position or course in two dimensions specially adapted to land vehicles with means for defining a desired trajectory involving a learning process
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B25HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25JMANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J5/00Manipulators mounted on wheels or on carriages
    • B25J5/007Manipulators mounted on wheels or on carriages mounted on wheels
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B25HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25JMANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J19/00Accessories fitted to manipulators, e.g. for monitoring, for viewing; Safety devices combined with or specially adapted for use in connection with manipulators
    • B25J19/005Accessories fitted to manipulators, e.g. for monitoring, for viewing; Safety devices combined with or specially adapted for use in connection with manipulators using batteries, e.g. as a back-up power source
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B25HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25JMANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J5/00Manipulators mounted on wheels or on carriages
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B25HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25JMANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00Programme-controlled manipulators
    • B25J9/16Programme controls
    • B25J9/1628Programme controls characterised by the control loop
    • B25J9/163Programme controls characterised by the control loop learning, adaptive, model based, rule based expert control
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B25HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25JMANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00Programme-controlled manipulators
    • B25J9/16Programme controls
    • B25J9/1694Programme controls characterised by use of sensors other than normal servo-feedback from position, speed or acceleration sensors, perception control, multi-sensor controlled systems, sensor fusion
    • B25J9/1697Vision controlled systems
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60LPROPULSION OF ELECTRICALLY-PROPELLED VEHICLES; SUPPLYING ELECTRIC POWER FOR AUXILIARY EQUIPMENT OF ELECTRICALLY-PROPELLED VEHICLES; ELECTRODYNAMIC BRAKE SYSTEMS FOR VEHICLES IN GENERAL; MAGNETIC SUSPENSION OR LEVITATION FOR VEHICLES; MONITORING OPERATING VARIABLES OF ELECTRICALLY-PROPELLED VEHICLES; ELECTRIC SAFETY DEVICES FOR ELECTRICALLY-PROPELLED VEHICLES
    • B60L53/00Methods of charging batteries, specially adapted for electric vehicles; Charging stations or on-board charging equipment therefor; Exchange of energy storage elements in electric vehicles
    • B60L53/10Methods of charging batteries, specially adapted for electric vehicles; Charging stations or on-board charging equipment therefor; Exchange of energy storage elements in electric vehicles characterised by the energy transfer between the charging station and the vehicle
    • B60L53/14Conductive energy transfer
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60LPROPULSION OF ELECTRICALLY-PROPELLED VEHICLES; SUPPLYING ELECTRIC POWER FOR AUXILIARY EQUIPMENT OF ELECTRICALLY-PROPELLED VEHICLES; ELECTRODYNAMIC BRAKE SYSTEMS FOR VEHICLES IN GENERAL; MAGNETIC SUSPENSION OR LEVITATION FOR VEHICLES; MONITORING OPERATING VARIABLES OF ELECTRICALLY-PROPELLED VEHICLES; ELECTRIC SAFETY DEVICES FOR ELECTRICALLY-PROPELLED VEHICLES
    • B60L53/00Methods of charging batteries, specially adapted for electric vehicles; Charging stations or on-board charging equipment therefor; Exchange of energy storage elements in electric vehicles
    • B60L53/30Constructional details of charging stations
    • B60L53/31Charging columns specially adapted for electric vehicles
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60LPROPULSION OF ELECTRICALLY-PROPELLED VEHICLES; SUPPLYING ELECTRIC POWER FOR AUXILIARY EQUIPMENT OF ELECTRICALLY-PROPELLED VEHICLES; ELECTRODYNAMIC BRAKE SYSTEMS FOR VEHICLES IN GENERAL; MAGNETIC SUSPENSION OR LEVITATION FOR VEHICLES; MONITORING OPERATING VARIABLES OF ELECTRICALLY-PROPELLED VEHICLES; ELECTRIC SAFETY DEVICES FOR ELECTRICALLY-PROPELLED VEHICLES
    • B60L53/00Methods of charging batteries, specially adapted for electric vehicles; Charging stations or on-board charging equipment therefor; Exchange of energy storage elements in electric vehicles
    • B60L53/60Monitoring or controlling charging stations
    • B60L53/66Data transfer between charging stations and vehicles
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B19/00Programme-control systems
    • G05B19/02Programme-control systems electric
    • G05B19/18Numerical control [NC], i.e. automatically operating machines, in particular machine tools, e.g. in a manufacturing environment, so as to execute positioning, movement or co-ordinated operations by means of programme data in numerical form
    • G05B19/4155Numerical control [NC], i.e. automatically operating machines, in particular machine tools, e.g. in a manufacturing environment, so as to execute positioning, movement or co-ordinated operations by means of programme data in numerical form characterised by programme execution, i.e. part programme or machine function execution, e.g. selection of a programme
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course or altitude of land, water, air, or space vehicles, e.g. automatic pilot
    • G05D1/0088Control of position, course or altitude of land, water, air, or space vehicles, e.g. automatic pilot characterized by the autonomous decision making process, e.g. artificial intelligence, predefined behaviours
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course or altitude of land, water, air, or space vehicles, e.g. automatic pilot
    • G05D1/02Control of position or course in two dimensions
    • G05D1/021Control of position or course in two dimensions specially adapted to land vehicles
    • G05D1/0212Control of position or course in two dimensions specially adapted to land vehicles with means for defining a desired trajectory
    • G05D1/0225Control of position or course in two dimensions specially adapted to land vehicles with means for defining a desired trajectory involving docking at a fixed facility, e.g. base station or loading bay
    • HELECTRICITY
    • H02GENERATION; CONVERSION OR DISTRIBUTION OF ELECTRIC POWER
    • H02JCIRCUIT ARRANGEMENTS OR SYSTEMS FOR SUPPLYING OR DISTRIBUTING ELECTRIC POWER; SYSTEMS FOR STORING ELECTRIC ENERGY
    • H02J7/00Circuit arrangements for charging or depolarising batteries or for supplying loads from batteries
    • H02J7/00032Circuit arrangements for charging or depolarising batteries or for supplying loads from batteries characterised by data exchange
    • H02J7/00036Charger exchanging data with battery
    • HELECTRICITY
    • H02GENERATION; CONVERSION OR DISTRIBUTION OF ELECTRIC POWER
    • H02JCIRCUIT ARRANGEMENTS OR SYSTEMS FOR SUPPLYING OR DISTRIBUTING ELECTRIC POWER; SYSTEMS FOR STORING ELECTRIC ENERGY
    • H02J7/00Circuit arrangements for charging or depolarising batteries or for supplying loads from batteries
    • H02J7/00047Circuit arrangements for charging or depolarising batteries or for supplying loads from batteries with provisions for charging different types of batteries
    • HELECTRICITY
    • H02GENERATION; CONVERSION OR DISTRIBUTION OF ELECTRIC POWER
    • H02JCIRCUIT ARRANGEMENTS OR SYSTEMS FOR SUPPLYING OR DISTRIBUTING ELECTRIC POWER; SYSTEMS FOR STORING ELECTRIC ENERGY
    • H02J7/00Circuit arrangements for charging or depolarising batteries or for supplying loads from batteries
    • H02J7/0042Circuit arrangements for charging or depolarising batteries or for supplying loads from batteries characterised by the mechanical construction
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60LPROPULSION OF ELECTRICALLY-PROPELLED VEHICLES; SUPPLYING ELECTRIC POWER FOR AUXILIARY EQUIPMENT OF ELECTRICALLY-PROPELLED VEHICLES; ELECTRODYNAMIC BRAKE SYSTEMS FOR VEHICLES IN GENERAL; MAGNETIC SUSPENSION OR LEVITATION FOR VEHICLES; MONITORING OPERATING VARIABLES OF ELECTRICALLY-PROPELLED VEHICLES; ELECTRIC SAFETY DEVICES FOR ELECTRICALLY-PROPELLED VEHICLES
    • B60L2200/00Type of vehicles
    • B60L2200/40Working vehicles
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60LPROPULSION OF ELECTRICALLY-PROPELLED VEHICLES; SUPPLYING ELECTRIC POWER FOR AUXILIARY EQUIPMENT OF ELECTRICALLY-PROPELLED VEHICLES; ELECTRODYNAMIC BRAKE SYSTEMS FOR VEHICLES IN GENERAL; MAGNETIC SUSPENSION OR LEVITATION FOR VEHICLES; MONITORING OPERATING VARIABLES OF ELECTRICALLY-PROPELLED VEHICLES; ELECTRIC SAFETY DEVICES FOR ELECTRICALLY-PROPELLED VEHICLES
    • B60L2260/00Operating Modes
    • B60L2260/20Drive modes; Transition between modes
    • B60L2260/32Auto pilot mode
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60LPROPULSION OF ELECTRICALLY-PROPELLED VEHICLES; SUPPLYING ELECTRIC POWER FOR AUXILIARY EQUIPMENT OF ELECTRICALLY-PROPELLED VEHICLES; ELECTRODYNAMIC BRAKE SYSTEMS FOR VEHICLES IN GENERAL; MAGNETIC SUSPENSION OR LEVITATION FOR VEHICLES; MONITORING OPERATING VARIABLES OF ELECTRICALLY-PROPELLED VEHICLES; ELECTRIC SAFETY DEVICES FOR ELECTRICALLY-PROPELLED VEHICLES
    • B60L53/00Methods of charging batteries, specially adapted for electric vehicles; Charging stations or on-board charging equipment therefor; Exchange of energy storage elements in electric vehicles
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00Program-control systems
    • G05B2219/30Nc systems
    • G05B2219/40Robotics, robotics mapping to robotics vision
    • G05B2219/40153Teleassistance, operator assists, controls autonomous robot
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02TCLIMATE CHANGE MITIGATION TECHNOLOGIES RELATED TO TRANSPORTATION
    • Y02T10/00Road transport of goods or passengers
    • Y02T10/60Other road transportation technologies with climate change mitigation effect
    • Y02T10/70Energy storage systems for electromobility, e.g. batteries
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02TCLIMATE CHANGE MITIGATION TECHNOLOGIES RELATED TO TRANSPORTATION
    • Y02T10/00Road transport of goods or passengers
    • Y02T10/60Other road transportation technologies with climate change mitigation effect
    • Y02T10/7072Electromobility specific charging systems or methods for batteries, ultracapacitors, supercapacitors or double-layer capacitors
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02TCLIMATE CHANGE MITIGATION TECHNOLOGIES RELATED TO TRANSPORTATION
    • Y02T90/00Enabling technologies or technologies with a potential or indirect contribution to GHG emissions mitigation
    • Y02T90/10Technologies relating to charging of electric vehicles
    • Y02T90/12Electric charging stations
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02TCLIMATE CHANGE MITIGATION TECHNOLOGIES RELATED TO TRANSPORTATION
    • Y02T90/00Enabling technologies or technologies with a potential or indirect contribution to GHG emissions mitigation
    • Y02T90/10Technologies relating to charging of electric vehicles
    • Y02T90/14Plug-in electric vehicles
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02TCLIMATE CHANGE MITIGATION TECHNOLOGIES RELATED TO TRANSPORTATION
    • Y02T90/00Enabling technologies or technologies with a potential or indirect contribution to GHG emissions mitigation
    • Y02T90/10Technologies relating to charging of electric vehicles
    • Y02T90/16Information or communication technologies improving the operation of electric vehicles

Definitions

  • the present disclosure relates to an autonomous moving system, an autonomous moving body, a charging dock, a control method, and a program.
  • An autonomous moving body such as an autonomous moving robot that includes a battery and moves autonomously has been known.
  • an autonomous moving robot disclosed in Japanese Patent No. 4418381 charges a battery at a charging station (a charging dock).
  • An autonomous moving body consumes a battery by moving autonomously and executing various arithmetic processings. Therefore, the autonomous moving body needs to charge the battery in the charging dock every time it consumes the battery. However, the higher the frequency with which the autonomous moving body returns to the charging dock, the lower an operation efficiency of the autonomous moving body becomes.
  • Japanese Patent No. 5070441 discloses a technique in which when it becomes difficult for a robot (an autonomous moving body) to perform autonomous control, an operation terminal remote-controls the robot through wireless communication.
  • an operation terminal remote-controls the robot through wireless communication.
  • processing load of an arithmetic processing unit provided in the autonomous moving body can be reduced, which suppresses a consumption of the battery which the autonomous moving body includes.
  • a real-time moving operation of the autonomous moving body may become awkward depending on a communication amount or a communication speed.
  • the present disclosure has been made in view of the above-described problem, and provides an autonomous moving system, an autonomous moving body, a charging dock, a control method, and a program capable of preventing a problem in which a moving operation of an autonomous moving body becomes awkward from occurring while an operation efficiency of an autonomous moving body is prevented from being reduced.
  • a first exemplary aspect is an autonomous moving system, including an autonomous moving body and a charging dock, the autonomous moving body including: a driven body that includes at least a carriage capable of moving autonomously; and a battery, the charging dock including a charger configured to charge the battery,
  • the autonomous moving body further including: a first communication unit configured to be able to communicate with the charging dock; and a first arithmetic processing unit configured to execute first arithmetic processing related to the drive of the driven body among arithmetic processings of the autonomous moving body,
  • the charging dock further including: a second communication unit configured to be able to communicate with the autonomous moving body; and a second arithmetic processing unit configured to execute second arithmetic processing other than the first arithmetic processing among the arithmetic processings of the autonomous moving body, in which
  • the second communication unit is configured to be able to receive arithmetic data used for the second arithmetic processing from the first communication unit, and is configured to be able to transmit a processing result of the second arithmetic processing which has been executed by the second arithmetic processing unit to the first communication unit.
  • Another exemplary aspect is an autonomous moving body including:
  • a driven body including at least a carriage capable of moving autonomously; and a battery capable of charging at a charging dock,
  • the autonomous moving body further including:
  • a communication unit capable of communicating with the charging dock; and an arithmetic processing unit configured to execute first arithmetic processing related to the drive of the driven body among arithmetic processings of the autonomous moving body, in which
  • the communication unit is configured to be able to transmit arithmetic data used for second arithmetic processing other than the first arithmetic processing among the arithmetic processings of the autonomous moving body to the charging dock, and is configured to be able to receive a processing result of the second arithmetic processing which has been executed by the charging dock from the charging dock.
  • a charging dock including a charger configured to charge a battery of an autonomous moving body, the autonomous moving body including: a driven body that includes at least a carriage capable of moving autonomously; and the battery,
  • the charging dock further including:
  • a communication unit capable of communicating with the autonomous moving body
  • an arithmetic processing unit configured to execute second arithmetic processing other than first arithmetic processing related to the drive of the driven body among arithmetic processings of the autonomous moving body, in which
  • the communication unit is configured to be able to receive arithmetic data used for the second arithmetic processing from the autonomous moving body, and is configured to be able to transmit a processing result of the second arithmetic processing which has been executed by the arithmetic processing unit to the autonomous moving body.
  • Another exemplary aspect is a method for controlling an autonomous moving body, the autonomous moving body including: a driven body that includes at least a carriage capable of moving autonomously; and a battery capable of being charged at a charging dock, the method including;
  • the autonomous moving body configuring the autonomous moving body so as to be capable of executing first arithmetic processing related to the drive of the driven body among arithmetic processings of the autonomous moving body;
  • the autonomous moving body configuring the autonomous moving body so as to be capable of transmitting arithmetic data used for second arithmetic processing other than the first arithmetic processing among the arithmetic processings of the autonomous moving body to the charging dock;
  • the autonomous moving body configuring the autonomous moving body so as to be capable of receiving a processing result of the second arithmetic processing which has been executed by the charging dock from the charging dock.
  • Another exemplary aspect is a method for controlling a charging dock, the charging dock including a charger configured to charge a battery of an autonomous moving body, the autonomous moving body including: a driven body that includes at least a carriage capable of moving autonomously; and the battery, the method including:
  • the charging dock so as to be capable of receiving arithmetic data used for second arithmetic processing other than first arithmetic processing related to the drive of the driven body among arithmetic processings of the autonomous moving body from the autonomous moving body;
  • the charging dock so as to be capable of transmitting a processing result of the second arithmetic processing to the autonomous moving body.
  • Another exemplary aspect is a program causing an autonomous moving body to function as
  • a communication means capable of communicating with the charging dock
  • an arithmetic processing means for executing first arithmetic processing related to the drive of a driven body among arithmetic processings of the autonomous moving body, the autonomous moving body including: the driven body that includes at least a carriage capable of moving autonomously; and a battery capable of charging at a charging dock, in which
  • the communication means is configured to be able to transmit arithmetic data used for second arithmetic processing other than the first arithmetic processing among the arithmetic processings of the autonomous moving body, and is configured to be able to receive a processing result of the second arithmetic processing which has been executed by the charging dock from the charging dock.
  • Another exemplary aspect is a program causing a charging dock to function as
  • a communication means capable of communicating with an autonomous moving body
  • an arithmetic processing means for executing second arithmetic processing other than first arithmetic processing related to the drive of a driven body among arithmetic processings of the autonomous moving body
  • the charging dock including a charger configured to charge a battery of the autonomous moving body
  • the autonomous moving body including: the driven body that includes at least a carriage capable of moving autonomously; and the battery, in which
  • the communication means is configured to be able to receive arithmetic data used for the second arithmetic processing from the autonomous moving body, and is configured to be able to transmit a processing result of the second arithmetic processing which has been executed by the arithmetic processing means to the autonomous moving body.
  • an autonomous moving system an autonomous moving body, a charging dock, a control method, and a program capable of preventing a problem in which a moving operation of an autonomous moving body becomes awkward from occurring while an operation efficiency of an autonomous moving body is prevented from being reduced.
  • FIG. 1 shows an example of a schematic configuration of an autonomous moving system according to an embodiment
  • FIG. 2 is a block diagram showing a schematic functional block configuration of the autonomous moving system according to the embodiment
  • FIG. 3 is a sequence diagram showing an example of second arithmetic processing in which communication is performed when an autonomous moving robot is autonomously moving in the autonomous moving system according to the embodiment.
  • FIG. 4 is a sequence diagram showing an example of the second arithmetic processing in which communication is performed when a battery of an autonomous moving robot is being charged in the autonomous moving system according to the embodiment.
  • an autonomous moving body is an autonomous moving robot.
  • FIG. 1 shows an example of the schematic configuration of the autonomous moving system 1 according to this embodiment.
  • the autonomous moving system 1 includes an autonomous moving robot 10 and a charging dock 20 . Further, the autonomous moving robot 10 includes a carriage 111 , a body 112 , an arm 115 , and a first sensor 116 , and a second sensor 117 .
  • the carriage 111 and the arm 115 are examples of driven bodies.
  • the carriage 111 is configured to be able to rotate around a rotation axis. Further, wheels are provided in the carriage 111 , and an arithmetic processing unit 130 which will be described later controls a rotation of these wheels so that the autonomous moving robot 10 (the carriage 111 ) moves autonomously.
  • the body 112 is attached to the carriage 111 .
  • the arm 115 is provided in the body 112 .
  • the arm 115 includes a grasping unit 113 and an arm unit 114 .
  • the grasping unit 113 functions as a hand that grasps an object.
  • the grasping unit 113 is provided in a tip of the arms 115 (a side opposite to the body 112 ) and is supported by the arm unit 114 .
  • the first sensor 116 is attached to the carriage 111 and detects an obstacle in a moving environment in which the autonomous moving robot 10 can move.
  • the first sensor 116 is a sensor capable of simultaneously detecting distances to a plurality of points, or a sensor capable of simultaneously detecting a distance to a plane and an angle formed by the plane and direction of the sensor, and is for example, a laser range sensor.
  • the second sensor 117 is a three-dimensional sensor, such as a stereo camera and a three-dimensional camera, and is provided in the upper part of the body 112 .
  • the second sensor 117 photographs an object to be grasped by the autonomous moving robot 10 (the grasping unit 113 of the arm 115 ).
  • the autonomous moving robot 10 may be include a sensor other than the first and the second sensors 116 and 117 (for example, a microphone and a gyro sensor) to recognize a state in the moving environment.
  • a sensor other than the first and the second sensors 116 and 117 for example, a microphone and a gyro sensor
  • the arithmetic processing unit 130 acquires information on a distance to an obstacle in the moving environment by the first sensor 116 , generates a moving path based on the acquired distance information, and makes the autonomous moving robot 10 (the carriage 111 ) move autonomously along the generated moving path.
  • the autonomous moving robot 10 incorporates a battery 160 which will be described later, and is driven by the battery 160 .
  • the autonomous moving robot 10 determines that it is necessary to charge the battery 160 since the remaining capacity thereof is lowered, it returns to a charging dock 20 by moving autonomously.
  • the charging dock 20 is installed in the moving environment in which the autonomous moving robot 10 can move, and includes a charger 230 which will be described later.
  • the charger 230 supplies electricity supplied from a commercial power source through an outlet to the battery 160 of the autonomous moving body 10 to charge the same.
  • FIG. 2 is a block diagram showing a schematic functional block configuration of the autonomous moving system 1 according to the embodiment.
  • the autonomous moving robot 10 includes a communication unit 120 , an arithmetic processing unit 130 , a sensor group 140 , an actuator group 150 , the battery 160 , a communication terminal 170 , and a charging terminal 180 .
  • the communication unit 120 is an example of the first communication unit
  • the arithmetic processing unit 130 is an example of the first arithmetic processing unit.
  • the charging dock 20 includes a communication unit 210 , an arithmetic processing unit 220 , the charger 230 , a communication terminal 240 , and a charging terminal 250 .
  • the communication unit 210 is an example of the second communication unit
  • the arithmetic processing unit 220 is an example of the second arithmetic processing unit.
  • the battery 160 is incorporated into the carriage 111 shown in FIG. 1 .
  • the communication terminal 170 and the charging terminal 180 may be disposed at any position in the carriage 111 shown in FIG. 1 , such as the front surface, the rear surface, the side surfaces, or the bottom surface thereof.
  • the communication unit 120 and the arithmetic processing unit 130 may be incorporated into either the carriage 111 or the body 112 shown in FIG. 1 .
  • the communication terminal 240 and the charging terminal 250 may be disposed at positions corresponding to the communication terminal 170 and the charging terminal 180 of the autonomous moving robot 10 .
  • the charger 230 supplies electricity to the battery 160 to charge the same.
  • the battery 160 supplies electricity charged by the charger 230 to components in the autonomous moving robot 10 .
  • the charger 230 is connected to the charging terminal 250
  • the autonomous moving robot 10 the battery 160 is connected to the charging terminal 180 .
  • the autonomous moving robot 10 moves autonomously so that the charging terminal 180 of the autonomous moving robot 10 is connected to the charging terminal 250 of the charging dock 20 .
  • the charging terminal 180 is connected to the charging terminal 250 , charging the battery is started.
  • the communication terminal 170 of the autonomous moving robot 10 is also connected to the communication terminal 240 of the charging dock 20 . Accordingly, when the battery 160 of the autonomous moving robot 10 is charged, a wired communication unit 122 of the charging dock 20 and a wired communication unit 212 of the autonomous moving robot 10 are electrically connected to each other so that wired communication can be performed.
  • the communication unit 120 includes a wireless communication unit 121 and the wired communication unit 122
  • the communication unit 210 includes a wireless communication unit 211 and the wired communication unit 212 .
  • the wireless communication units 121 and 211 can communicate with each other through wireless communication.
  • the wireless communication system can be wireless LAN (Local Area Network) communication, Bluetooth (registered trademark) communication, or the like, it is not particularly limited thereto.
  • the wired communication unit 122 is connected to the communication terminal 170
  • the wired communication unit 212 is connected to the communication terminal 240 .
  • the communication terminal 170 is also connected to the communication terminal 240 .
  • the wired communication units 122 and 212 are electrically connected to each other through the communication terminals 170 and 240 , and thereby they can communicate with each other through wired communication.
  • the wired communication system can be wired LAN communication, wired serial communication, or the like, it is not particularly limited thereto.
  • the sensor group 140 includes the first sensor 116 , the second sensor 117 , and other sensors.
  • the actuator group 150 includes a motor that drives the carriage 111 , a motor that drives the arm 115 , and other actuators.
  • the arithmetic processing unit 130 uses sensor information or the like output from the sensor group 140 to execute various arithmetic processings. However, in this embodiment, a part of the arithmetic processing to be originally executed by the arithmetic processing unit 130 is executed by the arithmetic processing unit 220 of the charging dock 20 .
  • arithmetic processing related to the drive of the carriage 111 and the arm 115 (hereinafter, it is referred to as the first arithmetic processing) is executed by the arithmetic processing unit 130
  • arithmetic processing other than first arithmetic processing (hereinafter, it is referred to as the second arithmetic processing) is executed by the arithmetic processing unit 220 of the charging dock 20 .
  • the first arithmetic processing related to the drive of the carriage 111 executed by the arithmetic processing unit 130 is processing for moving the carriage 111 autonomously.
  • the processing of moving the carriage 111 autonomously includes, for example, generating a moving path based on sensor information (information on a distance to an obstacle) from the first sensor 116 , and controlling a motor that drives the carriage 111 so as to autonomously move along the moving path.
  • the first arithmetic processing related to the drive of the arm 115 executed by the arithmetic processing unit 130 is processing for making the grasping unit 113 of the arm 115 grasp an object.
  • the processing of making the grasping unit 113 grasp an object includes, for example, controlling a motor that drives the arm 115 so that the grasping unit 113 grasps an object.
  • the second arithmetic processing executed by the arithmetic processing unit 220 includes, for example, machine-learning an object grasped by the grasping unit 113 of the arm 115 (for example, machine-learning the object as a remote controller), and estimating an object grasped by the grasping unit 113 of the arm 115 based on a result of machine-learning (a learned model) (for example, estimating that the object is an remote controller).
  • machine-learning a learned model
  • processing related to a voice interaction for example, voice-recognizing an uttered voice of another party, and generating a response sentence for an uttered voice of another party
  • processing related to a voice interaction for example, voice-recognizing an uttered voice of another party, and generating a response sentence for an uttered voice of another party
  • the arithmetic processing unit 220 of the charging dock 20 executes the second arithmetic processing. Therefore, the communication unit 120 of the autonomous moving robot 10 is configured to be able to transmit arithmetic data (for example, sensor information) used for the second arithmetic processing to the communication unit 210 , and is configured to be able to receive a processing result of the second arithmetic processing which has been executed by the arithmetic processing unit 220 from the communication unit 210 .
  • arithmetic data for example, sensor information
  • the communication unit 210 of the charging dock 20 is configured to be able to receive arithmetic data used for the second arithmetic processing from the communication unit 120 , and is configured to be able to transmit a processing result of the second arithmetic processing which has been executed by the arithmetic processing unit 220 to the communication unit 120 .
  • the arithmetic processing unit 130 controls the actuator group 150 based on both the processing results of: the second arithmetic processing which has been executed by the arithmetic processing unit 220 and has been received by the communication unit 120 ; and the first arithmetic processing which the arithmetic processing unit 130 itself has executed.
  • communication related to a part of the second arithmetic processing is performed through wired communication when the battery 160 of the autonomous moving robot 10 is being charged, and merely the communication related to the remaining second arithmetic processing is performed when the autonomous moving robot 10 (the carriage 111 ) is moving autonomously through wireless communication.
  • the wired communication units 122 and 212 perform at least one of: communication of arithmetic data used for the second arithmetic processing; and communication of a processing result of the second arithmetic processing, through wired communication.
  • the wireless communication units 121 and 211 perform at least one of: communication of arithmetic data used for the second arithmetic processing; and communication of a processing result of the second arithmetic processing, through wireless communication.
  • this processing for machine learning is the above-described part of the second arithmetic processing, and the communication related to this processing is performed through wired communication when the battery 160 of the autonomous moving robot 10 is being charged.
  • Arithmetic processing executed by the autonomous moving system 1 according to this embodiment is described below.
  • the first arithmetic processing, which is executed inside the autonomous moving robot 10 is the same as that of a conventional autonomous moving system, and thus merely the second arithmetic processing executed in the charging dock 20 is described and the explanation of the first arithmetic processing is omitted.
  • FIG. 3 is a sequence diagram showing an example of this second arithmetic processing.
  • the second arithmetic processing shown in FIG. 3 is processing for estimating an object grasped by the grasping unit 113 of the arm 115 based on a result of machine learning.
  • the arithmetic processing unit 220 of the charging dock 20 has already performed machine learning which will be described later and has stored a result of the machine learning (a learned model).
  • the wireless communication unit 121 of the autonomous moving robot 10 transmits image data photographed by the second sensor 117 for estimation of an object to be estimated which is grasped by the arm 115 to the wireless communication unit 211 of the charging dock 20 through wireless communication (step S 11 ).
  • the arithmetic processing unit 220 of the charging dock 20 estimates the object to be estimated in the image data for estimation received by the wireless communication unit 211 based on a result of machine learning (step S 12 ).
  • the wireless communication unit 211 of the charging dock 20 transmits an estimation result of the object to be estimated which has been estimated by the arithmetic processing unit 220 through wireless communication to the wireless communication unit 121 of the autonomous moving robot 10 (step S 13 ).
  • FIG. 4 is a sequence diagram showing an example of this second arithmetic processing. Note that the second arithmetic processing shown in FIG. 4 is processing for machine-learning an object grasped by the grasping unit 113 of the arm 115 .
  • the wireless communication unit 122 of the autonomous moving robot 10 transmits image data for machine learning of an object to be learned which is grasped by the arm 115 , which the second sensor 117 has photographed, to the wired communication unit 212 of the charging dock 20 through wired communication (step S 21 ).
  • the image data for machine learning a large amount of image data in which the object to be learned is photographed at various angles is transmitted.
  • the arithmetic processing unit 220 of the charging dock 20 machine-learns the object to be learned in the image data for machine learning which has been received by the wired communication unit 212 (step S 22 ).
  • the arithmetic processing unit 220 of the charging dock 20 stores a result of machine learning (step S 23 ).
  • the second arithmetic processing according to this example is processing for machine-learning an object grasped by the grasping unit 113 of the arm 115 as described above.
  • the wired communication unit 212 of the charging dock 20 receives image data for machine learning in which an object to be learned is photographed as arithmetic data for the second arithmetic processing from the wired communication unit 122 of the autonomous moving robot 10 through wired communication.
  • the arithmetic processing unit 220 of the charging dock 20 machine-learns the object to be learned in the image data for machine learning which has been received by the wired communication unit 212 .
  • the arithmetic processing unit 220 machine-learns an object to be learned, a large amount of image data for machine learning in which the object is photographed at various angles is necessary.
  • a wireless communication band is narrowed.
  • image data for machine learning is transmitted through wired communication, and thereby the wireless communication band can be prevented from being narrowed by the transmission of the image data for machine learning.
  • the second arithmetic processing according to this example is processing for downloading and updating firmware of the autonomous moving robot 10 .
  • the arithmetic processing unit 220 of the charging dock 20 uses the wireless communication unit 211 to download firmware to be updated in the autonomous moving robot 10 through wireless communication from a predetermined server. Note that this downloading may be performed when the battery 160 of the autonomous moving robot 10 is being charged or may be performed in advance.
  • the wired communication unit 212 of the charging dock 20 sends firmware as a processing result of the second arithmetic processing and an instruction for updating the firmware to the wired communication unit 122 of the autonomous moving robot 10 through wired communication.
  • a wireless communication band is narrowed when each one of the plurality of the autonomous moving robots 10 respectively downloads firmware through wireless communication from a predetermined server.
  • the wireless communication band can be prevented from being narrowed by the download of the firmware.
  • the second arithmetic processing according to this example is processing for uploading diagnostic information on the autonomous moving robot 10 .
  • the autonomous moving robot 10 executes a diagnostic tool.
  • the wired communication unit 212 of the charging dock 20 receives diagnostic information indicating failed parts, the number of movements, and the like acquired by the execution of the diagnostic tool as arithmetic data for the second arithmetic processing from the wired communication unit 122 of the autonomous moving robot 10 through wired communication.
  • the arithmetic processing unit 220 of the charging dock 20 uses the wireless communication unit 211 to upload the diagnostic information on the autonomous moving robot 10 to a predetermined server through wireless communication.
  • a wireless communication band is narrowed when each one of the plurality of the autonomous moving robots 10 respectively uploads the diagnostic information to a predetermined server through wireless communication.
  • the wireless communication band can be prevented from being narrowed by the upload of the diagnostic information.
  • the second arithmetic processing according to this example is processing for sharing map data and image data in a plurality of autonomous moving robots 10 .
  • the arithmetic processing unit 220 of the charging dock 20 stores map data (for example, map data of the moving environment of the autonomous moving robot 10 ) and image data (image data which have been used for machine learning), which are shared by a plurality of autonomous moving robots 10 .
  • map data for example, map data of the moving environment of the autonomous moving robot 10
  • image data image data which have been used for machine learning
  • the wired communication unit 212 of the charging dock 20 sends the map data and the image data to be shared as a processing result of the second arithmetic processing to the wired communication unit 122 of the autonomous moving robot 10 through wired communication.
  • the autonomous moving robot 10 can share the map data and the image data merely by being connected to the charging dock 20 in order to charge the battery 160 , and thereby the data can be transferred to the autonomous moving robot 10 .
  • a wireless communication band can be prevented from being narrowed by the transmission of the map data and the image data.
  • the autonomous moving robot 10 executes the first arithmetic processing related to the drive of the carriage 111 and the arm 115
  • the charging dock 20 executes the second arithmetic processing other than the first arithmetic processing.
  • the charging dock 20 is configured to be able to receive arithmetic data used for the second arithmetic processing from the autonomous moving robot 10 , and is configured to be able to transmit a processing result of the second arithmetic processing which the charging dock 20 itself has executed to the autonomous moving robot 10 .
  • a part of the arithmetic processing of the autonomous moving robot 10 (the second arithmetic processing) is executed in the charging dock 20 .
  • the autonomous moving robot 10 executes this first arithmetic processing related to the drive of the carriage 111 , and communication related to this first arithmetic processing is not performed between the autonomous moving robot 10 and the charging dock 20 .
  • the autonomous moving robot 10 since the autonomous moving robot 10 also executes the first arithmetic processing related to the drive of the arm 115 , a real-time grasping operation of the arm 115 is prevented from being awkward.
  • the charging dock 20 receives arithmetic data and transmits a processing result, through wired communication, when the battery 160 of the autonomous moving robot 10 is being charged, and merely in regard to the remaining second arithmetic processing, the charging dock 20 receives arithmetic data and transmits a processing result, through wireless communication, when the carriage 111 of the autonomous moving robot 10 is moving autonomously.
  • communication according to the part of the second arithmetic processing is performed through wired communication when the charging dock 20 is charging the battery 160 .
  • it is possible to, for example, prevent a wireless communication band from being narrowed by the communication related to the second arithmetic processing, which is an advantage.
  • the autonomous moving body includes the carriage and the arm as a driven body
  • the present disclosure is not limited thereto.
  • the autonomous moving body may include at least the carriage, and there is no limitation on whether or not the arm is included.
  • an autonomous moving body may include a driven body other than the arm in addition to the carriage.
  • the communication terminals may be, for example, manually connected to each other by a user through a cable or the like.
  • the autonomous moving body and the charging dock according to the present disclosure have been described as a hardware configuration, but the present disclose is not limited thereto.
  • any processing of the autonomous moving body and the charging dock can be achieved by a processor, such as a CPU (Central Processing Unit), loading and executing a computer program stored in a memory.
  • a processor such as a CPU (Central Processing Unit)
  • CPU Central Processing Unit
  • Non-transitory computer readable media include any type of tangible storage media.
  • Examples of non-transitory computer readable media include magnetic storage media (such as floppy disks, magnetic tapes, hard disk drives, etc.), optical magnetic storage media (e.g. magneto-optical disks), CD-ROM (compact disc read only memory), CD-R (compact disc recordable), CD-R/W (compact disc rewritable), and semiconductor memories (such as mask ROM, PROM (programmable ROM), EPROM (erasable PROM), flash ROM, RAM (random access memory), etc.).
  • magnetic storage media such as floppy disks, magnetic tapes, hard disk drives, etc.
  • optical magnetic storage media e.g. magneto-optical disks
  • CD-ROM compact disc read only memory
  • CD-R compact disc recordable
  • CD-R/W compact disc rewritable
  • semiconductor memories such as mask ROM, PROM (programmable ROM), EPROM (erasable PROM), flash ROM
  • the program may be provided to a computer using any type of transitory computer readable media.
  • Examples of transitory computer readable media include electric signals, optical signals, and electromagnetic waves.
  • Transitory computer readable media can provide the program to a computer via a wired communication line (e.g. electric wires, and optical fibers) or a wireless communication line.

Abstract

An autonomous moving body includes: a driven body including a carriage capable of moving autonomously; a battery; a first communication unit capable of communicating with a charging dock; and a first arithmetic processing unit for executing first arithmetic processing related to the drive of the driven body among arithmetic processings of the autonomous moving body. A charging dock includes: a charger for charging the battery; a second communication unit capable of communicating with the autonomous moving body; and a second arithmetic processing unit for executing second arithmetic processing other than the first arithmetic processing among the arithmetic processings of the autonomous moving body. The second communication unit is configured to be able to receive arithmetic data used for the second arithmetic processing from the first communication unit, and to transmit a processing result of the second arithmetic processing executed by the second arithmetic processing unit to the first communication unit.

Description

CROSS REFERENCE TO RELATED APPLICATIONS
This application is based upon and claims the benefit of priority from Japanese patent application No. 2018-092141, filed on May 11, 2018, the disclosure of which is incorporated herein in its entirety by reference.
BACKGROUND
The present disclosure relates to an autonomous moving system, an autonomous moving body, a charging dock, a control method, and a program.
An autonomous moving body such as an autonomous moving robot that includes a battery and moves autonomously has been known. For example, an autonomous moving robot disclosed in Japanese Patent No. 4418381 charges a battery at a charging station (a charging dock).
An autonomous moving body consumes a battery by moving autonomously and executing various arithmetic processings. Therefore, the autonomous moving body needs to charge the battery in the charging dock every time it consumes the battery. However, the higher the frequency with which the autonomous moving body returns to the charging dock, the lower an operation efficiency of the autonomous moving body becomes.
On the other hand, Japanese Patent No. 5070441 discloses a technique in which when it becomes difficult for a robot (an autonomous moving body) to perform autonomous control, an operation terminal remote-controls the robot through wireless communication. When the period for remote-controlling the autonomous moving robot is set as described in Japanese Patent No. 5070441, processing load of an arithmetic processing unit provided in the autonomous moving body can be reduced, which suppresses a consumption of the battery which the autonomous moving body includes. As a result, it may be possible to prevent the operation efficiency of the autonomous moving body from being reduced. However, when the autonomous moving body is moved by remote control through wireless communication, a real-time moving operation of the autonomous moving body may become awkward depending on a communication amount or a communication speed.
SUMMARY
As described above, in related art regarding an autonomous moving body, there has been a demand for preventing a problem in which a moving operation of an autonomous moving body becomes awkward from occurring while an operation efficiency of an autonomous moving body is prevented from being reduced.
The present disclosure has been made in view of the above-described problem, and provides an autonomous moving system, an autonomous moving body, a charging dock, a control method, and a program capable of preventing a problem in which a moving operation of an autonomous moving body becomes awkward from occurring while an operation efficiency of an autonomous moving body is prevented from being reduced.
A first exemplary aspect is an autonomous moving system, including an autonomous moving body and a charging dock, the autonomous moving body including: a driven body that includes at least a carriage capable of moving autonomously; and a battery, the charging dock including a charger configured to charge the battery,
the autonomous moving body further including: a first communication unit configured to be able to communicate with the charging dock; and a first arithmetic processing unit configured to execute first arithmetic processing related to the drive of the driven body among arithmetic processings of the autonomous moving body,
the charging dock further including: a second communication unit configured to be able to communicate with the autonomous moving body; and a second arithmetic processing unit configured to execute second arithmetic processing other than the first arithmetic processing among the arithmetic processings of the autonomous moving body, in which
the second communication unit is configured to be able to receive arithmetic data used for the second arithmetic processing from the first communication unit, and is configured to be able to transmit a processing result of the second arithmetic processing which has been executed by the second arithmetic processing unit to the first communication unit.
Another exemplary aspect is an autonomous moving body including:
a driven body including at least a carriage capable of moving autonomously; and a battery capable of charging at a charging dock,
the autonomous moving body further including:
a communication unit capable of communicating with the charging dock; and an arithmetic processing unit configured to execute first arithmetic processing related to the drive of the driven body among arithmetic processings of the autonomous moving body, in which
the communication unit is configured to be able to transmit arithmetic data used for second arithmetic processing other than the first arithmetic processing among the arithmetic processings of the autonomous moving body to the charging dock, and is configured to be able to receive a processing result of the second arithmetic processing which has been executed by the charging dock from the charging dock.
Another exemplary aspect is a charging dock including a charger configured to charge a battery of an autonomous moving body, the autonomous moving body including: a driven body that includes at least a carriage capable of moving autonomously; and the battery,
the charging dock further including:
a communication unit capable of communicating with the autonomous moving body; and
an arithmetic processing unit configured to execute second arithmetic processing other than first arithmetic processing related to the drive of the driven body among arithmetic processings of the autonomous moving body, in which
the communication unit is configured to be able to receive arithmetic data used for the second arithmetic processing from the autonomous moving body, and is configured to be able to transmit a processing result of the second arithmetic processing which has been executed by the arithmetic processing unit to the autonomous moving body.
Another exemplary aspect is a method for controlling an autonomous moving body, the autonomous moving body including: a driven body that includes at least a carriage capable of moving autonomously; and a battery capable of being charged at a charging dock, the method including;
configuring the autonomous moving body so as to be capable of executing first arithmetic processing related to the drive of the driven body among arithmetic processings of the autonomous moving body;
configuring the autonomous moving body so as to be capable of transmitting arithmetic data used for second arithmetic processing other than the first arithmetic processing among the arithmetic processings of the autonomous moving body to the charging dock; and
configuring the autonomous moving body so as to be capable of receiving a processing result of the second arithmetic processing which has been executed by the charging dock from the charging dock.
Another exemplary aspect is a method for controlling a charging dock, the charging dock including a charger configured to charge a battery of an autonomous moving body, the autonomous moving body including: a driven body that includes at least a carriage capable of moving autonomously; and the battery, the method including:
configuring the charging dock so as to be capable of receiving arithmetic data used for second arithmetic processing other than first arithmetic processing related to the drive of the driven body among arithmetic processings of the autonomous moving body from the autonomous moving body;
configuring the charging dock so as to be capable of executing the second arithmetic processing; and
configuring the charging dock so as to be capable of transmitting a processing result of the second arithmetic processing to the autonomous moving body.
Another exemplary aspect is a program causing an autonomous moving body to function as
a communication means capable of communicating with the charging dock, and
an arithmetic processing means for executing first arithmetic processing related to the drive of a driven body among arithmetic processings of the autonomous moving body, the autonomous moving body including: the driven body that includes at least a carriage capable of moving autonomously; and a battery capable of charging at a charging dock, in which
the communication means is configured to be able to transmit arithmetic data used for second arithmetic processing other than the first arithmetic processing among the arithmetic processings of the autonomous moving body, and is configured to be able to receive a processing result of the second arithmetic processing which has been executed by the charging dock from the charging dock.
Another exemplary aspect is a program causing a charging dock to function as
a communication means capable of communicating with an autonomous moving body and
an arithmetic processing means for executing second arithmetic processing other than first arithmetic processing related to the drive of a driven body among arithmetic processings of the autonomous moving body, the charging dock including a charger configured to charge a battery of the autonomous moving body, the autonomous moving body including: the driven body that includes at least a carriage capable of moving autonomously; and the battery, in which
the communication means is configured to be able to receive arithmetic data used for the second arithmetic processing from the autonomous moving body, and is configured to be able to transmit a processing result of the second arithmetic processing which has been executed by the arithmetic processing means to the autonomous moving body.
According to the present disclosure, it is possible to provide an autonomous moving system, an autonomous moving body, a charging dock, a control method, and a program capable of preventing a problem in which a moving operation of an autonomous moving body becomes awkward from occurring while an operation efficiency of an autonomous moving body is prevented from being reduced.
The above and other objects, features and advantages of the present disclosure will become more fully understood from the detailed description given hereinbelow and the accompanying drawings which are given by way of illustration only, and thus are not to be considered as limiting the present disclosure.
BRIEF DESCRIPTION OF DRAWINGS
FIG. 1 shows an example of a schematic configuration of an autonomous moving system according to an embodiment;
FIG. 2 is a block diagram showing a schematic functional block configuration of the autonomous moving system according to the embodiment;
FIG. 3 is a sequence diagram showing an example of second arithmetic processing in which communication is performed when an autonomous moving robot is autonomously moving in the autonomous moving system according to the embodiment; and
FIG. 4 is a sequence diagram showing an example of the second arithmetic processing in which communication is performed when a battery of an autonomous moving robot is being charged in the autonomous moving system according to the embodiment.
DESCRIPTION OF EMBODIMENTS
Embodiments according to the present disclosure are described hereinafter with reference to the drawings. Note that for clarifying the explanation, the following descriptions and the drawings are simplified as appropriate. Further, the same symbols are assigned to the same components throughout the drawings and duplicated explanations are omitted as required. Furthermore, the following embodiments are described as that an autonomous moving body is an autonomous moving robot.
First, a schematic configuration of an autonomous moving system 1 according to this embodiment is described with reference to FIG. 1. FIG. 1 shows an example of the schematic configuration of the autonomous moving system 1 according to this embodiment.
As shown in FIG. 1, the autonomous moving system 1 according to this embodiment includes an autonomous moving robot 10 and a charging dock 20. Further, the autonomous moving robot 10 includes a carriage 111, a body 112, an arm 115, and a first sensor 116, and a second sensor 117. The carriage 111 and the arm 115 are examples of driven bodies.
The carriage 111 is configured to be able to rotate around a rotation axis. Further, wheels are provided in the carriage 111, and an arithmetic processing unit 130 which will be described later controls a rotation of these wheels so that the autonomous moving robot 10 (the carriage 111) moves autonomously.
The body 112 is attached to the carriage 111. The arm 115 is provided in the body 112. The arm 115 includes a grasping unit 113 and an arm unit 114. The grasping unit 113 functions as a hand that grasps an object. The grasping unit 113 is provided in a tip of the arms 115 (a side opposite to the body 112) and is supported by the arm unit 114.
The first sensor 116 is attached to the carriage 111 and detects an obstacle in a moving environment in which the autonomous moving robot 10 can move. The first sensor 116 is a sensor capable of simultaneously detecting distances to a plurality of points, or a sensor capable of simultaneously detecting a distance to a plane and an angle formed by the plane and direction of the sensor, and is for example, a laser range sensor.
The second sensor 117 is a three-dimensional sensor, such as a stereo camera and a three-dimensional camera, and is provided in the upper part of the body 112. For example, the second sensor 117 photographs an object to be grasped by the autonomous moving robot 10 (the grasping unit 113 of the arm 115).
Note that the autonomous moving robot 10 may be include a sensor other than the first and the second sensors 116 and 117 (for example, a microphone and a gyro sensor) to recognize a state in the moving environment.
An autonomous moving operation of the autonomous moving robot 10 are controlled by the arithmetic processing unit 130 which will be described later. The arithmetic processing unit 130 acquires information on a distance to an obstacle in the moving environment by the first sensor 116, generates a moving path based on the acquired distance information, and makes the autonomous moving robot 10 (the carriage 111) move autonomously along the generated moving path.
The autonomous moving robot 10 incorporates a battery 160 which will be described later, and is driven by the battery 160. When the autonomous moving robot 10 determines that it is necessary to charge the battery 160 since the remaining capacity thereof is lowered, it returns to a charging dock 20 by moving autonomously.
The charging dock 20 is installed in the moving environment in which the autonomous moving robot 10 can move, and includes a charger 230 which will be described later. When the autonomous moving robot 10 returns to the charging dock 20, the charger 230 supplies electricity supplied from a commercial power source through an outlet to the battery 160 of the autonomous moving body 10 to charge the same.
Next, a schematic functional block configuration of the autonomous moving system 1 according to this embodiment is described with reference to FIG. 2. FIG. 2 is a block diagram showing a schematic functional block configuration of the autonomous moving system 1 according to the embodiment.
As shown in FIG. 2, the autonomous moving robot 10 includes a communication unit 120, an arithmetic processing unit 130, a sensor group 140, an actuator group 150, the battery 160, a communication terminal 170, and a charging terminal 180. The communication unit 120 is an example of the first communication unit, and the arithmetic processing unit 130 is an example of the first arithmetic processing unit.
Further, the charging dock 20 includes a communication unit 210, an arithmetic processing unit 220, the charger 230, a communication terminal 240, and a charging terminal 250. The communication unit 210 is an example of the second communication unit, and the arithmetic processing unit 220 is an example of the second arithmetic processing unit.
Note that in the autonomous moving robot 10, for example, the battery 160 is incorporated into the carriage 111 shown in FIG. 1. The communication terminal 170 and the charging terminal 180 may be disposed at any position in the carriage 111 shown in FIG. 1, such as the front surface, the rear surface, the side surfaces, or the bottom surface thereof. Further, the communication unit 120 and the arithmetic processing unit 130 may be incorporated into either the carriage 111 or the body 112 shown in FIG. 1. Further, in the charging dock 20, the communication terminal 240 and the charging terminal 250 may be disposed at positions corresponding to the communication terminal 170 and the charging terminal 180 of the autonomous moving robot 10.
The charger 230 supplies electricity to the battery 160 to charge the same. The battery 160 supplies electricity charged by the charger 230 to components in the autonomous moving robot 10. In the charging dock 20, the charger 230 is connected to the charging terminal 250, and in the autonomous moving robot 10, the battery 160 is connected to the charging terminal 180. When the battery 160 of the autonomous moving robot 10 is charged, the autonomous moving robot 10 moves autonomously so that the charging terminal 180 of the autonomous moving robot 10 is connected to the charging terminal 250 of the charging dock 20. When the charging terminal 180 is connected to the charging terminal 250, charging the battery is started.
In this embodiment, when the charging terminal 180 of the autonomous moving robot 10 is connected to the charging terminal 250 of the charging dock 20, the communication terminal 170 of the autonomous moving robot 10 is also connected to the communication terminal 240 of the charging dock 20. Accordingly, when the battery 160 of the autonomous moving robot 10 is charged, a wired communication unit 122 of the charging dock 20 and a wired communication unit 212 of the autonomous moving robot 10 are electrically connected to each other so that wired communication can be performed.
The communication unit 120 includes a wireless communication unit 121 and the wired communication unit 122, and the communication unit 210 includes a wireless communication unit 211 and the wired communication unit 212.
The wireless communication units 121 and 211 can communicate with each other through wireless communication. Although the wireless communication system can be wireless LAN (Local Area Network) communication, Bluetooth (registered trademark) communication, or the like, it is not particularly limited thereto.
In the charging dock 20, the wired communication unit 122 is connected to the communication terminal 170, and in the autonomous moving robot 10, the wired communication unit 212 is connected to the communication terminal 240. As described above, in the case of charging the battery 160 of the autonomous moving robot 10, when the charging terminal 180 is connected to the charging terminal 250, the communication terminal 170 is also connected to the communication terminal 240. Accordingly, the wired communication units 122 and 212 are electrically connected to each other through the communication terminals 170 and 240, and thereby they can communicate with each other through wired communication. Although the wired communication system can be wired LAN communication, wired serial communication, or the like, it is not particularly limited thereto.
The sensor group 140 includes the first sensor 116, the second sensor 117, and other sensors. The actuator group 150 includes a motor that drives the carriage 111, a motor that drives the arm 115, and other actuators.
The arithmetic processing unit 130 uses sensor information or the like output from the sensor group 140 to execute various arithmetic processings. However, in this embodiment, a part of the arithmetic processing to be originally executed by the arithmetic processing unit 130 is executed by the arithmetic processing unit 220 of the charging dock 20. More specifically, arithmetic processing related to the drive of the carriage 111 and the arm 115 (hereinafter, it is referred to as the first arithmetic processing) is executed by the arithmetic processing unit 130, and arithmetic processing other than first arithmetic processing (hereinafter, it is referred to as the second arithmetic processing) is executed by the arithmetic processing unit 220 of the charging dock 20.
The first arithmetic processing related to the drive of the carriage 111 executed by the arithmetic processing unit 130 is processing for moving the carriage 111 autonomously. The processing of moving the carriage 111 autonomously includes, for example, generating a moving path based on sensor information (information on a distance to an obstacle) from the first sensor 116, and controlling a motor that drives the carriage 111 so as to autonomously move along the moving path. Further, the first arithmetic processing related to the drive of the arm 115 executed by the arithmetic processing unit 130 is processing for making the grasping unit 113 of the arm 115 grasp an object. The processing of making the grasping unit 113 grasp an object includes, for example, controlling a motor that drives the arm 115 so that the grasping unit 113 grasps an object.
On the other hand, the second arithmetic processing executed by the arithmetic processing unit 220 includes, for example, machine-learning an object grasped by the grasping unit 113 of the arm 115 (for example, machine-learning the object as a remote controller), and estimating an object grasped by the grasping unit 113 of the arm 115 based on a result of machine-learning (a learned model) (for example, estimating that the object is an remote controller). Further, in the case where the autonomous moving robot 10 includes a voice interaction function, processing related to a voice interaction (for example, voice-recognizing an uttered voice of another party, and generating a response sentence for an uttered voice of another party) is included in the second arithmetic processing.
In this embodiment, the arithmetic processing unit 220 of the charging dock 20 executes the second arithmetic processing. Therefore, the communication unit 120 of the autonomous moving robot 10 is configured to be able to transmit arithmetic data (for example, sensor information) used for the second arithmetic processing to the communication unit 210, and is configured to be able to receive a processing result of the second arithmetic processing which has been executed by the arithmetic processing unit 220 from the communication unit 210. Further, the communication unit 210 of the charging dock 20 is configured to be able to receive arithmetic data used for the second arithmetic processing from the communication unit 120, and is configured to be able to transmit a processing result of the second arithmetic processing which has been executed by the arithmetic processing unit 220 to the communication unit 120.
The arithmetic processing unit 130 controls the actuator group 150 based on both the processing results of: the second arithmetic processing which has been executed by the arithmetic processing unit 220 and has been received by the communication unit 120; and the first arithmetic processing which the arithmetic processing unit 130 itself has executed.
Note that between the communication unit 120 of the autonomous moving robot 10 and the communication unit 210 of the charging dock 20, all the communication related to the second arithmetic processing can be performed through wireless communication. However, when all the communication related to the second arithmetic processing is performed through wireless communication, problems, such as a wireless communication band is narrowed, occur.
Therefore, in this embodiment, communication related to a part of the second arithmetic processing is performed through wired communication when the battery 160 of the autonomous moving robot 10 is being charged, and merely the communication related to the remaining second arithmetic processing is performed when the autonomous moving robot 10 (the carriage 111) is moving autonomously through wireless communication.
Specifically, in regard to the above-described part of the second arithmetic processing, when the battery 160 of the autonomous moving robot 10 is being charged, the wired communication units 122 and 212 perform at least one of: communication of arithmetic data used for the second arithmetic processing; and communication of a processing result of the second arithmetic processing, through wired communication. Further, in regard to the remaining second arithmetic processing, when the autonomous moving robot 10 (the carriage 111) is moving autonomously, the wireless communication units 121 and 211 perform at least one of: communication of arithmetic data used for the second arithmetic processing; and communication of a processing result of the second arithmetic processing, through wireless communication.
For example, since it is necessary for processing of machine-learning an object grasped by the grasping unit 113 of the arm 115 among the above-described second arithmetic processings to transmit a large amount of image data for machine learning from the autonomous moving robot 10 to the charging dock 20, a wireless communication band is narrowed when the large amount of image data is continuously transmitted through wireless communication. Further, real-time performance is not required for this processing. Accordingly, this processing for machine learning is the above-described part of the second arithmetic processing, and the communication related to this processing is performed through wired communication when the battery 160 of the autonomous moving robot 10 is being charged.
On the other hand, real-time performance is required for processing of estimating an object grasped by the grasping unit 113 of the arm 115 based on a result of machine learning and processing related to a voice interaction, among the above-described second arithmetic processings. Accordingly, these processings are the above-described remaining second arithmetic processings, and the communication related to these processings is performed through wireless communication when the autonomous moving robot 10 (the carriage 111) is moving autonomously.
Note that another example of the above-described part of second arithmetic processing will be described later.
Arithmetic processing executed by the autonomous moving system 1 according to this embodiment is described below. However, the first arithmetic processing, which is executed inside the autonomous moving robot 10, is the same as that of a conventional autonomous moving system, and thus merely the second arithmetic processing executed in the charging dock 20 is described and the explanation of the first arithmetic processing is omitted.
First, the second arithmetic processing (corresponding to the above-described remaining second arithmetic processing) in which communication is performed when the autonomous moving robot 10 (the carriage 111) is moving autonomously is described with reference to FIG. 3. FIG. 3 is a sequence diagram showing an example of this second arithmetic processing. Note that the second arithmetic processing shown in FIG. 3 is processing for estimating an object grasped by the grasping unit 113 of the arm 115 based on a result of machine learning. Here, the arithmetic processing unit 220 of the charging dock 20 has already performed machine learning which will be described later and has stored a result of the machine learning (a learned model).
As shown in FIG. 3, first, the wireless communication unit 121 of the autonomous moving robot 10 transmits image data photographed by the second sensor 117 for estimation of an object to be estimated which is grasped by the arm 115 to the wireless communication unit 211 of the charging dock 20 through wireless communication (step S11).
Next, the arithmetic processing unit 220 of the charging dock 20 estimates the object to be estimated in the image data for estimation received by the wireless communication unit 211 based on a result of machine learning (step S12).
Then, the wireless communication unit 211 of the charging dock 20 transmits an estimation result of the object to be estimated which has been estimated by the arithmetic processing unit 220 through wireless communication to the wireless communication unit 121 of the autonomous moving robot 10 (step S13).
Next, the second arithmetic processing (corresponding to the above-described part of the second arithmetic processing) in which in which communication is performed when the battery 160 of the autonomous moving robot 10 is being charged is described with reference to FIG. 4. FIG. 4 is a sequence diagram showing an example of this second arithmetic processing. Note that the second arithmetic processing shown in FIG. 4 is processing for machine-learning an object grasped by the grasping unit 113 of the arm 115.
As shown in FIG. 4, first, the wireless communication unit 122 of the autonomous moving robot 10 transmits image data for machine learning of an object to be learned which is grasped by the arm 115, which the second sensor 117 has photographed, to the wired communication unit 212 of the charging dock 20 through wired communication (step S21). At this time, as the image data for machine learning, a large amount of image data in which the object to be learned is photographed at various angles is transmitted.
Next, the arithmetic processing unit 220 of the charging dock 20 machine-learns the object to be learned in the image data for machine learning which has been received by the wired communication unit 212 (step S22).
Then, the arithmetic processing unit 220 of the charging dock 20 stores a result of machine learning (step S23).
An example of the second arithmetic processing (corresponding to the above-described part of the second arithmetic processing) in which communication is performed when the battery 160 of the autonomous moving robot 10 is being charged among the second arithmetic processings executed by the arithmetic processing unit 220 of the charging dock 20 is described below.
(A) First Example
The second arithmetic processing according to this example is processing for machine-learning an object grasped by the grasping unit 113 of the arm 115 as described above.
In this example, when the battery 160 of the autonomous moving robot 10 is being charged, the wired communication unit 212 of the charging dock 20 receives image data for machine learning in which an object to be learned is photographed as arithmetic data for the second arithmetic processing from the wired communication unit 122 of the autonomous moving robot 10 through wired communication. The arithmetic processing unit 220 of the charging dock 20 machine-learns the object to be learned in the image data for machine learning which has been received by the wired communication unit 212.
When the arithmetic processing unit 220 machine-learns an object to be learned, a large amount of image data for machine learning in which the object is photographed at various angles is necessary. When the large amount of the image data for machine learning is continuously transmitted through wireless communication, a wireless communication band is narrowed.
In this example, image data for machine learning is transmitted through wired communication, and thereby the wireless communication band can be prevented from being narrowed by the transmission of the image data for machine learning.
(B) Second Example
The second arithmetic processing according to this example is processing for downloading and updating firmware of the autonomous moving robot 10.
In this example, the arithmetic processing unit 220 of the charging dock 20 uses the wireless communication unit 211 to download firmware to be updated in the autonomous moving robot 10 through wireless communication from a predetermined server. Note that this downloading may be performed when the battery 160 of the autonomous moving robot 10 is being charged or may be performed in advance. When the battery 160 of the autonomous moving robot 10 is being charged, the wired communication unit 212 of the charging dock 20 sends firmware as a processing result of the second arithmetic processing and an instruction for updating the firmware to the wired communication unit 122 of the autonomous moving robot 10 through wired communication.
For example, in the case where a plurality of autonomous moving robots 10 are operated by one charging dock 20, a wireless communication band is narrowed when each one of the plurality of the autonomous moving robots 10 respectively downloads firmware through wireless communication from a predetermined server. In this example, since merely one charging dock 20 downloads firmware through wireless communication, the wireless communication band can be prevented from being narrowed by the download of the firmware.
(C) Third Example
The second arithmetic processing according to this example is processing for uploading diagnostic information on the autonomous moving robot 10.
In this example, when the battery 160 of the autonomous moving robot 10 is being charged, the autonomous moving robot 10 executes a diagnostic tool. The wired communication unit 212 of the charging dock 20 receives diagnostic information indicating failed parts, the number of movements, and the like acquired by the execution of the diagnostic tool as arithmetic data for the second arithmetic processing from the wired communication unit 122 of the autonomous moving robot 10 through wired communication. The arithmetic processing unit 220 of the charging dock 20 uses the wireless communication unit 211 to upload the diagnostic information on the autonomous moving robot 10 to a predetermined server through wireless communication.
For example, in the case where a plurality of autonomous moving robots 10 are operated by one charging dock 20, a wireless communication band is narrowed when each one of the plurality of the autonomous moving robots 10 respectively uploads the diagnostic information to a predetermined server through wireless communication.
In this example, when the charging dock 20 collectively uploads the diagnostic information of the plurality of the autonomous moving robot 10 through wireless communication, the wireless communication band can be prevented from being narrowed by the upload of the diagnostic information.
(D) Fourth Example
The second arithmetic processing according to this example is processing for sharing map data and image data in a plurality of autonomous moving robots 10.
In this example, the arithmetic processing unit 220 of the charging dock 20 stores map data (for example, map data of the moving environment of the autonomous moving robot 10) and image data (image data which have been used for machine learning), which are shared by a plurality of autonomous moving robots 10. When the battery 160 of the autonomous moving robot 10 is being charged, the wired communication unit 212 of the charging dock 20 sends the map data and the image data to be shared as a processing result of the second arithmetic processing to the wired communication unit 122 of the autonomous moving robot 10 through wired communication.
In this example, when a plurality of the autonomous moving robots 10 are operated by one charging dock 20 or when the autonomous robot 10 is replaced, the autonomous moving robot 10 can share the map data and the image data merely by being connected to the charging dock 20 in order to charge the battery 160, and thereby the data can be transferred to the autonomous moving robot 10.
Further, in this example, by transmitting the map data and the image data through wired communication, a wireless communication band can be prevented from being narrowed by the transmission of the map data and the image data.
According to this embodiment as described above, the autonomous moving robot 10 executes the first arithmetic processing related to the drive of the carriage 111 and the arm 115, and the charging dock 20 executes the second arithmetic processing other than the first arithmetic processing. Further, the charging dock 20 is configured to be able to receive arithmetic data used for the second arithmetic processing from the autonomous moving robot 10, and is configured to be able to transmit a processing result of the second arithmetic processing which the charging dock 20 itself has executed to the autonomous moving robot 10.
According to this embodiment as described above, a part of the arithmetic processing of the autonomous moving robot 10 (the second arithmetic processing) is executed in the charging dock 20. This reduces a processing load of the arithmetic processing unit 130 and thereby prevents the battery 160 from being consumed. Accordingly, the autonomous moving robot 10 can improve an operation efficiency. Further, the autonomous moving robot 10 executes this first arithmetic processing related to the drive of the carriage 111, and communication related to this first arithmetic processing is not performed between the autonomous moving robot 10 and the charging dock 20. This prevents a real-time moving operation of the carriage 111 from being awkward due to a communication amount and a communication speed between the autonomous moving robot 10 and the charging dock 20. Accordingly, a problem in which a moving operation of an autonomous moving robot 10 becomes awkward can be prevented from occurring while an operation efficiency of the autonomous moving robot 10 is prevented from being reduced.
Further, according to this embodiment, since the autonomous moving robot 10 also executes the first arithmetic processing related to the drive of the arm 115, a real-time grasping operation of the arm 115 is prevented from being awkward.
Further, according to this embodiment, in regard to a part of the second arithmetic processing, the charging dock 20 receives arithmetic data and transmits a processing result, through wired communication, when the battery 160 of the autonomous moving robot 10 is being charged, and merely in regard to the remaining second arithmetic processing, the charging dock 20 receives arithmetic data and transmits a processing result, through wireless communication, when the carriage 111 of the autonomous moving robot 10 is moving autonomously.
According to this embodiment as described above, communication according to the part of the second arithmetic processing is performed through wired communication when the charging dock 20 is charging the battery 160. Thus, it is possible to, for example, prevent a wireless communication band from being narrowed by the communication related to the second arithmetic processing, which is an advantage.
Note that the present disclosure is not limited to the above-described embodiments, and can be appropriately changed without departing from the spirit of the present disclosure.
For example, in the above-described embodiments, although the autonomous moving body includes the carriage and the arm as a driven body, the present disclosure is not limited thereto. The autonomous moving body may include at least the carriage, and there is no limitation on whether or not the arm is included. Further, an autonomous moving body may include a driven body other than the arm in addition to the carriage.
Further, in the above-described embodiments, a configuration in which in the case of charging a battery of the autonomous moving body, when charging terminals are connected to each other, communication terminals are also connected to each other, and thus wired communication can be performed has been described, but the present disclosure is not limited to this configuration. The communication terminals may be, for example, manually connected to each other by a user through a cable or the like.
Further, in the above-described embodiments, the autonomous moving body and the charging dock according to the present disclosure have been described as a hardware configuration, but the present disclose is not limited thereto. In the present disclosure, any processing of the autonomous moving body and the charging dock can be achieved by a processor, such as a CPU (Central Processing Unit), loading and executing a computer program stored in a memory.
The program can be stored and provided to a computer using any type of non-transitory computer readable media. Non-transitory computer readable media include any type of tangible storage media. Examples of non-transitory computer readable media include magnetic storage media (such as floppy disks, magnetic tapes, hard disk drives, etc.), optical magnetic storage media (e.g. magneto-optical disks), CD-ROM (compact disc read only memory), CD-R (compact disc recordable), CD-R/W (compact disc rewritable), and semiconductor memories (such as mask ROM, PROM (programmable ROM), EPROM (erasable PROM), flash ROM, RAM (random access memory), etc.). The program may be provided to a computer using any type of transitory computer readable media. Examples of transitory computer readable media include electric signals, optical signals, and electromagnetic waves. Transitory computer readable media can provide the program to a computer via a wired communication line (e.g. electric wires, and optical fibers) or a wireless communication line.
From the disclosure thus described, it will be obvious that the embodiments of the disclosure may be varied in many ways. Such variations are not to be regarded as a departure from the spirit and scope of the disclosure, and all such modifications as would be obvious to one skilled in the art are intended for inclusion within the scope of the following claims.

Claims (8)

What is claimed is:
1. An autonomous moving system, comprising an autonomous moving body and a charging dock, the autonomous moving body comprising: a driven body comprising at least a carriage capable of moving autonomously; and a battery, the charging dock comprising a charger configured to charge the battery, the autonomous moving body further comprising:
a first communication unit configured to be able to communicate with the charging dock; and
a first arithmetic processing unit configured to execute first arithmetic processing related to the drive of the driven body among arithmetic processings of the autonomous moving body,
the charging dock further comprising:
a second communication unit configured to be able to communicate with the autonomous moving body; and
a second arithmetic processing unit configured to execute second arithmetic processing other than the first arithmetic processing among the arithmetic processings of the autonomous moving body, wherein
the second communication unit is configured to be able to receive arithmetic data used for the second arithmetic processing from the first communication unit, and is configured to be able to transmit a processing result of the second arithmetic processing which has been executed by the second arithmetic processing unit to the first communication unit,
the first communication unit and the second communication unit include a wireless communication function and a wired communication function,
in regard to a part of the second arithmetic processing, when the charger is charging the battery, the second communication unit performs at least one of: receiving the arithmetic data used for the part of the second arithmetic processing through wired communication; and transmitting a processing result of the part of the second arithmetic processing, through wired communication,
in regard to the remaining second arithmetic processing, when the carriage is moving autonomously, the second communication unit performs at least one of: receiving the arithmetic data used for the remaining second arithmetic processing; and transmitting a processing result of the remaining second arithmetic processing, through wireless communication,
the driven body comprises an arm provided in the carriage,
the first arithmetic processing is processing for making the carriage move autonomously and processing for making the arm grasp an object,
the part of the second arithmetic processing is processing for machine-learning the object grasped by the arm, and
the remaining second arithmetic processing is processing for estimating the object grasped by the arm based on a result of the machine learning.
2. The autonomous moving system according to claim 1, wherein
in the case where the part of the second arithmetic processing is processing for machine-learning an object,
the second communication unit receives image data for machine learning in which the object grasped by the arm is photographed from the first communication unit through wired communication, and the second arithmetic processing unit machine-learns the object in the image data for machine learning which has been received by the second communication unit, and
in the case where the remaining second arithmetic processing is processing for estimating the object grasped by the arm based on a result of the machine learning,
the second communication unit receives image data for estimation in which the object grasped by the arm is photographed from the first communication unit through wireless communication, the second arithmetic processing unit estimates the object in the image data for estimation which has been received by the second communication unit based on a result of machine learning, and the second communication unit transmits an estimation result of the object which has been estimated by the second arithmetic processing unit to the first communication unit through wireless communication.
3. An autonomous moving body comprising:
a driven body comprising at least a carriage capable of moving autonomously; and
a battery capable of charging at a charging dock,
the autonomous moving body further comprising:
a communication unit capable of communicating with the charging dock; and
an arithmetic processing unit configured to execute first arithmetic processing related to the drive of the driven body among arithmetic processings of the autonomous moving body, wherein
the communication unit is configured to be able to transmit arithmetic data used for second arithmetic processing other than the first arithmetic processing among the arithmetic processings of the autonomous moving body to the charging dock, and is configured to be able to receive a processing result of the second arithmetic processing which has been executed by the charging dock from the charging dock,
the communication unit includes a wireless communication function and a wired communication function,
in regard to a part of the second arithmetic processing, when the charging dock is charging the battery, the communication unit performs at least one of: transmitting the arithmetic data used for the part of the second arithmetic processing through wired communication; and receiving a processing result of the part of the second arithmetic processing, through wired communication,
in regard to the remaining second arithmetic processing, when the carriage is moving autonomously, the communication unit performs at least one of: transmitting the arithmetic data used for the remaining second arithmetic processing; and receiving a processing result of the remaining second arithmetic processing, through wireless communication,
the driven body comprises an arm provided in the carriage,
the first arithmetic processing is processing for making the carriage move autonomously and processing for making the arm grasp an object,
the part of the second arithmetic processing is processing for machine-learning the object grasped by the arm, and
the remaining second arithmetic processing is processing for estimating the object grasped by the arm based on a result of the machine learning.
4. A charging dock comprising a charger configured to charge a battery of an autonomous moving body, the autonomous moving body comprising: a driven body comprising at least a carriage capable of moving autonomously; and the battery,
the charging dock further comprising:
a communication unit capable of communicating with the autonomous moving body; and
an arithmetic processing unit configured to execute second arithmetic processing other than first arithmetic processing related to the drive of the driven body among arithmetic processings of the autonomous moving body, wherein
the communication unit is configured to be able to receive arithmetic data used for the second arithmetic processing from the autonomous moving body, and is configured to be able to transmit a processing result of the second arithmetic processing which has been executed by the arithmetic processing unit to the autonomous moving body,
the communication unit includes a wireless communication function and a wired communication function,
in regard to a part of the second arithmetic processing, when the charger is charging the battery, the communication unit performs at least one of: receiving the arithmetic data used for the part of the second arithmetic processing through wired communication; and transmitting a processing result of the part of the second arithmetic processing, through wired communication,
in regard to the remaining second arithmetic processing, when the carriage is moving autonomously, the communication unit performs at least one of: receiving the arithmetic data used for the remaining second arithmetic processing; and transmitting a processing result of the remaining second arithmetic processing, through wireless communication,
the driven body comprises an arm provided in the carriage,
the first arithmetic processing is processing for making the carriage move autonomously and processing for making the arm grasp an object,
the part of the second arithmetic processing is processing for machine-learning the object grasped by the arm, and
the remaining second arithmetic processing is processing for estimating the object grasped by the arm based on a result of the machine learning.
5. A method for controlling an autonomous moving body, the autonomous moving body comprising: a driven body comprising at least a carriage capable of moving autonomously; and a battery capable of being charged at a charging dock, the method comprising:
configuring the autonomous moving body so as to be capable of executing first arithmetic processing related to the drive of the driven body among arithmetic processings of the autonomous moving body;
configuring the autonomous moving body so as to be capable of transmitting, via a communication unit, arithmetic data used for second arithmetic processing other than the first arithmetic processing among the arithmetic processings of the autonomous moving body to the charging dock; and
configuring the autonomous moving body so as to be capable of receiving a processing result of the second arithmetic processing which has been executed by the charging dock from the charging dock, wherein
the communication unit includes a wireless communication function and a wired communication function,
in regard to a part of the second arithmetic processing, when the charging dock is charging the battery, the communication unit performs at least one of: transmitting the arithmetic data used for the part of the second arithmetic processing through wired communication; and receiving a processing result of the part of the second arithmetic processing, through wired communication,
in regard to the remaining second arithmetic processing, when the carriage is moving autonomously, the communication unit performs at least one of: transmitting the arithmetic data used for the remaining second arithmetic processing; and receiving a processing result of the remaining second arithmetic processing, through wireless communication,
the driven body comprises an arm provided in the carriage,
the first arithmetic processing is processing for making the carriage move autonomously and processing for making the arm grasp an object,
the part of the second arithmetic processing is processing for machine-learning the object grasped by the arm, and
the remaining second arithmetic processing is processing for estimating the object grasped by the arm based on a result of the machine learning.
6. A method for controlling a charging dock, the charging dock comprising a charger configured to charge a battery of an autonomous moving body, the autonomous moving body comprising: a driven body comprising at least a carriage capable of moving autonomously; and the battery, the method comprising:
configuring the charging dock so as to be capable of receiving, via a communication unit, arithmetic data used for second arithmetic processing other than first arithmetic processing related to the drive of the driven body among arithmetic processings of the autonomous moving body from the autonomous moving body;
configuring the charging dock so as to be capable of executing the second arithmetic processing; and
configuring the charging dock so as to be capable of transmitting a processing result of the second arithmetic processing to the autonomous moving body, wherein
the communication unit includes a wireless communication function and a wired communication function,
in regard to a part of the second arithmetic processing, when the charger is charging the battery, the communication unit performs at least one of: receiving the arithmetic data used for the part of the second arithmetic processing through wired communication; and transmitting a processing result of the part of the second arithmetic processing, through wired communication,
in regard to the remaining second arithmetic processing, when the carriage is moving autonomously, the communication unit performs at least one of: receiving the arithmetic data used for the remaining second arithmetic processing; and transmitting a processing result of the remaining second arithmetic processing, through wireless communication,
the driven body comprises an arm provided in the carriage,
the first arithmetic processing is processing for making the carriage move autonomously and processing for making the arm grasp an object,
the part of the second arithmetic processing is processing for machine-learning the object grasped by the arm, and
the remaining second arithmetic processing is processing for estimating the object grasped by the arm based on a result of the machine learning.
7. A non-transitory computer readable medium storing a program causing an autonomous moving body to function as
a communication means capable of communicating with a charging dock; and
an arithmetic processing means for executing first arithmetic processing related to the drive of a driven body among arithmetic processings of the autonomous moving body, the autonomous moving body comprising: the driven body comprising at least a carriage capable of moving autonomously; and a battery capable of charging at the charging dock, wherein
the communication means is configured to be able to transmit arithmetic data used for second arithmetic processing other than the first arithmetic processing among the arithmetic processings of the autonomous moving body, and is configured to be able to receive a processing result of the second arithmetic processing which has been executed by the charging dock from the charging dock,
the communication means includes a wireless communication function and a wired communication function,
in regard to a part of the second arithmetic processing, when the charging dock is charging the battery, the communication means performs at least one of: transmitting the arithmetic data used for the part of the second arithmetic processing through wired communication; and receiving a processing result of the part of the second arithmetic processing, through wired communication,
in regard to the remaining second arithmetic processing, when the carriage is moving autonomously, the communication means performs at least one of: transmitting the arithmetic data used for the remaining second arithmetic processing; and receiving a processing result of the remaining second arithmetic processing, through wireless communication,
the driven body comprises an arm provided in the carriage,
the first arithmetic processing is processing for making the carriage move autonomously and processing for making the arm grasp an object,
the part of the second arithmetic processing is processing for machine-learning the object grasped by the arm, and
the remaining second arithmetic processing is processing for estimating the object grasped by the arm based on a result of the machine learning.
8. A non-transitory computer readable medium storing a program causing a charging dock to function as
a communication means capable of communicating with an autonomous moving body; and
an arithmetic processing means for executing second arithmetic processing other than first arithmetic processing related to the drive of a driven body among arithmetic processings of the autonomous moving body, the charging dock comprising a charger configured to charge a battery of the autonomous moving body, the autonomous moving body comprising: the driven body comprising at least a carriage capable of moving autonomously; and the battery, wherein
the communication means is configured to be able to receive arithmetic data used for the second arithmetic processing from the autonomous moving body, and is configured to be able to transmit a processing result of the second arithmetic processing which has been executed by the arithmetic processing means to the autonomous moving body,
the communication means includes a wireless communication function and a wired communication function,
in regard to a part of the second arithmetic processing, when the charger is charging the battery, the communication means performs at least one of: receiving the arithmetic data used for the part of the second arithmetic processing through wired communication; and transmitting a processing result of the part of the second arithmetic processing, through wired communication,
in regard to the remaining second arithmetic processing, when the carriage is moving autonomously, the communication means performs at least one of: receiving the arithmetic data used for the remaining second arithmetic processing; and transmitting a processing result of the remaining second arithmetic processing, through wireless communication,
the driven body comprises an arm provided in the carriage,
the first arithmetic processing is processing for making the carriage move autonomously and processing for making the arm grasp an object,
the part of the second arithmetic processing is processing for machine-learning the object grasped by the arm, and
the remaining second arithmetic processing is processing for estimating the object grasped by the arm based on a result of the machine learning.
US16/378,679 2018-05-11 2019-04-09 Autonomous moving system, autonomous moving body, charging dock, control method, and program Active 2039-07-31 US11175672B2 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
JPJP2018-092141 2018-05-11
JP2018-092141 2018-05-11
JP2018092141A JP7052546B2 (en) 2018-05-11 2018-05-11 Autonomous mobile systems, autonomous mobiles, charging docks, control methods, and programs

Publications (2)

Publication Number Publication Date
US20190346852A1 US20190346852A1 (en) 2019-11-14
US11175672B2 true US11175672B2 (en) 2021-11-16

Family

ID=66175197

Family Applications (1)

Application Number Title Priority Date Filing Date
US16/378,679 Active 2039-07-31 US11175672B2 (en) 2018-05-11 2019-04-09 Autonomous moving system, autonomous moving body, charging dock, control method, and program

Country Status (4)

Country Link
US (1) US11175672B2 (en)
EP (1) EP3567695B1 (en)
JP (1) JP7052546B2 (en)
CN (1) CN110465916B (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111211813A (en) * 2019-12-23 2020-05-29 塔普翊海(上海)智能科技有限公司 Mobile robot, communication system and communication method of mobile robot
WO2021185805A2 (en) 2020-03-18 2021-09-23 Teknologisk Institut A relocatable robotic system for production facilities
CN111313504A (en) * 2020-03-28 2020-06-19 南京滨德科技有限公司 Multi-head charging system for myofascial gun battery pack and battery charging system

Citations (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4679152A (en) * 1985-02-20 1987-07-07 Heath Company Navigation system and method for a mobile robot
JP4418381B2 (en) 2005-02-23 2010-02-17 三菱重工業株式会社 Charging station for autonomous mobile robot
JP5070441B2 (en) 2007-10-10 2012-11-14 株式会社国際電気通信基礎技術研究所 Robot remote control system
US20140277718A1 (en) * 2013-03-15 2014-09-18 Eugene Izhikevich Adaptive predictor apparatus and methods
US20140371907A1 (en) * 2013-06-14 2014-12-18 Brain Corporation Robotic training apparatus and methods
US8977393B1 (en) * 2012-09-12 2015-03-10 Google Inc. Methods and systems for charging a robotic device
US20150202974A1 (en) 2012-07-21 2015-07-23 Audi Ag Method for operating a charging station
US20150321570A1 (en) 2014-05-08 2015-11-12 Honda Motor Co., Ltd. Electric vehicle charging control system
US20160250752A1 (en) * 2015-02-27 2016-09-01 Toyota Motor Engineering & Manufacturing North America, Inc. Modular robot with smart device
US20170066128A1 (en) * 2015-09-04 2017-03-09 Kindred Systems Inc. Systems, devices, and methods for self-preservation of robotic apparatus
US9717387B1 (en) * 2015-02-26 2017-08-01 Brain Corporation Apparatus and methods for programming and training of robotic household appliances
JP2017174359A (en) 2016-03-25 2017-09-28 株式会社デンソーウェーブ Information management system
JP2017185578A (en) 2016-04-05 2017-10-12 株式会社リコー Object gripping device and gripping control program
US9827678B1 (en) * 2016-05-16 2017-11-28 X Development Llc Kinematic design for robotic arm
US9827677B1 (en) * 2016-05-16 2017-11-28 X Development Llc Robotic device with coordinated sweeping tool and shovel tool
CN207051978U (en) 2017-06-12 2018-02-27 炬大科技有限公司 A kind of system for reaching indoor task object position determination by image recognition mode
US10089586B2 (en) * 2012-02-08 2018-10-02 Omron Adept Technologies, Inc. Job management system for a fleet of autonomous mobile robots
US20190291277A1 (en) * 2017-07-25 2019-09-26 Mbl Limited Systems and methods for operating a robotic system and executing robotic interactions

Family Cites Families (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7376487B2 (en) * 2003-11-25 2008-05-20 International Business Machines Corporation Nesting negotiation for self-mobile devices
JP4460411B2 (en) * 2004-10-01 2010-05-12 本田技研工業株式会社 Robot controller
JP2007043785A (en) * 2005-08-01 2007-02-15 Hideo Imagawa Portable equipment charging apparatus using solar cell
ES2623920T3 (en) * 2005-12-02 2017-07-12 Irobot Corporation Robot system
JP4772756B2 (en) * 2007-06-29 2011-09-14 オリンパス株式会社 Imaging apparatus and imaging program
JP4818997B2 (en) * 2007-06-29 2011-11-16 オリンパス株式会社 Face detection device and face detection program
US7926438B2 (en) * 2007-11-05 2011-04-19 Schlumberger Technology Corporation Subsea operations support system
JP2013027249A (en) * 2011-07-25 2013-02-04 Nec Casio Mobile Communications Ltd Portable terminal, portable terminal charging system, portable terminal charging method, and program
JP5954951B2 (en) * 2011-09-02 2016-07-20 株式会社構造計画研究所 Building safety monitoring system
CN104010872B (en) * 2011-10-20 2016-10-26 Ls产电株式会社 Electric motor car and the method handling this electric motor car
JP6459847B2 (en) * 2015-08-20 2019-01-30 トヨタ自動車株式会社 Charge control device
JP6604832B2 (en) * 2015-12-02 2019-11-13 池上通信機株式会社 Machine learning support device
JP6707733B2 (en) * 2015-12-25 2020-06-10 シャダイ株式会社 Mobile platform system
JP2017184353A (en) * 2016-03-29 2017-10-05 株式会社豊田自動織機 Charging device and charging method
CN205751277U (en) * 2016-05-18 2016-11-30 深圳市菁创未来科技有限公司 Unmanned plane automatic lifting stick management station and unmanned plane automatic lifting stick management system
JP2017205324A (en) * 2016-05-19 2017-11-24 パナソニックIpマネジメント株式会社 robot
JP6565869B2 (en) * 2016-11-08 2019-08-28 トヨタ自動車株式会社 Autonomous mobile body and control program for autonomous mobile body
CN106695741B (en) * 2017-02-10 2019-11-29 中国东方电气集团有限公司 A kind of method of mobile-robot system state-detection and initial work
CN107030703A (en) * 2017-06-09 2017-08-11 上海岭先机器人科技股份有限公司 A kind of mobile-robot system

Patent Citations (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4679152A (en) * 1985-02-20 1987-07-07 Heath Company Navigation system and method for a mobile robot
JP4418381B2 (en) 2005-02-23 2010-02-17 三菱重工業株式会社 Charging station for autonomous mobile robot
JP5070441B2 (en) 2007-10-10 2012-11-14 株式会社国際電気通信基礎技術研究所 Robot remote control system
US10089586B2 (en) * 2012-02-08 2018-10-02 Omron Adept Technologies, Inc. Job management system for a fleet of autonomous mobile robots
US20150202974A1 (en) 2012-07-21 2015-07-23 Audi Ag Method for operating a charging station
US8977393B1 (en) * 2012-09-12 2015-03-10 Google Inc. Methods and systems for charging a robotic device
US20140277718A1 (en) * 2013-03-15 2014-09-18 Eugene Izhikevich Adaptive predictor apparatus and methods
US20140371907A1 (en) * 2013-06-14 2014-12-18 Brain Corporation Robotic training apparatus and methods
US20150321570A1 (en) 2014-05-08 2015-11-12 Honda Motor Co., Ltd. Electric vehicle charging control system
US9717387B1 (en) * 2015-02-26 2017-08-01 Brain Corporation Apparatus and methods for programming and training of robotic household appliances
US20160250752A1 (en) * 2015-02-27 2016-09-01 Toyota Motor Engineering & Manufacturing North America, Inc. Modular robot with smart device
US20170066128A1 (en) * 2015-09-04 2017-03-09 Kindred Systems Inc. Systems, devices, and methods for self-preservation of robotic apparatus
JP2017174359A (en) 2016-03-25 2017-09-28 株式会社デンソーウェーブ Information management system
JP2017185578A (en) 2016-04-05 2017-10-12 株式会社リコー Object gripping device and gripping control program
US9827678B1 (en) * 2016-05-16 2017-11-28 X Development Llc Kinematic design for robotic arm
US9827677B1 (en) * 2016-05-16 2017-11-28 X Development Llc Robotic device with coordinated sweeping tool and shovel tool
CN207051978U (en) 2017-06-12 2018-02-27 炬大科技有限公司 A kind of system for reaching indoor task object position determination by image recognition mode
US20190291277A1 (en) * 2017-07-25 2019-09-26 Mbl Limited Systems and methods for operating a robotic system and executing robotic interactions

Also Published As

Publication number Publication date
JP7052546B2 (en) 2022-04-12
CN110465916B (en) 2022-10-25
JP2019197471A (en) 2019-11-14
CN110465916A (en) 2019-11-19
EP3567695A1 (en) 2019-11-13
EP3567695B1 (en) 2021-05-26
US20190346852A1 (en) 2019-11-14

Similar Documents

Publication Publication Date Title
US11175672B2 (en) Autonomous moving system, autonomous moving body, charging dock, control method, and program
US10476581B2 (en) Extending wireless signal coverage with drones
JP6328628B2 (en) Self-optimized power transfer
US9954992B2 (en) Mobile device enabled robotic system
JP2019087073A (en) Portable type manipulator, control method of portable type manipulator and program
US11498427B2 (en) Transporting robot and method for operating the same, system for controlling the transporting robot
US20220214692A1 (en) VIsion-Based Robot Navigation By Coupling Deep Reinforcement Learning And A Path Planning Algorithm
US20210094431A1 (en) Apparatus and method for automatically charging a vehicle
US20210107152A1 (en) Autonomous machine collaboration
US9821461B1 (en) Determining a trajectory for a walking robot to prevent motor overheating
EP3549422A1 (en) Work system and work method
US20210276712A1 (en) Flying body system equipped with plurality of connectable flying bodies
CN110275519B (en) Position estimation system, position detection method, and program
US20190384307A1 (en) Autonomous moving body and control program for autonomous moving body
KR101144102B1 (en) Charging System and Method for Mobile Robot
KR20210021169A (en) Charging system for robot and control method thereof
US20230341873A1 (en) Multi-Robot Control System and Method
CN117500642A (en) System, apparatus and method for exploiting robot autonomy
WO2019173918A1 (en) System and method for configuring and servicing a robotic host platform
EP4013579B1 (en) Robot and method for controlling thereof
US20220255318A1 (en) Power supply system and power supply device
JP2008131807A (en) Charging system for vehicle and charger for use therein
US11960277B2 (en) Unmanned vehicle controlling system and method, and nontransitory computer-readable medium
CN114800505A (en) Robot operation control method and device
EP3827936B1 (en) Control method for robot system

Legal Events

Date Code Title Description
AS Assignment

Owner name: TOYOTA JIDOSHA KABUSHIKI KAISHA, JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:ITOZAWA, YUTA;REEL/FRAME:048827/0685

Effective date: 20190329

FEPP Fee payment procedure

Free format text: ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

STPP Information on status: patent application and granting procedure in general

Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: FINAL REJECTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE AFTER FINAL ACTION FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: NOTICE OF ALLOWANCE MAILED -- APPLICATION RECEIVED IN OFFICE OF PUBLICATIONS

STPP Information on status: patent application and granting procedure in general

Free format text: AWAITING TC RESP, ISSUE FEE PAYMENT VERIFIED

STPP Information on status: patent application and granting procedure in general

Free format text: PUBLICATIONS -- ISSUE FEE PAYMENT VERIFIED

STCF Information on status: patent grant

Free format text: PATENTED CASE