WO2022017341A1 - 自动回充方法、装置、存储介质、充电基座及系统 - Google Patents
自动回充方法、装置、存储介质、充电基座及系统 Download PDFInfo
- Publication number
- WO2022017341A1 WO2022017341A1 PCT/CN2021/107229 CN2021107229W WO2022017341A1 WO 2022017341 A1 WO2022017341 A1 WO 2022017341A1 CN 2021107229 W CN2021107229 W CN 2021107229W WO 2022017341 A1 WO2022017341 A1 WO 2022017341A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- automatic recharging
- image
- distance
- feature
- charging
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 61
- 239000003550 marker Substances 0.000 claims description 31
- 238000009434 installation Methods 0.000 claims description 12
- 238000010586 diagram Methods 0.000 description 15
- 238000012545 processing Methods 0.000 description 7
- 230000002093 peripheral effect Effects 0.000 description 6
- 230000006870 function Effects 0.000 description 4
- 238000013473 artificial intelligence Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000010408 sweeping Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 238000010801 machine learning Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000009877 rendering Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
- G05D1/12—Target-seeking control
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
- G05D1/02—Control of position or course in two dimensions
- G05D1/021—Control of position or course in two dimensions specially adapted to land vehicles
- G05D1/0212—Control of position or course in two dimensions specially adapted to land vehicles with means for defining a desired trajectory
- G05D1/0225—Control of position or course in two dimensions specially adapted to land vehicles with means for defining a desired trajectory involving docking at a fixed facility, e.g. base station or loading bay
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60L—PROPULSION OF ELECTRICALLY-PROPELLED VEHICLES; SUPPLYING ELECTRIC POWER FOR AUXILIARY EQUIPMENT OF ELECTRICALLY-PROPELLED VEHICLES; ELECTRODYNAMIC BRAKE SYSTEMS FOR VEHICLES IN GENERAL; MAGNETIC SUSPENSION OR LEVITATION FOR VEHICLES; MONITORING OPERATING VARIABLES OF ELECTRICALLY-PROPELLED VEHICLES; ELECTRIC SAFETY DEVICES FOR ELECTRICALLY-PROPELLED VEHICLES
- B60L53/00—Methods of charging batteries, specially adapted for electric vehicles; Charging stations or on-board charging equipment therefor; Exchange of energy storage elements in electric vehicles
- B60L53/30—Constructional details of charging stations
- B60L53/35—Means for automatic or assisted adjustment of the relative position of charging devices and vehicles
- B60L53/37—Means for automatic or assisted adjustment of the relative position of charging devices and vehicles using optical position determination, e.g. using cameras
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
- G05D1/02—Control of position or course in two dimensions
- G05D1/021—Control of position or course in two dimensions specially adapted to land vehicles
- G05D1/0231—Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means
- G05D1/0234—Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means using optical markers or beacons
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/70—Determining position or orientation of objects or cameras
- G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60L—PROPULSION OF ELECTRICALLY-PROPELLED VEHICLES; SUPPLYING ELECTRIC POWER FOR AUXILIARY EQUIPMENT OF ELECTRICALLY-PROPELLED VEHICLES; ELECTRODYNAMIC BRAKE SYSTEMS FOR VEHICLES IN GENERAL; MAGNETIC SUSPENSION OR LEVITATION FOR VEHICLES; MONITORING OPERATING VARIABLES OF ELECTRICALLY-PROPELLED VEHICLES; ELECTRIC SAFETY DEVICES FOR ELECTRICALLY-PROPELLED VEHICLES
- B60L2200/00—Type of vehicles
- B60L2200/40—Working vehicles
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W60/00—Drive control systems specially adapted for autonomous road vehicles
- B60W60/001—Planning or execution of driving tasks
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
- G05D1/02—Control of position or course in two dimensions
- G05D1/021—Control of position or course in two dimensions specially adapted to land vehicles
- G05D1/0231—Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means
- G05D1/0246—Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means using a video camera in combination with image processing means
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
- G05D1/20—Control system inputs
- G05D1/22—Command input arrangements
- G05D1/221—Remote-control arrangements
- G05D1/222—Remote-control arrangements operated by humans
- G05D1/224—Output arrangements on the remote controller, e.g. displays, haptics or speakers
- G05D1/2244—Optic
- G05D1/2247—Optic providing the operator with simple or augmented images from one or more cameras
- G05D1/2248—Optic providing the operator with simple or augmented images from one or more cameras the one or more cameras located remotely from the vehicle
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
- G05D1/60—Intended control result
- G05D1/656—Interaction with payloads or external entities
- G05D1/661—Docking at a base station
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02T—CLIMATE CHANGE MITIGATION TECHNOLOGIES RELATED TO TRANSPORTATION
- Y02T10/00—Road transport of goods or passengers
- Y02T10/60—Other road transportation technologies with climate change mitigation effect
- Y02T10/70—Energy storage systems for electromobility, e.g. batteries
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02T—CLIMATE CHANGE MITIGATION TECHNOLOGIES RELATED TO TRANSPORTATION
- Y02T10/00—Road transport of goods or passengers
- Y02T10/60—Other road transportation technologies with climate change mitigation effect
- Y02T10/7072—Electromobility specific charging systems or methods for batteries, ultracapacitors, supercapacitors or double-layer capacitors
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02T—CLIMATE CHANGE MITIGATION TECHNOLOGIES RELATED TO TRANSPORTATION
- Y02T90/00—Enabling technologies or technologies with a potential or indirect contribution to GHG emissions mitigation
- Y02T90/10—Technologies relating to charging of electric vehicles
- Y02T90/12—Electric charging stations
Definitions
- the present application relates to an automatic recharging method, device and storage medium, belonging to the technical field of computers.
- self-mobile devices such as sweeping robots, smart lawn mowers, etc.
- the self-moving device needs to determine the location of the charging base.
- the method of determining the position of the charging base from the mobile device includes: continuously sending a signal through the charging base, and after receiving the signal from the mobile device, determining the position of the charging base based on the signal.
- the signals emitted by the charging base include infrared signals, ultrasonic signals, lidar signals, etc.
- the above-mentioned signals are easily interfered by environmental factors.
- the self-mobile device may not be able to find the charging base.
- the present application provides an automatic recharging method, device, storage medium, charging base and system, which can solve the problem that the automatic recharging device cannot find the charging base when the position of the charging base is located based on a signal.
- This application provides the following technical solutions:
- an automatic recharging method which is used in an automatic recharging device, wherein the automatic recharging device is installed with an image acquisition component, and the method includes:
- the relative positional relationship between the charging surface of the charging base and the automatic recharging device is determined based on the position of the feature marker in the automatic recharging image;
- the feature The logo is arranged on the charging base and displayed on the charging surface of the charging base;
- the charging base is used for charging the automatic recharging device;
- the moving direction of the automatic recharging device is determined based on the relative positional relationship, so that the automatic recharging device moves toward the charging surface of the charging base.
- the number of the feature identifiers is at least one; the relative positional relationship between the charging surface of the charging base and the automatic recharging device is determined based on the position of the feature identifier in the automatic recharging image ,include:
- a distance and an angle between the charging surface and the automatic recharging device are determined based on the position of the feature marker in the automatic recharging image and the installation position.
- the number of the feature identifiers is at least two, and the method further includes:
- the automatic recharging image includes the at least two feature identifiers
- triggering the execution of determining the charging surface of the charging base and the automatic recharging based on the position of the feature identifiers in the automatic recharging image The steps of the relative positional relationship of the device.
- the number of the feature identifiers is at least two, and the charging surface and the automatic recharging device are determined based on the position of the feature identifier in the automatic recharging image and the installation position. distances and angles between, including:
- the image distance in the second direction Based on the distance in the first direction, the image distance in the second direction, and the focal length of the image acquisition component, calculate the distance between the image acquisition component and the feature identifier in parallel with the ground and perpendicular to the travel direction the second direction distance in the direction;
- the angle between the charging surface and the automatic recharging device is determined based on the distance in the first direction of each feature identification and the distance in the second direction of each feature identification.
- the display positions of the at least two feature marks displayed through the charging surface have the same or different heights relative to the ground; and/or, the display positions of the at least two feature marks displayed through the charging surface are centrally symmetric.
- the starting the image acquisition component to collect the automatic recharging image during the automatic recharging process includes:
- an automatic recharging device which is used in the automatic recharging device, wherein the automatic recharging device is installed with an image acquisition component, and the device includes:
- an image acquisition module used to start the image acquisition component to acquire an automatic recharge image during the automatic recharge process
- a position determination module configured to determine the relative relationship between the charging surface of the charging base and the automatic recharging device based on the position of the feature identification in the automatic recharging image when the automatic recharging image includes a feature identification the positional relationship; the feature identification is arranged on the charging base and displayed on the charging surface of the charging base; the charging base is used for charging the automatic recharging device;
- the movement control module is configured to determine the movement direction of the automatic recharging device based on the relative positional relationship, so as to move the automatic recharging device to the charging surface of the charging base.
- an automatic recharging device in a third aspect, includes a processor and a memory; a program is stored in the memory, and the program is loaded and executed by the processor to realize the automatic recharging described in the first aspect. charging method.
- a computer-readable storage medium is provided, and a program is stored in the storage medium, and the program is loaded and executed by the processor to implement the automatic recharging method described in the first aspect.
- a charging base is provided, wherein the charging base is provided with a characteristic identifier, so that the automatic recharging device can start an image acquisition component to collect an automatic recharging image including the characteristic identifier during the automatic recharging process;
- the position of the feature identifier in the automatic recharging image determines the relative positional relationship between the charging base and the automatic recharging device; and the relative positional relationship between the automatic recharging device and the charging base is determined based on the relative positional relationship. direction of movement.
- an automatic recharging system comprising an automatic recharging device and a charging base;
- the automatic recharging device includes the automatic recharging device provided in the second aspect or the third aspect;
- the charging base includes the charging base provided in the fifth aspect.
- the automatic recharging image is collected by starting the image acquisition component during the automatic recharging process; when the automatic recharging image includes the feature identification, the charging base is determined based on the position of the feature identification in the automatic recharging image The relative positional relationship between the charging surface and the automatic recharging device; the feature identification is displayed through the charging surface of the charging base; the moving direction of the automatic recharging device is determined based on the relative positional relationship, so that the automatic recharging device can be charged to the charging base.
- the automatic recharging device cannot find the charging base when locating the position of the charging base based on the signal; because the characteristic mark is set on the charging surface of the charging base, the automatic recharging device recognizes the characteristic mark Determining the relative positional relationship with the charging surface can ensure that the automatic recharging device can find the charging base, and at the same time, it can ensure that the automatic recharging device can determine the charging surface of the charging base, and improve the movement determined by the automatic recharging device. Orientation accuracy.
- FIG. 1 is a schematic structural diagram of an automatic recharging system provided by an embodiment of the present application.
- FIG. 2 is a structural diagram of a charging base provided by an embodiment of the present application.
- FIG. 3 is a flowchart of an automatic recharging method provided by an embodiment of the present application.
- FIG. 4 is a schematic diagram of a relative positional relationship between a charging surface and an automatic recharging device provided by an embodiment of the present application;
- FIG. 5 is a schematic diagram of a relative positional relationship between a charging surface and an automatic recharging device provided by another embodiment of the present application;
- FIG. 6 is a schematic diagram of a relative positional relationship between a charging surface and an automatic recharging device provided by another embodiment of the present application.
- FIG. 7 is a schematic diagram of a relative positional relationship between a charging surface and an automatic recharging device provided by another embodiment of the present application.
- FIG. 8 is a block diagram of an automatic recharging device provided by an embodiment of the present application.
- FIG. 9 is a block diagram of an automatic recharging device provided by an embodiment of the present application.
- FIG. 1 is a schematic structural diagram of an automatic recharging system provided by an embodiment of the present application. As shown in FIG. 1 , the system at least includes: an automatic recharging device 110 and a charging base 120 .
- the automatic recharging device 110 refers to a device having the function of automatically finding a charging base.
- the automatic recharging device 110 is also called a self-moving device, a self-moving robot, etc. This embodiment does not limit the name of the automatic recharging device 110 .
- the automatic recharging device 110 includes, but is not limited to, a sweeping robot, an Automated Guided Vehicle (AGV), an intelligent lawn mower, etc. This embodiment does not limit the device type of the automatic recharging device 110 .
- the charging base 120 is used for charging the automatic recharging device 110 .
- the charging base 120 may charge the automatic recharging device 110 based on a wired charging technology or a wireless charging technology.
- an image capturing component 130 is installed on the automatic recharging device 110 , and the automatic recharging device 110 is connected in communication with the image capturing component 130 .
- Characteristic marks are provided on the charging base 120 and displayed through the charging surface of the charging base 120 .
- the charging surface refers to the surface of the charging base 120 that supplies power to the automatic recharging device 110 .
- the feature identifier can be installed on the charging surface; or, it can be installed inside the charging base 120, but can be displayed through the charging surface and captured by the image acquisition component 130 (for example: the feature identifier is a light-emitting element, the light-emitting element is set inside the charging base 120, and the emitted light is emitted through the charging surface).
- the feature identifier is used to identify the charging surface of the charging base 120 .
- the feature identification is represented by a visual means such as an optical signal (a visible light signal emitted by an LED or the like) or a preset pattern, and this embodiment does not limit the implementation of the feature identification.
- the number of feature identifiers is at least two. Referring to the charging base 120 shown in FIG. 2 , two feature marks 22 are provided on the charging surface 21 .
- the display positions of the at least two feature marks displayed through the charging surface have the same or different heights relative to the ground; and/or, the display positions of the at least two feature marks displayed through the charging surface are centrally symmetric.
- the display positions of the two feature marks 22 on the charging surface have the same height relative to the ground, and are centrally symmetrical on the charging surface.
- the automatic recharging device 110 is used to start the image capturing component 130 to capture the automatic recharging image during the automatic recharging process.
- the image capturing component 130 is configured to capture an automatic recharging image under the control of the automatic recharging device 110 , and send the automatic recharging image to the automatic recharging device 110 .
- the automatic recharging device 110 is further configured to determine the charging surface of the charging base and the automatic recharging based on the position of the feature marking in the automatic recharging image when the automatic recharging image includes the feature identifier after the automatic recharging image is obtained.
- the relative positional relationship of the device; the moving direction of the automatic recharging device is determined based on the relative positional relationship, so that the automatic recharging device 110 moves to the charging surface of the charging base 120 .
- the automatic recharging device 110 by setting a characteristic mark on the charging surface of the charging base 120, the automatic recharging device 110 recognizes the characteristic mark to determine the relative positional relationship with the charging surface, which can ensure the automatic recharging device 110 can determine the charging surface of the charging base 120 to improve the accuracy of the movement direction determined by the automatic recharging device 110 .
- FIG. 3 is a flowchart of an automatic recharging method provided by an embodiment of the present application.
- the method is applied to the automatic recharging system shown in FIG. 1 , and the execution subject of each step is the automatic recharging system in the system.
- the charging device 110 is taken as an example for description. The method includes at least the following steps:
- Step 301 in the automatic recharging process, start the image acquisition component to collect the automatic recharging image.
- the automatic recharging process refers to the process that the automatic recharging device finds the charging base.
- the automatic recharging device starts the image capturing component to collect the automatic recharging image when the power of the automatic recharging device is lower than the preset power value; or, when receiving the charging instruction, starts the image capturing component to collect the automatic recharging. image.
- the automatic recharging device may also determine the timing of starting the automatic recharging process in other ways, and this embodiment does not limit the manner in which the automatic recharging device determines the timing of starting the automatic recharging process.
- Step 302 when the automatic recharging image includes the feature identifier, determine the relative positional relationship between the charging surface of the charging base and the automatic recharging device based on the position of the feature marker in the automatic recharging image.
- the feature identification is arranged on the charging base and displayed on the charging surface of the charging base; the charging base is used for charging the automatic recharging device.
- the automatic recharging device determines the distance and angle between the charging surface and the automatic recharging device based on the position and installation position of the feature marker in the automatic recharging image.
- the number of feature identifiers is at least two.
- the automatic recharging device determines the first vertical distance between the image acquisition component and the feature marker in the direction perpendicular to the ground based on the installation position of the feature marker; The second vertical distance of the image center point of the filled image in the direction perpendicular to the ground; based on the first vertical distance, the second vertical distance, and the focal length of the image acquisition component, calculate the travel direction of the image acquisition component and the feature identifier distance in the first direction; the image distance in the second direction between the image position of the acquired feature identification and the image center point of the automatic recharge image in the direction parallel to the ground; based on the distance in the first direction, the image distance in the second direction and the image acquisition The focal length of the component, calculate the second direction distance between the image acquisition component and the feature mark in the direction parallel to the ground and perpendicular to the direction of travel; based on the first direction distance of each feature mark, the second direction distance of each feature mark , to determine
- the automatic recharging device pre-stores the height H1 of the image acquisition component relative to the ground, and the height H2 of each feature identifier relative to the ground (or storing the height H2 of each feature identifier relative to the bottom of the charging surface) and the distance between the bottom of the charging surface and the ground to obtain H2); based on the difference between H1 and H2, the first vertical distance between the image acquisition component and the feature marker in the direction perpendicular to the ground can be obtained.
- the direction perpendicular to the ground may also be referred to as the height direction, the z direction, etc. This embodiment does not limit the name of the direction perpendicular to the ground.
- the second vertical distance is the distance on the automatic recharging image after the first vertical distance is imaged by the image acquisition component.
- the focal length of the image acquisition component is pre-stored in the automatic recharging device; because the triangle formed by the focal length of the image acquisition component and the distance in the second vertical direction is similar to the distance in the first direction and the distance in the first vertical direction Therefore, based on the triangle similarity principle, the distance in the first direction can be calculated based on the distance in the first vertical direction, the distance in the second vertical direction, and the focal length of the image acquisition component.
- the traveling direction may also be referred to as the horizontal acquisition direction of the image acquisition component, the y direction, etc., and the name of the traveling direction is not limited in this embodiment.
- the image distance in the second direction is the distance in the automatic recharge image after the second direction distance is imaged by the image acquisition component.
- the triangle formed by the focal length of the image acquisition component and the image distance in the second direction is similar to the triangle formed by the distance in the first direction and the distance in the second direction, therefore, based on the triangle similarity principle, the The distance in the first direction, the image distance in the second direction and the focal length of the image acquisition component are used to calculate the distance in the second direction.
- the direction horizontal to the ground and perpendicular to the traveling direction may also be referred to as the height direction, the x direction, etc.
- This embodiment does not limit the name of the direction perpendicular to the ground.
- ⁇ is the angle between the charging surface and the automatic recharging device, and for any two of the multiple feature markers, X1 is the distance between any feature marker and the central axis of the charging surface, and L1 is the feature.
- the first direction distance of the mark, S1 is the second direction distance of the characteristic mark;
- X2 is the distance between another characteristic mark and the central axis of the charging surface,
- L2 is the first direction distance of another characteristic mark, and S2 is another characteristic mark.
- a distance in the second direction of the feature identification; L is the distance in the first direction between the charging surface and the automatic recharging device;
- S is the distance in the second direction between the charging surface and the automatic recharging device.
- ⁇ is the angle between the charging surface and the automatic recharging device
- L is the first direction distance between the charging surface and the automatic recharging device
- S is the second direction distance between the charging surface and the automatic recharging device.
- the display position of the feature identification 43 displayed by the charging surface 41 is centrally symmetric, and at this time, L is approximately the average value of the first direction distance from the image capturing component to each feature identification; S is approximately the distance between the image capturing assembly and each feature identification. The average value of the distance in the second direction.
- L1 is the first directional distance between the image acquisition component and the feature identifier 51
- L2 is the first directional distance between the image acquisition component and the feature identifier 52
- S1 is the second distance between the image acquisition component and the feature identifier 51 directional distance
- S2 is the second directional distance between the image acquisition component and the feature identifier 52 .
- the first vertical distance H between the image capture assembly and the feature marker 51 (that is, the distance H in the direction perpendicular to the ground) can be determined. distance).
- the automatic charging device can determine, from the automatic recharging image, the second vertical distance ⁇ H between the image position of the feature marker 51 and the image center point of the automatic recharging image (that is, in the direction perpendicular to the ground of the image acquisition frame) . If the focal length f of the image acquisition component is known, the following formula can be obtained based on the triangle similarity principle.
- the automatic recharging device determines whether the automatic recharging image includes at least two feature identifiers; this step is performed when the automatic recharging image includes at least two feature identifiers; When the charging image does not include at least two feature identifiers, step 301 is performed again.
- the number of signatures is at least one.
- the automatic refilling image includes a feature identifier
- the second vertical distance between the feature identifier and the image center point of the automatic recharging image, and the image Acquire the focal length of the component and calculate the distance in the first direction between the image acquisition component and the feature marker; obtain the image distance in the second direction between the image position of the feature marker and the image center point of the automatic recharge image in a direction parallel to the ground;
- Based on the distance in the first direction, the image distance in the second direction, and the focal length of the image acquisition component calculate the distance in the second direction between the image acquisition component and the feature marker in a direction parallel to the ground and perpendicular to the direction of travel; according to the distance in the first direction and the The distance in the second direction determines the initial angle between the charging surface and the automatic recharging device; control the self-moving device to rotate according to the initial angle, and move according
- the automatic recharging device detects whether the automatic recharging image includes the obstacle image; when the automatic recharging image includes the obstacle image, the automatic recharging device is controlled. Bypass the obstacle corresponding to the obstacle image; perform step 301 again.
- Step 303 Determine the moving direction of the automatic recharging device based on the relative positional relationship, so that the automatic recharging device moves toward the charging surface of the charging base.
- the image acquisition component is activated to collect the automatic recharging image during the automatic recharging process; when the automatic recharging image includes a feature identifier, the automatic recharging image is automatically recharged based on the feature identifier.
- the feature identification is displayed on the charging surface of the charging base, and the charging base is used to charge the automatic recharging device; determined based on the relative positional relationship
- the moving direction of the automatic recharging device so that the automatic recharging device moves to the charging surface of the charging base; it can solve the problem that the automatic recharging device cannot find the charging base when locating the position of the charging base based on the signal;
- the automatic recharging device recognizes the characteristic mark to determine the relative positional relationship with the charging surface, which can ensure that the automatic recharging device can find the charging base, and at the same time can ensure the automatic recharging
- the device can determine the charging surface of the charging base, thereby improving the accuracy of the moving direction determined by the automatic recharging device.
- FIG. 8 is a block diagram of an automatic recharging device provided by an embodiment of the present application. This embodiment is described by taking the device applied to the automatic recharging device 110 in the automatic recharging system shown in FIG. 1 as an example.
- the device includes at least the following modules: an image acquisition module 810 , a position determination module 820 and a movement control module 830 .
- an image acquisition module 810 configured to start the image acquisition component to acquire an automatic recharge image during the automatic recharge process
- the position determination module 820 is configured to, when the automatic recharging image includes a feature identifier, determine the relationship between the charging surface of the charging base and the automatic recharging device based on the position of the feature identifier in the automatic recharging image. relative positional relationship; the feature identification is arranged on the charging surface of the charging base, and displayed through the charging surface of the charging base; the charging base is used for charging the automatic recharging device;
- the movement control module 830 is configured to determine the movement direction of the automatic recharging device based on the relative positional relationship, so as to move the automatic recharging device to the charging surface of the charging base.
- the automatic recharging device provided in the above embodiment performs automatic recharging
- only the division of the above functional modules is used as an example for illustration. In practical applications, the above functions can be assigned to different functions as required.
- the module is completed, that is, the internal structure of the automatic recharging device is divided into different functional modules, so as to complete all or part of the functions described above.
- the automatic recharging device and the automatic recharging method embodiments provided by the above embodiments belong to the same concept, and the specific implementation process thereof is detailed in the method embodiments, which will not be repeated here.
- FIG. 9 is a block diagram of an automatic recharging device provided by an embodiment of the present application, and the device may be the automatic recharging device 110 in the automatic recharging system shown in FIG. 1 .
- the apparatus includes at least a processor 901 and a memory 902 .
- the processor 901 may include one or more processing cores, such as a 4-core processor, an 8-core processor, and the like.
- the processor 901 can use DSP (Digital Signal Processing, digital signal processing), FPGA (Field-Programmable Gate Array, field programmable gate array), PLA
- the processor 901 may also include a main processor and a co-processor.
- the main processor is a processor used to process data in the wake-up state, also called CPU (Central Processing Unit, central processing unit); the co-processor is A low-power processor for processing data in a standby state.
- the processor 901 may be integrated with a GPU (Graphics Processing Unit, image processor), and the GPU is used for rendering and drawing the content that needs to be displayed on the display screen.
- the processor 901 may further include an AI (Artificial Intelligence, artificial intelligence) processor, where the AI processor is used to process computing operations related to machine learning.
- AI Artificial Intelligence, artificial intelligence
- Memory 902 may include one or more computer-readable storage media, which may be non-transitory. Memory 902 may also include high-speed random access memory, as well as non-volatile memory, such as one or more disk storage devices, flash storage devices. In some embodiments, the non-transitory computer-readable storage medium in the memory 902 is used for storing at least one instruction, and the at least one instruction is used for being executed by the processor 901 to realize the automatic return provided by the method embodiments in this application. charging method.
- the automatic recharging device may optionally further include: a peripheral device interface and at least one peripheral device.
- the processor 901, the memory 902 and the peripheral device interface can be connected through a bus or a signal line.
- Each peripheral device can be connected to the peripheral device interface through bus, signal line or circuit board.
- peripheral devices include, but are not limited to, radio frequency circuits, touch screen displays, audio circuits, and power supplies.
- the automatic recharging device may also include fewer or more components, which is not limited in this embodiment.
- the present application further provides a computer-readable storage medium, where a program is stored in the computer-readable storage medium, and the program is loaded and executed by a processor to implement the automatic recharging method of the foregoing method embodiment.
- the present application further provides a computer product, the computer product includes a computer-readable storage medium, and a program is stored in the computer-readable storage medium, and the program is loaded and executed by a processor to implement the above method embodiments automatic recharge method.
- the present application also provides a charging base, the charging base is provided with a feature identification, for the automatic recharging device to start the image acquisition component during the automatic recharging process to collect an automatic recharging image including the feature identification; based on the feature identification
- the position in the automatic recharging image determines the relative positional relationship between the charging base and the automatic recharging device; the moving direction of the automatic recharging device to the charging base is determined based on the relative positional relationship.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Automation & Control Theory (AREA)
- Transportation (AREA)
- Mechanical Engineering (AREA)
- Remote Sensing (AREA)
- Aviation & Aerospace Engineering (AREA)
- Radar, Positioning & Navigation (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Power Engineering (AREA)
- Theoretical Computer Science (AREA)
- Electromagnetism (AREA)
- Human Computer Interaction (AREA)
- Charge And Discharge Circuits For Batteries Or The Like (AREA)
- Control Of Position, Course, Altitude, Or Attitude Of Moving Bodies (AREA)
- Multimedia (AREA)
- Control Of Charge By Means Of Generators (AREA)
- Preliminary Treatment Of Fibers (AREA)
Abstract
Description
Claims (10)
- 一种自动回充方法,其特征在于,用于自动回充装置中,所述自动回充装置安装有图像采集组件,所述方法包括:在自动回充过程中启动所述图像采集组件采集自动回充图像;在所述自动回充图像包括特征标识时,基于所述特征标识在所述自动回充图像中的位置以及所述特征标识在充电基座的充电面上的安装位置,确定所述图像采集组件与所述特征标识在所述自动回充装置的行进方向上的第一方向距离,以及所述图像采集组件与所述特征标识在与地面平行、且与所述行进方向垂直的方向上的第二方向距离;所述特征标识设置于所述充电基座上,并通过所述充电基座的充电面展示;所述充电基座用于为所述自动回充装置充电;基于所述第一方向距离、所述第二方向距离,确定所述充电基座的充电面与所述自动回充装置的相对位置关系;基于所述相对位置关系确定所述自动回充装置的移动方向,以使所述自动回充装置向所述充电基座的充电面移动。
- 根据权利要求1所述的方法,其特征在于,所述基于所述第一方向距离、所述第二方向距离,确定所述充电基座的充电面与所述自动回充装置的相对位置关系,包括:基于所述第一方向距离、所述第二方向距离,确定所述充电面与所述自动回充装置之间的距离和角度;所述基于所述相对位置关系确定所述自动回充装置的移动方向,以使所述自动回充装置向所述充电基座的充电面移动,包括:基于所述充电面与所述自动回充装置之间的距离和角度,确定所述自动回充装置的移动方向,以使所述自动回充装置向所述充电基座的充电面移动。
- 根据权利要求2所述的方法,其特征在于,所述基于所述特征标识在所述自动回充图像中的位置以及所述特征标识在所述充电基座的充电面上的安装位置,确定所述图像采集组件与所述特征标识在行进方向上的第一方向距离,以及所述图像采集组件与所述特征标识在与地面平行、且与所述行进方向垂直的方向上的第二方向距离,包括:基于所述特征标识的安装位置确定所述图像采集组件与所述特征标识在与地面垂直的方向上的第一垂直方向距离;获取所述特征标识的图像位置与所述自动回充图像的图像中心点在所述与地面垂直的方向上的第二垂直方向距离;基于所述第一垂直方向距离、所述第二垂直方向距离、以及所述图像采集组件的焦距,计算所述图像采集组件与所述特征标识在所述行进方向上的第一方向距离;获取所述特征标识的图像位置与所述自动回充图像的图像中心点在与所述地面平行的方向上的第二方向图像距离;基于所述第一方向距离、所述第二方向图像距离以及所述图像采集组件的焦距,计算所述图像采集组件与所述特征标识在与所述地面平行、且与所述行进方向垂直的方向上的第二方向距离。
- 根据权利要求1所述的方法,其特征在于,所述特征标识的数量为至少两个,所述方法还包括:确定所述自动回充图像是否包括至少两个特征标识;在所述自动回充图像包括所述至少两个特征标识时,触发执行所述基于所述特征标识在所述自动回充图像中的位置以及所述特征标识在所述充电基座的充电面上的安装位置,确定所述图像采集组件与所述特征标识在所述自动回充装置的行进方向上的第一方向距离,以及所述图像采集组件与所述特征标识在与地面平行、且与所述行进方向垂直的方向上的第二方向距离的步骤。
- 根据权利要求2所述的方法,其特征在于,所述特征标识的数量为至少两个,所述基于所述第一方向距离、所述第二方向距离,确定所述充电面与所述自动回充装置之间的距离和角度,包括:基于所述至少两个特征标识中的每个特征标识的第一方向距离、每个特征标识的第二方向距离,确定所述充电面与所述自动回充装置之间的距离和角度。
- 根据权利要求1所述的方法,其特征在于,所述特征标识的数量为至少两个,所述至少两个特征标识通过所述充电面展示的展示位置相对于地面的高度相同或不同;和/或,所述至少两个特征标识通过所述充电面展示的展示位置呈中心对称。
- 根据权利要求1至6任一所述的方法,其特征在于,所述在自动回充过程中启动所述图像采集组件采集自动回充图像,包括:在所述自动回充装置的电量低于预设电量值时,启动所述图像采集组件采集所述自动回充图像;或者,在接收到充电指令时,启动所述图像采集组件采集所述自动回充图像。
- 一种自动回充装置,其特征在于,所述装置包括处理器和存储器;所述存储器中存储有程序,所述程序由所述处理器加载并执行以实现如权利要求1至7任一项所述的自动回充方法。
- 一种计算机可读存储介质,其特征在于,所述存储介质中存储有程序,所述程序被处理器执行时用于实现如权利要求1至7任一项所述的自动回充方法。
- 一种自动回充系统,其特征在于,所述系统包括自动回充装置和充电基座;所述自动回充装置包括权利要求8所述的自动回充装置;所述充电基座设置有特征标识。
Priority Applications (5)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP21847216.5A EP4184278A4 (en) | 2020-07-21 | 2021-07-20 | AUTOMATIC RECHARGING METHOD AND APPARATUS, STORAGE MEDIUM, CHARGING BASE AND SYSTEM |
KR1020237001867A KR20230025706A (ko) | 2020-07-21 | 2021-07-20 | 자동 재충전 방법 및 자동 재충전 시스템 |
JP2023501663A JP2023534795A (ja) | 2020-07-21 | 2021-07-20 | 自動帰還充電方法、装置、記憶媒体、充電台及びシステム |
AU2021314387A AU2021314387A1 (en) | 2020-07-21 | 2021-07-20 | Automatic recharging method and apparatus, storage medium, charging base, and system |
CA3186047A CA3186047A1 (en) | 2020-07-21 | 2021-07-20 | Automatic recharging method and apparatus, storage medium, charging base, and system |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010704916.0 | 2020-07-21 | ||
CN202010704916.0A CN111596694B (zh) | 2020-07-21 | 2020-07-21 | 自动回充方法、装置、存储介质及系统 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2022017341A1 true WO2022017341A1 (zh) | 2022-01-27 |
Family
ID=72190250
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2021/107229 WO2022017341A1 (zh) | 2020-07-21 | 2021-07-20 | 自动回充方法、装置、存储介质、充电基座及系统 |
Country Status (9)
Country | Link |
---|---|
US (1) | US11865937B2 (zh) |
EP (1) | EP4184278A4 (zh) |
JP (1) | JP2023534795A (zh) |
KR (1) | KR20230025706A (zh) |
CN (2) | CN111596694B (zh) |
AU (1) | AU2021314387A1 (zh) |
CA (1) | CA3186047A1 (zh) |
DE (1) | DE102021118748A1 (zh) |
WO (1) | WO2022017341A1 (zh) |
Families Citing this family (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111596694B (zh) * | 2020-07-21 | 2020-11-17 | 追创科技(苏州)有限公司 | 自动回充方法、装置、存储介质及系统 |
CN113872287A (zh) * | 2021-09-26 | 2021-12-31 | 追觅创新科技(苏州)有限公司 | 充电设备、自移动设备、充电方法、系统及存储介质 |
CN114794992B (zh) * | 2022-06-07 | 2024-01-09 | 深圳甲壳虫智能有限公司 | 充电座、机器人的回充方法和扫地机器人 |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN107450540A (zh) * | 2017-08-04 | 2017-12-08 | 山东大学 | 基于红外路标的室内移动机器人导航系统及方法 |
CN107703933A (zh) * | 2016-08-09 | 2018-02-16 | 深圳光启合众科技有限公司 | 机器人的充电方法、装置和设备 |
CN108646727A (zh) * | 2018-05-14 | 2018-10-12 | 珠海市微半导体有限公司 | 一种视觉充电座及其定位方法和回充方法 |
CN109541535A (zh) * | 2019-01-11 | 2019-03-29 | 浙江智澜科技有限公司 | 一种基于uwb和视觉slam的agv室内定位及导航的方法 |
CN110263601A (zh) * | 2018-03-12 | 2019-09-20 | 杭州萤石软件有限公司 | 一种充电座识别方法及移动机器人 |
CN111596694A (zh) * | 2020-07-21 | 2020-08-28 | 追创科技(苏州)有限公司 | 自动回充方法、装置、存储介质及系统 |
Family Cites Families (17)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPS60148613U (ja) * | 1984-03-13 | 1985-10-02 | 三菱重工業株式会社 | 無人搬送車制御装置 |
JP2005309531A (ja) * | 2004-04-16 | 2005-11-04 | Funai Electric Co Ltd | 自走式掃除機および移動可能なロボット |
KR20060110483A (ko) * | 2005-04-20 | 2006-10-25 | 엘지전자 주식회사 | 충전대 자동 복귀 기능을 가진 청소로봇 및 그 방법 |
CN102327940B (zh) | 2011-07-19 | 2015-02-18 | 大连液压件有限公司 | 钢球密封碾压封口装置及工艺 |
GB2513912B (en) * | 2013-05-10 | 2018-01-24 | Dyson Technology Ltd | Apparatus for guiding an autonomous vehicle towards a docking station |
EP3082005B1 (en) * | 2013-12-13 | 2019-06-12 | Toshiba Lifestyle Products & Services Corporation | Autonomously traveling electric cleaning device |
US10575696B2 (en) * | 2016-07-13 | 2020-03-03 | Irobot Corporation | Autonomous robot auto-docking and energy management systems and methods |
TWI645276B (zh) * | 2017-08-30 | 2018-12-21 | 世擘股份有限公司 | 自動充電方法以及清潔機器人 |
KR102203439B1 (ko) * | 2018-01-17 | 2021-01-14 | 엘지전자 주식회사 | 이동 로봇 및 이동 로봇의 제어방법 |
CN108508897B (zh) | 2018-04-20 | 2021-03-05 | 杭州蓝芯科技有限公司 | 一种基于视觉的机器人自动充电对准系统及方法 |
CN110757446B (zh) * | 2018-07-25 | 2021-08-27 | 深圳市优必选科技有限公司 | 机器人回充登录的方法、装置及存储装置 |
CN110893085B (zh) * | 2018-09-11 | 2021-12-31 | 原相科技股份有限公司 | 清洁机器人及其充电路径决定方法 |
JP7025317B2 (ja) * | 2018-10-31 | 2022-02-24 | ファナック株式会社 | 測距装置を有する物体監視システム |
CN109975793B (zh) * | 2019-04-25 | 2021-03-12 | 苏州玖物互通智能科技有限公司 | 一种激光二维测距传感器的标定方法 |
CN110353583A (zh) * | 2019-08-21 | 2019-10-22 | 追创科技(苏州)有限公司 | 扫地机器人及扫地机器人的自动控制方法 |
CN110850882A (zh) * | 2019-11-29 | 2020-02-28 | 小狗电器互联网科技(北京)股份有限公司 | 一种扫地机器人的充电桩定位方法及装置 |
CN111136648B (zh) * | 2019-12-27 | 2021-08-27 | 深圳市优必选科技股份有限公司 | 一种移动机器人的定位方法、定位装置及移动机器人 |
-
2020
- 2020-07-21 CN CN202010704916.0A patent/CN111596694B/zh active Active
- 2020-07-21 CN CN202011150803.7A patent/CN112327940B/zh active Active
-
2021
- 2021-07-20 DE DE102021118748.6A patent/DE102021118748A1/de active Pending
- 2021-07-20 WO PCT/CN2021/107229 patent/WO2022017341A1/zh unknown
- 2021-07-20 EP EP21847216.5A patent/EP4184278A4/en active Pending
- 2021-07-20 KR KR1020237001867A patent/KR20230025706A/ko active Search and Examination
- 2021-07-20 AU AU2021314387A patent/AU2021314387A1/en not_active Abandoned
- 2021-07-20 JP JP2023501663A patent/JP2023534795A/ja active Pending
- 2021-07-20 US US17/380,555 patent/US11865937B2/en active Active
- 2021-07-20 CA CA3186047A patent/CA3186047A1/en active Pending
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN107703933A (zh) * | 2016-08-09 | 2018-02-16 | 深圳光启合众科技有限公司 | 机器人的充电方法、装置和设备 |
CN107450540A (zh) * | 2017-08-04 | 2017-12-08 | 山东大学 | 基于红外路标的室内移动机器人导航系统及方法 |
CN110263601A (zh) * | 2018-03-12 | 2019-09-20 | 杭州萤石软件有限公司 | 一种充电座识别方法及移动机器人 |
CN108646727A (zh) * | 2018-05-14 | 2018-10-12 | 珠海市微半导体有限公司 | 一种视觉充电座及其定位方法和回充方法 |
CN109541535A (zh) * | 2019-01-11 | 2019-03-29 | 浙江智澜科技有限公司 | 一种基于uwb和视觉slam的agv室内定位及导航的方法 |
CN111596694A (zh) * | 2020-07-21 | 2020-08-28 | 追创科技(苏州)有限公司 | 自动回充方法、装置、存储介质及系统 |
CN112327940A (zh) * | 2020-07-21 | 2021-02-05 | 追创科技(苏州)有限公司 | 自动回充方法、装置、存储介质、充电基座及系统 |
Non-Patent Citations (1)
Title |
---|
See also references of EP4184278A4 * |
Also Published As
Publication number | Publication date |
---|---|
EP4184278A4 (en) | 2023-11-29 |
DE102021118748A1 (de) | 2022-01-27 |
CN112327940A (zh) | 2021-02-05 |
JP2023534795A (ja) | 2023-08-14 |
CN111596694B (zh) | 2020-11-17 |
AU2021314387A1 (en) | 2023-02-09 |
KR20230025706A (ko) | 2023-02-22 |
CN111596694A (zh) | 2020-08-28 |
US20220024333A1 (en) | 2022-01-27 |
CA3186047A1 (en) | 2022-01-27 |
CN112327940B (zh) | 2023-01-13 |
US11865937B2 (en) | 2024-01-09 |
EP4184278A1 (en) | 2023-05-24 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2022017341A1 (zh) | 自动回充方法、装置、存储介质、充电基座及系统 | |
JP7484015B2 (ja) | 障害物検出方法および装置、自走式ロボット並びに記憶媒体 | |
KR102003152B1 (ko) | 정보 처리 방법, 디바이스, 및 단말기 | |
WO2018210059A9 (zh) | 机器人充电方法及装置 | |
CN103901895B (zh) | 一种基于无极FastSLAM算法和匹配优化目标定位方法及机器人 | |
JP2021516401A (ja) | データ融合方法及び関連装置 | |
CN113256716B (zh) | 一种机器人的控制方法及机器人 | |
CN116278880A (zh) | 一种充电设备以及控制机械臂充电的方法 | |
CN113561963A (zh) | 一种泊车方法、装置及车辆 | |
WO2023125363A1 (zh) | 电子围栏自动生成方法、实时检测方法及装置 | |
US20230297120A1 (en) | Method, apparatus, and device for creating map for self-moving device with improved map generation efficiency | |
CN110871440B (zh) | 机器人的行驶控制方法和装置 | |
US11734850B2 (en) | On-floor obstacle detection method and mobile machine using the same | |
EP4242775B1 (en) | Charging station, method for returning to said charging station for a lawnmower robot | |
CN113359712A (zh) | 充电对接方法、装置和充电桩 | |
KR102471487B1 (ko) | 청소 로봇 및 그 제어방법 | |
CN115474863B (zh) | 障碍物检测方法、装置、介质及清洁机器人 | |
CN106204516B (zh) | 一种机器人的自动充电方法及装置 | |
CN110412993A (zh) | 自主充电的方法以及移动机器人 | |
CN113872287A (zh) | 充电设备、自移动设备、充电方法、系统及存储介质 | |
CN115979251B (zh) | 地图的生成方法和机器人 | |
WO2023109347A1 (zh) | 自移动设备的重定位方法、设备及存储介质 | |
WO2023165329A1 (zh) | 自移动设备的地图更新方法、自移动设备及存储介质 | |
US11460854B1 (en) | System to determine floor or obstacle by autonomous mobile device | |
US20240335080A1 (en) | Mobile robot |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 21847216 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 2023501663 Country of ref document: JP Kind code of ref document: A |
|
ENP | Entry into the national phase |
Ref document number: 3186047 Country of ref document: CA |
|
ENP | Entry into the national phase |
Ref document number: 20237001867 Country of ref document: KR Kind code of ref document: A |
|
ENP | Entry into the national phase |
Ref document number: 2021314387 Country of ref document: AU Date of ref document: 20210720 Kind code of ref document: A |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
ENP | Entry into the national phase |
Ref document number: 2021847216 Country of ref document: EP Effective date: 20230217 |