WO2024002395A2 - Vehicle charging port positioning method and related device - Google Patents

Vehicle charging port positioning method and related device Download PDF

Info

Publication number
WO2024002395A2
WO2024002395A2 PCT/CN2023/121985 CN2023121985W WO2024002395A2 WO 2024002395 A2 WO2024002395 A2 WO 2024002395A2 CN 2023121985 W CN2023121985 W CN 2023121985W WO 2024002395 A2 WO2024002395 A2 WO 2024002395A2
Authority
WO
WIPO (PCT)
Prior art keywords
information
charging port
image
position information
image acquisition
Prior art date
Application number
PCT/CN2023/121985
Other languages
French (fr)
Chinese (zh)
Other versions
WO2024002395A3 (en
Inventor
蒋亚西
金梦磊
李建朋
岳川元
李成杰
Original Assignee
浙江安吉智电控股有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 浙江安吉智电控股有限公司 filed Critical 浙江安吉智电控股有限公司
Publication of WO2024002395A2 publication Critical patent/WO2024002395A2/en
Publication of WO2024002395A3 publication Critical patent/WO2024002395A3/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/0002Inspection of images, e.g. flaw detection
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/70Determining position or orientation of objects or cameras
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10024Color image
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10028Range image; Depth image; 3D point clouds
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02TCLIMATE CHANGE MITIGATION TECHNOLOGIES RELATED TO TRANSPORTATION
    • Y02T10/00Road transport of goods or passengers
    • Y02T10/60Other road transportation technologies with climate change mitigation effect
    • Y02T10/70Energy storage systems for electromobility, e.g. batteries
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02TCLIMATE CHANGE MITIGATION TECHNOLOGIES RELATED TO TRANSPORTATION
    • Y02T10/00Road transport of goods or passengers
    • Y02T10/60Other road transportation technologies with climate change mitigation effect
    • Y02T10/7072Electromobility specific charging systems or methods for batteries, ultracapacitors, supercapacitors or double-layer capacitors

Definitions

  • the present application relates to the field of vehicle charging technology, and in particular to a vehicle charging port positioning method and related equipment.
  • the current vehicle charging port positioning is based on the location of the vehicle and the position of the charging port relative to the vehicle.
  • the image is usually obtained through an image acquisition device, and the charging port is determined based on the match between the image and the important features of the target charging port. The location of the mouth.
  • the above method can only be used to locate the vehicle charging port when important features for matching can be observed in the images collected by the image acquisition device.
  • the image acquisition device cannot directly collect image information containing important features for matching, such as the side image of a vehicle charging port, etc.
  • the above image information cannot be effectively utilized and can only Continuing to collect images will increase the positioning time and difficulty, affecting the convenience and practicality of the vehicle charging port positioning method.
  • This application provides a vehicle charging port positioning method and related equipment to solve the problem that the current vehicle charging port positioning can only be used when important features for matching can be observed in the images collected by the image acquisition device. Due to the positioning of the vehicle charging port, the positioning of the vehicle charging port has higher requirements for the collected images, and the information in the image cannot be effectively used, resulting in the need for multiple acquisitions, increasing the acquisition time and positioning difficulty, and thus affecting the vehicle charging port. Convenience and practicality of positioning methods.
  • this application provides a vehicle charging port positioning method for a charging device, including:
  • the current posture information includes: at least one of current shooting angle information, current height information and current location information of the image collection device;
  • first angular position information of the charging port to be positioned is determined.
  • the vehicle charging port positioning method further includes:
  • control the image collection device According to the first angular position information of the charging port to be positioned, control the image collection device to move to the front of the charging port to be positioned;
  • the distance information determine the distance position information of the charging port to be located
  • the position information of the charging port to be located is determined.
  • the vehicle charging port positioning method further includes:
  • target angular position information of the charging port to be located is determined.
  • the image information includes color image information and depth image information.
  • determining the relative position information of the charging port to be positioned relative to the image acquisition device based on the image information and the current posture information of the image includes:
  • the color image information determine the outline position information of the charging port to be located in the color image
  • relative position information of the charging port to be positioned relative to the image acquisition device is determined.
  • the method before the step of obtaining the image information of the charging port to be located through the image acquisition device, the method further includes:
  • the range to be located where the charging port to be located is determined.
  • the vehicle charging port positioning method further includes:
  • the image acquisition device If the image acquisition device cannot obtain the image information of the charging port to be located in the current posture, the image acquisition device is controlled to move within the range to be located.
  • this application also provides a vehicle charging port positioning device for a charging device, including:
  • the pose acquisition module is used to acquire the current pose information of the image acquisition device associated with the charging device, where the current pose information includes: the current shooting angle information, the current height information and the current position of the image acquisition device. at least one of the information;
  • An image acquisition module configured to acquire image information of the charging port to be located through the image acquisition device
  • a relative position determination module configured to determine the relative position information of the charging port to be positioned relative to the image acquisition device based on the image information and the current posture information;
  • An angular position determination module configured to determine first angular position information of the charging port to be located based on the relative position information and the current posture information.
  • the present application also provides an electronic device, including a memory and a processor.
  • the processor is configured to implement the vehicle charging port positioning method as described in any one of the above first aspects when executing a computer program stored in the memory. A step of.
  • the present application also provides a computer-readable storage medium on which a computer program is stored.
  • the computer program is executed by a processor, the vehicle charging port positioning method as described in any one of the first aspects is implemented. A step of.
  • the present application provides a computer program, including computer readable code.
  • the computer readable code When the computer readable code is run on a server, it causes the server to execute any one of the aforementioned vehicle charging port positioning methods.
  • the present application provides a computer-readable medium in which a computer program for the aforementioned vehicle charging port positioning method is stored.
  • the present application provides a vehicle charging port positioning method and related equipment for a charging device, including: obtaining the current position information of the image acquisition device associated with the charging device, wherein the current position
  • the attitude information includes: at least one of the current shooting angle information, current height information and current location information of the image acquisition device; obtaining the image information of the charging port to be located through the image acquisition device; according to the image information and the Determine the relative position information of the charging port to be positioned relative to the image acquisition device based on the current pose information; determine the first angle of the charging port to be positioned based on the relative position information and the current pose information location information.
  • the positioning of the vehicle charging port is not suitable for the collected images.
  • the image requirements are high, and the information in the image cannot be effectively used, resulting in the need for multiple acquisitions, which increases the acquisition time and positioning difficulty, which in turn affects the convenience and practicality of the vehicle charging port positioning method.
  • the relative position information between the image collection device and the charging port to be located can be determined, and based on the image collection device
  • the current pose information and relative position information can be used to determine the actual position of the charging port to be located in space, which can improve the accuracy and practicality of vehicle charging port positioning.
  • Figure 1 is a schematic flow chart of a vehicle charging port positioning method provided by an embodiment of the present application
  • FIG. 2 is a schematic structural diagram of a vehicle charging port positioning device provided by an embodiment of the present application.
  • Figure 3 is a schematic structural diagram of an electronic device provided by an embodiment of the present application.
  • Figure 4 is a schematic structural diagram of a computer-readable storage medium provided by an embodiment of the present application.
  • Figure 5 schematically shows a block diagram of a server for executing a method according to the present application
  • Figure 6 schematically shows a storage unit for holding or carrying program code for implementing the method according to the present application.
  • an embodiment of the present application provides a vehicle charging port positioning method.
  • the execution subject of the method may be a server, a controller, etc., and is used for a charging device.
  • the method includes:
  • Step S110 Obtain the current posture information of the image collection device associated with the charging device, where the current posture information includes: at least one of the current shooting angle information, current height information and current location information of the above image collection device. .
  • the current pose information can be obtained through a control device associated with the image acquisition device.
  • Step S120 Obtain the image information of the charging port to be located through the above-mentioned image acquisition device.
  • Step S130 Determine the relative position information of the charging port to be positioned relative to the image collection device based on the image information and the current posture information.
  • an image processing algorithm can be used to extract the outline of the charging port in the above image information to obtain the outline information of the charging port to be located.
  • an image information database of image and pose mapping can be established.
  • the above image information of the charging port to be located can be used to The relative position information of the charging port to be positioned relative to the image collection device is determined based on the matching result between the information and the above-mentioned image information database.
  • Step S140 Determine the first angular position information of the charging port to be located based on the relative position information and the current posture information.
  • the above-mentioned first angular position information is the angle of the charging port to be positioned relative to the charging device when the image acquisition device is in the current posture.
  • the image collected by the image collection device is an image of the side of the charging port, etc.
  • determine the relative position information between the image collection device and the charging port to be located and determine based on the current posture information and relative position information of the image collection device.
  • the actual position of the charging port to be located in space can thereby improve the accuracy and practicality of positioning the vehicle charging port.
  • the above vehicle charging port positioning method further includes:
  • control the image collection device According to the first angular position information of the charging port to be positioned, control the image collection device to move to the front of the charging port to be positioned;
  • the ranging depth image information of the charging port to be located is collected directly in front of the charging port to be located through the image acquisition device;
  • the position information of the charging port to be located is determined.
  • the location directly in front of the charging port to be positioned can be determined based on the first angular position information
  • the above-mentioned image acquisition device can be clamped by a robotic arm, the above-mentioned image acquisition device can be moved directly in front of the charging port to be positioned, and the image acquisition can be obtained The current pose information of the device.
  • the above-mentioned image acquisition device may be a 3D camera, which acquires a depth image directly in front of the charging port to be located as the above-mentioned ranging depth image information.
  • the straight-line distance between the image collection device and the charging port to be located can be determined through an image processing algorithm based on the above-mentioned ranging depth image information, and the position information of the charging port to be located can be determined based on the above-mentioned straight-line distance and the current posture of the image collection device.
  • the straight-line distance between the image acquisition device and the charging port to be located can be obtained, and the actual position of the charging port to be located in space can be determined, thereby improving the accuracy of charging port positioning. and practicality.
  • the above vehicle charging port positioning method further includes:
  • the target angular position information of the charging port to be located is determined.
  • the above-mentioned first switching pose information may be determined based on the above-mentioned relative position information. At least one switching pose information of the image acquisition device can be obtained.
  • the above-mentioned second angular position information is the angle of the charging port to be positioned relative to the charging device when the image collection device is in the first switching posture.
  • the first angular position information and the second angular position information can be fitted.
  • the difference between the two angular positions is greater than the preset difference
  • the first angular position information and the second angular position information can be fitted.
  • the position between the position information is used as the second switching pose, and the image acquisition device is controlled to obtain the second switching pose image information.
  • the first angular position information and the second angular position information it is determined Target angular position information.
  • the difference between the two angular positions is less than or equal to the preset difference, the first angular position or the second angular position may be determined as the target angular position.
  • the first relative position information of the charging port to be positioned relative to the first switching posture of the image acquisition device is determined, and then the first relative position information of the charging port to be positioned is determined.
  • the second angular position information of the charging port to be located in space is determined by processing the above-mentioned first angular position information and second angular position information to determine the target angular position information. Therefore, by collecting images of the charging port to be located in the space at least twice, combined with the switching posture of the image acquisition device and the associated image information, the accuracy of the angular position information of the charging port to be located in the space can be improved. , which can improve the practicality and positioning efficiency of charging port positioning.
  • the above-mentioned image information includes color image information and depth image information.
  • the accuracy of the relative position information can be improved, which in turn can improve the positioning efficiency and positioning quality of the charging port positioning.
  • determining the relative position information of the charging port to be positioned relative to the image acquisition device based on the image information and the current posture information of the image includes:
  • the relative position information of the charging port to be positioned relative to the image acquisition device is determined.
  • a connection can be made between any two points on the outline information.
  • the relative position of the connection between the above connection and the connection between the same two points on the standard charging port image the relative position of the charging port to be positioned can be determined.
  • Color relative position information of the above image acquisition device According to the depth image information, the depth difference of any two points in the depth image can be compared with the depth difference of the same two points on the standard charging port image to determine the depth relative position of the charging port to be positioned relative to the image acquisition device.
  • the above relative angle position information can be determined based on the above color relative position information and depth relative position information. Based on the relative angle position information and the depth image information, the relative position information can be determined.
  • the relative angle and relative distance between the image acquisition device in the current posture and the charging port to be positioned can be determined at the same time, and then the charging port to be positioned relative to the image acquisition can be determined
  • the relative position of the device improves the accuracy of the charging port positioning, which in turn improves the positioning efficiency and positioning quality of the charging port positioning.
  • the method before the above step of obtaining the image information of the charging port to be located through the above image acquisition device, the method further includes:
  • the to-be-located range in which the above-mentioned charging port to be located is determined.
  • the usage status of the parking space can be determined based on the charging management system associated with the parking space.
  • the above-mentioned parking status information includes at least one of the parking orientation and the parking angle of the vehicle in the parking space.
  • the relative position of the charging port relative to the entire body can be determined through the vehicle model information.
  • the above vehicle charging port positioning method further includes:
  • the image acquisition device When the image acquisition device cannot obtain the image information of the charging port to be located in the current posture, the image acquisition device is controlled to move into the range to be located.
  • the above-mentioned current acquisition range is the image acquisition range of the image acquisition device in the current posture.
  • the collection efficiency can be improved, and the collection efficiency can be improved by avoiding the need for multiple adjustments after collecting invalid images.
  • Figure 2 is a schematic structural diagram of a vehicle charging port positioning device provided by an embodiment of the present application.
  • the embodiment of the present application provides a vehicle charging port positioning device 200, which includes:
  • the pose acquisition module 201 is used to acquire the current pose information of the image capture device associated with the charging device, where the above-mentioned current pose information includes: the current shooting angle information, current height information and current location information of the above-mentioned image capture device. at least one of;
  • the image acquisition module 202 is used to acquire the image information of the charging port to be located through the above-mentioned image acquisition device;
  • the relative position determination module 203 is used to determine the relative position information of the charging port to be positioned relative to the image collection device based on the above image information and the above current posture information;
  • the angular position determination module 204 is configured to determine the first angular position information of the charging port to be located based on the relative position information and the current posture information.
  • a vehicle charging port positioning device 200 can implement each process implemented in the method embodiment of Figure 1. To avoid repetition, details will not be described here.
  • FIG. 3 is a schematic structural diagram of an electronic device provided by an embodiment of the present application.
  • the embodiment of the present application provides an electronic device 300, which includes a memory 310, a processor 320, and a computer program 311 stored in the memory 310 and executable on the processor 320.
  • the processor 320 executes the computer program 311, it implements the following steps:
  • the above-mentioned current posture information includes: at least one of the current shooting angle information, current height information and current location information of the above-mentioned image collection device;
  • the first angular position information of the charging port to be located is determined.
  • any implementation manner in the embodiment corresponding to Figure 1 can be implemented.
  • the electronic device introduced in this embodiment is a device used to implement a device in the embodiment of this application, based on the method introduced in the embodiment of this application, those skilled in the art can understand the functions of the electronic device in this embodiment. Specific embodiments and various variations thereof, so how the electronic device implements the methods in the embodiments of the application will not be described in detail here. As long as those skilled in the art implement the methods used in the embodiments of the application, the equipment used will be All fall within the scope of protection sought by this application.
  • Figure 4 is a schematic structural diagram of a computer-readable storage medium provided by an embodiment of the present application.
  • This embodiment provides a computer-readable storage medium 400 on which a computer program 411 is stored.
  • the computer program 411 implements the following steps when executed by a processor:
  • the current posture information includes: at least one of current shooting angle information, current height information and current location information of the image collection device;
  • first angular position information of the charging port to be positioned is determined.
  • embodiments of the present application may be provided as methods, systems, or computer program products. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment that combines software and hardware aspects. Furthermore, the present application may employ methods including one or more A form of computer program product implemented on a computer-usable storage medium (including but not limited to disk memory, CD-ROM, optical storage, etc.) containing computer-usable program code.
  • a computer-usable storage medium including but not limited to disk memory, CD-ROM, optical storage, etc.
  • These computer program instructions may also be stored in a computer-readable memory that causes a computer or other programmable data processing apparatus to operate in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including the instruction means, the instructions
  • the device implements the functions specified in a process or processes of the flowchart and/or a block or blocks of the block diagram.
  • These computer program instructions may also be loaded onto a computer or other programmable data processing device, causing a series of operating steps to be performed on the computer or other programmable device to produce computer-implemented processing, thereby executing on the computer or other programmable device.
  • Instructions provide steps for implementing the functions specified in a process or processes of a flowchart diagram and/or a block or blocks of a block diagram.
  • Embodiments of the present application also provide a computer program product.
  • the computer program product includes computer software instructions.
  • the processing device causes the processing device to execute the vehicle charging port positioning method in the corresponding embodiment of Figure 1. process in.
  • the above-mentioned computer program product includes one or more computer instructions.
  • the above computer program instructions When the above computer program instructions are loaded and executed on a computer, the above-mentioned processes or functions according to the embodiments of the present application are generated in whole or in part.
  • the above-mentioned computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices.
  • the above computer instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium.
  • the above-mentioned computer instructions may be transmitted from a website, computer, server or data center via a wired (such as coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (such as infrared, wireless, microwave, etc.) to another website, computer, server or data center.
  • the above-mentioned computer-readable storage medium can be any available medium that a computer can store or a data storage device such as a server or data center integrated with one or more available media.
  • the above available media may be magnetic media (eg, floppy disk, hard disk, tape), optical media (eg, DVD), or semiconductor media (eg, solid state disk (SSD)), etc.
  • the disclosed systems, devices and methods can be implemented in other ways.
  • the device embodiments described above are only illustrative.
  • the division of the above units is only a logical function division. In actual implementation, there may be other division methods.
  • multiple units or components may be combined or may be integrated into another system, or Some features can be ignored, or not implemented.
  • the coupling or direct coupling or communication connection between each other shown or discussed may be through some interfaces, and the indirect coupling or communication connection of the devices or units may be in electrical, mechanical or other forms.
  • the units described above as separate components may or may not be physically separated.
  • the components shown as units may or may not be physical units, that is, they may be located in one place, or they may be distributed to multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.
  • each functional unit in each embodiment of the present application can be integrated into one processing unit, each unit can exist physically alone, or two or more units can be integrated into one unit.
  • the above integrated units can be implemented in the form of hardware or software functional units.
  • the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium.
  • the technical solution of the present application is essentially or contributes to the existing technology, or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium , including several instructions to cause a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the above methods in various embodiments of the present application.
  • the aforementioned storage media include: U disk, mobile hard disk, read-only memory (ROM), random access memory (Random Access Memory, RAM), magnetic disk or optical disk and other media that can store program code. .
  • Various component embodiments of the present disclosure may be implemented in hardware, or in software modules running on one or more processors, or in a combination thereof.
  • a microprocessor or a digital signal processor (DSP) may be used in practice to implement some or all functions of some or all components in the message processing device of the live broadcast platform according to embodiments of the present application.
  • DSP digital signal processor
  • the present application may also be implemented as an apparatus or device program (eg, computer program and computer program product) for performing part or all of the methods described herein.
  • Such a program implementing the present application may be stored on a computer-readable medium, or may be in the form of one or more signals. Such signals may be downloaded from an Internet website, or provided on a carrier signal, or in any other form.
  • Figure 5 shows a server that can implement message processing according to the platform of the present application.
  • the server conventionally includes a processor 510 and a computer program product or computer-readable medium in the form of memory 520 .
  • Memory 520 may be electronic memory such as flash memory, EEPROM (Electrically Erasable Programmable Read Only Memory), EPROM, hard disk, or ROM.
  • the memory 520 has a storage space 530 for program code 531 for executing any method steps in the above-described methods.
  • the storage space 530 of the program code may include individual program codes 531 respectively used to implement various steps in the above method. These program codes can be read from or written into one or more computer program products.
  • These computer program products include program code carriers such as hard disks, compact disks (CDs), memory cards or floppy disks. Such computer program products are typically portable or fixed storage units as described with reference to FIG. 6 .
  • the storage unit may have storage segments, storage spaces, etc. arranged similarly to the memory 520 in the server of FIG. 5 .
  • the program code may, for example, be compressed in a suitable form.
  • the storage unit includes computer readable code 531', ie code that can be read by, for example, a processor such as 510, which code, when run by a server, causes the server to perform the various steps in the method described above.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Quality & Reliability (AREA)
  • Navigation (AREA)
  • Charge And Discharge Circuits For Batteries Or The Like (AREA)

Abstract

Provided in the present application are a vehicle charging port positioning method and a related device, which are applied to a charging apparatus. The method comprises: acquiring the current pose information of an image collection device associated with a charging apparatus, wherein the current pose information comprises at least one of the current photographing angle information, the current height information and the current position information of the image collection device; acquiring, by means of the image collection device, image information of a charging port to be positioned; according to the image information and the current pose information, determining relative position information of said charging port relative to the image collection device; and determining first angle position information of said charging port on the basis of the relative position information and the current pose information. In situations such as when an image collected by an image collection device is a charging port side image, relative position information between the image collection device and a charging port to be positioned is determined, and the actual position of said charging port in a space is determined on the basis of the current pose information of the image collection device and the relative position information, such that the accuracy and practicability of vehicle charging port positioning can be improved.

Description

一种车辆充电口定位方法及相关设备A vehicle charging port positioning method and related equipment
本申请要求于2022年12月02日提交中国专利局、申请号为202211540463.8、申请名称为“一种车辆充电口定位方法及相关设备”的中国专利申请的优先权,其全部内容通过引用结合在申请中。This application claims priority to the Chinese patent application submitted to the China Patent Office on December 2, 2022, with the application number 202211540463.8 and the application title "A vehicle charging port positioning method and related equipment", the entire content of which is incorporated by reference. Applying.
技术领域Technical field
本申请涉及车辆充电技术领域,尤其涉及一种车辆充电口定位方法及相关设备。The present application relates to the field of vehicle charging technology, and in particular to a vehicle charging port positioning method and related equipment.
背景技术Background technique
随着电动车辆应用的普及与科学技术的进步,自动充电技术应运而生。目前的车辆充电口定位是基于车辆所处位置和充电口相对于车辆的位置关系共同实现的,通常是通过图像采集设备获取图像,并根据图像与目标充电口的重要特征的匹配情况,确定充电口的所处位置。但是,上述方法仅能在图像采集设备所采集到的图像中可以观察到用于匹配的重要特征的情况下,才能用于车辆充电口的定位。但在实际的应用场景中,可能存在图像采集设备无法直接采集到包含有用于匹配的重要特征的图像信息,例如,车辆充电口的侧面图像等,而导致上述图像信息无法被有效利用,只能继续进行图像采集,从而会导致增加定位时长和定位难度,影响车辆充电口定位方法的便捷性和实用性。With the popularization of electric vehicle applications and the advancement of science and technology, automatic charging technology has emerged. The current vehicle charging port positioning is based on the location of the vehicle and the position of the charging port relative to the vehicle. The image is usually obtained through an image acquisition device, and the charging port is determined based on the match between the image and the important features of the target charging port. The location of the mouth. However, the above method can only be used to locate the vehicle charging port when important features for matching can be observed in the images collected by the image acquisition device. However, in actual application scenarios, there may be cases where the image acquisition device cannot directly collect image information containing important features for matching, such as the side image of a vehicle charging port, etc. As a result, the above image information cannot be effectively utilized and can only Continuing to collect images will increase the positioning time and difficulty, affecting the convenience and practicality of the vehicle charging port positioning method.
申请内容Application content
本申请提供了一种车辆充电口定位方法及相关设备,以解决目前的车辆充电口定位仅能在图像采集设备所采集到的图像中可以观察到用于匹配的重要特征的情况下,才能用于车辆充电口的定位,进而导致车辆充电口定位对于采集到的图像要求较高,图像中的信息无法被有效利用,导致需要进行多次采集,增加采集时长和定位难度,进而影响车辆充电口定位方法的便捷性和实用性的问题。This application provides a vehicle charging port positioning method and related equipment to solve the problem that the current vehicle charging port positioning can only be used when important features for matching can be observed in the images collected by the image acquisition device. Due to the positioning of the vehicle charging port, the positioning of the vehicle charging port has higher requirements for the collected images, and the information in the image cannot be effectively used, resulting in the need for multiple acquisitions, increasing the acquisition time and positioning difficulty, and thus affecting the vehicle charging port. Convenience and practicality of positioning methods.
第一方面,本申请提供了一种车辆充电口定位方法,用于充电装置,包括:In the first aspect, this application provides a vehicle charging port positioning method for a charging device, including:
获取与充电装置相关联的图像采集设备的当前位姿信息,其中,所述当前位姿信息包括:所述图像采集设备的当前拍摄角度信息、当前高度信息和当前位置信息中的至少一者;Obtain the current posture information of the image collection device associated with the charging device, wherein the current posture information includes: at least one of current shooting angle information, current height information and current location information of the image collection device;
通过所述图像采集设备获取待定位充电口的图像信息;Obtain the image information of the charging port to be located through the image acquisition device;
根据所述图像信息与所述当前位姿信息,确定所述待定位充电口相对于所述图像采集设备的相对位置信息;Determine the relative position information of the charging port to be positioned relative to the image acquisition device according to the image information and the current posture information;
基于所述相对位置信息和所述当前位姿信息,确定所述待定位充电口的第一角度位置信息。 Based on the relative position information and the current posture information, first angular position information of the charging port to be positioned is determined.
在一个实施例中,所述的车辆充电口定位方法,还包括:In one embodiment, the vehicle charging port positioning method further includes:
根据所述待定位充电口的第一角度位置信息,控制所述图像采集设备移动至所述移动至所述待定位充电口的正前方;According to the first angular position information of the charging port to be positioned, control the image collection device to move to the front of the charging port to be positioned;
通过所述图像采集设备在所述待定位充电口的正前方采集所述待定位充电口的测距深度图像信息;Collect the ranging depth image information of the charging port to be located directly in front of the charging port to be located by using the image acquisition device;
基于所述测距深度图像信息,确定所述图像采集设备与所述待定位充电口的距离信息;Based on the ranging depth image information, determine the distance information between the image acquisition device and the charging port to be located;
根据所述距离信息,确定所述待定位充电口的距离位置信息;According to the distance information, determine the distance position information of the charging port to be located;
基于所述第一角度位置信息和所述距离位置信息,确定所述待定位充电口的位置信息。Based on the first angular position information and the distance position information, the position information of the charging port to be located is determined.
在一个实施例中,所述的车辆充电口定位方法,还包括:In one embodiment, the vehicle charging port positioning method further includes:
获取所述图像采集设备的第一切换位姿信息;Obtain the first switching pose information of the image acquisition device;
控制所述图像采集设备切换为第一切换位姿;Control the image acquisition device to switch to the first switching pose;
通过所述图像采集设备获取待定位充电口的第一切换位姿图像信息;Obtain the first switching pose image information of the charging port to be located through the image acquisition device;
根据所述图像信息与所述第一切换位姿信息,确定所述待定位充电口相对于所述图像采集设备的第一切换位姿的第一相对位置信息;Determine first relative position information of the charging port to be positioned relative to the first switching posture of the image acquisition device based on the image information and the first switching pose information;
基于所述第一相对位置信息和所述第一切换位姿信息,确定所述待定位充电口的第二角度位置信息;Based on the first relative position information and the first switching posture information, determine the second angular position information of the charging port to be positioned;
基于所述第一角度位置信息和所述第二角度位置信息,确定所述待定位充电口的目标角度位置信息。Based on the first angular position information and the second angular position information, target angular position information of the charging port to be located is determined.
在一个实施例中,所述图像信息包括彩色图像信息和深度图像信息。In one embodiment, the image information includes color image information and depth image information.
在一个实施例中,所述根据所述图像信息与所像信述当前位姿信息,确定所述待定位充电口相对于所述图像采集设备的相对位置信息,包括:In one embodiment, determining the relative position information of the charging port to be positioned relative to the image acquisition device based on the image information and the current posture information of the image includes:
根据所述彩色图像信息,确定所述待定位充电口在彩色图像中的轮廓位置信息;According to the color image information, determine the outline position information of the charging port to be located in the color image;
基于所述深度图像信息和所述轮廓位置信息,确定所述待定位充电口相对于所述图像采集设备的当前拍摄角度的相对角度位置信息;Based on the depth image information and the contour position information, determine the relative angular position information of the charging port to be positioned relative to the current shooting angle of the image acquisition device;
基于所述相对角度位置信息,确定所述待定位充电口相对于所述图像采集设备的相对位置信息。Based on the relative angular position information, relative position information of the charging port to be positioned relative to the image acquisition device is determined.
在一个实施例中,在所述通过所述图像采集设备获取待定位充电口的图像信息的步骤之前,还包括:In one embodiment, before the step of obtaining the image information of the charging port to be located through the image acquisition device, the method further includes:
获取所述图像采集设备相关联的车位的使用状态信息;Obtain the usage status information of the parking space associated with the image acquisition device;
在所述车位内存在车辆的情况下,获取所述车辆的停放状态信息;When there is a vehicle in the parking space, obtain the parking status information of the vehicle;
获取所述车辆的型号信息;Obtain the model information of the vehicle;
基于所述型号信息和所述停放状态信息,确定所述待定位充电口所处的待定位范围。Based on the model information and the parking status information, the range to be located where the charging port to be located is determined.
在一个实施例中,所述的车辆充电口定位方法,还包括:In one embodiment, the vehicle charging port positioning method further includes:
根据所述图像采集设备的当前位姿信息,确定所述图像采集设备的当前采集范围; Determine the current acquisition range of the image acquisition device according to the current pose information of the image acquisition device;
基于所述当前采集范围和所述待定位范围,判断所述图像采集设备在当前位姿是否能够获取到待定位充电口的图像信息;Based on the current acquisition range and the to-be-located range, determine whether the image acquisition device can obtain the image information of the charging port to be located in the current posture;
在所述图像采集设备在当前位姿不能获取到待定位充电口的图像信息的情况下,控制所述图像采集设备移动至所述待定位范围内。If the image acquisition device cannot obtain the image information of the charging port to be located in the current posture, the image acquisition device is controlled to move within the range to be located.
第二方面,本申请还提供了一种车辆充电口定位装置,用于充电装置,包括:In a second aspect, this application also provides a vehicle charging port positioning device for a charging device, including:
位姿采集模块,用于获取与充电装置相关联的图像采集设备的当前位姿信息,其中,所述当前位姿信息包括:所述图像采集设备的当前拍摄角度信息、当前高度信息和当前位置信息中的至少一者;The pose acquisition module is used to acquire the current pose information of the image acquisition device associated with the charging device, where the current pose information includes: the current shooting angle information, the current height information and the current position of the image acquisition device. at least one of the information;
图像采集模块,用于通过所述图像采集设备获取待定位充电口的图像信息;An image acquisition module, configured to acquire image information of the charging port to be located through the image acquisition device;
相对位置确定模块,用于根据所述图像信息与所述当前位姿信息,确定所述待定位充电口相对于所述图像采集设备的相对位置信息;A relative position determination module, configured to determine the relative position information of the charging port to be positioned relative to the image acquisition device based on the image information and the current posture information;
角度位置确定模块,用于基于所述相对位置信息和所述当前位姿信息,确定所述待定位充电口的第一角度位置信息。An angular position determination module, configured to determine first angular position information of the charging port to be located based on the relative position information and the current posture information.
第三方面,本申请还提供了一种电子设备,包括存储器、处理器,所述处理器用于执行存储器中存储的计算机程序时实现如上述第一方面任一种所述的车辆充电口定位方法的步骤。In a third aspect, the present application also provides an electronic device, including a memory and a processor. The processor is configured to implement the vehicle charging port positioning method as described in any one of the above first aspects when executing a computer program stored in the memory. A step of.
第四方面,本申请还提供了一种计算机可读存储介质,其上存储有计算机程序,所述计算机程序被处理器执行时实现如上述第一方面任一种所述的车辆充电口定位方法的步骤。In a fourth aspect, the present application also provides a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, the vehicle charging port positioning method as described in any one of the first aspects is implemented. A step of.
第五方面,本申请提供了一种计算机程序,包括计算机可读代码,当所述计算机可读代码在服务器上运行时,导致所述服务器执行前述任一个所述车辆充电口定位方法。In a fifth aspect, the present application provides a computer program, including computer readable code. When the computer readable code is run on a server, it causes the server to execute any one of the aforementioned vehicle charging port positioning methods.
第六方面,本申请提供了一种计算机可读介质,其中存储了如前述车辆充电口定位方法的计算机程序。In a sixth aspect, the present application provides a computer-readable medium in which a computer program for the aforementioned vehicle charging port positioning method is stored.
由以上技术方案可知,本申请提供了一种车辆充电口定位方法及相关设备,用于充电装置,包括:获取与充电装置相关联的图像采集设备的当前位姿信息,其中,所述当前位姿信息包括:所述图像采集设备的当前拍摄角度信息、当前高度信息和当前位置信息中的至少一者;通过所述图像采集设备获取待定位充电口的图像信息;根据所述图像信息与所述当前位姿信息,确定所述待定位充电口相对于所述图像采集设备的相对位置信息;基于所述相对位置信息和所述当前位姿信息,确定所述待定位充电口的第一角度位置信息。由于目前的车辆充电口定位仅能在图像采集设备所采集到的图像中可以观察到用于匹配的重要特征的情况下,才能用于车辆充电口的定位,进而导致车辆充电口定位对于采集到的图像要求较高,图像中的信息无法被有效利用,导致需要进行多次采集,增加采集时长和定位难度,进而会影响车辆充电口定位方法的便捷性和实用性。这样,可以在图像采集设备采集到的图像为充电口侧边图像等情况下,确定图像采集设备与待定位充电口之间的相对位置信息,并基于图像采集设备 的当前位姿信息和相对位置信息,确定待定位充电口在空间中的实际位置,进而可以提高车辆充电口定位的准确性和实用性。As can be seen from the above technical solution, the present application provides a vehicle charging port positioning method and related equipment for a charging device, including: obtaining the current position information of the image acquisition device associated with the charging device, wherein the current position The attitude information includes: at least one of the current shooting angle information, current height information and current location information of the image acquisition device; obtaining the image information of the charging port to be located through the image acquisition device; according to the image information and the Determine the relative position information of the charging port to be positioned relative to the image acquisition device based on the current pose information; determine the first angle of the charging port to be positioned based on the relative position information and the current pose information location information. Since the current positioning of the vehicle charging port can only be used to position the vehicle charging port when important features for matching can be observed in the images collected by the image acquisition device, the positioning of the vehicle charging port is not suitable for the collected images. The image requirements are high, and the information in the image cannot be effectively used, resulting in the need for multiple acquisitions, which increases the acquisition time and positioning difficulty, which in turn affects the convenience and practicality of the vehicle charging port positioning method. In this way, when the image collected by the image collection device is the side image of the charging port, the relative position information between the image collection device and the charging port to be located can be determined, and based on the image collection device The current pose information and relative position information can be used to determine the actual position of the charging port to be located in space, which can improve the accuracy and practicality of vehicle charging port positioning.
附图说明Description of drawings
为了更清楚地说明本申请的技术方案,下面将对实施例中所需要使用的附图作简单地介绍,显而易见地,对于本领域普通技术人员而言,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。In order to explain the technical solutions of the present application more clearly, the drawings required to be used in the embodiments will be briefly introduced below. Obviously, for those of ordinary skill in the art, without exerting creative efforts, Additional drawings can be obtained from these drawings.
图1为本申请实施例提供的一种车辆充电口定位方法的示意性流程图;Figure 1 is a schematic flow chart of a vehicle charging port positioning method provided by an embodiment of the present application;
图2为本申请实施例提供的一种车辆充电口定位装置的示意性结构图;Figure 2 is a schematic structural diagram of a vehicle charging port positioning device provided by an embodiment of the present application;
图3为本申请实施例提供的一种电子设备的示意性结构图;Figure 3 is a schematic structural diagram of an electronic device provided by an embodiment of the present application;
图4为本申请实施例提供的一种计算机可读存储介质的示意性结构图;Figure 4 is a schematic structural diagram of a computer-readable storage medium provided by an embodiment of the present application;
图5示意性地示出了用于执行根据本申请的方法的服务器的框图;Figure 5 schematically shows a block diagram of a server for executing a method according to the present application;
图6示意性地示出了用于保持或者携带实现根据本申请的方法的程序代码的存储单元。Figure 6 schematically shows a storage unit for holding or carrying program code for implementing the method according to the present application.
具体实施方式Detailed ways
下面将详细地对实施例进行说明,其示例表示在附图中。下面的描述涉及附图时,除非另有表示,不同附图中的相同数字表示相同或相似的要素。以下实施例中描述的实施方式并不代表与本申请相一致的所有实施方式。仅是与权利要求书中所详述的、本申请的一些方面相一致的系统和方法的示例。在本申请实施例所提供的几个实施例中,应该理解到,所揭露的装置和方法,也可以通过其它的方式实现,以下所描述的装置实施例仅仅是示例性的。An embodiment will be described in detail below, examples of which are illustrated in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings refer to the same or similar elements unless otherwise indicated. The implementations described in the following examples do not represent all implementations consistent with this application. are merely examples of systems and methods consistent with some aspects of the application as detailed in the claims. Among the several embodiments provided in the embodiments of this application, it should be understood that the disclosed devices and methods can also be implemented in other ways, and the device embodiments described below are only exemplary.
如图1所示,本申请实施例提供了一种车辆充电口定位方法,该方法的执行主体可以为服务器和控制器等,用于充电装置,该方法包括:As shown in Figure 1, an embodiment of the present application provides a vehicle charging port positioning method. The execution subject of the method may be a server, a controller, etc., and is used for a charging device. The method includes:
步骤S110、获取与充电装置相关联的图像采集设备的当前位姿信息,其中,上述当前位姿信息包括:上述图像采集设备的当前拍摄角度信息、当前高度信息和当前位置信息中的至少一者。Step S110: Obtain the current posture information of the image collection device associated with the charging device, where the current posture information includes: at least one of the current shooting angle information, current height information and current location information of the above image collection device. .
示例性的,可以通过与上述图像采集设备相关联的控制装置获取上述当前位姿信息。For example, the current pose information can be obtained through a control device associated with the image acquisition device.
步骤S120、通过上述图像采集设备获取待定位充电口的图像信息。Step S120: Obtain the image information of the charging port to be located through the above-mentioned image acquisition device.
步骤S130、根据上述图像信息与上述当前位姿信息,确定上述待定位充电口相对于上述图像采集设备的相对位置信息。Step S130: Determine the relative position information of the charging port to be positioned relative to the image collection device based on the image information and the current posture information.
示例性的,可以通过图像处理算法,对上述图像信息中的充电口轮廓进行提取,获取待定位充电口的轮廓信息。可以通过采集标准充电口各位姿的图像,建立图像与位姿映射的图像信息数据库,可以通过上述待定位充电口的图像信 息与上述图像信息数据库的匹配结果,确定待定位充电口相对于上述图像采集设备的相对位置信息。For example, an image processing algorithm can be used to extract the outline of the charging port in the above image information to obtain the outline information of the charging port to be located. By collecting images of various poses of the standard charging port, an image information database of image and pose mapping can be established. The above image information of the charging port to be located can be used to The relative position information of the charging port to be positioned relative to the image collection device is determined based on the matching result between the information and the above-mentioned image information database.
步骤S140、基于上述相对位置信息和上述当前位姿信息,确定上述待定位充电口的第一角度位置信息。Step S140: Determine the first angular position information of the charging port to be located based on the relative position information and the current posture information.
示例性的,上述第一角度位置信息为图像采集设备处于当前位姿时,待定位充电口相对于充电装置的角度。For example, the above-mentioned first angular position information is the angle of the charging port to be positioned relative to the charging device when the image acquisition device is in the current posture.
在图像采集设备采集到的图像为充电口侧边图像等情况下,确定图像采集设备与待定位充电口之间的相对位置信息,并基于图像采集设备的当前位姿信息和相对位置信息,确定待定位充电口在空间中的实际位置,进而可以提高车辆充电口定位的准确性和实用性。When the image collected by the image collection device is an image of the side of the charging port, etc., determine the relative position information between the image collection device and the charging port to be located, and determine based on the current posture information and relative position information of the image collection device. The actual position of the charging port to be located in space can thereby improve the accuracy and practicality of positioning the vehicle charging port.
根据一些实施例,上述的车辆充电口定位方法,还包括:According to some embodiments, the above vehicle charging port positioning method further includes:
根据上述待定位充电口的第一角度位置信息,控制上述图像采集设备移动至上述移动至上述待定位充电口的正前方;According to the first angular position information of the charging port to be positioned, control the image collection device to move to the front of the charging port to be positioned;
通过上述图像采集设备在上述待定位充电口的正前方采集上述待定位充电口的测距深度图像信息;The ranging depth image information of the charging port to be located is collected directly in front of the charging port to be located through the image acquisition device;
基于上述测距深度图像信息,确定上述图像采集设备与上述待定位充电口的距离信息;Based on the above-mentioned ranging depth image information, determine the distance information between the above-mentioned image acquisition device and the above-mentioned charging port to be located;
根据上述距离信息,确定上述待定位充电口的距离位置信息;According to the above distance information, determine the distance position information of the above charging port to be located;
基于上述第一角度位置信息和上述距离位置信息,确定上述待定位充电口的位置信息。Based on the first angle position information and the distance position information, the position information of the charging port to be located is determined.
示例性的,可以根据第一角度位置信息,确定待定位充电口的正前方,可以通过机械臂夹持上述图像采集设备,将上述图像采集设备至待定位充电口的正前方,并获取图像采集设备的当前位姿信息。上述图像采集设备可以为3D相机,在待定位充电口的正前方获取深度图像,作为上述测距深度图像信息。可以通过图像处理算法,根据上述测距深度图像信息确定图像采集设备与待定位充电口的直线距离,根据上述直线距离及图像采集设备的当前位姿,确定待定位充电口的位置信息。For example, the location directly in front of the charging port to be positioned can be determined based on the first angular position information, the above-mentioned image acquisition device can be clamped by a robotic arm, the above-mentioned image acquisition device can be moved directly in front of the charging port to be positioned, and the image acquisition can be obtained The current pose information of the device. The above-mentioned image acquisition device may be a 3D camera, which acquires a depth image directly in front of the charging port to be located as the above-mentioned ranging depth image information. The straight-line distance between the image collection device and the charging port to be located can be determined through an image processing algorithm based on the above-mentioned ranging depth image information, and the position information of the charging port to be located can be determined based on the above-mentioned straight-line distance and the current posture of the image collection device.
通过在待定位充电口的正前方进行深度图像采集,可以获取图像采集设备与待定位充电口的直线距离,可以确定待定位充电口在空间中的实际位置,进而可以提高充电口定位的准确性和实用性。By collecting depth images directly in front of the charging port to be located, the straight-line distance between the image acquisition device and the charging port to be located can be obtained, and the actual position of the charging port to be located in space can be determined, thereby improving the accuracy of charging port positioning. and practicality.
根据一些实施例,上述的车辆充电口定位方法,还包括:According to some embodiments, the above vehicle charging port positioning method further includes:
获取上述图像采集设备的第一切换位姿信息;Obtain the first switching pose information of the above-mentioned image acquisition device;
控制上述图像采集设备切换为第一切换位姿;Control the above-mentioned image acquisition device to switch to the first switching pose;
通过上述图像采集设备获取待定位充电口的第一切换位姿图像信息;Obtain the first switching pose image information of the charging port to be located through the above-mentioned image acquisition device;
根据上述图像信息与上述第一切换位姿信息,确定上述待定位充电口相对于上述图像采集设备的第一切换位姿的第一相对位置信息;Determine first relative position information of the charging port to be positioned relative to the first switching posture of the image acquisition device based on the above image information and the above first switching pose information;
基于上述第一相对位置信息和上述第一切换位姿信息,确定上述待定位充电口的第二角度位置信息; Based on the above-mentioned first relative position information and the above-mentioned first switching posture information, determine the second angular position information of the above-mentioned charging port to be positioned;
基于上述第一角度位置信息和上述第二角度位置信息,确定上述待定位充电口的目标角度位置信息。Based on the first angular position information and the second angular position information, the target angular position information of the charging port to be located is determined.
示例性的,上述第一切换位姿信息可以为根据上述相对位置信息确定的。可以获取图像采集设备的至少一个切换位姿信息。上述第二角度位置信息为图像采集设备处于第一切换位姿时,待定位充电口相对于充电装置的角度。可以对上述第一角度位置信息和上述第二角度位置信息进行拟合,在上述两个角度位置的差值大于预设差值的情况下,可以将上述第一角度位置信息和上述第二角度位置信息之间的位置作为第二切换位姿,并控制图像采集设备获取第二切换位姿图像信息,根据上述第二切换位姿图像信息、第一角度位置信息和第二角度位置信息,确定目标角度位置信息。在上述两个角度位置的差值小于或等于预设差值的情况下,可以将上述第一角度位置或第二角度位置确定为目标角度位置。For example, the above-mentioned first switching pose information may be determined based on the above-mentioned relative position information. At least one switching pose information of the image acquisition device can be obtained. The above-mentioned second angular position information is the angle of the charging port to be positioned relative to the charging device when the image collection device is in the first switching posture. The first angular position information and the second angular position information can be fitted. When the difference between the two angular positions is greater than the preset difference, the first angular position information and the second angular position information can be fitted. The position between the position information is used as the second switching pose, and the image acquisition device is controlled to obtain the second switching pose image information. According to the above-mentioned second switching pose image information, the first angular position information and the second angular position information, it is determined Target angular position information. When the difference between the two angular positions is less than or equal to the preset difference, the first angular position or the second angular position may be determined as the target angular position.
通过对图像采集设备的位姿进行切换,并对待定位充电口对待定位充电口再次进行图像采集,确定待定位充电口相对于图像采集设备第一切换位姿的第一相对位置信息,进而确定待定位充电口在空间中的第二角度位置信息,通过对上述第一角度位置信息和第二角度位置信息进行处理,确定目标角度位置信息。因此,通过待定位充电口在空间内的进行至少两次的图像采集,结合图像采集设备的切换位姿及相关联的图像信息,可以提高待定位充电口在空间中的角度位置信息的准确性,进而可以提高充电口定位的实用性和定位效率。By switching the posture of the image acquisition device, and collecting images of the charging port to be positioned, the first relative position information of the charging port to be positioned relative to the first switching posture of the image acquisition device is determined, and then the first relative position information of the charging port to be positioned is determined. The second angular position information of the charging port to be located in space is determined by processing the above-mentioned first angular position information and second angular position information to determine the target angular position information. Therefore, by collecting images of the charging port to be located in the space at least twice, combined with the switching posture of the image acquisition device and the associated image information, the accuracy of the angular position information of the charging port to be located in the space can be improved. , which can improve the practicality and positioning efficiency of charging port positioning.
根据一些实施例,上述图像信息包括彩色图像信息和深度图像信息。According to some embodiments, the above-mentioned image information includes color image information and depth image information.
通过当前位姿信息结合彩色图像信息和深度图像信息,可以提高相对位置信息的准确性,进而可以提高充电口定位的定位效率和定位质量。By combining the current pose information with color image information and depth image information, the accuracy of the relative position information can be improved, which in turn can improve the positioning efficiency and positioning quality of the charging port positioning.
根据一些实施例,上述根据上述图像信息与所像信述当前位姿信息,确定上述待定位充电口相对于上述图像采集设备的相对位置信息,包括:According to some embodiments, determining the relative position information of the charging port to be positioned relative to the image acquisition device based on the image information and the current posture information of the image includes:
根据上述彩色图像信息,确定上述待定位充电口在彩色图像中的轮廓位置信息;According to the above-mentioned color image information, determine the outline position information of the above-mentioned charging port to be located in the color image;
基于上述深度图像信息和上述轮廓位置信息,确定上述待定位充电口相对于上述图像采集设备的当前拍摄角度的相对角度位置信息;Based on the above-mentioned depth image information and the above-mentioned contour position information, determine the relative angular position information of the above-mentioned charging port to be positioned relative to the current shooting angle of the above-mentioned image acquisition device;
基于上述相对角度位置信息,确定上述待定位充电口相对于上述图像采集设备的相对位置信息。Based on the relative angle position information, the relative position information of the charging port to be positioned relative to the image acquisition device is determined.
示例性的,可以在轮廓信息上的任意两点之间进行连线,可以根据上述连线与标准充电口图像上相同两点之间的连线的相对位置,确定上述待定位充电口相对于上述图像采集设备的彩色相对位置信息。可以根据深度图像信息,根据深度图像中任意两点的深度差值,与标准充电口图像上相同两点的深度差值进行比较,确定上述待定位充电口相对于上述图像采集设备的深度相对位置信息。可以根据上述彩色相对位置信息和深度相对位置信息,确定上述相对角度位置信息。基于上述相对角度位置信息和深度图像信息,可以确定上述相对位置信息。 For example, a connection can be made between any two points on the outline information. According to the relative position of the connection between the above connection and the connection between the same two points on the standard charging port image, the relative position of the charging port to be positioned can be determined. Color relative position information of the above image acquisition device. According to the depth image information, the depth difference of any two points in the depth image can be compared with the depth difference of the same two points on the standard charging port image to determine the depth relative position of the charging port to be positioned relative to the image acquisition device. information. The above relative angle position information can be determined based on the above color relative position information and depth relative position information. Based on the relative angle position information and the depth image information, the relative position information can be determined.
通过当前位姿信息结合彩色图像信息和深度图像信息,可以同时确定当前位姿下的图像采集设备与待定位充电口之间的相对角度和相对距离,进而可以确定待定位充电口相对于图像采集设备的相对位置,提高充电口定位的准确性,进而可以提高充电口定位的定位效率和定位质量。By combining the current posture information with the color image information and depth image information, the relative angle and relative distance between the image acquisition device in the current posture and the charging port to be positioned can be determined at the same time, and then the charging port to be positioned relative to the image acquisition can be determined The relative position of the device improves the accuracy of the charging port positioning, which in turn improves the positioning efficiency and positioning quality of the charging port positioning.
根据一些实施例,在上述通过上述图像采集设备获取待定位充电口的图像信息的步骤之前,还包括:According to some embodiments, before the above step of obtaining the image information of the charging port to be located through the above image acquisition device, the method further includes:
获取上述图像采集设备相关联的车位的使用状态信息;Obtain the usage status information of the parking space associated with the above-mentioned image collection device;
在上述车位内存在车辆的情况下,获取上述车辆的停放状态信息;When there is a vehicle in the above-mentioned parking space, obtain the parking status information of the above-mentioned vehicle;
获取上述车辆的型号信息;Obtain model information of the above vehicles;
基于上述型号信息和上述停放状态信息,确定上述待定位充电口所处的待定位范围。Based on the above model information and the above parking status information, the to-be-located range in which the above-mentioned charging port to be located is determined.
示例性的,可以根据上述车位相关联的充电管理系统,确定车位的使用状态。上述停放状态信息包括车辆在车位的停放朝向和停放角度中的至少一者。可以通过车辆的型号信息,确定充电口相对于整个车身的相对位置。For example, the usage status of the parking space can be determined based on the charging management system associated with the parking space. The above-mentioned parking status information includes at least one of the parking orientation and the parking angle of the vehicle in the parking space. The relative position of the charging port relative to the entire body can be determined through the vehicle model information.
通过确定车辆的型号信息和停放状态信息,可以推测出车辆充电口可能所处的待定位范围,在上述待定位范围内进行图像采集,可以避免采集到无效图像,节约定位时间,提高定位效率。By determining the model information and parking status information of the vehicle, it is possible to infer the range to be located where the vehicle charging port may be located. Collecting images within the range to be located can avoid collecting invalid images, save positioning time, and improve positioning efficiency.
根据一些实施例,上述的车辆充电口定位方法,还包括:According to some embodiments, the above vehicle charging port positioning method further includes:
根据上述图像采集设备的当前位姿信息,确定上述图像采集设备的当前采集范围;Determine the current collection range of the above-mentioned image collection device according to the current posture information of the above-mentioned image collection device;
基于上述当前采集范围和上述待定位范围,判断上述图像采集设备在当前位姿是否能够获取到待定位充电口的图像信息;Based on the above-mentioned current collection range and the above-mentioned range to be positioned, determine whether the above-mentioned image collection device can obtain the image information of the charging port to be positioned in the current posture;
在上述图像采集设备在当前位姿不能获取到待定位充电口的图像信息的情况下,控制上述图像采集设备移动至上述待定位范围内。When the image acquisition device cannot obtain the image information of the charging port to be located in the current posture, the image acquisition device is controlled to move into the range to be located.
示例性的,上述当前采集范围为图像采集设备在当前位姿下的图像采集范围。For example, the above-mentioned current acquisition range is the image acquisition range of the image acquisition device in the current posture.
通过当前采集范围与待定位范围进行匹配,在不匹配的情况下,控制图像采集设备移动,可以提高采集的效率,避免采集到无效图像后需要多次进行调整,可以提高采集效率。By matching the current collection range with the range to be positioned, and controlling the movement of the image collection device in the case of mismatch, the collection efficiency can be improved, and the collection efficiency can be improved by avoiding the need for multiple adjustments after collecting invalid images.
如图2所示,图2为本申请实施例提供的一种车辆充电口定位装置的示意性结构图。As shown in Figure 2, Figure 2 is a schematic structural diagram of a vehicle charging port positioning device provided by an embodiment of the present application.
本申请实施例提供了一种车辆充电口定位装置200,该装置包括:The embodiment of the present application provides a vehicle charging port positioning device 200, which includes:
位姿采集模块201,用于获取与充电装置相关联的图像采集设备的当前位姿信息,其中,上述当前位姿信息包括:上述图像采集设备的当前拍摄角度信息、当前高度信息和当前位置信息中的至少一者;The pose acquisition module 201 is used to acquire the current pose information of the image capture device associated with the charging device, where the above-mentioned current pose information includes: the current shooting angle information, current height information and current location information of the above-mentioned image capture device. at least one of;
图像采集模块202,用于通过上述图像采集设备获取待定位充电口的图像信息;The image acquisition module 202 is used to acquire the image information of the charging port to be located through the above-mentioned image acquisition device;
相对位置确定模块203,用于根据上述图像信息与上述当前位姿信息,确定上述待定位充电口相对于上述图像采集设备的相对位置信息; The relative position determination module 203 is used to determine the relative position information of the charging port to be positioned relative to the image collection device based on the above image information and the above current posture information;
角度位置确定模块204,用于基于上述相对位置信息和上述当前位姿信息,确定上述待定位充电口的第一角度位置信息。The angular position determination module 204 is configured to determine the first angular position information of the charging port to be located based on the relative position information and the current posture information.
一种车辆充电口定位装置200够实现图1的方法实施例中实现的各个过程,为避免重复,这里不再赘述。A vehicle charging port positioning device 200 can implement each process implemented in the method embodiment of Figure 1. To avoid repetition, details will not be described here.
请参阅图3,图3为本申请实施例提供的电子设备的示意性结构图。Please refer to FIG. 3 , which is a schematic structural diagram of an electronic device provided by an embodiment of the present application.
本申请实施例提供了一种电子设备300,包括存储器310、处理器320及存储在存储器310上并可在处理器320上运行的计算机程序311,处理器320执行计算机程序311时实现以下步骤:The embodiment of the present application provides an electronic device 300, which includes a memory 310, a processor 320, and a computer program 311 stored in the memory 310 and executable on the processor 320. When the processor 320 executes the computer program 311, it implements the following steps:
获取与充电装置相关联的图像采集设备的当前位姿信息,其中,上述当前位姿信息包括:上述图像采集设备的当前拍摄角度信息、当前高度信息和当前位置信息中的至少一者;Obtain the current posture information of the image collection device associated with the charging device, wherein the above-mentioned current posture information includes: at least one of the current shooting angle information, current height information and current location information of the above-mentioned image collection device;
通过上述图像采集设备获取待定位充电口的图像信息;Obtain the image information of the charging port to be located through the above image acquisition device;
根据上述图像信息与上述当前位姿信息,确定上述待定位充电口相对于上述图像采集设备的相对位置信息;Determine the relative position information of the charging port to be positioned relative to the image collection device based on the above image information and the above current pose information;
基于上述相对位置信息和上述当前位姿信息,确定上述待定位充电口的第一角度位置信息。Based on the relative position information and the current posture information, the first angular position information of the charging port to be located is determined.
在具体实施过程中,处理器320执行计算机程序311时,可以实现图1对应的实施例中任一实施方式。During specific implementation, when the processor 320 executes the computer program 311, any implementation manner in the embodiment corresponding to Figure 1 can be implemented.
由于本实施例所介绍的电子设备为实施本申请实施例中一种装置所采用的设备,故而基于本申请实施例中所介绍的方法,本领域所属技术人员能够了解本实施例的电子设备的具体实施方式以及其各种变化形式,所以在此对于该电子设备如何实现本申请实施例中的方法不再详细介绍,只要本领域所属技术人员实施本申请实施例中的方法所采用的设备,都属于本申请所欲保护的范围。Since the electronic device introduced in this embodiment is a device used to implement a device in the embodiment of this application, based on the method introduced in the embodiment of this application, those skilled in the art can understand the functions of the electronic device in this embodiment. Specific embodiments and various variations thereof, so how the electronic device implements the methods in the embodiments of the application will not be described in detail here. As long as those skilled in the art implement the methods used in the embodiments of the application, the equipment used will be All fall within the scope of protection sought by this application.
如图4所示,图4为本申请实施例提供的一种计算机可读存储介质的示意性结构图。As shown in Figure 4, Figure 4 is a schematic structural diagram of a computer-readable storage medium provided by an embodiment of the present application.
本实施例提供了一种计算机可读存储介质400,其上存储有计算机程序411,该计算机程序411被处理器执行时实现如下步骤:This embodiment provides a computer-readable storage medium 400 on which a computer program 411 is stored. The computer program 411 implements the following steps when executed by a processor:
获取与充电装置相关联的图像采集设备的当前位姿信息,其中,所述当前位姿信息包括:所述图像采集设备的当前拍摄角度信息、当前高度信息和当前位置信息中的至少一者;Obtain the current posture information of the image collection device associated with the charging device, wherein the current posture information includes: at least one of current shooting angle information, current height information and current location information of the image collection device;
通过所述图像采集设备获取待定位充电口的图像信息;Obtain the image information of the charging port to be located through the image acquisition device;
根据所述图像信息与所述当前位姿信息,确定所述待定位充电口相对于所述图像采集设备的相对位置信息;Determine the relative position information of the charging port to be positioned relative to the image acquisition device according to the image information and the current pose information;
基于所述相对位置信息和所述当前位姿信息,确定所述待定位充电口的第一角度位置信息。Based on the relative position information and the current posture information, first angular position information of the charging port to be positioned is determined.
本领域内的技术人员应明白,本申请的实施例可提供为方法、系统、或计算机程序产品。因此,本申请可采用完全硬件实施例、完全软件实施例、或结合软件和硬件方面的实施例的形式。而且,本申请可采用在一个或多个其中包 含有计算机可用程序代码的计算机可用存储介质(包括但不限于磁盘存储器、CD-ROM、光学存储器等)上实施的计算机程序产品的形式。Those skilled in the art will understand that embodiments of the present application may be provided as methods, systems, or computer program products. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment that combines software and hardware aspects. Furthermore, the present application may employ methods including one or more A form of computer program product implemented on a computer-usable storage medium (including but not limited to disk memory, CD-ROM, optical storage, etc.) containing computer-usable program code.
本申请是参照根据本申请实施例的方法、设备(系统)、和计算机程序产品的流程图和/或方框图来描述。应理解可由计算机程序指令实现流程图和/或方框图中的每一流程和/或方框、以及流程图和/或方框图中的流程和/或方框的结合。可提供这些计算机程序指令到通用计算机、专用计算机、嵌入式计算机或者其他可编程数据处理设备的处理器以产生一个机器,使得通过计算机或其他可编程数据处理设备的处理器执行的指令产生用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的装置。The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each process and/or block in the flowchart illustrations and/or block diagrams, and combinations of processes and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded computer, or other programmable data processing device to produce a machine, such that the instructions executed by the processor of the computer or other programmable data processing device produce a machine for A device that implements the functions specified in a process or processes in a flowchart and/or in a block or blocks in a block diagram.
这些计算机程序指令也可存储在能引导计算机或其他可编程数据处理设备以特定方式工作的计算机可读存储器中,使得存储在该计算机可读存储器中的指令产生包括指令装置的制造品,该指令装置实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能。These computer program instructions may also be stored in a computer-readable memory that causes a computer or other programmable data processing apparatus to operate in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including the instruction means, the instructions The device implements the functions specified in a process or processes of the flowchart and/or a block or blocks of the block diagram.
这些计算机程序指令也可装载到计算机或其他可编程数据处理设备上,使得在计算机或其他可编程设备上执行一系列操作步骤以产生计算机实现的处理,从而在计算机或其他可编程设备上执行的指令提供用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的步骤。These computer program instructions may also be loaded onto a computer or other programmable data processing device, causing a series of operating steps to be performed on the computer or other programmable device to produce computer-implemented processing, thereby executing on the computer or other programmable device. Instructions provide steps for implementing the functions specified in a process or processes of a flowchart diagram and/or a block or blocks of a block diagram.
本申请实施例还提供了一种计算机程序产品,该计算机程序产品包括计算机软件指令,当计算机软件指令在处理设备上运行时,使得处理设备执行如图1对应实施例中的车辆充电口定位方法中的流程。Embodiments of the present application also provide a computer program product. The computer program product includes computer software instructions. When the computer software instructions are run on a processing device, the processing device causes the processing device to execute the vehicle charging port positioning method in the corresponding embodiment of Figure 1. process in.
上述计算机程序产品包括一个或多个计算机指令。在计算机上加载和执行上述计算机程序指令时,全部或部分地产生按照本申请实施例上述的流程或功能。上述计算机可以是通用计算机、专用计算机、计算机网络、或者其他可编程装置。上述计算机指令可以存储在计算机可读存储介质中,或者从一个计算机可读存储介质向另一计算机可读存储介质传输,例如,上述计算机指令可以从一个网站站点、计算机、服务器或数据中心通过有线(例如同轴电缆、光纤、数字用户线(digital subscriber line,DSL))或无线(例如红外、无线、微波等)方式向另一个网站站点、计算机、服务器或数据中心进行传输。上述计算机可读存储介质可以是计算机能够存储的任何可用介质或者是包含一个或多个可用介质集成的服务器、数据中心等数据存储设备。上述可用介质可以是磁性介质,(例如,软盘、硬盘、磁带)、光介质(例如,DVD)、或者半导体介质(例如固态硬盘(solid state disk,SSD))等。The above-mentioned computer program product includes one or more computer instructions. When the above computer program instructions are loaded and executed on a computer, the above-mentioned processes or functions according to the embodiments of the present application are generated in whole or in part. The above-mentioned computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The above computer instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the above-mentioned computer instructions may be transmitted from a website, computer, server or data center via a wired (such as coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (such as infrared, wireless, microwave, etc.) to another website, computer, server or data center. The above-mentioned computer-readable storage medium can be any available medium that a computer can store or a data storage device such as a server or data center integrated with one or more available media. The above available media may be magnetic media (eg, floppy disk, hard disk, tape), optical media (eg, DVD), or semiconductor media (eg, solid state disk (SSD)), etc.
所属领域的技术人员可以清楚地了解到,为描述的方便和简洁,上述描述的系统,装置和单元的具体工作过程,可以参考前述方法实施例中的对应过程,在此不再赘述。Those skilled in the art can clearly understand that for the convenience and simplicity of description, the specific working processes of the systems, devices and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be described again here.
在本申请所提供的几个实施例中,应该理解到,所揭露的系统,装置和方法,可以通过其它的方式实现。例如,以上所描述的装置实施例仅仅是示意性的,例如,上述单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个单元或组件可以结合或者可以集成到另一个系统,或 一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口,装置或单元的间接耦合或通信连接,可以是电性,机械或其它的形式。In the several embodiments provided in this application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only illustrative. For example, the division of the above units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components may be combined or may be integrated into another system, or Some features can be ignored, or not implemented. On the other hand, the coupling or direct coupling or communication connection between each other shown or discussed may be through some interfaces, and the indirect coupling or communication connection of the devices or units may be in electrical, mechanical or other forms.
上述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。The units described above as separate components may or may not be physically separated. The components shown as units may or may not be physical units, that is, they may be located in one place, or they may be distributed to multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.
另外,在本申请各个实施例中的各功能单元可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现,也可以采用软件功能单元的形式实现。In addition, each functional unit in each embodiment of the present application can be integrated into one processing unit, each unit can exist physically alone, or two or more units can be integrated into one unit. The above integrated units can be implemented in the form of hardware or software functional units.
上述集成的单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时,可以存储在一个计算机可读取存储介质中。基于这样的理解,本申请的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的全部或部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质中,包括若干指令用以使得一台计算机设备(可以是个人计算机,服务器,或者网络设备等)执行本申请各个实施例上述方法的全部或部分步骤。而前述的存储介质包括:U盘、移动硬盘、只读存储器(Read-Only Memory,ROM)、随机存取存储器(Random Access Memory,RAM)、磁碟或者光盘等各种可以存储程序代码的介质。If the above-mentioned integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application is essentially or contributes to the existing technology, or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium , including several instructions to cause a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the above methods in various embodiments of the present application. The aforementioned storage media include: U disk, mobile hard disk, read-only memory (ROM), random access memory (Random Access Memory, RAM), magnetic disk or optical disk and other media that can store program code. .
综上所述,以上实施例仅用以说明本申请的技术方案,而非对其限制;尽管参照前述实施例对本申请进行了详细的说明,本领域的普通技术人员应当理解:其依然可以对前述各实施例所记载的技术方案进行修改,或者对其中部分技术特征进行等同替换;而这些修改或者替换,并不使相应技术方案的本质脱离本申请各实施例技术方案的精神和范围。In summary, the above embodiments are only used to illustrate the technical solution of the present application, but not to limit it; although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that they can still The technical solutions described in the foregoing embodiments may be modified, or some of the technical features thereof may be equivalently replaced; however, these modifications or substitutions shall not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present application.
本公开的各个部件实施例可以以硬件实现,或者以在一个或者多个处理器上运行的软件模块实现,或者以它们的组合实现。本领域的技术人员应当理解,可以在实践中使用微处理器或者数字信号处理器(DSP)来实现根据本申请实施例的直播平台的消息处理设备中的一些或者全部部件的一些或者全部功能。本申请还可以实现为用于执行这里所描述的方法的一部分或者全部的设备或者装置程序(例如,计算机程序和计算机程序产品)。这样的实现本申请的程序可以存储在计算机可读介质上,或者可以具有一个或者多个信号的形式。这样的信号可以从因特网网站上下载得到,或者在载体信号上提供,或者以任何其他形式提供。Various component embodiments of the present disclosure may be implemented in hardware, or in software modules running on one or more processors, or in a combination thereof. Those skilled in the art should understand that a microprocessor or a digital signal processor (DSP) may be used in practice to implement some or all functions of some or all components in the message processing device of the live broadcast platform according to embodiments of the present application. The present application may also be implemented as an apparatus or device program (eg, computer program and computer program product) for performing part or all of the methods described herein. Such a program implementing the present application may be stored on a computer-readable medium, or may be in the form of one or more signals. Such signals may be downloaded from an Internet website, or provided on a carrier signal, or in any other form.
例如,图5示出了可以实现根据本申请的平台的消息处理的服务器。该服务器传统上包括处理器510和以存储器520形式的计算机程序产品或者计算机可读介质。存储器520可以是诸如闪存、EEPROM(电可擦除可编程只读存储器)、EPROM、硬盘或者ROM之类的电子存储器。存储器520具有用于执行上述方法中的任何方法步骤的程序代码531的存储空间530。例如,用于程 序代码的存储空间530可以包括分别用于实现上面的方法中的各种步骤的各个程序代码531。这些程序代码可以从一个或者多个计算机程序产品中读出或者写入到这一个或者多个计算机程序产品中。这些计算机程序产品包括诸如硬盘,紧致盘(CD)、存储卡或者软盘之类的程序代码载体。这样的计算机程序产品通常为如参考图6所述的便携式或者固定存储单元。该存储单元可以具有与图5的服务器中的存储器520类似布置的存储段、存储空间等。程序代码可以例如以适当形式进行压缩。通常,存储单元包括计算机可读代码531’,即可以由例如诸如510之类的处理器读取的代码,这些代码当由服务器运行时,导致该服务器执行上面所描述的方法中的各个步骤。For example, Figure 5 shows a server that can implement message processing according to the platform of the present application. The server conventionally includes a processor 510 and a computer program product or computer-readable medium in the form of memory 520 . Memory 520 may be electronic memory such as flash memory, EEPROM (Electrically Erasable Programmable Read Only Memory), EPROM, hard disk, or ROM. The memory 520 has a storage space 530 for program code 531 for executing any method steps in the above-described methods. For example, for program The storage space 530 of the program code may include individual program codes 531 respectively used to implement various steps in the above method. These program codes can be read from or written into one or more computer program products. These computer program products include program code carriers such as hard disks, compact disks (CDs), memory cards or floppy disks. Such computer program products are typically portable or fixed storage units as described with reference to FIG. 6 . The storage unit may have storage segments, storage spaces, etc. arranged similarly to the memory 520 in the server of FIG. 5 . The program code may, for example, be compressed in a suitable form. Typically, the storage unit includes computer readable code 531', ie code that can be read by, for example, a processor such as 510, which code, when run by a server, causes the server to perform the various steps in the method described above.
本文中所称的“一个实施例”、“实施例”或者“一个或者多个实施例”意味着,结合实施例描述的特定特征、结构或者特性包括在本申请的至少一个实施例中。此外,请注意,这里“在一个实施例中”的词语例子不一定全指同一个实施例。Reference herein to "one embodiment," "an embodiment," or "one or more embodiments" means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the present application. In addition, please note that the examples of the word "in one embodiment" here do not necessarily all refer to the same embodiment.
在此处所提供的说明书中,说明了大量具体细节。然而,能够理解,本申请的实施例可以在没有这些具体细节的情况下被实践。在一些实例中,并未详细示出公知的方法、结构和技术,以便不模糊对本说明书的理解。In the instructions provided here, a number of specific details are described. However, it is understood that embodiments of the present application may be practiced without these specific details. In some instances, well-known methods, structures, and techniques have not been shown in detail so as not to obscure the understanding of this description.
应该注意的是上述实施例对本申请进行说明而不是对本申请进行限制,并且本领域技术人员在不脱离所附权利要求的范围的情况下可设计出替换实施例。在权利要求中,不应将位于括号之间的任何参考符号构造成对权利要求的限制。单词“包含”不排除存在未列在权利要求中的元件或步骤。位于元件之前的单词“一”或“一个”不排除存在多个这样的元件。本申请可以借助于包括有若干不同元件的硬件以及借助于适当编程的计算机来实现。在列举了若干装置的单元权利要求中,这些装置中的若干个可以是通过同一个硬件项来具体体现。单词第一、第二、以及第三等的使用不表示任何顺序。可将这些单词解释为名称。It should be noted that the above-mentioned embodiments illustrate rather than limit the application, and that those skilled in the art will be able to design alternative embodiments without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word "comprising" does not exclude the presence of elements or steps not listed in a claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The application may be implemented by means of hardware comprising several different elements and by means of a suitably programmed computer. In the element claim enumerating several means, several of these means may be embodied by the same item of hardware. The use of the words first, second, third, etc. does not indicate any order. These words can be interpreted as names.
此外,还应当注意,本说明书中使用的语言主要是为了可读性和教导的目的而选择的,而不是为了解释或者限定本申请的主题而选择的。因此,在不偏离所附权利要求书的范围和精神的情况下,对于本技术领域的普通技术人员来说许多修改和变更都是显而易见的。对于本申请的范围,对本申请所做的公开是说明性的,而非限制性的,本申请的范围由所附权利要求书限定。 In addition, it should be noted that the language used in this specification has been selected primarily for readability and teaching purposes, and has not been selected to explain or define the subject matter of the application. Accordingly, many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the appended claims. The disclosure of the present application is illustrative rather than restrictive as to the scope of the present application, which is defined by the appended claims.

Claims (12)

  1. 一种车辆充电口定位方法,其中,用于充电装置,包括:A vehicle charging port positioning method, wherein the charging device includes:
    获取与充电装置相关联的图像采集设备的当前位姿信息,其中,所述当前位姿信息包括:所述图像采集设备的当前拍摄角度信息、当前高度信息和当前位置信息中的至少一者;Obtain the current posture information of the image collection device associated with the charging device, wherein the current posture information includes: at least one of current shooting angle information, current height information and current location information of the image collection device;
    通过所述图像采集设备获取待定位充电口的图像信息;Obtain the image information of the charging port to be located through the image acquisition device;
    根据所述图像信息与所述当前位姿信息,确定所述待定位充电口相对于所述图像采集设备的相对位置信息;Determine the relative position information of the charging port to be positioned relative to the image acquisition device according to the image information and the current pose information;
    基于所述相对位置信息和所述当前位姿信息,确定所述待定位充电口的第一角度位置信息。Based on the relative position information and the current posture information, first angular position information of the charging port to be positioned is determined.
  2. 如权利要求1所述的车辆充电口定位方法,其中,还包括:The vehicle charging port positioning method as claimed in claim 1, further comprising:
    根据所述待定位充电口的第一角度位置信息,控制所述图像采集设备移动至所述移动至所述待定位充电口的正前方;According to the first angular position information of the charging port to be positioned, control the image collection device to move to the front of the charging port to be positioned;
    通过所述图像采集设备在所述待定位充电口的正前方采集所述待定位充电口的测距深度图像信息;Collect the ranging depth image information of the charging port to be located directly in front of the charging port to be located by using the image acquisition device;
    基于所述测距深度图像信息,确定所述图像采集设备与所述待定位充电口的距离信息;Based on the ranging depth image information, determine the distance information between the image acquisition device and the charging port to be located;
    根据所述距离信息,确定所述待定位充电口的距离位置信息;According to the distance information, determine the distance position information of the charging port to be located;
    基于所述第一角度位置信息和所述距离位置信息,确定所述待定位充电口的位置信息。Based on the first angular position information and the distance position information, the position information of the charging port to be located is determined.
  3. 如权利要求1所述的车辆充电口定位方法,其中,还包括:The vehicle charging port positioning method as claimed in claim 1, further comprising:
    获取所述图像采集设备的第一切换位姿信息;Obtain the first switching pose information of the image acquisition device;
    控制所述图像采集设备切换为第一切换位姿;Control the image acquisition device to switch to the first switching pose;
    通过所述图像采集设备获取待定位充电口的第一切换位姿图像信息;Obtain the first switching pose image information of the charging port to be located through the image acquisition device;
    根据所述图像信息与所述第一切换位姿信息,确定所述待定位充电口相对于所述图像采集设备的第一切换位姿的第一相对位置信息;Determine first relative position information of the charging port to be positioned relative to the first switching posture of the image acquisition device based on the image information and the first switching pose information;
    基于所述第一相对位置信息和所述第一切换位姿信息,确定所述待定位充电口的第二角度位置信息;Based on the first relative position information and the first switching posture information, determine the second angular position information of the charging port to be positioned;
    基于所述第一角度位置信息和所述第二角度位置信息,确定所述待定位充电口的目标角度位置信息。Based on the first angular position information and the second angular position information, target angular position information of the charging port to be located is determined.
  4. 如权利要求1所述的车辆充电口定位方法,其中,所述图像信息包括彩色图像信息和深度图像信息。The vehicle charging port positioning method according to claim 1, wherein the image information includes color image information and depth image information.
  5. 如权利要求4所述的车辆充电口定位方法,其中,所述根据所述图像信息与所述当前位姿信息,确定所述待定位充电口相对于所述图像采集设备的相对位置信息,包括:The vehicle charging port positioning method according to claim 4, wherein determining the relative position information of the charging port to be located relative to the image acquisition device based on the image information and the current posture information includes: :
    根据所述彩色图像信息,确定所述待定位充电口在彩色图像中的轮廓位置信息; According to the color image information, determine the outline position information of the charging port to be located in the color image;
    基于所述深度图像信息和所述轮廓位置信息,确定所述待定位充电口相对于所述图像采集设备的当前拍摄角度的相对角度位置信息;Based on the depth image information and the contour position information, determine the relative angular position information of the charging port to be positioned relative to the current shooting angle of the image acquisition device;
    基于所述相对角度位置信息,确定所述待定位充电口相对于所述图像采集设备的相对位置信息。Based on the relative angular position information, relative position information of the charging port to be positioned relative to the image acquisition device is determined.
  6. 如权利要求1所述的车辆充电口定位方法,其中,在所述通过所述图像采集设备获取待定位充电口的图像信息的步骤之前,还包括:The vehicle charging port positioning method according to claim 1, wherein before the step of obtaining the image information of the charging port to be located through the image acquisition device, it further includes:
    获取所述图像采集设备相关联的车位的使用状态信息;Obtain the usage status information of the parking space associated with the image acquisition device;
    在所述车位内存在车辆的情况下,获取所述车辆的停放状态信息;When there is a vehicle in the parking space, obtain the parking status information of the vehicle;
    获取所述车辆的型号信息;Obtain the model information of the vehicle;
    基于所述型号信息和所述停放状态信息,确定所述待定位充电口所处的待定位范围。Based on the model information and the parking status information, the range to be located where the charging port to be located is determined.
  7. 如权利要求6所述的车辆充电口定位方法,其中,还包括:The vehicle charging port positioning method as claimed in claim 6, further comprising:
    根据所述图像采集设备的当前位姿信息,确定所述图像采集设备的当前采集范围;Determine the current acquisition range of the image acquisition device according to the current pose information of the image acquisition device;
    基于所述当前采集范围和所述待定位范围,判断所述图像采集设备在当前位姿是否能够获取到待定位充电口的图像信息;Based on the current acquisition range and the to-be-located range, determine whether the image acquisition device can obtain the image information of the charging port to be located in the current posture;
    在所述图像采集设备在当前位姿不能获取到待定位充电口的图像信息的情况下,控制所述图像采集设备移动至所述待定位范围内。If the image acquisition device cannot obtain the image information of the charging port to be located in the current posture, the image acquisition device is controlled to move within the range to be located.
  8. 一种车辆充电口定位装置,其中,用于充电装置,包括:A vehicle charging port positioning device, wherein the charging device includes:
    位姿采集模块,用于获取与充电装置相关联的图像采集设备的当前位姿信息,其中,所述当前位姿信息包括:所述图像采集设备的当前拍摄角度信息、当前高度信息和当前位置信息中的至少一者;The pose acquisition module is used to acquire the current pose information of the image acquisition device associated with the charging device, where the current pose information includes: the current shooting angle information, the current height information and the current position of the image acquisition device. at least one of the information;
    图像采集模块,用于通过所述图像采集设备获取待定位充电口的图像信息;An image acquisition module, configured to acquire image information of the charging port to be located through the image acquisition device;
    相对位置确定模块,用于根据所述图像信息与所述当前位姿信息,确定所述待定位充电口相对于所述图像采集设备的相对位置信息;A relative position determination module, configured to determine the relative position information of the charging port to be positioned relative to the image acquisition device based on the image information and the current posture information;
    角度位置确定模块,用于基于所述相对位置信息和所述当前位姿信息,确定所述待定位充电口的第一角度位置信息。An angular position determination module, configured to determine first angular position information of the charging port to be located based on the relative position information and the current posture information.
  9. 一种电子设备,包括存储器、处理器,其中,所述处理器用于执行存储器中存储的计算机程序时实现如权利要求1至7中任一项所述的车辆充电口定位方法的步骤。An electronic device includes a memory and a processor, wherein the processor is configured to implement the steps of the vehicle charging port positioning method according to any one of claims 1 to 7 when executing a computer program stored in the memory.
  10. 一种计算机可读存储介质,其上存储有计算机程序,其中:所述计算机程序被处理器执行时实现如权利要求1至7中任一项所述的车辆充电口定位方法的步骤。A computer-readable storage medium having a computer program stored thereon, wherein: when the computer program is executed by a processor, the steps of the vehicle charging port positioning method according to any one of claims 1 to 7 are implemented.
  11. 一种计算机程序,包括计算机可读代码,当所述计算机可读代码在服务器上运行时,导致所述服务器执行根据权利要求1至7中任一项所述的车辆充电口定位方法的步骤。A computer program, comprising computer readable code, when the computer readable code is run on a server, causes the server to perform the steps of the vehicle charging port positioning method according to any one of claims 1 to 7.
  12. 一种计算机可读介质,其中存储了如权利要求11所述的计算机程序。 A computer-readable medium in which the computer program of claim 11 is stored.
PCT/CN2023/121985 2022-12-02 2023-09-27 Vehicle charging port positioning method and related device WO2024002395A2 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202211540463.8 2022-12-02
CN202211540463.8A CN116051464A (en) 2022-12-02 2022-12-02 Vehicle charging port positioning method and related equipment

Publications (2)

Publication Number Publication Date
WO2024002395A2 true WO2024002395A2 (en) 2024-01-04
WO2024002395A3 WO2024002395A3 (en) 2024-04-04

Family

ID=86118905

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2023/121985 WO2024002395A2 (en) 2022-12-02 2023-09-27 Vehicle charging port positioning method and related device

Country Status (2)

Country Link
CN (1) CN116051464A (en)
WO (1) WO2024002395A2 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116051464A (en) * 2022-12-02 2023-05-02 浙江安吉智电控股有限公司 Vehicle charging port positioning method and related equipment

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114364569B (en) * 2019-05-31 2024-03-15 Abb电动汽车有限责任公司 Device and method for charging an electric vehicle, and method for calibrating a device for charging an electric vehicle
CN112248835B (en) * 2020-10-21 2022-02-08 北京理工大学 Charging mechanical arm control method and system
NL2028169B1 (en) * 2021-05-06 2022-11-24 Rocsys B V Method and device for determining a position and orientation of a socket of an electric vehicle
US12062208B2 (en) * 2021-05-26 2024-08-13 ABB E-mobility B.V. Multi-stage autonomous localization architecture for charging electric vehicles
CN114194056B (en) * 2021-12-09 2024-03-01 北京有竹居网络技术有限公司 Vehicle charging method and device and electronic equipment
CN116051464A (en) * 2022-12-02 2023-05-02 浙江安吉智电控股有限公司 Vehicle charging port positioning method and related equipment

Also Published As

Publication number Publication date
CN116051464A (en) 2023-05-02
WO2024002395A3 (en) 2024-04-04

Similar Documents

Publication Publication Date Title
CN110310326B (en) Visual positioning data processing method and device, terminal and computer readable storage medium
US9418280B2 (en) Image segmentation method and image segmentation device
CN110648363B (en) Camera gesture determining method and device, storage medium and electronic equipment
CN111325798B (en) Camera model correction method, device, AR implementation equipment and readable storage medium
US10997733B2 (en) Rigid-body configuration method, apparatus, terminal device, and computer readable storage medium
EP3588325B1 (en) Method, device and system for processing image tagging information
TWI686771B (en) 3d model reconstruction method, electronic device, and non-transitory computer readable storage medium
WO2021136386A1 (en) Data processing method, terminal, and server
WO2024002395A2 (en) Vehicle charging port positioning method and related device
CN111402413B (en) Three-dimensional visual positioning method and device, computing equipment and storage medium
WO2021103824A1 (en) Key point position determining method and device in robot hand-eye calibration based on calibration block
TW202244680A (en) Pose acquisition method, electronic equipment and storage medium
CN115205383A (en) Camera pose determination method and device, electronic equipment and storage medium
CN113763466B (en) Loop detection method and device, electronic equipment and storage medium
CN111832579A (en) Map interest point data processing method and device, electronic equipment and readable medium
JP7204786B2 (en) Visual search method, device, computer equipment and storage medium
CN110120090B (en) Three-dimensional panoramic model construction method and device and readable storage medium
JP2022519398A (en) Image processing methods, equipment and electronic devices
CN111179408B (en) Three-dimensional modeling method and equipment
CN110188630A (en) A kind of face identification method and camera
CN112907657A (en) Robot repositioning method, device, equipment and storage medium
US20210073580A1 (en) Method and apparatus for obtaining product training images, and non-transitory computer-readable storage medium
CN112258647A (en) Map reconstruction method and device, computer readable medium and electronic device
CN112017304A (en) Method, apparatus, electronic device, and medium for presenting augmented reality data
CN114898084B (en) Visual positioning method, device and storage medium

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23830557

Country of ref document: EP

Kind code of ref document: A2