WO2020107438A1 - 三维重建方法和装置 - Google Patents

三维重建方法和装置 Download PDF

Info

Publication number
WO2020107438A1
WO2020107438A1 PCT/CN2018/118668 CN2018118668W WO2020107438A1 WO 2020107438 A1 WO2020107438 A1 WO 2020107438A1 CN 2018118668 W CN2018118668 W CN 2018118668W WO 2020107438 A1 WO2020107438 A1 WO 2020107438A1
Authority
WO
WIPO (PCT)
Prior art keywords
microwave radar
information
target object
coordinate system
target
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2018/118668
Other languages
English (en)
French (fr)
Inventor
祝煌剑
高迪
王春明
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
SZ DJI Technology Co Ltd
Original Assignee
SZ DJI Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by SZ DJI Technology Co Ltd filed Critical SZ DJI Technology Co Ltd
Priority to PCT/CN2018/118668 priority Critical patent/WO2020107438A1/zh
Priority to CN201880069853.7A priority patent/CN111406225A/zh
Publication of WO2020107438A1 publication Critical patent/WO2020107438A1/zh
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/88Radar or analogous systems specially adapted for specific applications
    • G01S13/89Radar or analogous systems specially adapted for specific applications for mapping or imaging
    • G01S13/90Radar or analogous systems specially adapted for specific applications for mapping or imaging using synthetic aperture techniques, e.g. synthetic aperture radar [SAR] techniques

Definitions

  • This application relates to the field of computer technology, and in particular to a three-dimensional reconstruction method and device.
  • Three-dimensional reconstruction technology refers to acquiring a three-dimensional point set of the target scene through a certain measurement method, analyzing and processing the point set, and reconstructing the high-precision three-dimensional model suitable for computer representation and processing, including the spatial structure model and surface texture model.
  • the 3D reconstruction technology is suitable for autonomous robots (autonomous obstacle avoidance, path planning), geographic information systems (surveying, digital cities) and other fields.
  • the current three-dimensional reconstruction method can be based on laser detection technology, but the laser detection technology has high requirements on the light environment and is susceptible to interference from external environmental light sources; the current three-dimensional reconstruction method can also be an image-based method: pixels in the image of the target scene The coordinate index and the pixel value corresponding to the pixel are analyzed and processed to extract the point cloud data of the target scene from the image, but this method has certain requirements on the ambient lighting conditions when acquiring the image of the target scene and the calculation method is more complicated.
  • Embodiments of the present application provide a three-dimensional reconstruction method and device.
  • the reconstruction process is not disturbed by external environmental light sources, which improves the efficiency of three-dimensional reconstruction of the target scene.
  • an embodiment of the present application provides a three-dimensional reconstruction method, which is applied to a microwave radar.
  • the method includes:
  • microwave radar is used to perform three-dimensional reconstruction of the target scene.
  • the detection signal emitted by the microwave radar is microwave, and the microwave is not interfered by the external environment light source, which makes the three-dimensional reconstruction of the target scene easy to implement and the microwave radar can work all-weather. Improve the efficiency of 3D reconstruction of the target scene.
  • the observation information includes an azimuth angle, a rotation angle of the microwave radar, and an observation distance, where the azimuth angle is an angle at which the target object is located compared to the microwave radar, the The rotation angle of the microwave radar is the rotation angle when the microwave radar observes the target object, and the observation distance is the distance from the target object to the microwave radar.
  • the acquiring observation information of each target object in the target scene includes:
  • the rotation angle of the microwave radar corresponding to each target object is determined according to the rotation angle of the antenna of the microwave radar when the echo signal corresponding to each target object is received.
  • the rotation angle of the antenna of the microwave radar when the echo signal of the target object is received is detected by the angle sensor of the microwave radar.
  • the angle sensor of the microwave radar includes at least one of the following: a grating angle sensor and a Hall sensor.
  • the observation information includes at least one of the following: observation distance, observation angle, and observation energy.
  • the determining the three-dimensional coordinate information of each target object in the microwave radar coordinate system according to the observation information of each target object includes:
  • each of the target objects determine the horizontal distance of each of the target objects relative to the center of the microwave radar, the depth of field of each of the target objects relative to the center of the microwave radar, and each of the targets The vertical distance of the object relative to the center of the microwave radar.
  • the three-dimensional reconstruction of the target scene according to the three-dimensional coordinate information of each target object in the microwave radar coordinate system includes:
  • three-dimensional reconstruction of the target scene is performed.
  • the converting the three-dimensional coordinate information of each target object in the coordinate system of the microwave radar into three-dimensional coordinate information of each target object in the geodetic coordinate system includes:
  • the acquiring three-dimensional coordinate information of the microwave radar in the geodetic coordinate system when observing each of the target objects includes:
  • the three-dimensional coordinate information of the microwave radar in the geodetic coordinate system is obtained according to the current longitude information and the current latitude information of the microwave radar, and the coordinate origin of the geodetic coordinate system.
  • the coordinate origin of the geodetic coordinate system is set at a preset coordinate position.
  • the preset coordinate position includes at least one of the following: a coordinate position preset by a user, and a coordinate position when the microwave radar starts to rotate.
  • the three-dimensional reconstruction of the target scene according to the three-dimensional coordinate information of each of the target objects in the coordinate system of the microwave radar includes:
  • an embodiment of the present application provides a microwave radar, including:
  • Antenna device used to transmit microwave signals and receive echo signals reflected back from the target object
  • a rotation driving device for driving the antenna device to rotate
  • the controller is in communication connection with the antenna device and the rotation driving device, and is used to perform the following operations:
  • the rotation driving device includes a motor for driving the rotation of the antenna device and an angle sensor for sensing the rotation angle of the antenna device.
  • the angle sensor of the microwave radar includes at least one of the following: a grating angle sensor and a Hall sensor.
  • the observation information includes an azimuth angle, a rotation angle of the microwave radar, and an observation distance, where the azimuth angle is an angle at which the target object is located compared to the microwave radar, the The rotation angle of the microwave radar is the rotation angle when the microwave radar observes the target object, and the observation distance is the distance from the target object to the microwave radar.
  • the controller is specifically used when acquiring observation information of each target object in the target scene:
  • the rotation angle of the microwave radar corresponding to each target object is determined according to the rotation angle of the antenna device when the echo signals corresponding to each target object acquired from the angle sensor are received.
  • the observation information includes at least one of the following: observation distance, observation angle, and observation energy.
  • the controller determines the three-dimensional coordinate information of each target object in the coordinate system of the microwave radar according to the observation information of each target object, it is specifically used to:
  • each of the target objects determine the horizontal distance of each of the target objects relative to the center of the microwave radar, the depth of field of each of the target objects relative to the center of the microwave radar, and each of the targets The vertical distance of the object relative to the center of the microwave radar.
  • the controller when the controller performs three-dimensional reconstruction of the target scene according to the three-dimensional coordinate information of each target object in the coordinate system of the microwave radar, it is specifically used to:
  • three-dimensional reconstruction of the target scene is performed.
  • the microwave radar further includes an inertial measurement unit, and the inertial measurement unit and the controller are communicatively connected;
  • the inertial measurement unit is configured to acquire the attitude information of the microwave radar when each of the target objects is observed;
  • the controller converts the three-dimensional coordinate information of each target object in the coordinate system of the microwave radar into the three-dimensional coordinate information of each target object in the geodetic coordinate system, it is specifically used to:
  • the microwave radar further includes a global positioning system GPS, and the GPS is in communication with the controller;
  • the GPS is used to obtain current longitude information and current latitude information of the microwave radar when each of the target objects is observed;
  • the controller When the controller observes each of the target objects, it is specifically used when acquiring the three-dimensional coordinate information of the microwave radar in the geodetic coordinate system:
  • the three-dimensional coordinate information of the microwave radar in the geodetic coordinate system is obtained according to the current longitude information and the current latitude information of the microwave radar, and the coordinate origin of the geodetic coordinate system.
  • the coordinate origin of the geodetic coordinate system is set at a preset coordinate position.
  • the preset coordinate position includes at least one of the following: a coordinate position preset by a user, and a coordinate position when the microwave radar starts to rotate.
  • the controller when the controller performs three-dimensional reconstruction of the target scene according to the three-dimensional coordinate information of each target object in the coordinate system of the microwave radar, it is specifically used to:
  • an embodiment of the present application provides a mobile platform, including:
  • the microwave radar is installed on the body.
  • the movable platform is an unmanned aerial vehicle or an autonomous vehicle.
  • an embodiment of the present application provides a computer-readable storage medium, including a program or an instruction, when the program or instruction runs on a computer, the first aspect and the method described in any possible design of the first aspect Was executed.
  • This application uses microwave radar to perform three-dimensional reconstruction of the target scene.
  • the detection signal emitted by the microwave radar is microwave, and the microwave is not interfered by the external environment light source, which makes the three-dimensional reconstruction of the target scene easy to realize and the microwave radar can work all-weather, therefore, it improves The efficiency of 3D reconstruction of the target scene.
  • FIG. 1 is a schematic structural diagram of a movable platform provided by an embodiment of the present application.
  • FIG. 3 is a schematic structural diagram 1 of a microwave radar provided by an embodiment of this application.
  • FIG. 4 is a second schematic structural diagram of a microwave radar provided by an embodiment of the present application.
  • FIG. 5 is a schematic structural diagram 3 of a microwave radar provided by an embodiment of the present application.
  • the embodiments of the present application provide a three-dimensional reconstruction method and device.
  • the device of the three-dimensional reconstruction method may be a microwave radar.
  • the microwave radar can be mounted on the body of a movable platform when it is used for three-dimensional reconstruction, such as the body of an unmanned aerial vehicle or the body of an autonomous vehicle.
  • FIG. 1 is a schematic structural diagram of a movable platform provided by an embodiment of the present application.
  • the movable platform 100 is an unmanned aerial vehicle.
  • the movable platform includes a body 11 and a microwave radar 12 for three-dimensional reconstruction.
  • the microwave radar 12 is installed on the body 11.
  • the microwave radar 12 moves with the movement of the unmanned aerial vehicle, scans the target scene to be three-dimensionally reconstructed to obtain data for three-dimensional reconstruction—the three-dimensional coordinate information of each target object of the target scene, and according to each target of the target scene
  • the three-dimensional coordinate information of the object completes the three-dimensional reconstruction of the target scene.
  • the microwave radar 12 used for three-dimensional reconstruction in this embodiment may be a rotating millimeter microwave radar.
  • FIG. 2 is a flowchart of a three-dimensional reconstruction method provided by an embodiment of the present application. Referring to FIG. 2, the method of this embodiment includes:
  • Step S101 Obtain observation information of each target object in the target scene
  • the target scene in this embodiment is a scene to be three-dimensionally reconstructed.
  • Obtain the observation information of each target object in the target scene including:
  • the antenna of the microwave radar when the microwave radar performs three-dimensional reconstruction, the antenna of the microwave radar emits a microwave detection signal, and the microwave detection signal is reflected by a target object included in the target scene to generate an echo signal, and the antenna of the microwave radar receives the echo signal.
  • the target object in this embodiment is an object that can reflect the microwave detection signal emitted by the antenna of the microwave radar in the target scene.
  • the microwave radar Because the microwave radar is carried on the movable platform during the three-dimensional reconstruction, it moves along with the movement of the movable platform to complete the scanning of the target scene. Therefore, there are multiple target objects in the target scene, and the microwave radar will acquire each target object Corresponding echo signal.
  • the microwave radar processes the echo signal to obtain the distance from the target object to the microwave radar (observation distance of the target object) and the target object Compared to the angle of the microwave radar (azimuth of the target object).
  • the microwave radar will rotate around a center of rotation during the three-dimensional reconstruction process.
  • the antenna of the microwave radar also rotates relative to the center of rotation, then for each target object, the echo signal corresponding to the target object is received
  • the rotation angle of the microwave radar antenna with respect to the rotation center is the rotation angle of the microwave radar corresponding to the target object
  • the rotation angle of the microwave radar corresponding to the target object is the rotation angle of the microwave radar when the target object is observed.
  • the rotation angle of the microwave radar antenna when receiving the echo signal corresponding to the target object can be detected by the microwave radar angle sensor.
  • the angle sensor of the microwave radar includes but is not limited to at least one of the following: grating angle sensor and Hall sensor.
  • the observation information of the target object can include: azimuth angle, rotation angle of the microwave radar and observation distance, where the azimuth angle is the angle of the target object compared to the microwave radar, and the rotation angle of the microwave radar is observed by the microwave radar
  • the rotation angle of the target object, the observation distance is the distance from the target object to the microwave radar.
  • the observation information may include at least one of the following: observation distance and observation angle; further, the observation information may also include observation energy, which is the energy of the echo signal.
  • Step S102 Determine the three-dimensional coordinate information of each target object in the microwave radar coordinate system according to the observation information of each target object.
  • the three-dimensional coordinate information of each target object in the coordinate system of the microwave radar may be determined according to the observation information of each target object.
  • the origin of the coordinate system of the microwave radar is the center of the microwave radar.
  • the microwave radar coordinate system which specifically includes:
  • each target object determine the horizontal distance of each target object relative to the center of the microwave radar, the depth of field distance of each target object relative to the center of the microwave radar, and the vertical distance of each target object relative to the center of the microwave radar.
  • the three-dimensional coordinate information of the target object in the microwave radar coordinate system includes: the horizontal distance of the target object relative to the center of the microwave radar, the depth of field distance of the target object relative to the center of the microwave radar, and the target object relative to the microwave The vertical distance of the center of the radar.
  • the three-dimensional coordinate information of the target object in the microwave radar coordinate system can be obtained by the following formula:
  • x represents the horizontal distance of the target object relative to the center of the microwave radar
  • y represents the depth of field distance of the target object relative to the center of the microwave radar
  • z represents the vertical distance of the target object relative to the center of the microwave radar
  • r represents the target object's Observation distance (the distance from the target object to the center of the microwave radar)
  • represents the azimuth of the target object (the angle of the target object compared to the microwave radar)
  • Step S103 Perform three-dimensional reconstruction of the target scene according to the three-dimensional coordinate information of each target object in the microwave radar coordinate system.
  • the target scene can be three-dimensionally reconstructed according to the three-dimensional coordinate information of each target object in the microwave radar coordinate system.
  • the microwave radar Before superimposing the 3D coordinate information of each target object in the microwave radar coordinate system to perform the 3D reconstruction of the target scene, the microwave radar must be compensated Own position and posture, therefore, in one way, according to the three-dimensional coordinate information of each target object in the microwave radar coordinate system, the three-dimensional reconstruction of the target scene includes:
  • the three-dimensional coordinate information of each target object in the microwave radar coordinate system is transformed into the three-dimensional coordinate information of each target object in the geodetic coordinate system, which specifically includes:
  • the attitude information of the microwave radar may be the attitude quaternion of the microwave radar.
  • the attitude information of the microwave radar can be obtained by an inertial measurement unit (IMU) of the microwave radar.
  • IMU inertial measurement unit
  • the method of acquiring the three-dimensional coordinate information of the microwave radar in the geodetic coordinate system when the target object is observed can be as follows:
  • the current longitude information and current latitude information of the microwave radar are obtained, and the observed longitude information and current latitude information of the microwave radar and the coordinate origin of the earth coordinate system are obtained.
  • the current longitude information and current latitude information of the microwave radar can be obtained through the global positioning system (GPS) of the microwave radar.
  • GPS global positioning system
  • the current longitude information and current latitude information of the microwave radar when the target object is observed can be converted into the observation based on the origin of the geodetic coordinate system
  • the origin of the geodetic coordinate system is set at a preset coordinate position.
  • the preset coordinate position may be a coordinate position preset by the user, for example, a coordinate position where both longitude and latitude are 0°.
  • the preset coordinate position may be the coordinate position when the microwave radar starts to rotate.
  • the coordinate position when the microwave radar starts to rotate is the position where the microwave radar starts to emit the microwave detection signal during the three-dimensional reconstruction of the target scene.
  • the target object is placed in the coordinate system of the microwave radar Transforms the three-dimensional coordinate information into three-dimensional coordinate information in the geodetic coordinate system.
  • the three-dimensional coordinate information of the target object in the microwave radar coordinate system can be transformed into the three-dimensional coordinate information in the geodetic coordinate system by the following formula:
  • x G represents the distance of the target object from the north of the coordinate origin of the geodetic coordinate system
  • y G represents the target object relative
  • z G represents the distance of the target object in the vertical direction relative to the coordinate origin of the geodetic coordinate system
  • the three-dimensional coordinate information of each target object in the geodetic coordinate system is superimposed to obtain a three-dimensional reconstruction model of the target scene.
  • a three-dimensional reconstruction algorithm For a specific three-dimensional reconstruction algorithm, reference may be made to the algorithm in the prior art, and details are not described in this embodiment.
  • the 3D coordinate information in the coordinate system of the 3D reconstruction of the target scene includes:
  • the three-dimensional reconstruction of the target scene may include:
  • the microwave radar is used to perform three-dimensional reconstruction of the target scene.
  • the detection signal emitted by the microwave radar is microwave, and the microwave is not disturbed by the external environmental light source, which makes the three-dimensional reconstruction of the target scene easy to realize and the microwave radar can work around the clock , Improve the efficiency of 3D reconstruction of the target scene.
  • the method of using microwave radar to reconstruct the three-dimensional target scene is simple, which further improves the efficiency of the three-dimensional reconstruction of the target scene.
  • the three-dimensional reconstruction method of this embodiment includes acquiring the observation information of each target object in the target scene, determining the three-dimensional coordinate information of each target object in the microwave radar coordinate system according to the observation information of each target object; The three-dimensional coordinate information in the coordinate system of the microwave radar performs three-dimensional reconstruction of the target scene.
  • the three-dimensional reconstruction method of this embodiment improves the efficiency of three-dimensional reconstruction of the target scene.
  • FIG. 3 is a schematic structural diagram 1 of a microwave radar provided by an embodiment of this application; referring to FIG. 3, the microwave radar 300 of this embodiment includes:
  • the antenna device 31 is used to transmit microwave signals and receive echo signals reflected back from the target object;
  • the rotation driving device 32 is used to drive the antenna device to rotate
  • the controller 33 is in communication with the antenna device 31 and the rotation driving device 32, and is used to perform the following operations:
  • three-dimensional reconstruction of the target scene is performed.
  • the rotation driving device includes a motor 321 for driving the antenna device to rotate, and an angle sensor 322 for sensing the rotation angle of the antenna device.
  • the angle sensor of the microwave radar includes at least one of the following: a grating angle sensor and a Hall sensor.
  • the microwave radar in this embodiment may be used to implement the technical solutions in the foregoing method embodiments.
  • the implementation principles and technical effects are similar, and are not described here again.
  • the observation information includes an azimuth angle, a rotation angle of the microwave radar 300, and an observation distance, wherein the azimuth angle is an angle at which the target object is located compared to the microwave radar 300, and the microwave radar
  • the rotation angle of 300 is the rotation angle when the microwave radar 300 observes the target object
  • the observation distance is the distance from the target object to the microwave radar 300.
  • the controller 33 when acquiring the observation information of each target object in the target scene, the controller 33 is specifically used to:
  • the rotation angle of the microwave radar 300 is determined according to the rotation angle of the antenna device 31 when the echo signals corresponding to the target objects acquired from the angle sensor 322 are received.
  • the observation information includes at least one of the following: observation distance, observation angle, and observation energy.
  • controller 33 determines the three-dimensional coordinate information of each target object in the coordinate system of the microwave radar 300 according to the observation information of each target object, it is specifically used to:
  • each of the target objects determine the horizontal distance of each of the target objects relative to the center of the microwave radar 300, the depth of field of each of the target objects relative to the center of the microwave radar 300, and each The vertical distance of the target object relative to the center of the microwave radar 300.
  • controller 33 when the controller 33 performs three-dimensional reconstruction of the target scene according to the three-dimensional coordinate information of each target object in the coordinate system of the microwave radar 300, it is specifically used to:
  • three-dimensional reconstruction of the target scene is performed.
  • the microwave radar in this embodiment may be used to implement the technical solutions in the foregoing method embodiments.
  • the implementation principles and technical effects are similar, and are not described here again.
  • FIG. 4 is a schematic structural diagram 2 of a microwave radar provided by an embodiment of the present application; referring to FIG. 4, the microwave radar of this embodiment further includes: an inertial measurement unit 34 in communication with the controller 33 based on the previous embodiment .
  • the inertial measurement unit 34 is configured to acquire the attitude information of the microwave radar 300 when each target object is observed;
  • controller 33 converts the three-dimensional coordinate information of each target object in the coordinate system of the microwave radar 300 into the three-dimensional coordinate information of each target object in the geodetic coordinate system, it is specifically used for:
  • the posture information of the microwave radar 300 and the three-dimensional coordinate information of the microwave radar 300 in the geodetic coordinate system convert the three-dimensional coordinate information of each target object in the coordinate system of the microwave radar 300 into Three-dimensional coordinate information in the geodetic coordinate system.
  • the microwave radar in this embodiment may be used to implement the technical solutions in the foregoing method embodiments.
  • the implementation principles and technical effects are similar, and are not described here again.
  • FIG. 5 is a schematic structural diagram 3 of a microwave radar provided by an embodiment of the present application; referring to FIG. 5, the microwave radar of this embodiment further includes: a GPS 35 in communication with the controller 33 on the basis of the previous embodiment.
  • the GPS 35 is used to obtain current longitude information and current latitude information of the microwave radar 300 when each of the target objects is observed;
  • the controller 33 When the controller 33 observes each of the target objects, it is specifically used when acquiring the three-dimensional coordinate information of the microwave radar 300 in the geodetic coordinate system:
  • the three-dimensional coordinate information of the microwave radar 300 in the geodetic coordinate system is acquired.
  • the coordinate origin of the geodetic coordinate system is set at a preset coordinate position.
  • the preset coordinate position includes at least one of the following: a coordinate position preset by a user, and a coordinate position when the microwave radar 300 starts to rotate.
  • the microwave radar in this embodiment may be used to implement the technical solutions in the foregoing method embodiments.
  • the implementation principles and technical effects are similar, and are not described here again.
  • An embodiment of the present application further provides a computer-readable storage medium, including a program or an instruction, and when the program or instruction runs on a computer, the method described in the foregoing method embodiment is executed.
  • the aforementioned program may be stored in a computer-readable storage medium.
  • the steps including the foregoing method embodiments are executed; and the foregoing storage medium includes various media that can store program codes, such as ROM, RAM, magnetic disk, or optical disk.

Landscapes

  • Engineering & Computer Science (AREA)
  • Remote Sensing (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Physics & Mathematics (AREA)
  • Electromagnetism (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • General Physics & Mathematics (AREA)
  • Radar Systems Or Details Thereof (AREA)

Abstract

一种三维重建方法和装置,该方法包括:获取目标场景内的各个目标物体的观测信息(S101),根据各个所述目标物体的观测信息,确定各个所述目标物体在微波雷达的坐标系中的三维坐标信息(S102),以及根据各个所述目标物体在所述微波雷达的坐标系中的三维坐标信息,对所述目标场景进行三维重建(S103)。采用微波雷达对目标场景进行三维重建,微波雷达发射的探测信号为微波,微波不受外界环境光源的干扰,使得目标场景的三维重建易实现且微波雷达可以全天候的工作,提高了对目标场景进行三维重建的效率。

Description

三维重建方法和装置 技术领域
本申请涉及计算机技术领域,尤其涉及一种三维重建方法和装置。
背景技术
三维重建技术是指通过一定的测量方法获取目标场景的三维点集,对点集进行分析、处理,重建目标场景适合计算机表示和处理的高精度三维模型,包括空间结构模型和表面纹理模型。三维重建技术适用于自主机器人(自主避障、路径规划)、地理信息系统(测绘、数字城市)等领域。
目前三维重建方法可依据激光探测技术,但是激光探测技术对光环境有很高的要求,易受外界环境光源的干扰;目前三维重建方法还可基于图像的方法:对目标场景的图像中像素点的坐标索引和像素点对应的像素值进行分析、处理,从图像中提取目标场景的点云数据,但该方法对获取目标场景的图像时的环境光照条件有一定的要求且计算方法较复杂。
发明内容
本申请实施例提供一种三维重建方法和装置,重建过程不受外界环境光源的干扰,提高了对目标场景进行三维重建的效率。
第一方面,本申请实施例提供一种三维重建方法,应用于微波雷达,所述方法包括:
获取目标场景内的各个目标物体的观测信息;
根据各个所述目标物体的观测信息,确定各个所述目标物体在微波雷达的坐标系中的三维坐标信息;以及
根据各个所述目标物体在所述微波雷达的坐标系中的三维坐标信息,对所述目标场景进行三维重建。
本方案中,采用微波雷达对目标场景进行三维重建,微波雷达发射的探测信号为微波,微波不受外界环境光源的干扰,使得目标场景的三维重建易实现且微波雷达可以全天候的工作,因此,提高了对目标场景进行三维重建 的效率。
在一种可能的设计中,所述观测信息包括方位角、微波雷达的旋转角以及观测距离,其中,所述方位角为所述目标物体相较于所述微波雷达所处的角度,所述微波雷达的旋转角为所述微波雷达观测到所述目标物体时的旋转角度,所述观测距离为所述目标物体至所述微波雷达的距离。
在一种可能的设计中,所述获取目标场景内的各个目标物体的观测信息,包括:
获取各个所述目标物体对应的回波信号;
根据各个所述目标物体对应的回波信号,确定各个所述目标物体的所述观测距离以及方位角;
根据各个所述目标物体对应的回波信号接收时所述微波雷达的天线的转动角度,确定各个所述目标物体对应的所述微波雷达的旋转角。
在一种可能的设计中,所述目标物体的回波信号接收时所述微波雷达的天线的转动角度通过所述微波雷达的角度传感器检测得到。
在一种可能的设计中,所述微波雷达的角度传感器包括如下至少一种:光栅角度传感器,霍尔传感器。
在一种可能的设计中,所述观测信息包括如下至少一种:观测距离,观测角度,观测能量。
在一种可能的设计中,所述根据各个所述目标物体的观测信息,确定各个所述目标物体在微波雷达的坐标系中的三维坐标信息包括:
根据各个所述目标物体的观测信息,确定各个所述目标物体相对于所述微波雷达的中心的水平距离,各个所述目标物体相对于所述微波雷达的中心的景深距离,以及各个所述目标物体相对于所述微波雷达的中心的垂直距离。
在一种可能的设计中,所述根据各个所述目标物体在所述微波雷达的坐标系中三维坐标信息,对所述目标场景进行三维重建包括:
将各个所述目标物体在所述微波雷达的坐标系中三维坐标信息,变换为各个所述目标物体在大地坐标系中的三维坐标信息;
根据各个所述目标物体在大地坐标系中的三维坐标信息,对所述目标场景进行三维重建。
在一种可能的设计中,所述将各个所述目标物体在所述微波雷达的坐标系中三维坐标信息,变换为各个所述目标物体在大地坐标系中的三维坐标信息,包括:
在观测到各个所述目标物体时,获取所述微波雷达的姿态信息以及所述微波雷达在所述大地坐标系中的三维坐标信息;
根据所述微波雷达的姿态信息以及所述微波雷达在所述大地坐标系中的三维坐标信息,将各个所述目标物体在所述微波雷达的坐标系中的三维坐标信息变换为在大地坐标系中的三维坐标信息。
在一种可能的设计中,所述在观测到各个所述目标物体时,获取所述微波雷达在所述大地坐标系中的三维坐标信息,包括:
在观测到各个所述目标物体时,获取所述微波雷达的当前经度信息和当前纬度信息;
根据所述微波雷达的当前经度信息和当前纬度信息,以及所述大地坐标系的坐标原点,获取所述微波雷达在所述大地坐标系中的三维坐标信息。
在一种可能的设计中,所述大地坐标系的坐标原点设置在预设坐标位置。
在一种可能的设计中,所述预设坐标位置包括如下至少一种:用户预设的坐标位置,所述微波雷达开始旋转时的坐标位置。
在一种可能的设计中,所述根据各个所述目标物体在所述微波雷达的坐标系中的三维坐标信息,对所述目标场景进行三维重建,包括:
在所述微波雷达连续旋转多圈时,获取每一圈探测的各个所述目标物体在所述微波雷达的坐标系中的三维坐标信息;
根据所述微波雷达连续旋转多圈时探测的各个所述目标物体的所述三维坐标信息,对相同的所述目标物体的所述三维坐标信息进行融合处理;
根据融合后的各个所述目标物体的所述三维坐标信息,对所述目标场景进行三维重建。
第二方面,本申请实施例提供一种微波雷达,包括:
天线装置,用于发射微波信号以及接收目标物体反射回来的回波信号;
旋转驱动装置,用于带动所述天线装置转动;
控制器,与所述天线装置以及旋转驱动装置通信连接,用于执行如下操作:
获取目标场景内的各个目标物体的观测信息;
根据各个所述目标物体的观测信息,确定各个所述目标物体在所述微波雷达的坐标系中的三维坐标信息;以及
根据各个所述目标物体在所述微波雷达的坐标系中的三维坐标信息,对所述目标场景进行三维重建。
在一种可能的设计中,所述旋转驱动装置包括用于带动所述天线装置转动的电机以及用于感测所述天线装置转动角度的角度传感器。
在一种可能的设计中,所述微波雷达的角度传感器包括如下至少一种:光栅角度传感器,霍尔传感器。
在一种可能的设计中,所述观测信息包括方位角、微波雷达的旋转角以及观测距离,其中,所述方位角为所述目标物体相较于所述微波雷达所处的角度,所述微波雷达的旋转角为所述微波雷达观测到所述目标物体时的旋转角度,所述观测距离为所述目标物体至所述微波雷达的距离。
在一种可能的设计中,所述控制器在获取目标场景内的各个目标物体的观测信息时,具体用于:
从所述天线装置获取各个所述目标物体对应的回波信号;
根据各个所述目标物体对应的回波信号,确定各个所述目标物体的所述观测距离以及方位角;
根据从所述角度传感器获取的各个所述目标物体对应的回波信号接收时所述天线装置的转动角度,确定各个所述目标物体对应的所述微波雷达的旋转角。
在一种可能的设计中,所述观测信息包括如下至少一种:观测距离,观测角度,观测能量。
在一种可能的设计中,,所述控制器在根据各个所述目标物体的观测信息,确定各个所述目标物体在所述微波雷达的坐标系中的三维坐标信息时,具体用于:
根据各个所述目标物体的观测信息,确定各个所述目标物体相对于所述微波雷达的中心的水平距离,各个所述目标物体相对于所述微波雷达的中心 的景深距离,以及各个所述目标物体相对于所述微波雷达的中心的垂直距离。
在一种可能的设计中,所述控制器在根据各个所述目标物体在所述微波雷达的坐标系中的三维坐标信息,对所述目标场景进行三维重建时,具体用于:
将各个所述目标物体在所述微波雷达的坐标系中三维坐标信息,变换为各个所述目标物体在大地坐标系中的三维坐标信息;
根据各个所述目标物体在大地坐标系中的三维坐标信息,对所述目标场景进行三维重建。
在一种可能的设计中,述微波雷达还包括惯性测量单元,所述惯性测量单元和所述控制器通信连接;
所述惯性测量单元,用于在观测到各个所述目标物体时,获取所述微波雷达的姿态信息;
所述控制器在将各个所述目标物体在所述微波雷达的坐标系中三维坐标信息,变换为各个所述目标物体在大地坐标系中的三维坐标信息时,具体用于:
从所述惯性测量单元获取在观测到各个所述目标物体时,所述微波雷达的姿态信息;
在观测到各个所述目标物体时,获取所述微波雷达在所述大地坐标系中的三维坐标信息;
根据所述微波雷达的姿态信息以及所述微波雷达在所述大地坐标系中的三维坐标信息,将各个所述目标物体在所述微波雷达的坐标系中的三维坐标信息变换为在大地坐标系中的三维坐标信息。
在一种可能的设计中,所述微波雷达还包括全球定位系统GPS,所述GPS和所述控制器通信连接;
所述GPS,用于在观测到各个所述目标物体时,获取所述微波雷达的当前经度信息和当前纬度信息;
所述控制器在观测到各个所述目标物体时,获取所述微波雷达在所述大地坐标系中的三维坐标信息时具体用于:
从所述GPS获取在观测到各个所述目标物体时,所述微波雷达的当前 经度信息和当前纬度信息;
根据所述微波雷达的当前经度信息和当前纬度信息,以及所述大地坐标系的坐标原点,获取所述微波雷达在所述大地坐标系中的三维坐标信息。
在一种可能的设计中,所述大地坐标系的坐标原点设置在预设坐标位置。
在一种可能的设计中,所述预设坐标位置包括如下至少一种:用户预设的坐标位置,所述微波雷达开始旋转时的坐标位置。
在一种可能的设计中,所述控制器在根据各个所述目标物体在所述微波雷达的坐标系中的三维坐标信息,对所述目标场景进行三维重建时,具体用于:
在所述微波雷达连续旋转多圈时,获取每一圈探测的各个所述目标物体在所述微波雷达的坐标系中的三维坐标信息;
根据所述微波雷达连续旋转多圈时探测的各个所述目标物体的所述三维坐标信息,对相同的所述目标物体的所述三维坐标信息进行融合处理;
根据融合后的各个所述目标物体的所述三维坐标信息,对所述目标场景进行三维重建。
第三方面,本申请实施例提供一种可移动平台,包括:
机体;
第二方面以及第二方面任一可能的设计所述的微波雷达,所述微波雷达安装在所述机体上。
在一种可能的设计中,所述可移动平台为无人飞行器或自动驾驶汽车。
第四方面,本申请实施例提供一种计算机可读存储介质,包括程序或指令,当所述程序或指令在计算机上运行时,第一方面以及第一方面任一可能的设计所述的方法被执行。
本申请采用微波雷达对目标场景进行三维重建,微波雷达发射的探测信号为微波,微波不受外界环境光源的干扰,使得目标场景的三维重建易实现且微波雷达可以全天候的工作,因此,提高了对目标场景进行三维重建的效率。
附图说明
为了更清楚地说明本申请实施例或现有技术中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作一简单地介绍,显而易见地,下面描述中的附图是本申请的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动性的前提下,还可以根据这些附图获得其他的附图。
图1为本申请实施例提供的可移动平台的结构示意图。
图2为本申请实施例提供的三维重建方法的流程图;
图3为本申请实施例提供的微波雷达的结构示意图一;
图4为本申请实施例提供的微波雷达的结构示意图二;
图5为本申请实施例提供的微波雷达的结构示意图三。
具体实施方式
为使本申请实施例的目的、技术方案和优点更加清楚,下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例是本申请一部分实施例,而不是全部的实施例。基于本申请中的实施例,本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例,都属于本申请保护的范围。
本申请实施例提供了一种三维重建方法和装置,三维重建方法的装置可为微波雷达。其中,微波雷达在用于三维重建时,可搭载在可移动平台的机体上,比如搭载在无人飞行器的机体或自动驾驶汽车的机体上。
图1为本申请实施例提供的可移动平台的结构示意图。参见图1,该可移动平台100为无人飞行器,该可移动平台包括机体11和用于三维重建的微波雷达12。微波雷达12安装在机体11上。
微波雷达12随着无人飞行器的移动而移动,进行对待三维重建的目标场景的扫描,以获取用于三维重建的数据—目标场景的各目标物体的三维坐标信息,并根据目标场景的各目标物体的三维坐标信息完成对目标场景的三维重建。
其中,本实施例中用于三维重建的微波雷达12可为旋转毫米微波雷达。
下面结合具体的实施例,对上述微波雷达进行三维重建的方法进行详细说明。
图2为本申请实施例提供的三维重建方法的流程图,参见图2,本实施例的方法包括:
步骤S101、获取目标场景内的各个目标物体的观测信息;
具体地,本实施例的目标场景为待三维重建的场景。
获取目标场景内的各个目标物体的观测信息,具体包括:
(1)获取各个目标物体对应的回波信号。
具体地,微波雷达在进行三维重建时,微波雷达的天线发射微波探测信号,微波探测信号经目标场景包括的目标物体反射后产生回波信号,微波雷达的天线接收回波信号。也就是说本实施例中的目标物体为目标场景内能够反射微波雷达的天线发射的微波探测信号的物体。
由于微波雷达在进行三维重建时搭载在可移动平台上,随着可移动平台的移动而移动,完成对目标场景的扫描,因此,目标场景内具有多个目标物体,微波雷达会获取各个目标物体对应的回波信号。
(2)根据各个目标物体对应的回波信号,确定各个目标物体的观测距离以及方位角。
具体地,对于每个目标物体,微波雷达在获取到该目标物体的回波信号后,对回波信号进行处理,得到该目标物体至微波雷达的距离(目标物体的观测距离)以及该目标物体相较于微波雷达所处的角度(目标物体的方位角)。
(3)根据各个目标物体对应的回波信号接收时微波雷达的天线的转动角度,确定各个目标物体对应的微波雷达的旋转角。
具体地,微波雷达在进行三维重建的过程中会绕一旋转中心进行旋转,相应地,微波雷达的天线也相对于旋转中心在转动,那么对于每个目标物体,目标物体对应的回波信号接收时微波雷达的天线相对于旋转中心的转动角度即为该目标物体对应的微波雷达的旋转角,该目标物体对应的微波雷达的旋转角也就是观测到该目标物体时微波雷达的旋转角。
其中,目标物体对应的回波信号接收时微波雷达的天线的转动角度可通过微波雷达的角度传感器检测得到。微波雷达的角度传感器包括但不限于如 下中的至少一种:光栅角度传感器,霍尔传感器。
综上,目标物体的观测信息可包括:方位角、微波雷达的旋转角以及观测距离,其中,方位角为目标物体相较于微波雷达所处的角度,微波雷达的旋转角为微波雷达观测到目标物体时的旋转角度,观测距离为目标物体至微波雷达的距离。
即观测信息可包括如下至少一种:观测距离、观测角度;进一步地,观测信息还可包括观测能量,观测能量即为回波信号的能量。
步骤S102、根据各个目标物体的观测信息,确定各个目标物体在微波雷达的坐标系中的三维坐标信息。
具体地,在获取到各个目标物体的观测信息后,可根据各个目标物体的观测信息,确定各个目标物体在微波雷达的坐标系中的三维坐标信息。其中,微波雷达的坐标系的坐标原点为微波雷达的中心。
根据各个目标物体的观测信息,确定各个目标物体在微波雷达的坐标系中的三维坐标信息,具体包括:
根据各个目标物体的观测信息,确定各个目标物体相对于微波雷达的中心的水平距离,各个目标物体相对于微波雷达的中心的景深距离,以及各个目标物体相对于微波雷达的中心的垂直距离。
其中,目标物体在微波雷达的坐标系中的三维坐标信息包括:该目标物体相对于微波雷达的中心的水平距离,该目标物体相对于微波雷达的中心的景深距离,以及该目标物体相对于微波雷达的中心的垂直距离。
在一种方式中,可通过如下公式得到目标物体在微波雷达的坐标系中的三维坐标信息:
Figure PCTCN2018118668-appb-000001
式中,x表示目标物体相对于微波雷达的中心的水平距离,y表示目标物体相对于微波雷达的中心的景深距离,z表示目标物体相对于微波雷达的中心的垂直距离,r表示目标物体的观测距离(目标物体至微波雷达的中心的距离),θ表示目标物体的方位角(目标物体相较于微波雷达所处的角度),
Figure PCTCN2018118668-appb-000002
表示目标物体对应的微波雷达的旋转角度(即微波雷达观测到目标物体时的 旋转角度)。
步骤S103、根据各个目标物体在微波雷达的坐标系中的三维坐标信息,对目标场景进行三维重建。
具体地,在得到了各个目标物体在微波雷达的坐标系中的三维坐标信息后,可根据各个目标物体在微波雷达的坐标系中的三维坐标信息,对目标场景进行三维重建。
在整个的三维重建的过程中,微波雷达的空间位置和姿态时刻都在变化,在将各个目标物体在微波雷达的坐标系中的三维坐标信息叠加以进行目标场景的三维重建之前要补偿微波雷达自身的位置和姿态,因此,在一种方式中,根据各个目标物体在微波雷达的坐标系中的三维坐标信息,对目标场景进行三维重建,包括:
(1)将各个目标物体在微波雷达的坐标系中的三维坐标信息,变换为各个目标物体在大地坐标系中的三维坐标信息。
具体地,将各个目标物体在微波雷达的坐标系中的三维坐标信息,变换为各个目标物体在大地坐标系中的三维坐标信息,具体包括:
a、在观测到各个目标物体时,获取微波雷达的姿态信息以及微波雷达在大地坐标系中的三维坐标信息;
具体地,微波雷达的姿态信息可为微波雷达的姿态四元数。微波雷达的姿态信息可通过微波雷达的惯性测量单元(inertial measurement unit,简称IMU)获取。
其中,在观测到目标物体时,获取微波雷达在大地坐标系中的三维坐标信息的方法可如下:
对于每个目标物体,在观测到该目标物体时,获取微波雷达的当前经度信息和当前纬度信息,根据微波雷达的当前经度信息和当前纬度信息,以及大地坐标系的坐标原点,获取观测到该目标物体时微波雷达在大地坐标系中的三维坐标信息。
其中,在观测到目标物体时,微波雷达的当前经度信息和当前纬度信息可通过微波雷达的全球定位系统(global positioning system,简称GPS)获取。
获取到在观测到目标物体时微波雷达的当前经度信息和当前纬度信息 后,可根据大地坐标系的原点,将在观测到目标物体时微波雷达的当前经度信息和当前纬度信息,转化成在观测到目标物体时微波雷达在大地坐标系中的三维坐标信息。其中,大地坐标系的原点设置在预设坐标位置。
可选地,预设坐标位置可为用户预设的坐标位置,比如经度和纬度均为0°的坐标位置。
可选地,预设坐标位置可为微波雷达开始旋转时的坐标位置。其中,微波雷达开始旋转时的坐标位置也就是微波雷达在进行目标场景的三维重建的过程中,开始发射微波探测信号的位置。
b、根据微波雷达的姿态信息以及微波雷达在大地坐标系中的三维坐标信息,将各个目标物体在微波雷达的坐标系中的三维坐标信息变换为在大地坐标系中的三维坐标信息。
具体地,对于每个目标物体,根据步骤a中获取的观测到该目标物体时微波雷达的姿态信息以及微波雷达在大地坐标系中的三维坐标信息,将该目标物体在微波雷达的坐标系中的三维坐标信息变换为在大地坐标系中的三维坐标信息。
在一种方式中,可通过如下的公式将目标物体在微波雷达的坐标系中的三维坐标信息变换为在大地坐标系中的三维坐标信息:
Figure PCTCN2018118668-appb-000003
Figure PCTCN2018118668-appb-000004
Figure PCTCN2018118668-appb-000005
Figure PCTCN2018118668-appb-000006
其中,若大地坐标系为东北天坐标系(east-north-up coordinate system,简称ENU),则x G表示目标物体相对于大地坐标系的坐标原点正北方向上的距离,y G表示目标物体相对于大地坐标系的坐标原点正东方向上的距离,z G表示目标物体相对于大地坐标系的坐标原点垂直方向上的距离,
Figure PCTCN2018118668-appb-000007
为观测到该目标物体时微波雷达的姿态四元数,
Figure PCTCN2018118668-appb-000008
为观测到该目标物体时微波雷达在大地坐标系统中的三维坐标信息。
(2)根据各个目标物体在大地坐标系中的三维坐标信息,对目标场景进行三维重建。
具体地,将各个目标物体在大地坐标系中的三维坐标信息进行叠加,得到目标场景的三维重建模型。具体的三维重建算法可参照现有技术中的算法,本实施例中不再赘述。
进一步地,在整个的三维重建的过程中,为了使得对目标场景的三维重建尽可能的准确,需要获取足够多的目标物体在微波雷达的坐标系中的三维坐标信息,即微波雷达在整个的三维重建的过程中可能需要连续旋转多圈,在微波雷达连续旋转多圈时探测的到的多个目标物体可能具有相同的目标物体,因此,在一种方式中,根据各个目标物体在微波雷达的坐标系中的三维坐标信息,对目标场景进行三维重建,包括:
(1)在微波雷达连续旋转多圈时,获取每一圈探测的各个目标物体在微波雷达的坐标系中的三维坐标信息;
(2)根据微波雷达连续旋转多圈时探测的各个目标物体在微波雷达的坐标系中的三维坐标信息,对相同的目标物体在微波雷达的坐标系中的三维坐标信息进行融合处理;
(3)根据融合后的各个目标物体在微波雷达的坐标系中的三维坐标信息,对目标场景进行三维重建。
其中,根据融合后的各个目标物体在微波雷达的坐标系中的三维坐标信息,对目标场景进行三维重建,可包括:
将融合后的各个目标物体在微波雷达的坐标系中的三维坐标信息,变换为融合后的各个目标物体在大地坐标系中的三维坐标信息,根据融合后的各个目标物体在大地坐标系中的三维坐标信息,对目标场景进行三维重建。
本实施例中,采用微波雷达对目标场景进行三维重建,微波雷达发射的探测信号为微波,微波不受外界环境光源的干扰,使得目标场景的三维重建易实现且微波雷达可以全天候的工作,因此,提高了对目标场景进行三维重建的效率。同时,采用微波雷达对目标场景进行三维重建的方法简单,进一 步提高了对目标场景进行三维重建的效率。
本实施例的三维重建方法包括获取目标场景内的各个目标物体的观测信息,根据各个目标物体的观测信息,确定各个目标物体在微波雷达的坐标系中的三维坐标信息;以及根据各个目标物体在所述微波雷达的坐标系中的三维坐标信息,对目标场景进行三维重建。本实施例的三维重建方法,提高了对目标场景进行三维重建的效率。
下面采用具体的实施例对实现上述三维重建方法的微波雷达进行说明。
图3为本申请实施例提供的微波雷达的结构示意图一;参见图3,本实施例的微波雷达300包括:
天线装置31,用于发射微波信号以及接收目标物体反射回来的回波信号;
旋转驱动装置32,用于带动所述天线装置转动;
控制器33,与所述天线装置31以及旋转驱动装置32通信连接,用于执行如下操作:
获取目标场景内的各个目标物体的观测信息;
根据各个所述目标物体的观测信息,确定各个所述目标物体在所述微波雷达300的坐标系中的三维坐标信息;以及
根据各个所述目标物体在所述微波雷达300的坐标系中的三维坐标信息,对所述目标场景进行三维重建。
可选地,所述旋转驱动装置包括用于带动所述天线装置转动的电机321以及用于感测所述天线装置转动角度的角度传感器322。
可选地,所述微波雷达的角度传感器包括如下至少一种:光栅角度传感器,霍尔传感器。
本实施例微波雷达,可以用于执行上述各方法实施例中的技术方案,其实现原理和技术效果类似,此处不再赘述。
可选地,所述观测信息包括方位角、微波雷达300的旋转角以及观测距离,其中,所述方位角为所述目标物体相较于所述微波雷达300所处的角度,所述微波雷达300的旋转角为所述微波雷达300观测到所述目标物体时的旋转角度,所述观测距离为所述目标物体至所述微波雷达300的距离。
可选地,所述控制器33在获取目标场景内的各个目标物体的观测信息 时,具体用于:
从所述天线装置31获取各个所述目标物体对应的回波信号;
根据各个所述目标物体对应的回波信号,确定各个所述目标物体的所述观测距离以及方位角;
根据从所述角度传感器322获取的各个所述目标物体对应的回波信号接收时所述天线装置31的转动角度,确定所述微波雷达300的旋转角。
可选地,所述观测信息包括如下至少一种:观测距离,观测角度,观测能量。
可选地,所述控制器33在根据各个所述目标物体的观测信息,确定各个所述目标物体在所述微波雷达300的坐标系中的三维坐标信息时,具体用于:
根据各个所述目标物体的观测信息,确定各个所述目标物体相对于所述微波雷达300的中心的水平距离,各个所述目标物体相对于所述微波雷达300的中心的景深距离,以及各个所述目标物体相对于所述微波雷达300的中心的垂直距离。
可选地,所述控制器33在根据各个所述目标物体在所述微波雷达300的坐标系中的三维坐标信息,对所述目标场景进行三维重建时,具体用于:
将各个所述目标物体在所述微波雷达的坐标系中三维坐标信息,变换为各个所述目标物体在大地坐标系中的三维坐标信息;
根据各个所述目标物体在大地坐标系中的三维坐标信息,对所述目标场景进行三维重建。
本实施例微波雷达,可以用于执行上述各方法实施例中的技术方案,其实现原理和技术效果类似,此处不再赘述。
图4为本申请实施例提供的微波雷达的结构示意图二;参见图4,本实施例的微波雷达在上一实施例的基础上还包括:与所述控制器33通信连接的惯性测量单元34。
所述惯性测量单元34,用于在观测到各个所述目标物体时,获取所述微波雷达300的姿态信息;
所述控制器33在将各个所述目标物体在所述微波雷达300的坐标系中三维坐标信息,变换为各个所述目标物体在大地坐标系中的三维坐标信息 时,具体用于:
从所述惯性测量单元34获取在观测到各个所述目标物体时,所述微波雷达300的姿态信息;
在观测到各个所述目标物体时,获取所述微波雷达300在所述大地坐标系中的三维坐标信息;
根据所述微波雷达300的姿态信息以及所述微波雷达300在所述大地坐标系中的三维坐标信息,将各个所述目标物体在所述微波雷达300的坐标系中的三维坐标信息变换为在大地坐标系中的三维坐标信息。
本实施例微波雷达,可以用于执行上述各方法实施例中的技术方案,其实现原理和技术效果类似,此处不再赘述。
图5为本申请实施例提供的微波雷达的结构示意图三;参见图5,本实施例的微波雷达在上一实施例的基础上还包括:与所述控制器33通信连接的GPS 35。
所述GPS 35,用于在观测到各个所述目标物体时,获取所述微波雷达300的当前经度信息和当前纬度信息;
所述控制器33在观测到各个所述目标物体时,获取所述微波雷达300在所述大地坐标系中的三维坐标信息时具体用于:
从所述GPS 35获取在观测到各个所述目标物体时所述微波雷达的当前经度信息和当前纬度信息;
根据所述微波雷达的当前经度信息和当前纬度信息,以及所述大地坐标系的坐标原点,获取所述微波雷达300在所述大地坐标系中的三维坐标信息。
可选地,所述大地坐标系的坐标原点设置在预设坐标位置。
可选地,所述预设坐标位置包括如下至少一种:用户预设的坐标位置,所述微波雷达300开始旋转时的坐标位置。
本实施例微波雷达,可以用于执行上述各方法实施例中的技术方案,其实现原理和技术效果类似,此处不再赘述。
本申请实施例还提供一种计算机可读存储介质,包括程序或指令,当所述程序或指令在计算机上运行时,上述方法实施例所述的方法被执行。
本领域普通技术人员可以理解:实现上述各方法实施例的全部或部分步 骤可以通过程序指令相关的硬件来完成。前述的程序可以存储于一计算机可读取存储介质中。该程序在执行时,执行包括上述各方法实施例的步骤;而前述的存储介质包括:ROM、RAM、磁碟或者光盘等各种可以存储程序代码的介质。
最后应说明的是:以上各实施例仅用以说明本申请的技术方案,而非对其限制;尽管参照前述各实施例对本申请进行了详细的说明,本领域的普通技术人员应当理解:其依然可以对前述各实施例所记载的技术方案进行修改,或者对其中部分或者全部技术特征进行等同替换;而这些修改或者替换,并不使相应技术方案的本质脱离本申请各实施例技术方案的范围。

Claims (29)

  1. 一种三维重建方法,其特征在于,应用于微波雷达,所述方法包括:
    获取目标场景内的各个目标物体的观测信息;
    根据各个所述目标物体的观测信息,确定各个所述目标物体在所述微波雷达的坐标系中的三维坐标信息;以及
    根据各个所述目标物体在所述微波雷达的坐标系中的三维坐标信息,对所述目标场景进行三维重建。
  2. 根据权利要求1所述的方法,其特征在于,所述观测信息包括方位角、所述微波雷达的旋转角以及观测距离,其中,所述方位角为所述目标物体相较于所述微波雷达所处的角度,所述微波雷达的旋转角为所述微波雷达观测到所述目标物体时的旋转角度,所述观测距离为所述目标物体至所述微波雷达的距离。
  3. 根据权利要求2所述的方法,其特征在于,所述获取目标场景内的各个目标物体的观测信息,包括:
    获取各个所述目标物体对应的回波信号;
    根据各个所述目标物体对应的回波信号,确定各个所述目标物体的所述观测距离以及方位角;
    根据各个所述目标物体对应的回波信号接收时所述微波雷达的天线的转动角度,确定各个所述目标物体对应的所述微波雷达的旋转角。
  4. 根据权利要求3所述的方法,其特征在于,所述目标物体的回波信号接收时所述微波雷达的天线的转动角度通过所述微波雷达的角度传感器检测得到。
  5. 根据权利要求4所述的方法,其特征在于,所述微波雷达的角度传感器包括如下至少一种:光栅角度传感器,霍尔传感器。
  6. 根据权利要求1所述的方法,其特征在于,所述观测信息包括如下至少一种:观测距离,观测角度,观测能量。
  7. 根据权利要求1所述的方法,其特征在于,所述根据各个所述目标物体的观测信息,确定各个所述目标物体在所述微波雷达的坐标系中的三维坐标信息包括:
    根据各个所述目标物体的观测信息,确定各个所述目标物体相对于所述微波雷达的中心的水平距离,各个所述目标物体相对于所述微波雷达的中心的景深距离,以及各个所述目标物体相对于所述微波雷达的中心的垂直距离。
  8. 根据权利要求1所述的方法,其特征在于,所述根据各个所述目标物体在所述微波雷达的坐标系中三维坐标信息,对所述目标场景进行三维重建包括:
    将各个所述目标物体在所述微波雷达的坐标系中三维坐标信息,变换为各个所述目标物体在大地坐标系中的三维坐标信息;
    根据各个所述目标物体在大地坐标系中的三维坐标信息,对所述目标场景进行三维重建。
  9. 根据权利要求8所述的方法,其特征在于,所述将各个所述目标物体在所述微波雷达的坐标系中三维坐标信息,变换为各个所述目标物体在大地坐标系中的三维坐标信息,包括:
    在观测到各个所述目标物体时,获取所述微波雷达的姿态信息以及所述微波雷达在所述大地坐标系中的三维坐标信息;
    根据所述微波雷达的姿态信息以及所述微波雷达在所述大地坐标系中的三维坐标信息,将各个所述目标物体在所述微波雷达的坐标系中的三维坐标信息变换为在大地坐标系中的三维坐标信息。
  10. 根据权利要求9所述的方法,其特征在于,所述在观测到各个所述目标物体时,获取所述微波雷达在所述大地坐标系中的三维坐标信息,包括:
    在观测到各个所述目标物体时,获取所述微波雷达的当前经度信息和当前纬度信息;
    根据所述微波雷达的当前经度信息和当前纬度信息,以及所述大地坐标系的坐标原点,获取所述微波雷达在所述大地坐标系中的三维坐标信息。
  11. 根据权利要求9或10所述的方法,其特征在于,所述大地坐标系的坐标原点设置在预设坐标位置。
  12. 根据权利要求11所述的方法,其特征在于,所述预设坐标位置包 括如下至少一种:用户预设的坐标位置,所述微波雷达开始旋转时的坐标位置。
  13. 根据权利要求1所述的方法,其特征在于,所述根据各个所述目标物体在所述微波雷达的坐标系中的三维坐标信息,对所述目标场景进行三维重建,包括:
    在所述微波雷达连续旋转多圈时,获取每一圈探测的各个所述目标物体在所述微波雷达的坐标系中的三维坐标信息;
    根据所述微波雷达连续旋转多圈时探测的各个所述目标物体的所述三维坐标信息,对相同的所述目标物体的所述三维坐标信息进行融合处理;
    根据融合后的各个所述目标物体的所述三维坐标信息,对所述目标场景进行三维重建。
  14. 一种微波雷达,其特征在于,包括:
    天线装置,用于发射微波信号以及接收目标物体反射回来的回波信号;
    旋转驱动装置,用于带动所述天线装置转动;
    控制器,与所述天线装置以及旋转驱动装置通信连接,用于执行如下操作:
    获取目标场景内的各个目标物体的观测信息;
    根据各个所述目标物体的观测信息,确定各个所述目标物体在所述微波雷达的坐标系中的三维坐标信息;以及
    根据各个所述目标物体在所述微波雷达的坐标系中的三维坐标信息,对所述目标场景进行三维重建。
  15. 根据权利要求14所述的微波雷达,其特征在于,所述旋转驱动装置包括用于带动所述天线装置转动的电机以及用于感测所述天线装置转动角度的角度传感器。
  16. 根据权利要求15所述的微波雷达,其特征在于,所述微波雷达的角度传感器包括如下至少一种:光栅角度传感器,霍尔传感器。
  17. 根据权利要求15或16所述的微波雷达,其特征在于,所述观测信息包括方位角、微波雷达的旋转角以及观测距离,其中,所述方位角为所述目标物体相较于所述微波雷达所处的角度,所述微波雷达的旋转角为所述微波雷达观测到所述目标物体时的旋转角度,所述观测距离为所述目标物体至 所述微波雷达的距离。
  18. 根据权利要求17所述的微波雷达,其特征在于,所述控制器在获取目标场景内的各个目标物体的观测信息时,具体用于:
    从所述天线装置获取各个所述目标物体对应的回波信号;
    根据各个所述目标物体对应的回波信号,确定各个所述目标物体的所述观测距离以及方位角;
    根据从所述角度传感器获取的各个所述目标物体对应的回波信号接收时所述天线装置的转动角度,确定各个所述目标物体对应的所述微波雷达的旋转角。
  19. 根据权利要求14所述的微波雷达,其特征在于,所述观测信息包括如下至少一种:观测距离,观测角度,观测能量。
  20. 根据权利要求14所述的微波雷达,其特征在于,所述控制器在根据各个所述目标物体的观测信息,确定各个所述目标物体在所述微波雷达的坐标系中的三维坐标信息时,具体用于:
    根据各个所述目标物体的观测信息,确定各个所述目标物体相对于所述微波雷达的中心的水平距离,各个所述目标物体相对于所述微波雷达的中心的景深距离,以及各个所述目标物体相对于所述微波雷达的中心的垂直距离。
  21. 根据权利要求14所述的微波雷达,其特征在于,所述控制器在根据各个所述目标物体在所述微波雷达的坐标系中的三维坐标信息,对所述目标场景进行三维重建时,具体用于:
    将各个所述目标物体在所述微波雷达的坐标系中三维坐标信息,变换为各个所述目标物体在大地坐标系中的三维坐标信息;
    根据各个所述目标物体在大地坐标系中的三维坐标信息,对所述目标场景进行三维重建。
  22. 根据权利要求21所述的微波雷达,其特征在于,所述微波雷达还包括惯性测量单元,所述惯性测量单元和所述控制器通信连接;
    所述惯性测量单元,用于在观测到各个所述目标物体时,获取所述微波雷达的姿态信息;
    所述控制器在将各个所述目标物体在所述微波雷达的坐标系中三维坐标 信息,变换为各个所述目标物体在大地坐标系中的三维坐标信息时,具体用于:
    从所述惯性测量单元获取在观测到各个所述目标物体时所述微波雷达的姿态信息;
    在观测到各个所述目标物体时,获取所述微波雷达在所述大地坐标系中的三维坐标信息;
    根据所述微波雷达的姿态信息以及所述微波雷达在所述大地坐标系中的三维坐标信息,将各个所述目标物体在所述微波雷达的坐标系中的三维坐标信息变换为在大地坐标系中的三维坐标信息。
  23. 根据权利要求22所述的微波雷达,其特征在于,所述微波雷达还包括全球定位系统GPS,所述GPS和所述控制器通信连接;
    所述GPS,用于在观测到各个所述目标物体时,获取所述微波雷达的当前经度信息和当前纬度信息;
    所述控制器在观测到各个所述目标物体时,获取所述微波雷达在所述大地坐标系中的三维坐标信息时具体用于:
    从所述GPS获取在观测到各个所述目标物体时所述微波雷达的当前经度信息和当前纬度信息;
    根据所述微波雷达的当前经度信息和当前纬度信息,以及所述大地坐标系的坐标原点,获取所述微波雷达在所述大地坐标系中的三维坐标信息。
  24. 根据权利要求22或23所述的微波雷达,其特征在于,所述大地坐标系的坐标原点设置在预设坐标位置。
  25. 根据权利要求24所述的微波雷达,其特征在于,所述预设坐标位置包括如下至少一种:用户预设的坐标位置,所述微波雷达开始旋转时的坐标位置。
  26. 根据权利要求14所述的微波雷达,其特征在于,所述控制器在根据各个所述目标物体在所述微波雷达的坐标系中的三维坐标信息,对所述目标场景进行三维重建时,具体用于:
    在所述微波雷达连续旋转多圈时,获取每一圈探测的各个所述目标物体在所述微波雷达的坐标系中的三维坐标信息;
    根据所述微波雷达连续旋转多圈时探测的各个所述目标物体的所述三维坐标信息,对相同的所述目标物体的所述三维坐标信息进行融合处理;
    根据融合后的各个所述目标物体的所述三维坐标信息,对所述目标场景进行三维重建。
  27. 一种可移动平台,其特征在于,包括:
    机体;
    权利要求14~26任一项所述的微波雷达,所述微波雷达安装在所述机体上。
  28. 根据权利要求27所述的可移动平台,其特征在于,所述可移动平台为无人飞行器或自动驾驶汽车。
  29. 一种计算机可读存储介质,包括程序或指令,当所述程序或指令在计算机上运行时,权利要求1~13任一所述的方法被执行。
PCT/CN2018/118668 2018-11-30 2018-11-30 三维重建方法和装置 Ceased WO2020107438A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
PCT/CN2018/118668 WO2020107438A1 (zh) 2018-11-30 2018-11-30 三维重建方法和装置
CN201880069853.7A CN111406225A (zh) 2018-11-30 2018-11-30 三维重建方法和装置

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2018/118668 WO2020107438A1 (zh) 2018-11-30 2018-11-30 三维重建方法和装置

Publications (1)

Publication Number Publication Date
WO2020107438A1 true WO2020107438A1 (zh) 2020-06-04

Family

ID=70854405

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/118668 Ceased WO2020107438A1 (zh) 2018-11-30 2018-11-30 三维重建方法和装置

Country Status (2)

Country Link
CN (1) CN111406225A (zh)
WO (1) WO2020107438A1 (zh)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2012037157A2 (en) * 2010-09-13 2012-03-22 Alt Software (Us) Llc System and method for displaying data having spatial coordinates
CN102944876A (zh) * 2012-11-23 2013-02-27 北京航空航天大学 一种高效的宽带单脉冲雷达三维成像方法
CN104898118A (zh) * 2015-03-18 2015-09-09 中国科学院电子学研究所 一种基于稀疏频点的三维全息成像的重建方法
CN108872985A (zh) * 2018-04-10 2018-11-23 西北工业大学 一种近场圆周sar快速三维成像方法

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103941243B (zh) * 2014-04-03 2016-08-17 电子科技大学 一种基于sar三维成像的自旋式飞行器测高方法
CN104503339A (zh) * 2015-01-05 2015-04-08 黑龙江工程学院 基于激光雷达和四轴飞行器的多分辨室内三维场景重构装置及方法
CN106646562A (zh) * 2016-09-09 2017-05-10 华东师范大学 高精度三维实景室内外一体化定位方法及装置
CN106772380A (zh) * 2017-03-31 2017-05-31 电子科技大学 一种圆周合成孔径雷达成像方法
CN107329116B (zh) * 2017-05-18 2020-04-14 陕西长岭电子科技有限责任公司 机载雷达三维运动场景显示方法

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2012037157A2 (en) * 2010-09-13 2012-03-22 Alt Software (Us) Llc System and method for displaying data having spatial coordinates
CN102944876A (zh) * 2012-11-23 2013-02-27 北京航空航天大学 一种高效的宽带单脉冲雷达三维成像方法
CN104898118A (zh) * 2015-03-18 2015-09-09 中国科学院电子学研究所 一种基于稀疏频点的三维全息成像的重建方法
CN108872985A (zh) * 2018-04-10 2018-11-23 西北工业大学 一种近场圆周sar快速三维成像方法

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
杨科 等 (YANG, KE ET AL.): "旋转上升合成孔径雷达三维成像算法 (Three-dimensional Imaging Algorithm for Spiral Synthetic Aperture Radar)", 系统工程与电子技术 (SYSTEMS ENGINEERING AND ELECTRONICS), vol. 36, no. 1, 31 January 2014 (2014-01-31), XP055272997, ISSN: 1001-506X, DOI: 20190818155447Y *

Also Published As

Publication number Publication date
CN111406225A (zh) 2020-07-10

Similar Documents

Publication Publication Date Title
JP7398506B2 (ja) ローカライゼーション基準データを生成及び使用する方法及びシステム
CN108171733B (zh) 使两个或更多个三维3d点云配准的方法
JP3561473B2 (ja) 物体位置の追跡・検知方法及びビークル
US12117312B2 (en) Systems and methods for vehicle mapping and localization using synthetic aperture radar
CN110703268B (zh) 一种自主定位导航的航线规划方法和装置
US11561553B1 (en) System and method of providing a multi-modal localization for an object
Wang et al. Acoustic camera-based pose graph slam for dense 3-d mapping in underwater environments
JP6138326B1 (ja) 移動体、移動体の制御方法、移動体を制御するプログラム、制御システム、及び情報処理装置
US11733041B2 (en) Apparatus and method for fault-proof collection of imagery for underwater survey
CN112461204B (zh) 卫星对动态飞行目标多视角成像联合计算航行高度的方法
KR101409802B1 (ko) 3차원 3d 스캐너를 활용한 최적의 공간정보 분석 시스템
CN109282813B (zh) 一种无人艇全局障碍物识别的方法
CN120663329A (zh) 机器人感测装置和传感器规划方法
Khoshelham et al. Vehicle positioning in the absence of GNSS signals: Potential of visual-inertial odometry
CN111936946A (zh) 一种定位系统和方法
Beall et al. Bundle adjustment in large-scale 3d reconstructions based on underwater robotic surveys
CN114459461B (zh) 一种基于gis与实时光电视频的导航定位方法
US11580690B1 (en) Horizon-based navigation
Iannucci et al. Cross-Modal Localization: Using automotive radar for absolute geolocation within a map produced with visible-light imagery
CN113899356A (zh) 一种非接触式移动测量系统及方法
Vandana et al. 3D Mapping using Lidar
CN121120974B (zh) 车载移动测量系统的实景三维模型构建方法、装置及车载移动测量系统
Alsubaie et al. The feasibility of 3D point cloud generation from smartphones
US12241744B2 (en) Geolocation system and method
He et al. Spinning-Actuated LiDAR-Based SLAM for Robotic Mapping: A Concise Survey

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18941472

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18941472

Country of ref document: EP

Kind code of ref document: A1