WO2017024673A1 - Target positioning system and method based on radio frequency and binocular vision - Google Patents

Target positioning system and method based on radio frequency and binocular vision Download PDF

Info

Publication number
WO2017024673A1
WO2017024673A1 PCT/CN2015/091893 CN2015091893W WO2017024673A1 WO 2017024673 A1 WO2017024673 A1 WO 2017024673A1 CN 2015091893 W CN2015091893 W CN 2015091893W WO 2017024673 A1 WO2017024673 A1 WO 2017024673A1
Authority
WO
WIPO (PCT)
Prior art keywords
target
time
signal
camera
unit
Prior art date
Application number
PCT/CN2015/091893
Other languages
French (fr)
Chinese (zh)
Inventor
李志强
高少波
桂小琰
Original Assignee
西安斯凯智能科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 西安斯凯智能科技有限公司 filed Critical 西安斯凯智能科技有限公司
Publication of WO2017024673A1 publication Critical patent/WO2017024673A1/en

Links

Images

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S11/00Systems for determining distance or velocity not using reflection or reradiation
    • G01S11/02Systems for determining distance or velocity not using reflection or reradiation using radio waves
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C11/00Photogrammetry or videogrammetry, e.g. stereogrammetry; Photographic surveying

Definitions

  • the present invention relates to the field of target positioning, and in particular to a system and method for precise positioning of targets based on radio frequency and binocular vision.
  • the existing navigation and target tracking methods are mainly based on manual real-time control methods or GPS-based methods for target tracking or navigation.
  • the accuracy of these navigation, positioning and tracking methods is low, and in the absence of GPS signals, such as These methods will be difficult to play an effective role in densely populated areas or indoors.
  • the navigation and target tracking method based on monocular vision came into being. This method mainly aims to meet the needs of different tasks by setting up a camera to capture video and then processing the video.
  • monocular vision lacks the spatial depth information of the target, and the accuracy of navigation, positioning and tracking is difficult to guarantee.
  • Binocular vision can accurately determine the spatial position of the target, but the amount of calculation for the dual purpose is large, and it is difficult to meet the requirements of real-time. Therefore, there is a need to develop positioning techniques that combine real-time and accuracy to improve the accuracy of navigation and target tracking.
  • the present invention provides a target positioning system, including a target coarse positioning module and a target precise positioning module; wherein the target coarse positioning module has a signal generating unit and a signal receiving unit; Transmitting and receiving the signal-related time of the signal generating unit and the signal receiving unit to acquire a transmission time of the signal in the air, and determining a search range of the target based on the transmission time; the target precise positioning module according to the target The search range determines the exact position coordinates of the target.
  • the signal generating unit is capable of transmitting an interrogation signal to the signal receiving unit and receiving a first response signal from the signal receiving unit;
  • the signal receiving unit is capable of receiving the interrogation signal from the signal generating unit Transmitting the first response signal to the signal generating unit based on the received query signal;
  • the target coarse positioning module is capable of recording a first time and receipt of the signal generating unit to transmit the interrogation signal a second time of the first response signal of the signal receiving unit and a third time when the signal receiving unit receives the interrogation signal and a fourth time when the signal receiving unit sends the first response signal;
  • the target coarse positioning module acquires a first transmission time by subtracting a difference between the second time and the first time by a difference between the fourth time and the third time, and based on the Determining, by the first transmission time, a first distance between the signal generating unit and the target, and determining the target based on the acquired first distance Cable range.
  • the signal generating unit is further capable of transmitting a second response signal to the signal receiving unit;
  • the receiving unit is further capable of receiving the second response signal from the signal generating unit;
  • the target coarse positioning module is further capable of recording a fifth time when the signal generating unit transmits the second response signal, and the signal receiving unit a sixth time at which the second response signal is received; wherein the target coarse positioning module further subtracts the fifth time and the second by subtracting the difference between the sixth time and the fourth time Obtaining a second transmission time according to the difference of time, and acquiring a second distance between the signal generating unit and the target based on the second transmission time, adding the first distance and the second distance Dividing by 2 to obtain an average distance of the signal generating unit from the target, and determining a search range of the target based on the average distance.
  • the signal generating unit has a first timing unit capable of recording the first time, the second time, and the fifth time; the signal receiving unit has a second timing unit The second timing unit is capable of recording the third time, the fourth time, and the sixth time.
  • the target precise positioning module comprises a binocular camera and a video processing unit;
  • the binocular camera comprises a first camera and a second camera, capable of taking pictures within a search range of the target from different orientations and perspectives;
  • the video processing unit is capable of processing the picture to obtain precise position coordinates of the target.
  • the video processing unit controls the first camera and the second camera to capture a picture containing a target according to a search range of the target.
  • the video processing unit acquires three-dimensional coordinates of one of the coordinate systems in which the first camera and the second camera are referenced by using the target-containing picture in a triangular relationship.
  • the target precise positioning module further comprises a displacement sensor capable of acquiring a spatial transformation matrix between the camera coordinate system and a coordinate system of the flying device in which the target positioning system is located.
  • the video processing unit is capable of converting the three-dimensional coordinates of the target in the camera coordinate system into three-dimensional coordinates of the target in the coordinate system of the flying device by using the spatial transformation matrix.
  • the signal transmitting unit is disposed on the flying device, and the signal receiving unit is disposed on the target.
  • Another invention of the present invention provides a target positioning method, comprising: a target coarse positioning step of acquiring a transmission time of a signal in the air according to a time at which the signal is transmitted and received, and determining a search range of the target based on the transmission time. a target precise positioning step of determining a precise position coordinate of the target based on the search range of the target.
  • the target coarse positioning step includes: the signal generating unit transmits an inquiry signal to the signal receiving unit; recording a first time at which the inquiry signal is transmitted; the signal receiving unit receives the inquiry signal; and recording and receiving the inquiry signal a third time; the signal receiving unit transmits a first response signal to the signal generating unit based on the received query signal, the third time, and the recorded fourth of transmitting the first response signal Time; the signal occurs Receiving, by the unit, the first response signal, the third time, and the fourth time; recording a second time of receiving the first response signal; based on the first time, the second time, the first Calculating, by the third time and the fourth time, a first distance of the signal generating unit from the target; determining a search range of the target based on the first distance; wherein, by using the second time and the first time And subtracting the difference between the fourth time and the third time to obtain the transmission time, and acquiring the first distance based on the first transmission time.
  • the target coarse positioning step further comprises: the signal generating unit transmitting a second response signal to the signal receiving unit; recording a fifth time for transmitting the second response signal, and recording the second time sum Transmitting the fifth time to the signal receiving unit; the signal receiving unit receiving the second response signal, the second time, and the fifth time from the signal generating unit; a sixth time of the second response signal; obtaining a second transmission time by subtracting the difference between the sixth time and the fourth time by the difference between the fifth time and the second time, and based on the a second transmission time multiplied by a second distance between the signal generating unit and the target; adding the first distance and the second distance and dividing by 2 to obtain the distance of the signal generating unit An average distance of the target; a search range of the target is determined based on the average distance.
  • the target precise positioning step further includes: a picture acquiring step, the first camera and the second camera take a picture in the target search range from different orientations and perspectives; and the video processing step processes the picture to obtain The exact position coordinates of the target.
  • the first camera and the second camera are controlled to capture a picture containing the target according to the search range of the target.
  • the three-dimensional one of the coordinate systems in which the target is referenced by the first camera and the second camera is acquired by a triangular relationship using the picture containing the target. coordinate.
  • the video processing step further comprises a spatial transformation matrix acquisition step of acquiring a spatial transformation matrix between a coordinate system of the first camera and the second camera and a coordinate system of a flight device in which the target positioning system is located.
  • the three-dimensional coordinates of the target in the coordinate system of the first camera and the second camera are converted into targets on the flying device by using the space conversion matrix.
  • the three-dimensional coordinates in the coordinate system to obtain the precise position coordinates of the target.
  • the invention firstly uses the radio frequency positioning technology to realize fast search and detection of the target, and determines the search range of the target. Then, the binocular vision positioning method is used to capture the target within the determined target search range, and the target is accurately positioned to improve the positioning speed. At the same time, the system of the present invention processes only the image of the No. 1 camera, detects whether the target exists, and saves the image of the No. 2 camera, that is, only relies on the camera taken by the No. 2 camera to perform target retrieval and judgment, and completes the precise positioning of the target, so that It can greatly reduce the amount of calculation and improve the positioning efficiency.
  • FIG. 1 is a schematic structural diagram of a target positioning system based on radio frequency and binocular vision according to the present invention
  • FIG. 2 is a schematic structural diagram of a signal generating unit according to the present invention.
  • FIG. 3 is a schematic structural diagram of a signal receiving unit according to the present invention.
  • FIG. 4 is a flow chart of positioning of a target positioning system based on radio frequency and binocular vision according to the present invention
  • FIG. 5 is a flowchart of a method for coarse positioning based on a radio frequency positioning module according to the present invention
  • FIG. 6 is a schematic diagram of the operation of the radio frequency positioning module according to the present invention.
  • FIG. 7 is a flow chart of a method for accurately positioning a binocular positioning module according to the present invention.
  • FIG. 8 is a schematic diagram of a dual target model with positioning targets according to the present invention.
  • FIG. 1 is a schematic structural diagram of a target positioning system based on radio frequency and binocular vision according to an embodiment of the present invention.
  • the system includes a radio frequency positioning module 1, a binocular positioning module 2, and a control module 3.
  • the radio frequency positioning module 1 includes a signal generating unit 11, a signal receiving unit 12, a core processing unit 13, and an input and output unit.
  • the binocular positioning module 2 includes a binocular camera unit 21, a video processing unit 22, a displacement sensor unit 23, and an input and output unit 24.
  • the signal generating unit 11, the core processing unit 13 and the input and output unit 14 of the radio frequency positioning module 1 and the binocular camera unit 21, the video processing unit 22, the displacement sensor unit 23 and the input and output unit 24 of the binocular positioning module 2 They are all disposed on the flying device, and the above units can be connected by data lines for data transmission.
  • the signal receiving unit 12 of the radio frequency positioning module 1 is disposed on the target, and the signal receiving unit 12 and the input and output unit 14 can be communicably connected by wireless communication, thereby implementing the signal receiving unit 12 and the radio frequency positioning module.
  • the control module 3 can be located on the ground and controlled by an operator.
  • the radio frequency positioning module 1 and the binocular positioning module 2 can communicate with the control module 3 by wireless communication.
  • the input/output unit 14, the signal generating unit 11, and the core processing unit 13 of the radio frequency positioning module 1 are disposed on the flying device, and can communicate with each other through the data bus 15; the radio frequency positioning module 1 and the binocular The positioning modules 2 can be connected by means of data lines or the like.
  • the control module 3 performs wireless communication with the radio frequency positioning module 1 through the input and output unit 14 of the radio frequency positioning module 1 and exchanges information.
  • the wireless communication may include wireless communication such as Bluetooth or wifi.
  • FIG. 2 is a schematic diagram showing the configuration of a signal generation unit according to the embodiment.
  • the signal occurs
  • the unit 11 comprises a wireless signal transmitting device 111, a timing unit 112, a processing unit 113 and a storage unit 114, wherein the wireless signal transmitting device 111 is capable of transmitting a radio signal (i.e., an interrogation signal), and the processing unit 113 is capable of generating the signal
  • a radio signal i.e., an interrogation signal
  • the processing unit 113 is capable of generating the signal
  • the data information received by the unit 11 is processed, and the wireless signal transmitting apparatus 111 is controlled to transmit a radio signal, and the timing unit 112 has a timing function capable of transmitting time information of the radio signal and the signal to the wireless signal transmitting apparatus 111.
  • the generating unit 11 receives the time information of the response signal sent by the signal receiving unit 12, and the storage unit 114 can store the time information recorded by the timing unit 112 and other data or information, etc., while the timing Unit 112 may also send the recorded time information to the core processing unit 13.
  • the radio transmitting device 111 is a UWB signal transmitting device capable of transmitting a UWB signal.
  • the UWB signal is an ultra-wideband signal, and has the advantages of multi-channel, high bandwidth, low power, and the like, and operates from 3.1 GHz to 10.6 GHz.
  • FIG. 3 is a schematic diagram showing the configuration of a signal receiving unit according to the embodiment.
  • the signal receiving unit 12 includes a wireless signal receiving device 121, a timing unit 122, a processing unit 123, and a storage unit 124, wherein the wireless signal receiving device 121 is capable of receiving a radio from the signal generating unit 11.
  • the processing unit 123 is capable of processing the radio signal and the data information received by the signal receiving unit 12, generating a response signal, and transmitting the response signal to the signal generating unit 11 and the core processing unit 13,
  • the timing unit 122 has a timing function capable of recording time information of the radio signal receiving means 121 receiving the radio signal from the signal generating unit 11 and time information of the response signal transmitted by the processing unit 123, the storage unit 124 may store time information recorded by the timing unit 122, as well as other data or information, etc., while the timing unit 122 may also transmit the recorded time information to the core processing unit 13.
  • the core processing unit 13 is capable of calculating a search range of a target by using the time information of transmitting and receiving a radio signal and transmitting and receiving related data information by the signal generating unit 11 and the signal receiving unit 12, and calculating the search range.
  • the information is sent to the binocular positioning module 2.
  • the core processing unit 13 is capable of receiving information transmitted by the control module 3 and controlling the operation of the signal generating unit 11 and the signal receiving unit 12 to transmit or receive radio signals and to transmit and receive related data information, such as controlling the frequency of radio signal transmission, Channel, clock, etc.
  • the binocular camera unit 21 of the binocular positioning module 2 includes cameras No. 1 and No. 2.
  • the orientation and viewing angle of the two cameras can be different, and the target can be photographed simultaneously for a specific area, and the captured picture is sent to Video processing unit 22.
  • the video processing unit 22 internally provides a storage device (not shown), stores an image processing algorithm and can store a picture captured by a binocular camera; the video processing unit 22 can process the received picture using a stored image processing algorithm. And obtaining the precise coordinates of the target captured by the binocular camera unit 21; at the same time, the video processing unit 22 can control the binocular camera unit 21 to have a target within the search range according to the target search range information sent by the radio frequency positioning module 1. Take pictures in the area.
  • the displacement sensor unit 23 is capable of acquiring the binocular camera unit 21 sitting A spatial transformation matrix between the calibration system and the coordinate system of the flight device, and the matrix is sent to the video processing unit 22.
  • the input/output unit 24, the binocular camera unit 21, the video processing unit 22, and the displacement sensor unit 23 of the binocular positioning module 2 are communicably connected to each other via a data bus 25.
  • the binocular positioning module 2 can perform wireless communication with the control module 3 and exchange information.
  • the wireless communication may include wireless communication such as Bluetooth or wifi.
  • the control module 3 has a wireless communication component such as Bluetooth or wifi (not shown), and can receive the target search range information sent by the radio frequency positioning module 1 and the target precise location information sent by the binocular positioning module 2, and display the received information in the un
  • the illustrated display provides a reference for the operator; the operator sends control information to the RF positioning module 1 and the binocular positioning module 2 via a display or other input device (not shown).
  • the target positioning system further has a storage module (not shown) capable of storing information such as a positioning record of the target positioning system, the binocular positioning module 2 being communicably connected to the storage module, and capable of calling the storage. The information stored by the module.
  • step S1 The operator sends a positioning task to the radio frequency positioning module 1 and the binocular positioning module 2 on the flight device through the control module 3, and the core processing unit 13 of the radio frequency positioning module 1 of the flight device determines whether a positioning task is received (step S2).
  • the core processing unit 13 of the radio frequency positioning module 1 of the flight device determines that the positioning task has not been received (NO in step S2), and continues to wait for receiving the positioning task. If the core processing unit 13 of the radio frequency positioning module 1 determines that the positioning task is received (YES in step S2), the target is searched by the radio frequency positioning module 1 to determine the target search range (step S3), and the target search range is determined. It is sent to the binocular positioning module 2 and the control module 3 (step S4).
  • FIG. 5 is a flowchart of determining the target search range by the radio frequency positioning module 1 in step S3 according to the embodiment.
  • FIG. 6 is a schematic diagram of the operation of the radio frequency positioning module 1 according to the embodiment. The process of target coarse positioning will be specifically described based on FIGS. 5 and 6.
  • the core processing unit 13 of the radio frequency positioning module 1 determines that the positioning task is received, the core processing unit 13 instructs the processing unit 113 of the signal generating unit 11 to cause the wireless signal transmitting device 111 to transmit with an ID.
  • the radio signal (Poll signal) of the information, and the timing unit 112 of the signal generation unit 11 record the time T a at which the above-mentioned Poll signal is transmitted and store the time T a in the storage unit 114 of the signal generation unit 11 (step S31) ).
  • the ID information may be a specific number of the flight device or a specific code information that the signal receiving unit 12 can recognize the signal generating unit 11.
  • the Poll signal transmitted by the signal generating unit 11 is received by the signal receiving unit 12 on the target.
  • the processing unit 123 of the signal receiving unit 12 determines whether the signal receiving device 121 receives the Poll signal from the signal generating unit 11 based on the ID information (step S32).
  • step S32 determines that the Poll signal is not received (NO in step S32)
  • the processing unit 123 determines the signal receiving unit 12 receives the Poll signal (step S32)
  • the timing unit 122 of the recording signal receiving unit 12 receives the time T b of the Poll signal and stores the The storage unit 124 of the signal receiving unit 12 is described (step S33).
  • the processing unit 123 of the signal receiving unit 12 performs an acknowledgement process on the received Poll signal and generates a corresponding response signal (step S34), and transmits the response signal with the ID information and the response signal. transmitting the transmission time and the recording time T d T b together with other information to the signal generation unit 11 (step S35).
  • the processing unit 113 of the signal generating unit 11 determines whether the response signal sent in step S35 and the time T d and the time T b are received according to the ID information. (Step S36). If the processing unit 113 of the signal generation unit 11 determines that the response signal or the like is not received (step S36: NO), it continues to wait. If the signal generating unit 11 receives the response information (Step S36: YES) signals, the timing signal generating unit 11 of the recording unit 112 receives the response time T c signal to the signal generating and storing The storage unit 114 of the unit 11 (step S37), while the signal generation unit 11 performs a confirmation process on the received response signal.
  • the signal generation unit 11 transmits all of the above-described time information T a , T b , T c , T d to the core processing unit 13, which calculates a wireless signal (Poll signal) and a response signal to fly in the air.
  • the clocks of the signal receiving unit 12 and the signal generating unit 11 may be out of synchronization, that is, there is a clock difference, if the time T 1 in which the wireless signal is directly used to fly in the air is received by the signal receiving unit 12
  • the time T b of the signal is subtracted from the time T a of the signal transmitted by the signal generating unit 11, that is, (T b -T a ), because the signal receiving unit 12 and the signal generating unit 11
  • the existence of a clock difference between the above results in an inaccurate flight time of the above calculated signal in the air.
  • the adverse effects caused by the out-of-synchronization of the clocks of the signal receiving unit 12 and the signal generating unit 11 are eliminated.
  • (T d -T b ) is a time interval from the reception of the wireless signal from the signal generating unit 11 by the signal receiving unit 12 to the signal receiving unit 12 transmitting the response signal, at the time interval Internally, the wireless signal does not fly in the air and therefore needs to be subtracted to more accurately calculate the time during which the wireless signal is flying in the air.
  • the signal generating unit 11 issues another response signal with the ID information, the transmitting station, while receiving the response signal of the signal receiving unit 12.
  • Information such as the time T e of the other response signal and the time information T c is sent to the signal receiving unit 12 (step S39).
  • the processing unit 123 of the signal receiving unit 12 determines whether the received signal is the information transmitted in step S39 based on the ID information (step S10), if the processing unit 123 of the signal receiving unit 12 determines that the other response signal is not received, The information such as the time T e and the time information T c (NO in step S310) continues to wait.
  • the timing unit 122 of the signal receiving unit 12 records the time T at which the information is received. f is stored in the storage unit 124 of the signal receiving unit 12 (step S311).
  • the signal receiving unit 12 then transmits the time information T e , T f , T c , T d in steps S35 to S311 to the core processing unit 13, which calculates the response signal and the other
  • the core processing unit 13 obtains the target search range (d-d ⁇ , d+d ⁇ ) based on the distance between the flying device and the target and according to the radio transmission chip self error ⁇ (where d ⁇ is the distance error; the chip itself has an error
  • the unit is a unit of time such as nanoseconds, milliseconds, etc. (step S314).
  • the above search range is transmitted to the binocular positioning module 2 and the control module 3 (step S4).
  • the binocular positioning module 2 accurately locates the target according to the target search range information sent by the radio frequency positioning module (step S5).
  • FIG. 7 is a flow chart of a method for precise positioning based on a binocular positioning module according to the present invention.
  • FIG. 8 is a schematic diagram of a dual target model with positioning targets according to the present invention.
  • the video processing unit 22 controls the cameras No. 1 and No. 2 of the binocular camera unit 21 to capture the regions having targets in the search range from different perspectives and orientations, respectively, through the received target search range information.
  • the captured picture is transmitted to the video processing unit 22 (step S51).
  • the video processing unit 22 performs a target search on the received picture, and determines whether or not the picture having the target is retrieved (step S52). If the video processing unit 22 does not retrieve the picture containing the target (NO in step S52), the search is continued.
  • the video processing unit 22 retrieves the picture containing the target (YES in step S52), the video processing unit 22 processes the picture containing the target, as shown in FIG. 8, respectively, in the No. 1 camera and the No. 2 camera.
  • the two-dimensional image coordinates P 1 (u, v) and P 2 (u', v') of the target in the captured picture step S53).
  • the three-dimensional coordinates (X, Y, Z) of the target center in the No. 1 camera coordinate system C or the No. 2 camera coordinate system C' are obtained.
  • the No. 1 camera coordinate system C is used as a reference system for calculation and description.
  • Step S54 specifically, as shown in FIG. 8, the optical axis 1 of the No. 1 camera is parallel to the optical axis 2 of the No. 2 camera, and the target can be obtained in the coordinate system C with reference to the No. 1 camera by the triangular relationship.
  • f is the focal length of the camera
  • L is the distance between the two cameras
  • (u 0 , v 0 ) is the coordinate of the central pixel point of the imaging plane of the camera.
  • Z z) of the parameters X x, Y y, Z z , the three-dimensional coordinates of the center of the target by the number 1 may refer to the camera coordinate system C is converted to the aircraft coordinate system:
  • the position coordinate information is transmitted to the control module 3 (step S6).
  • the target space coordinates can be converted into the flight device coordinates to achieve spatially accurate positioning of the target relative to the aircraft coordinate system.

Abstract

A target positioning system and a target positioning method. The system comprises a target coarse positioning module (1) and a target precise positioning module (2). The target coarse positioning module (1) is provided with a signal generation unit (11) and a signal receiving unit (12). The target coarse positioning module (1) acquires the transmission time of a related signal in the air according to the time at which the signal generation unit (11) sends the related signal and the time at which the signal receiving unit (12) receives the related signal, and determines the search range of a target based on the transmission time. The target precise positioning module (2) determines coordinates of a precise location of the target according to the search range of the target.

Description

一种基于射频和双目视觉的目标定位系统及方法Target positioning system and method based on radio frequency and binocular vision 技术领域Technical field
本发明涉及目标定位领域,尤其涉及一种基于射频和双目视觉的目标精确定位的系统及方法。The present invention relates to the field of target positioning, and in particular to a system and method for precise positioning of targets based on radio frequency and binocular vision.
背景技术Background technique
目前现有的导航和目标跟踪方法主要是基于人工实时控制的方法或者基于GPS的方法进行目标跟踪或导航,这些导航、定位和跟踪方法的精度较低,而且在没有GPS信号的情况下,如在建筑物密集区或室内等,这些方法将很难发挥有效的作用。针对上述情况,基于单目视觉的导航和目标跟踪方法应运而生,这种方法主要是通过设置一个摄像头摄取视频,然后对视频进行处理以达到不同任务的需求目的。然而,单目视觉缺乏目标的空间深度信息,其导航、定位和跟踪的精度难以保证。双目视觉则可以很准确的确定出目标的空间位置,但是双目的计算量较大,难以满足实时性的要求。因此,需要开发能够兼顾实时性和精确性的定位技术,以提高导航和目标跟踪的准确性。At present, the existing navigation and target tracking methods are mainly based on manual real-time control methods or GPS-based methods for target tracking or navigation. The accuracy of these navigation, positioning and tracking methods is low, and in the absence of GPS signals, such as These methods will be difficult to play an effective role in densely populated areas or indoors. In view of the above situation, the navigation and target tracking method based on monocular vision came into being. This method mainly aims to meet the needs of different tasks by setting up a camera to capture video and then processing the video. However, monocular vision lacks the spatial depth information of the target, and the accuracy of navigation, positioning and tracking is difficult to guarantee. Binocular vision can accurately determine the spatial position of the target, but the amount of calculation for the dual purpose is large, and it is difficult to meet the requirements of real-time. Therefore, there is a need to develop positioning techniques that combine real-time and accuracy to improve the accuracy of navigation and target tracking.
发明内容Summary of the invention
为了解决以上问题,本发明提供一种目标定位系统,包括目标粗定位模块和目标精确定位模块;其中,所述目标粗定位模块具有信号发生单元和信号接收单元;所述目标粗定位模块根据所述信号发生单元和所述信号接收单元的发送和接收有关信号的时间获取有关信号在空中的传输时间,并基于所述传输时间来确定目标的搜索范围;所述目标精确定位模块根据所述目标的搜索范围确定目标的精确位置坐标。In order to solve the above problems, the present invention provides a target positioning system, including a target coarse positioning module and a target precise positioning module; wherein the target coarse positioning module has a signal generating unit and a signal receiving unit; Transmitting and receiving the signal-related time of the signal generating unit and the signal receiving unit to acquire a transmission time of the signal in the air, and determining a search range of the target based on the transmission time; the target precise positioning module according to the target The search range determines the exact position coordinates of the target.
优选地,所述信号发生单元能够向所述信号接收单元发射询问信号,并接收来自所述信号接收单元的第一响应信号;所述信号接收单元能够从所述信号发生单元接收所述询问信号,并基于所接收到的所述询问信号向所述信号发生单元发送所述第一响应信号;所述目标粗定位模块能够记录所述信号发生单元发射所述询问信号的第一时间和收到所述信号接收单元的所述第一响应信号的第二时间以及所述信号接收单元接收到所述询问信号的第三时间和所述信号接收单元发出所述第一响应信号的第四时间;其中,所述目标粗定位模块通过将所述第二时间和所述第一时间的差值减去所述第四时间和所述第三时间的差值获取第一传输时间,并基于所述第一传输时间获取所述信号发生单元与所述目标之间的第一距离,基于所获取的所述第一距离来确定所述目标的搜索范围。Preferably, the signal generating unit is capable of transmitting an interrogation signal to the signal receiving unit and receiving a first response signal from the signal receiving unit; the signal receiving unit is capable of receiving the interrogation signal from the signal generating unit Transmitting the first response signal to the signal generating unit based on the received query signal; the target coarse positioning module is capable of recording a first time and receipt of the signal generating unit to transmit the interrogation signal a second time of the first response signal of the signal receiving unit and a third time when the signal receiving unit receives the interrogation signal and a fourth time when the signal receiving unit sends the first response signal; The target coarse positioning module acquires a first transmission time by subtracting a difference between the second time and the first time by a difference between the fourth time and the third time, and based on the Determining, by the first transmission time, a first distance between the signal generating unit and the target, and determining the target based on the acquired first distance Cable range.
优选地,所述信号发生单元还能够向所述信号接收单元发送第二响应信号;所述信号 接收单元还能够从所述信号发生单元接收所述第二响应信号;所述目标粗定位模块还能够记录所述信号发生单元发送所述第二响应信号的第五时间,以及所述信号接收单元接收到所述第二响应信号的第六时间;其中,所述目标粗定位模块还通过将所述第六时间和所述第四时间的差值减去所述第五时间和所述第二时间的差值获取第二传输时间,并基于所述第二传输时间获取所述信号发生单元与所述目标之间的第二距离,将所述第一距离和所述第二距离相加后除以2,以获取所述信号发生单元距离所述目标的平均距离,基于所述平均距离来确定所述目标的搜索范围。Preferably, the signal generating unit is further capable of transmitting a second response signal to the signal receiving unit; The receiving unit is further capable of receiving the second response signal from the signal generating unit; the target coarse positioning module is further capable of recording a fifth time when the signal generating unit transmits the second response signal, and the signal receiving unit a sixth time at which the second response signal is received; wherein the target coarse positioning module further subtracts the fifth time and the second by subtracting the difference between the sixth time and the fourth time Obtaining a second transmission time according to the difference of time, and acquiring a second distance between the signal generating unit and the target based on the second transmission time, adding the first distance and the second distance Dividing by 2 to obtain an average distance of the signal generating unit from the target, and determining a search range of the target based on the average distance.
优选地,所述信号发生单元具有第一计时单元,所述第一计时单元能够记录所述第一时间、所述第二时间和所述第五时间;所述信号接收单元具有第二计时单元,所述第二计时单元能够记录所述第三时间、所述第四时间和所述第六时间。Preferably, the signal generating unit has a first timing unit capable of recording the first time, the second time, and the fifth time; the signal receiving unit has a second timing unit The second timing unit is capable of recording the third time, the fourth time, and the sixth time.
优选地,所述目标精确定位模块包括双目摄像机和视频处理单元;所述双目摄像机包括第一摄像头和第二摄像头,能够从不同方位和视角在所述目标的搜索范围内拍摄图片;所述视频处理单元能够对所述图片进行处理,获取目标的精确位置坐标。Preferably, the target precise positioning module comprises a binocular camera and a video processing unit; the binocular camera comprises a first camera and a second camera, capable of taking pictures within a search range of the target from different orientations and perspectives; The video processing unit is capable of processing the picture to obtain precise position coordinates of the target.
优选地,所述视频处理单元根据所述目标的搜索范围控制所述第一摄像头和所述第二摄像头拍摄含有目标的图片。Preferably, the video processing unit controls the first camera and the second camera to capture a picture containing a target according to a search range of the target.
优选地,所述视频处理单元利用所述含有目标的图片通过三角关系获取目标在所述第一摄像头和所述第二摄像头为参考的坐标系中其中之一的三维坐标。Preferably, the video processing unit acquires three-dimensional coordinates of one of the coordinate systems in which the first camera and the second camera are referenced by using the target-containing picture in a triangular relationship.
优选地,所述目标精确定位模块还包括位移传感器,所述位移传感器能够获取摄像头坐标系和所述目标定位系统所在的飞行装置的坐标系之间的空间转换矩阵。Preferably, the target precise positioning module further comprises a displacement sensor capable of acquiring a spatial transformation matrix between the camera coordinate system and a coordinate system of the flying device in which the target positioning system is located.
优选地,所述视频处理单元能够利用所述空间转换矩阵,将目标在所述摄像头坐标系中的三维坐标转换成目标在所述飞行装置的坐标系中的三维坐标。Preferably, the video processing unit is capable of converting the three-dimensional coordinates of the target in the camera coordinate system into three-dimensional coordinates of the target in the coordinate system of the flying device by using the spatial transformation matrix.
优选地,所述信号发射单元设置在所述飞行装置上,所述信号接收单元设置在所述目标上。Preferably, the signal transmitting unit is disposed on the flying device, and the signal receiving unit is disposed on the target.
本发明的另一发明提供了一种目标定位方法,包括:目标粗定位步骤,根据发送和接收有关信号的时间获取有关信号在空中的传输时间,并基于所述传输时间来确定目标的搜索范围;目标精确定位步骤,根据所述目标的搜索范围确定目标的精确位置坐标。Another invention of the present invention provides a target positioning method, comprising: a target coarse positioning step of acquiring a transmission time of a signal in the air according to a time at which the signal is transmitted and received, and determining a search range of the target based on the transmission time. a target precise positioning step of determining a precise position coordinate of the target based on the search range of the target.
优选地,所述目标粗定位步骤包括;信号发生单元向信号接收单元发射询问信号;记录发射所述询问信号的第一时间;所述信号接收单元接收所述询问信号;记录接收所述询问信号的第三时间;所述信号接收单元基于所接收到的所述询问信号向所述信号发生单元发送第一响应信号、所述第三时间和发送所述第一响应信号的所记录的第四时间;所述信号发生 单元接收所述第一响应信号、所述第三时间和所述第四时间;记录接收所述第一响应信号的第二时间;基于所述第一时间、所述第二时间、所述第三时间和所述第四时间计算所述信号发生单元距离目标的第一距离;基于所述第一距离确定所述目标的搜索范围;其中,通过将所述第二时间和所述第一时间的差值减去所述第四时间和所述第三时间的差值获取所述传输时间,并基于所述第一传输时间获取所述第一距离。Preferably, the target coarse positioning step includes: the signal generating unit transmits an inquiry signal to the signal receiving unit; recording a first time at which the inquiry signal is transmitted; the signal receiving unit receives the inquiry signal; and recording and receiving the inquiry signal a third time; the signal receiving unit transmits a first response signal to the signal generating unit based on the received query signal, the third time, and the recorded fourth of transmitting the first response signal Time; the signal occurs Receiving, by the unit, the first response signal, the third time, and the fourth time; recording a second time of receiving the first response signal; based on the first time, the second time, the first Calculating, by the third time and the fourth time, a first distance of the signal generating unit from the target; determining a search range of the target based on the first distance; wherein, by using the second time and the first time And subtracting the difference between the fourth time and the third time to obtain the transmission time, and acquiring the first distance based on the first transmission time.
优选地,所述目标粗定位步骤还包括:所述信号发生单元向所述信号接收单元发送第二响应信号;记录发送所述第二响应信号的第五时间,并将所述第二时间和所述第五时间发送给所述信号接收单元;所述信号接收单元从所述信号发生单元接收所述第二响应信号、所述第二时间和所述第五时间;记录接收到所述第二响应信号的第六时间;通过将所述第六时间和所述第四时间的差值减去所述第五时间和所述第二时间的差值获取第二传输时间,并基于所述第二传输时间乘获取所述信号发生单元与所述目标之间的第二距离;将所述第一距离和所述第二距离相加后除以2,以获取所述信号发生单元距离所述目标的平均距离;基于所述平均距离来确定所述目标的搜索范围。Preferably, the target coarse positioning step further comprises: the signal generating unit transmitting a second response signal to the signal receiving unit; recording a fifth time for transmitting the second response signal, and recording the second time sum Transmitting the fifth time to the signal receiving unit; the signal receiving unit receiving the second response signal, the second time, and the fifth time from the signal generating unit; a sixth time of the second response signal; obtaining a second transmission time by subtracting the difference between the sixth time and the fourth time by the difference between the fifth time and the second time, and based on the a second transmission time multiplied by a second distance between the signal generating unit and the target; adding the first distance and the second distance and dividing by 2 to obtain the distance of the signal generating unit An average distance of the target; a search range of the target is determined based on the average distance.
优选地,所述目标精确定位步骤还包括:图片获取步骤,第一摄像头和第二摄像头从不同方位和视角在所述目标搜索范围内拍摄图片;视频处理步骤,对所述图片进行处理,获取目标的精确位置坐标。Preferably, the target precise positioning step further includes: a picture acquiring step, the first camera and the second camera take a picture in the target search range from different orientations and perspectives; and the video processing step processes the picture to obtain The exact position coordinates of the target.
优选地,在所述图片获取步骤中,根据所述目标的搜索范围控制所述第一摄像头和所述第二摄像头拍摄含有所述目标的图片。Preferably, in the picture obtaining step, the first camera and the second camera are controlled to capture a picture containing the target according to the search range of the target.
优选地,在所述视频处理步骤中,利用所述含有所述目标的图片通过三角关系获取所述目标在所述第一摄像头和所述第二摄像头为参考的坐标系中其中之一的三维坐标。Preferably, in the video processing step, the three-dimensional one of the coordinate systems in which the target is referenced by the first camera and the second camera is acquired by a triangular relationship using the picture containing the target. coordinate.
优选地,所述视频处理步骤还包括空间转换矩阵获取步骤,获取所述第一摄像头和所述第二摄像头的坐标系和目标定位系统所在的飞行装置的坐标系之间的空间转换矩阵。Preferably, the video processing step further comprises a spatial transformation matrix acquisition step of acquiring a spatial transformation matrix between a coordinate system of the first camera and the second camera and a coordinate system of a flight device in which the target positioning system is located.
优选地,在所述视频处理步骤中,利用所述空间转换矩阵,将目标所述在所述第一摄像头和所述第二摄像头的坐标系中的三维坐标转换成目标在所述飞行装置的坐标系中的三维坐标,获取目标的精确位置坐标。Preferably, in the video processing step, the three-dimensional coordinates of the target in the coordinate system of the first camera and the second camera are converted into targets on the flying device by using the space conversion matrix. The three-dimensional coordinates in the coordinate system to obtain the precise position coordinates of the target.
本发明首先利用射频定位技术实现对目标的快速搜索和检测,确定目标的搜索范围。然后采用双目视觉定位的方法使用双目摄像机在确定的目标搜索范围内进行拍摄,对目标进行精确定位从而提高了定位的速度。同时本发明所述的系统只对1号摄像头图像进行处理,检测目标是否存在,2号摄像头的图片保存,即仅依赖2号摄像头拍摄的摄像头进行目标的检索与判断,完成目标精确定位,这样可以大大降低计算量,提高定位效率。 The invention firstly uses the radio frequency positioning technology to realize fast search and detection of the target, and determines the search range of the target. Then, the binocular vision positioning method is used to capture the target within the determined target search range, and the target is accurately positioned to improve the positioning speed. At the same time, the system of the present invention processes only the image of the No. 1 camera, detects whether the target exists, and saves the image of the No. 2 camera, that is, only relies on the camera taken by the No. 2 camera to perform target retrieval and judgment, and completes the precise positioning of the target, so that It can greatly reduce the amount of calculation and improve the positioning efficiency.
附图说明DRAWINGS
图1为本发明所涉及的基于射频和双目视觉的目标定位系统的结构示意图;1 is a schematic structural diagram of a target positioning system based on radio frequency and binocular vision according to the present invention;
图2为本发明所涉及的信号发生单元的结构示意图;2 is a schematic structural diagram of a signal generating unit according to the present invention;
图3为本发明所涉及的信号接收单元的结构示意图;3 is a schematic structural diagram of a signal receiving unit according to the present invention;
图4为本发明涉及的基于射频和双目视觉的目标定位系统定位的流程图;4 is a flow chart of positioning of a target positioning system based on radio frequency and binocular vision according to the present invention;
图5为本发明涉及的基于射频定位模块的粗定位的方法流程图;FIG. 5 is a flowchart of a method for coarse positioning based on a radio frequency positioning module according to the present invention; FIG.
图6为本发明涉及的基于射频定位模块的工作示意图;6 is a schematic diagram of the operation of the radio frequency positioning module according to the present invention;
图7为本发明所涉及的基于双目定位模块的精确定位的方法流程图;7 is a flow chart of a method for accurately positioning a binocular positioning module according to the present invention;
图8为本发明所涉及的含定位目标的双目标定模型示意图。FIG. 8 is a schematic diagram of a dual target model with positioning targets according to the present invention.
具体实施方式detailed description
下面根据附图所示实施方式阐述本发明。此次公开的实施方式可以认为在所有方面均为例示,不具限制性。本发明的范围不受以下实施方式的说明所限,仅由权利要求书的范围所示,而且包括与权利要求范围具有同样意思及权利要求范围内的所有变形。The invention is illustrated below in accordance with the embodiments shown in the drawings. The disclosed embodiments are to be considered in all respects as illustrative and not restrictive. The scope of the present invention is defined by the scope of the claims, and the scope of the claims and the scope of the claims.
图1为本实施方式所涉及的基于射频和双目视觉的目标定位系统的结构示意图。如图1所示,所述系统包括射频定位模块1、双目定位模块2以及控制模块3,所述射频定位模块1包括信号发生单元11、信号接收单元12、核心处理单元13和输入输出单元14;所述双目定位模块2包括双目摄像机单元21、视频处理单元22、位移传感器单元23和输入输出单元24。所述射频定位模块1的信号发生单元11、核心处理单元13和输入输出单元14以及所述双目定位模块2的双目摄像机单元21、视频处理单元22、位移传感器单元23和输入输出单元24均设置于飞行装置上,且上述各单元之间可以通过数据线进行通信连接,进行数据传递。所述射频定位模块1的信号接收单元12设置于目标上,所述信号接收单元12与输入输出单元14可以通过无线通信方式进行通信连接,从而实现所述信号接收单元12与所述射频定位模块1的其他各单元之间的通信连接。所述控制模块3可以位于地面上,由操作人员控制,所述射频定位模块1和双目定位模块2可以通过无线通信方式与控制模块3进行通信。FIG. 1 is a schematic structural diagram of a target positioning system based on radio frequency and binocular vision according to an embodiment of the present invention. As shown in FIG. 1, the system includes a radio frequency positioning module 1, a binocular positioning module 2, and a control module 3. The radio frequency positioning module 1 includes a signal generating unit 11, a signal receiving unit 12, a core processing unit 13, and an input and output unit. The binocular positioning module 2 includes a binocular camera unit 21, a video processing unit 22, a displacement sensor unit 23, and an input and output unit 24. The signal generating unit 11, the core processing unit 13 and the input and output unit 14 of the radio frequency positioning module 1 and the binocular camera unit 21, the video processing unit 22, the displacement sensor unit 23 and the input and output unit 24 of the binocular positioning module 2 They are all disposed on the flying device, and the above units can be connected by data lines for data transmission. The signal receiving unit 12 of the radio frequency positioning module 1 is disposed on the target, and the signal receiving unit 12 and the input and output unit 14 can be communicably connected by wireless communication, thereby implementing the signal receiving unit 12 and the radio frequency positioning module. The communication connection between the other units of 1. The control module 3 can be located on the ground and controlled by an operator. The radio frequency positioning module 1 and the binocular positioning module 2 can communicate with the control module 3 by wireless communication.
其中,所述射频定位模块1的输入输出单元14、信号发生单元11和核心处理单元13设置于飞行装置上,能够通过数据总线15进行相互通信连接;所述射频定位模块1和所述双目定位模块2之间可以通过数据线等方式进行通信连接。控制模块3通过所述射频定位模块1的所述输入输出单元14实现与所述射频定位模块1进行无线通信,并进行信息交换。所述无线通信可以包括蓝牙或wifi等无线通信。The input/output unit 14, the signal generating unit 11, and the core processing unit 13 of the radio frequency positioning module 1 are disposed on the flying device, and can communicate with each other through the data bus 15; the radio frequency positioning module 1 and the binocular The positioning modules 2 can be connected by means of data lines or the like. The control module 3 performs wireless communication with the radio frequency positioning module 1 through the input and output unit 14 of the radio frequency positioning module 1 and exchanges information. The wireless communication may include wireless communication such as Bluetooth or wifi.
图2为本实施方式所涉及的信号发生单元的结构示意图。如图2所示,所述信号发生 单元11包括无线信号发射装置111、计时单元112、处理单元113和存储单元114,其中所述无线信号发射装置111能够发射无线电信号(即询问信号),所述处理单元113能够对所述信号发生单元11所接收到的数据信息进行处理,并且控制所述无线信号发射装置111发射无线电信号,所述计时单元112具有计时功能,能够对无线信号发射装置111发射无线电信号的时间信息和所述信号发生单元11接收到所述信号接收单元12所发送的响应信号的时间信息进行记录,所述存储单元114可以存储所述计时单元112所记录的时间信息以及其他数据或信息等,同时所述计时单元112也可以将所记录的时间信息发送到所述核心处理单元13。优选地,所述无线电发射装置111为UWB信号发射装置,能够发射UWB信号。上述UWB信号为超宽频信号,具有多频道、高带宽、低功率等优点,工作于3.1GHz~10.6GHz。FIG. 2 is a schematic diagram showing the configuration of a signal generation unit according to the embodiment. As shown in Figure 2, the signal occurs The unit 11 comprises a wireless signal transmitting device 111, a timing unit 112, a processing unit 113 and a storage unit 114, wherein the wireless signal transmitting device 111 is capable of transmitting a radio signal (i.e., an interrogation signal), and the processing unit 113 is capable of generating the signal The data information received by the unit 11 is processed, and the wireless signal transmitting apparatus 111 is controlled to transmit a radio signal, and the timing unit 112 has a timing function capable of transmitting time information of the radio signal and the signal to the wireless signal transmitting apparatus 111. The generating unit 11 receives the time information of the response signal sent by the signal receiving unit 12, and the storage unit 114 can store the time information recorded by the timing unit 112 and other data or information, etc., while the timing Unit 112 may also send the recorded time information to the core processing unit 13. Preferably, the radio transmitting device 111 is a UWB signal transmitting device capable of transmitting a UWB signal. The UWB signal is an ultra-wideband signal, and has the advantages of multi-channel, high bandwidth, low power, and the like, and operates from 3.1 GHz to 10.6 GHz.
图3为本实施方式所涉及的信号接收单元的结构示意图。如图3所示,所述信号接收单元12包括无线信号接收装置121、计时单元122、处理单元123和存储单元124,其中所述无线信号接收装置121能够接收来自所述信号发生单元11的无线电信号,所述处理单元123能够对所述信号接收单元12所接收到的无线电信号和数据信息进行处理,产生响应信号,并将所述响应信号发送给信号发生单元11和核心处理单元13,所述计时单元122具有计时功能,能够对无线信号接收装置121接收来自所述信号发生单元11的无线电信号的时间信息和所述处理单元123所发送的响应信号的时间信息进行记录,所述存储单元124可以存储所述计时单元122所记录的时间信息以及其他数据或信息等,同时所述计时单元122也可以将所记录的时间信息发送到所述核心处理单元13。FIG. 3 is a schematic diagram showing the configuration of a signal receiving unit according to the embodiment. As shown in FIG. 3, the signal receiving unit 12 includes a wireless signal receiving device 121, a timing unit 122, a processing unit 123, and a storage unit 124, wherein the wireless signal receiving device 121 is capable of receiving a radio from the signal generating unit 11. a signal, the processing unit 123 is capable of processing the radio signal and the data information received by the signal receiving unit 12, generating a response signal, and transmitting the response signal to the signal generating unit 11 and the core processing unit 13, The timing unit 122 has a timing function capable of recording time information of the radio signal receiving means 121 receiving the radio signal from the signal generating unit 11 and time information of the response signal transmitted by the processing unit 123, the storage unit 124 may store time information recorded by the timing unit 122, as well as other data or information, etc., while the timing unit 122 may also transmit the recorded time information to the core processing unit 13.
返回图1所示,所述核心处理单元13能够利用信号发生单元11和信号接收单元12发射和接收无线电信号以及发送和接收相关数据信息等的时间信息计算目标的搜索范围,并将该搜索范围信息发送给双目定位模块2。同时,该核心处理单元13能够接收控制模块3发送的信息并控制信号发生单元11和信号接收单元12发射或接收无线电信号以及发送和接收相关数据信息等的工作,如控制无线电信号发射的频率、信道、时钟等。Returning to FIG. 1, the core processing unit 13 is capable of calculating a search range of a target by using the time information of transmitting and receiving a radio signal and transmitting and receiving related data information by the signal generating unit 11 and the signal receiving unit 12, and calculating the search range. The information is sent to the binocular positioning module 2. At the same time, the core processing unit 13 is capable of receiving information transmitted by the control module 3 and controlling the operation of the signal generating unit 11 and the signal receiving unit 12 to transmit or receive radio signals and to transmit and receive related data information, such as controlling the frequency of radio signal transmission, Channel, clock, etc.
所述双目定位模块2的双目摄像机单元21包括1号和2号摄像头,两部摄像头的方位和视角可以不同,能够分别同时对某特定区域进行目标的拍摄,并将拍摄的图片发送至视频处理单元22。所述视频处理单元22内部设置未图示的存储装置,存储有图像处理算法并且能够存储双目摄像机拍摄的图片;所述视频处理单元22能够利用存储的图像处理算法对接收到的图片进行处理,并获得所述双目摄像机单元21所拍摄的目标的精确坐标;同时所述视频处理单元22能够根据射频定位模块1发送的目标搜索范围信息控制双目摄像机单元21在搜索范围内有目标的区域拍摄图片。所述位移传感器单元23能够获取双目摄像机单元21坐 标系与飞行装置的坐标系之间的空间转换矩阵,并将该矩阵发送至所述视频处理单元22。所述双目定位模块2的所述输入输出单元24、所述双目摄像机单元21、视频处理单元22和所述位移传感器单元23通过数据总线25进行相互通信连接。同时,所述双目定位模块2能够与控制模块3进行无线通信,并进行信息交换。所述无线通信可以包括蓝牙或wifi等无线通信。The binocular camera unit 21 of the binocular positioning module 2 includes cameras No. 1 and No. 2. The orientation and viewing angle of the two cameras can be different, and the target can be photographed simultaneously for a specific area, and the captured picture is sent to Video processing unit 22. The video processing unit 22 internally provides a storage device (not shown), stores an image processing algorithm and can store a picture captured by a binocular camera; the video processing unit 22 can process the received picture using a stored image processing algorithm. And obtaining the precise coordinates of the target captured by the binocular camera unit 21; at the same time, the video processing unit 22 can control the binocular camera unit 21 to have a target within the search range according to the target search range information sent by the radio frequency positioning module 1. Take pictures in the area. The displacement sensor unit 23 is capable of acquiring the binocular camera unit 21 sitting A spatial transformation matrix between the calibration system and the coordinate system of the flight device, and the matrix is sent to the video processing unit 22. The input/output unit 24, the binocular camera unit 21, the video processing unit 22, and the displacement sensor unit 23 of the binocular positioning module 2 are communicably connected to each other via a data bus 25. At the same time, the binocular positioning module 2 can perform wireless communication with the control module 3 and exchange information. The wireless communication may include wireless communication such as Bluetooth or wifi.
控制模块3具有未图示的蓝牙或wifi等无线通信部件,能够接收射频定位模块1发送的目标搜索范围信息和双目定位模块2发送的目标精确位置信息,并将接收到的信息显示在未图示的显示器上,为操作人员提供参考;操作人员通过显示器或者其他输入设备(未图示)向射频定位模块1和双目定位模块2发送控制信息。The control module 3 has a wireless communication component such as Bluetooth or wifi (not shown), and can receive the target search range information sent by the radio frequency positioning module 1 and the target precise location information sent by the binocular positioning module 2, and display the received information in the un The illustrated display provides a reference for the operator; the operator sends control information to the RF positioning module 1 and the binocular positioning module 2 via a display or other input device (not shown).
此外,所述目标定位系统还具有未图示的存储模块,能够存储所述目标定位系统的定位记录等信息,所述双目定位模块2能够与该存储模块进行通信连接,并且能够调用该存储模块存储的信息。In addition, the target positioning system further has a storage module (not shown) capable of storing information such as a positioning record of the target positioning system, the binocular positioning module 2 being communicably connected to the storage module, and capable of calling the storage. The information stored by the module.
图4为本实施方式所涉及的基于射频和双目视觉的目标定位系统定位的流程图。如图4所示,操作人员对所述目标定位系统通电,并通过控制模块3对系统的硬件芯片以及无线电信号发射的控制信息等进行初始化,例如初始化输入输出单元14的接口,以及无线电信号的发射的频率、信道、时钟等信息(步骤S1)。操作人员通过控制模块3向飞行装置上的射频定位模块1和双目定位模块2发送定位任务,飞行装置的射频定位模块1的核心处理单元13判断是否接收到定位任务(步骤S2)。飞行装置的射频定位模块1的核心处理单元13判断没有收到定位任务(步骤S2为否),则继续等待接收定位任务。如果射频定位模块1的核心处理单元13判断接收到所述定位任务(步骤S2为是),则由射频定位模块1对目标进行粗定位,确定目标搜索范围(步骤S3),并将目标搜索范围发送至双目定位模块2和控制模块3(步骤S4)。4 is a flow chart of positioning of a target positioning system based on radio frequency and binocular vision according to the embodiment. As shown in FIG. 4, the operator energizes the target positioning system, and initializes the hardware chip of the system and the control information of the radio signal transmission through the control module 3, for example, the interface of the initialization input/output unit 14, and the radio signal. Information such as frequency, channel, clock, etc. transmitted (step S1). The operator sends a positioning task to the radio frequency positioning module 1 and the binocular positioning module 2 on the flight device through the control module 3, and the core processing unit 13 of the radio frequency positioning module 1 of the flight device determines whether a positioning task is received (step S2). The core processing unit 13 of the radio frequency positioning module 1 of the flight device determines that the positioning task has not been received (NO in step S2), and continues to wait for receiving the positioning task. If the core processing unit 13 of the radio frequency positioning module 1 determines that the positioning task is received (YES in step S2), the target is searched by the radio frequency positioning module 1 to determine the target search range (step S3), and the target search range is determined. It is sent to the binocular positioning module 2 and the control module 3 (step S4).
图5为本实施方式所涉及的步骤S3中所述射频定位模块1确定目标搜索范围的流程图。图6为本实施方式所涉及的射频定位模块1的工作示意图。根据图5和图6具体说明目标粗定位的过程。在所述射频定位模块1的核心处理单元13判断接收到所述定位任务后,所述核心处理单元13指示所述信号发生单元11的处理单元113让所述无线信号发射装置111发射带有ID信息的无线电信号(Poll信号),以及所述信号发生单元11的计时单元112记录发射上述Poll信号的时间Ta并将时间Ta存储到所述信号发生单元11的存储单元114中(步骤S31)。其中,上述ID信息可以是飞行装置的特定编号或者为信号接收单元12能够识别所述信号发生单元11的特定码信息。所述信号发生单元11所发射的Poll信号由目标上的所述 信号接收单元12接收。所述信号接收单元12的处理单元123根据ID信息判断所述信号接收装置121是否接收到来自所述信号发生单元11的所述Poll信号(步骤S32)。如果所述信号接收单元12的处理单元123判断未接收到所述Poll信号(步骤S32为否),则继续等待。如果所述信号接收单元12的处理单元123判断接收到所述Poll信号(步骤S32为是),所述信号接收单元12的计时单元122记录接收到所述Poll信号的时间Tb并存储到所述信号接收单元12的存储单元124(步骤S33)。所述信号接收单元12的处理单元123对所收到的Poll信号进行确认处理并产生相应的响应信号(步骤S34),并将带有ID信息的所述响应信号、发送所述响应信号时所记录的发送时间Td和所述时间Tb等信息一起发送至所述信号发生单元11(步骤S35)。所述信号发生单元11的处理单元113接收到信号接收单元12发送的信息后,根据所述ID信息判断是否接收到步骤S35发送的响应信号及所述时间Td和所述时间Tb等信息(步骤S36)。如果所述信号发生单元11的处理单元113判断未接收到所述响应信号等信息(步骤S36:否),则继续等待。如果所述信号发生单元11接收到所述响应信号等信息(步骤S36:是),所述信号发生单元11的计时单元112记录接收到所述响应信号的时间Tc并存储到所述信号发生单元11的存储单元114(步骤S37),同时所述信号发生单元11对接收到的响应信号进行确认处理。所述信号发生单元11将上述所有的时间信息Ta、Tb、Tc、Td都发送至核心处理单元13,所述核心处理单元13计算无线信号(Poll信号)和响应信号在空中飞行所用时间之和T1=(Tc-Ta)-(Td-Tb)。同时,因为信号在空中的飞行速度可视为与光速相当,所以可以测算飞行装置与目标之间的距离为d1=(T1×光速)/2(步骤S38)。FIG. 5 is a flowchart of determining the target search range by the radio frequency positioning module 1 in step S3 according to the embodiment. FIG. 6 is a schematic diagram of the operation of the radio frequency positioning module 1 according to the embodiment. The process of target coarse positioning will be specifically described based on FIGS. 5 and 6. After the core processing unit 13 of the radio frequency positioning module 1 determines that the positioning task is received, the core processing unit 13 instructs the processing unit 113 of the signal generating unit 11 to cause the wireless signal transmitting device 111 to transmit with an ID. The radio signal (Poll signal) of the information, and the timing unit 112 of the signal generation unit 11 record the time T a at which the above-mentioned Poll signal is transmitted and store the time T a in the storage unit 114 of the signal generation unit 11 (step S31) ). The ID information may be a specific number of the flight device or a specific code information that the signal receiving unit 12 can recognize the signal generating unit 11. The Poll signal transmitted by the signal generating unit 11 is received by the signal receiving unit 12 on the target. The processing unit 123 of the signal receiving unit 12 determines whether the signal receiving device 121 receives the Poll signal from the signal generating unit 11 based on the ID information (step S32). If the processing unit 123 of the signal receiving unit 12 determines that the Poll signal is not received (NO in step S32), it continues to wait. If the processing unit 123 determines the signal receiving unit 12 receives the Poll signal (step S32), the timing unit 122 of the recording signal receiving unit 12 receives the time T b of the Poll signal and stores the The storage unit 124 of the signal receiving unit 12 is described (step S33). The processing unit 123 of the signal receiving unit 12 performs an acknowledgement process on the received Poll signal and generates a corresponding response signal (step S34), and transmits the response signal with the ID information and the response signal. transmitting the transmission time and the recording time T d T b together with other information to the signal generation unit 11 (step S35). After receiving the information sent by the signal receiving unit 12, the processing unit 113 of the signal generating unit 11 determines whether the response signal sent in step S35 and the time T d and the time T b are received according to the ID information. (Step S36). If the processing unit 113 of the signal generation unit 11 determines that the response signal or the like is not received (step S36: NO), it continues to wait. If the signal generating unit 11 receives the response information (Step S36: YES) signals, the timing signal generating unit 11 of the recording unit 112 receives the response time T c signal to the signal generating and storing The storage unit 114 of the unit 11 (step S37), while the signal generation unit 11 performs a confirmation process on the received response signal. The signal generation unit 11 transmits all of the above-described time information T a , T b , T c , T d to the core processing unit 13, which calculates a wireless signal (Poll signal) and a response signal to fly in the air. The sum of the times used is T 1 =(T c -T a )-(T d -T b ). Meanwhile, since the flying speed of the signal in the air can be regarded as equivalent to the speed of light, it is possible to measure the distance between the flying device and the target as d 1 = (T 1 × light speed) / 2 (step S38).
由于所述信号接收单元12和所述信号发生单元11的时钟可能会存在不同步的情况,即存在时钟差,如果直接采用无线信号在空中飞行的时间T1为所述信号接收单元12所接收到信号的时间Tb减去所述信号发生单元11所发射所述信号的时间Ta,即(Tb-Ta),则会因为所述信号接收单元12和所述信号发生单元11之间所存在的时钟差导致上述所计算出来的信号在空中的飞行时间不准确。然而,采用了本实施方式所提供的方法,消除了所述信号接收单元12和所述信号发生单元11的时钟存在不同步所带来的不利影响。另外,由于(Td-Tb)为所述信号接收单元12从接收到来自所述信号发生单元11的无线信号起到所述信号接收单元12发送响应信号止的时间间隔,在该时间间隔内,无线信号并没有在空中飞行,因而需要减除,从而更加精确地计算出无线信号在空中飞行的时间。Since the clocks of the signal receiving unit 12 and the signal generating unit 11 may be out of synchronization, that is, there is a clock difference, if the time T 1 in which the wireless signal is directly used to fly in the air is received by the signal receiving unit 12 The time T b of the signal is subtracted from the time T a of the signal transmitted by the signal generating unit 11, that is, (T b -T a ), because the signal receiving unit 12 and the signal generating unit 11 The existence of a clock difference between the above results in an inaccurate flight time of the above calculated signal in the air. However, with the method provided by the present embodiment, the adverse effects caused by the out-of-synchronization of the clocks of the signal receiving unit 12 and the signal generating unit 11 are eliminated. In addition, since (T d -T b ) is a time interval from the reception of the wireless signal from the signal generating unit 11 by the signal receiving unit 12 to the signal receiving unit 12 transmitting the response signal, at the time interval Internally, the wireless signal does not fly in the air and therefore needs to be subtracted to more accurately calculate the time during which the wireless signal is flying in the air.
为了进一步地消除信号发生单元11和信号接收单元12的时钟差,所述信号发生单元11在收到所述信号接收单元12的响应信号的同时发出带有ID信息的另一响应信号、发送所述另一响应信号的时间Te以及时间信息Tc等信息发送至所述信号接收单元12(步骤S39)。 信号接收单元12的处理单元123根据ID信息判断接收到的信号是否为步骤S39发送的信息(步骤S10),如果所述信号接收单元12的处理单元123判断未接收到所述另一响应信号、时间Te以及时间信息Tc等信息(步骤S310为否),则继续等待。如果信号接收单元12接收到所述另一响应信号、时间Te以及时间信息Tc等信息(步骤S310为是),所述信号接收单元12的计时单元122记录接收到所述信息的时间Tf并存储到所述信号接收单元12的存储单元124(步骤S311)。之后所述信号接收单元12将步骤S35~S311中的时间信息Te、Tf、Tc、Td发送至核心处理单元13,所述核心处理单元13计算所述响应信号和所述另一响应信号在空中的飞行时间之和为T2=(Tf-Td)-(Te-Tc),并测算出飞行装置与目标之间的距离d2=(T2×光速)/2(步骤S312)。核心处理单元13对上述步骤S38和S312中的两个距离取平均,即为飞行装置与目标之间的距离:d=(d1+d2)/2(步骤S313)。核心处理单元13基于飞行装置与目标之间的距离并根据无线电发射芯片自身误差σ得到目标的搜索范围(d-dσ,d+dσ)(其中dσ为距离误差;芯片自身都有误差,单位是纳秒、毫秒等时间单位)(步骤S314)。In order to further eliminate the clock difference between the signal generating unit 11 and the signal receiving unit 12, the signal generating unit 11 issues another response signal with the ID information, the transmitting station, while receiving the response signal of the signal receiving unit 12. Information such as the time T e of the other response signal and the time information T c is sent to the signal receiving unit 12 (step S39). The processing unit 123 of the signal receiving unit 12 determines whether the received signal is the information transmitted in step S39 based on the ID information (step S10), if the processing unit 123 of the signal receiving unit 12 determines that the other response signal is not received, The information such as the time T e and the time information T c (NO in step S310) continues to wait. If the signal receiving unit 12 receives the information such as the other response signal, the time T e, and the time information T c (YES in step S310), the timing unit 122 of the signal receiving unit 12 records the time T at which the information is received. f is stored in the storage unit 124 of the signal receiving unit 12 (step S311). The signal receiving unit 12 then transmits the time information T e , T f , T c , T d in steps S35 to S311 to the core processing unit 13, which calculates the response signal and the other The sum of the flight times of the response signals in the air is T 2 =(T f -T d )-(T e -T c ), and the distance between the flying device and the target is measured d 2 =(T 2 ×speed of light)/ 2 (step S312). The core processing unit 13 averages the two distances in the above steps S38 and S312, that is, the distance between the flying device and the target: d = (d 1 + d 2 )/2 (step S313). The core processing unit 13 obtains the target search range (d-d σ , d+d σ ) based on the distance between the flying device and the target and according to the radio transmission chip self error σ (where d σ is the distance error; the chip itself has an error The unit is a unit of time such as nanoseconds, milliseconds, etc. (step S314).
返回图4,将上述搜索范围发送至双目定位模块2和控制模块3(步骤S4)。Returning to Fig. 4, the above search range is transmitted to the binocular positioning module 2 and the control module 3 (step S4).
当射频定位模块对目标进行粗定位后,由双目定位模块2根据射频定位模块发送的目标搜索范围信息对目标进行精确定位(步骤S5)。After the radio positioning module performs coarse positioning on the target, the binocular positioning module 2 accurately locates the target according to the target search range information sent by the radio frequency positioning module (step S5).
图7为本发明所涉及的基于双目定位模块的精确定位的方法流程图。图8为本发明所涉及的含定位目标的双目标定模型示意图。如图7所示,首先视频处理单元22通过接收到的目标搜索范围信息控制双目摄像机单元21的1号、2号摄像头从不同视角及方位分别对在搜索范围内有目标的区域进行拍摄,并将拍摄的图片传输至视频处理单元22(步骤S51)。视频处理单元22对接收的图片进行目标检索,判断是否检索出具有目标的图片(步骤S52)。如果所述视频处理单元22未检索到含有目标的图片(步骤S52为否),则继续检索。如果所述视频处理单元22检索到了含有目标的图片(步骤S52为是),则所述视频处理单元22对含有目标的图片进行处理,如图8所示分别获得在1号摄像头和2号摄像头所拍摄的图片中目标的二维图像坐标P1(u,v)和P2(u′,v′)(步骤S53)。7 is a flow chart of a method for precise positioning based on a binocular positioning module according to the present invention. FIG. 8 is a schematic diagram of a dual target model with positioning targets according to the present invention. As shown in FIG. 7, first, the video processing unit 22 controls the cameras No. 1 and No. 2 of the binocular camera unit 21 to capture the regions having targets in the search range from different perspectives and orientations, respectively, through the received target search range information. The captured picture is transmitted to the video processing unit 22 (step S51). The video processing unit 22 performs a target search on the received picture, and determines whether or not the picture having the target is retrieved (step S52). If the video processing unit 22 does not retrieve the picture containing the target (NO in step S52), the search is continued. If the video processing unit 22 retrieves the picture containing the target (YES in step S52), the video processing unit 22 processes the picture containing the target, as shown in FIG. 8, respectively, in the No. 1 camera and the No. 2 camera. The two-dimensional image coordinates P 1 (u, v) and P 2 (u', v') of the target in the captured picture (step S53).
然后获取目标中心在1号摄像头坐标系C或者在2号摄像头坐标系C’中的三维坐标(X,Y,Z),在本实施方式中以1号摄像头坐标系C为参考系进行计算说明(步骤S54);具体的,如图8所示,1号摄像头的光轴1平行于2号摄像头的光轴2,通过三角关系可求出目标在以1号摄像头为参考的坐标系C中的三维坐标P(X,Y,Z): Then, the three-dimensional coordinates (X, Y, Z) of the target center in the No. 1 camera coordinate system C or the No. 2 camera coordinate system C' are obtained. In the present embodiment, the No. 1 camera coordinate system C is used as a reference system for calculation and description. (Step S54); specifically, as shown in FIG. 8, the optical axis 1 of the No. 1 camera is parallel to the optical axis 2 of the No. 2 camera, and the target can be obtained in the coordinate system C with reference to the No. 1 camera by the triangular relationship. The three-dimensional coordinates P(X, Y, Z):
Figure PCTCN2015091893-appb-000001
(k为像元长度)
Figure PCTCN2015091893-appb-000001
(k is the length of the pixel)
上式中,f为摄像头焦距,L为两摄像头之间的距离,d=u-u′为视差,(u0,v0)是摄像头成像平面中心像素点的坐标。最后根据空间转换矩阵获取目标中心在飞行装置的坐标系中的三维坐标(XO,YO,ZO)(记为O)(步骤S55);具体的,由安装在飞行装置中的位移传感器单元23实时测得1号摄像头坐标系C中(X,Y,Z)与飞行装置的坐标系O(XO,YO,ZO)之间的空间转换矩阵T(Xx,Yy,Zz)的各参数Xx、Yy、Zz,则目标中心的三维坐标可以由1号摄像头为参考的坐标系C转换至飞行器坐标系中:In the above formula, f is the focal length of the camera, L is the distance between the two cameras, d=u-u' is the parallax, and (u 0 , v 0 ) is the coordinate of the central pixel point of the imaging plane of the camera. Finally, according to the space conversion matrix, the three-dimensional coordinates (X O , Y O , Z O ) of the target center in the coordinate system of the flying device are obtained (indicated as O) (step S55); specifically, the displacement sensor installed in the flying device The unit 23 measures the space conversion matrix T(X x , Y y between the (X, Y, Z) of the camera coordinate system C in the No. 1 and the coordinate system O (X O , Y O , Z O ) of the flying device in real time. Z z) of the parameters X x, Y y, Z z , the three-dimensional coordinates of the center of the target by the number 1 may refer to the camera coordinate system C is converted to the aircraft coordinate system:
Figure PCTCN2015091893-appb-000002
Figure PCTCN2015091893-appb-000002
获取目标中心在飞行装置的坐标系中的三维坐标O(XO,YO,ZO)即目标的精确位置坐标后,将该位置坐标信息发送至控制模块3(步骤S6)。After acquiring the three-dimensional coordinates O(X O , Y O , Z O ) of the target center in the coordinate system of the flying device, that is, the precise position coordinates of the target, the position coordinate information is transmitted to the control module 3 (step S6).
此后,在获取任意目标之后,通过以上计算步骤,就可以将目标空间坐标转换到飞行装置坐标中,实现目标相对于飞行器坐标系的空间精确定位。 Thereafter, after acquiring any target, through the above calculation steps, the target space coordinates can be converted into the flight device coordinates to achieve spatially accurate positioning of the target relative to the aircraft coordinate system.

Claims (18)

  1. 一种目标定位系统,包括目标粗定位模块和目标精确定位模块;其中,A target positioning system includes a target coarse positioning module and a target precise positioning module; wherein
    所述目标粗定位模块具有信号发生单元和信号接收单元;The target coarse positioning module has a signal generating unit and a signal receiving unit;
    所述目标粗定位模块根据所述信号发生单元和所述信号接收单元的发送和接收有关信号的时间获取有关信号在空中的传输时间,并基于所述传输时间来确定目标的搜索范围;The target coarse positioning module acquires a transmission time of the relevant signal in the air according to the time at which the signal generating unit and the signal receiving unit transmit and receive the relevant signals, and determines a search range of the target based on the transmission time;
    所述目标精确定位模块根据所述目标的搜索范围确定目标的精确位置坐标。The target precise positioning module determines the precise position coordinates of the target according to the search range of the target.
  2. 根据权利要求1所述的目标定位系统,其特征在于:The target positioning system of claim 1 wherein:
    所述信号发生单元能够向所述信号接收单元发射询问信号,并接收来自所述信号接收单元的第一响应信号;The signal generating unit is capable of transmitting an interrogation signal to the signal receiving unit and receiving a first response signal from the signal receiving unit;
    所述信号接收单元能够从所述信号发生单元接收所述询问信号,并基于所接收到的所述询问信号向所述信号发生单元发送所述第一响应信号;The signal receiving unit is capable of receiving the interrogation signal from the signal generating unit, and transmitting the first response signal to the signal generating unit based on the received interrogation signal;
    所述目标粗定位模块能够记录所述信号发生单元发射所述询问信号的第一时间和收到所述信号接收单元的所述第一响应信号的第二时间以及所述信号接收单元接收到所述询问信号的第三时间和所述信号接收单元发出所述第一响应信号的第四时间;The target coarse positioning module is capable of recording a first time when the signal generating unit transmits the inquiry signal and a second time of receiving the first response signal of the signal receiving unit, and the signal receiving unit receives the a third time of the inquiry signal and a fourth time when the signal receiving unit sends the first response signal;
    其中,所述目标粗定位模块通过将所述第二时间和所述第一时间的差值减去所述第四时间和所述第三时间的差值获取所述第一传输时间,基于所述第一传输时间获取所述信号发生单元与所述目标之间的第一距离,并基于所获取的所述第一距离来确定所述目标的搜索范围。The target coarse positioning module acquires the first transmission time by subtracting the difference between the second time and the first time by the difference between the fourth time and the third time, based on the Determining, by the first transmission time, a first distance between the signal generating unit and the target, and determining a search range of the target based on the acquired first distance.
  3. 根据权利要求2所述的目标定位系统,其特征在于:The target positioning system according to claim 2, wherein:
    所述信号发生单元还能够向所述信号接收单元发送第二响应信号;The signal generating unit is further capable of transmitting a second response signal to the signal receiving unit;
    所述信号接收单元还能够从所述信号发生单元接收所述第二响应信号;The signal receiving unit is further capable of receiving the second response signal from the signal generating unit;
    所述目标粗定位模块还能够记录所述信号发生单元发送所述第二响应信号的第五时间,以及所述信号接收单元接收到所述第二响应信号的第六时间;The target coarse positioning module is further configured to record a fifth time when the signal generating unit sends the second response signal, and a sixth time when the signal receiving unit receives the second response signal;
    其中,所述目标粗定位模块还通过将所述第六时间和所述第四时间的差值减去所述第五时间和所述第二时间的差值获取第二传输时间,并基于所述第二传输时间获取所述信号发生单元与所述目标之间的第二距离,The target coarse positioning module further acquires a second transmission time by subtracting a difference between the sixth time and the fourth time by a difference between the fifth time and the second time, and based on the Determining, by the second transmission time, a second distance between the signal generating unit and the target,
    将所述第一距离和所述第二距离相加后除以2,以获取所述信号发生单元距离所述目标的平均距离,Adding the first distance and the second distance and dividing by 2 to obtain an average distance of the signal generating unit from the target,
    基于所述平均距离来确定所述目标的搜索范围。A search range of the target is determined based on the average distance.
  4. 根据权利要求3所述的目标定位系统,其特征在于:The target positioning system according to claim 3, wherein:
    所述信号发生单元具有第一计时单元,所述第一计时单元能够记录所述第一时间、所述第二时间和所述第五时间; The signal generating unit has a first timing unit, and the first timing unit is capable of recording the first time, the second time, and the fifth time;
    所述信号接收单元具有第二计时单元,所述第二计时单元能够记录所述第三时间、所述第四时间和所述第六时间。The signal receiving unit has a second timing unit capable of recording the third time, the fourth time, and the sixth time.
  5. 根据权利要求1~4任意一项所述的目标定位系统,其特征在于:The target positioning system according to any one of claims 1 to 4, characterized in that:
    所述目标精确定位模块包括双目摄像机和视频处理单元;The target precise positioning module includes a binocular camera and a video processing unit;
    所述双目摄像机包括第一摄像头和第二摄像头,能够从不同方位和视角在所述目标的搜索范围内拍摄图片;The binocular camera includes a first camera and a second camera capable of taking pictures within a search range of the target from different orientations and angles of view;
    所述视频处理单元能够对所述图片进行处理,获取目标的精确位置坐标。The video processing unit is capable of processing the picture to obtain precise position coordinates of the target.
  6. 根据权利要求5所述的目标定位系统,其特征在于:The target positioning system according to claim 5, wherein:
    所述视频处理单元根据所述目标的搜索范围控制所述第一摄像头和所述第二摄像头拍摄含有目标的图片。The video processing unit controls the first camera and the second camera to capture a picture containing a target according to a search range of the target.
  7. 根据权利要求6所述的目标定位系统,其特征在于:The target positioning system according to claim 6, wherein:
    所述视频处理单元利用所述含有目标的图片通过三角关系获取目标在所述第一摄像头和所述第二摄像头为参考的坐标系中其中之一的三维坐标。The video processing unit acquires three-dimensional coordinates of one of the coordinate systems in which the first camera and the second camera are referenced by using the target-containing picture in a triangular relationship.
  8. 根据权利要求7所述的目标定位系统,其特征在于:The target positioning system according to claim 7, wherein:
    所述目标精确定位模块还包括位移传感器,所述位移传感器能够获取摄像头坐标系和所述目标定位系统所在的飞行装置的坐标系之间的空间转换矩阵。The target precision positioning module further includes a displacement sensor capable of acquiring a spatial transformation matrix between the camera coordinate system and a coordinate system of the flying device in which the target positioning system is located.
  9. 根据权利要求8所述的目标定位系统,其特征在于:The target positioning system of claim 8 wherein:
    所述视频处理单元能够利用所述空间转换矩阵,将所述目标在所述摄像头坐标系中的三维坐标转换成所述目标在所述飞行装置的坐标系中的三维坐标。The video processing unit is capable of converting, by the spatial transformation matrix, three-dimensional coordinates of the target in the camera coordinate system into three-dimensional coordinates of the target in a coordinate system of the flying device.
  10. 根据权利要求1~4任意一项所述的目标定位系统,其特征在于:所述信号发射单元设置在飞行装置上,所述信号接收单元设置在所述目标上。The target positioning system according to any one of claims 1 to 4, characterized in that the signal transmitting unit is disposed on the flying device, and the signal receiving unit is disposed on the target.
  11. 一种目标定位方法,包括:A target location method includes:
    目标粗定位步骤,根据发送和接收有关信号的时间获取有关信号在空中的传输时间,并基于所述传输时间来确定目标的搜索范围;a target coarse positioning step of acquiring a transmission time of the relevant signal in the air according to a time at which the signal is transmitted and received, and determining a search range of the target based on the transmission time;
    目标精确定位步骤,根据所述目标的搜索范围确定目标的精确位置坐标。The target precise positioning step determines the precise position coordinates of the target according to the search range of the target.
  12. 根据权利要求11所述的目标定位方法,其特征在于,所述目标粗定位步骤包括;The target positioning method according to claim 11, wherein the target coarse positioning step comprises:
    信号发生单元向信号接收单元发射询问信号;The signal generating unit transmits an interrogation signal to the signal receiving unit;
    记录发射所述询问信号的第一时间;Recording a first time when the interrogation signal is transmitted;
    所述信号接收单元接收所述询问信号;The signal receiving unit receives the inquiry signal;
    记录接收所述询问信号的第三时间; Recording a third time of receiving the inquiry signal;
    所述信号接收单元基于所接收到的所述询问信号向所述信号发生单元发送第一响应信号、所述第三时间和发送所述第一响应信号的所记录的第四时间;The signal receiving unit transmits a first response signal, the third time, and a recorded fourth time of transmitting the first response signal to the signal generating unit based on the received query signal;
    所述信号发生单元接收所述第一响应信号、所述第三时间和所述第四时间;The signal generating unit receives the first response signal, the third time, and the fourth time;
    记录接收所述第一响应信号的第二时间;Recording a second time of receiving the first response signal;
    基于所述第一时间、所述第二时间、所述第三时间和所述第四时间获取所述信号发生单元与目标之间的第一距离;Acquiring a first distance between the signal generating unit and the target based on the first time, the second time, the third time, and the fourth time;
    基于所述第一距离确定所述目标的搜索范围;Determining a search range of the target based on the first distance;
    其中,通过将所述第二时间和所述第一时间的差值减去所述第四时间和所述第三时间的差值获取第一传输时间,并基于所述第一传输时间获取所述第一距离。The first transmission time is obtained by subtracting the difference between the second time and the first time by the difference between the fourth time and the third time, and acquiring the location based on the first transmission time. Said the first distance.
  13. 根据权利要求12所述的目标定位方法,其特征在于,所述目标粗定位步骤还包括:The target positioning method according to claim 12, wherein the target coarse positioning step further comprises:
    所述信号发生单元向所述信号接收单元发送第二响应信号;The signal generating unit sends a second response signal to the signal receiving unit;
    记录发送所述第二响应信号的第五时间,并将所述第二时间和所述第五时间发送给所述信号接收单元;Recording a fifth time of transmitting the second response signal, and transmitting the second time and the fifth time to the signal receiving unit;
    所述信号接收单元从所述信号发生单元接收所述第二响应信号、所述第二时间和所述第五时间;The signal receiving unit receives the second response signal, the second time, and the fifth time from the signal generating unit;
    记录接收到所述第二响应信号的第六时间;Recording a sixth time when the second response signal is received;
    通过将所述第六时间和所述第四时间的差值减去所述第五时间和所述第二时间的差值获取第二传输时间,并基于所述第二传输时间获取所述信号发生单元与所述目标之间的第二距离;Obtaining a second transmission time by subtracting a difference between the sixth time and the fourth time by a difference between the fifth time and the second time, and acquiring the signal based on the second transmission time a second distance between the generating unit and the target;
    将所述第一距离和所述第二距离相加后除以2,以获取所述信号发生单元距离所述目标的平均距离;Adding the first distance and the second distance and dividing by 2 to obtain an average distance of the signal generating unit from the target;
    基于所述平均距离来确定所述目标的搜索范围。A search range of the target is determined based on the average distance.
  14. 根据权利要求11~13任意一项所述的目标定位方法,其特征在于,所述目标精确定位步骤还包括:The target positioning method according to any one of claims 11 to 13, wherein the target precise positioning step further comprises:
    图片获取步骤,第一摄像头和第二摄像头从不同方位和视角在所述目标搜索范围内拍摄图片;视频处理步骤,对所述图片进行处理,获取目标的精确位置坐标。a picture acquisition step, the first camera and the second camera take pictures from the target search range from different orientations and angles of view; the video processing step processes the picture to obtain the precise position coordinates of the target.
  15. 根据权利要求14所述的目标定位方法,其特征在于:The target positioning method according to claim 14, wherein:
    在所述图片获取步骤中,根据所述目标的搜索范围控制所述第一摄像头和所述第二摄像头拍摄含有所述目标的图片。In the picture acquisition step, the first camera and the second camera are controlled to capture a picture containing the target according to the search range of the target.
  16. 根据权利要求15所述的目标定位方法,其特征在于:The target positioning method according to claim 15, wherein:
    在所述视频处理步骤中,利用所述含有所述目标的图片通过三角关系获取所述目标在所述第 一摄像头和所述第二摄像头为参考的坐标系中其中之一的三维坐标。In the video processing step, acquiring the target by the triangular relationship using the picture containing the target in the first A camera and the second camera are three-dimensional coordinates of one of the reference coordinate systems.
  17. 根据权利要求16所述的目标定位方法,其特征在于:The target positioning method according to claim 16, wherein:
    所述视频处理步骤还包括空间转换矩阵获取步骤,获取所述第一摄像头和所述第二摄像头的坐标系和目标定位系统的所在的飞行装置的坐标系之间的空间转换矩阵。The video processing step further includes a spatial transformation matrix acquisition step of acquiring a spatial transformation matrix between a coordinate system of the first camera and the second camera and a coordinate system of a flying device in which the target positioning system is located.
  18. 根据权利要求17所述的目标定位方法,其特征在于:The target positioning method according to claim 17, wherein:
    在所述视频处理步骤中,利用所述空间转换矩阵,将所述目标所述在所述第一摄像头和所述第二摄像头的坐标系中的三维坐标转换成所述目标在所述飞行装置的坐标系中的三维坐标,获取目标的精确位置坐标。 In the video processing step, using the space conversion matrix, converting the three-dimensional coordinates of the target in the coordinate system of the first camera and the second camera into the target in the flying device The three-dimensional coordinates in the coordinate system are used to obtain the precise position coordinates of the target.
PCT/CN2015/091893 2015-08-12 2015-10-14 Target positioning system and method based on radio frequency and binocular vision WO2017024673A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201510492077.X 2015-08-12
CN201510492077.XA CN105182319A (en) 2015-08-12 2015-08-12 Target positioning system and target positioning method based on radio frequency and binocular vision

Publications (1)

Publication Number Publication Date
WO2017024673A1 true WO2017024673A1 (en) 2017-02-16

Family

ID=54904519

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2015/091893 WO2017024673A1 (en) 2015-08-12 2015-10-14 Target positioning system and method based on radio frequency and binocular vision

Country Status (2)

Country Link
CN (1) CN105182319A (en)
WO (1) WO2017024673A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111862235A (en) * 2020-07-22 2020-10-30 中国科学院上海微系统与信息技术研究所 Binocular camera self-calibration method and system
CN114290016A (en) * 2021-12-21 2022-04-08 燕山大学 High-precision wood furniture assembling system and method based on binocular parallax calculation

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105487550A (en) * 2015-12-29 2016-04-13 西安斯凯智能科技有限公司 Autonomous landing system of flight device and method
CN105913082B (en) * 2016-04-08 2020-11-27 北京邦视科技有限公司 Method and system for classifying targets in image
CN107437044B (en) * 2016-05-26 2020-06-16 中国矿业大学(北京) Mine moving target tracking and positioning method
CN106598071B (en) * 2016-12-20 2019-10-11 北京小米移动软件有限公司 Flight control method and device, the unmanned plane of trailing type
CN107490346B (en) * 2017-08-17 2021-05-28 江苏省质量和标准化研究院 RFID multi-label network three-dimensional measurement modeling method based on vision
CN109798873A (en) * 2018-12-04 2019-05-24 华南理工大学 A kind of stereoscopic vision optical positioning system
EP3671273B1 (en) * 2018-12-18 2022-05-04 Leica Geosystems AG System for rough localization of moveable cooperative targets during laser tracker based industrial object measurement
CN110075462A (en) * 2019-05-14 2019-08-02 中国科学院自动化研究所 Fire-fighting system
CN112729304A (en) * 2020-12-21 2021-04-30 武汉大学 Indoor and outdoor high-precision positioning system and positioning method for unmanned aerial vehicle

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TW200941024A (en) * 2008-03-18 2009-10-01 Univ Nat Taiwan Science Tech Positioning method of radio frequency tag and positioning apparatus thereof
CN102043151A (en) * 2009-10-19 2011-05-04 中兴通讯股份有限公司 Mobile terminal and method for positioning based on radio frequency identification
CN102928813A (en) * 2012-10-19 2013-02-13 南京大学 RSSI (Received Signal Strength Indicator) weighted centroid algorithm-based passive RFID (Radio Frequency Identification Device) label locating method
CN103076592A (en) * 2012-12-27 2013-05-01 重庆大学 Precise wireless positioning method facing service robot in intelligent space
KR101273125B1 (en) * 2011-06-24 2013-06-13 엘지이노텍 주식회사 Real Time Location Apparatus and method thereof
CN103249142A (en) * 2013-04-26 2013-08-14 东莞宇龙通信科技有限公司 Locating method, locating system and mobile terminal

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140073352A1 (en) * 2012-09-11 2014-03-13 Qualcomm Incorporated Method for precise location determination
CN204165516U (en) * 2014-10-11 2015-02-18 三峡大学 A kind of cliff blast hole detection & localization device based on binocular vision

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TW200941024A (en) * 2008-03-18 2009-10-01 Univ Nat Taiwan Science Tech Positioning method of radio frequency tag and positioning apparatus thereof
CN102043151A (en) * 2009-10-19 2011-05-04 中兴通讯股份有限公司 Mobile terminal and method for positioning based on radio frequency identification
KR101273125B1 (en) * 2011-06-24 2013-06-13 엘지이노텍 주식회사 Real Time Location Apparatus and method thereof
CN102928813A (en) * 2012-10-19 2013-02-13 南京大学 RSSI (Received Signal Strength Indicator) weighted centroid algorithm-based passive RFID (Radio Frequency Identification Device) label locating method
CN103076592A (en) * 2012-12-27 2013-05-01 重庆大学 Precise wireless positioning method facing service robot in intelligent space
CN103249142A (en) * 2013-04-26 2013-08-14 东莞宇龙通信科技有限公司 Locating method, locating system and mobile terminal

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
ZHANG, LIANG ET AL.: "Target Tracking and Locating for UAV Based on Binocular Stereo Vision", COMPUTER ENGINEERING AND APPLICATIONS, vol. 50, no. 24, 19 August 2014 (2014-08-19), ISSN: 1002-8331 *

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111862235A (en) * 2020-07-22 2020-10-30 中国科学院上海微系统与信息技术研究所 Binocular camera self-calibration method and system
CN111862235B (en) * 2020-07-22 2023-12-29 中国科学院上海微系统与信息技术研究所 Binocular camera self-calibration method and system
CN114290016A (en) * 2021-12-21 2022-04-08 燕山大学 High-precision wood furniture assembling system and method based on binocular parallax calculation
CN114290016B (en) * 2021-12-21 2023-01-03 燕山大学 High-precision wood furniture assembling system and method based on binocular parallax calculation

Also Published As

Publication number Publication date
CN105182319A (en) 2015-12-23

Similar Documents

Publication Publication Date Title
WO2017024673A1 (en) Target positioning system and method based on radio frequency and binocular vision
EP3469306B1 (en) Geometric matching in visual navigation systems
US6664529B2 (en) 3D multispectral lidar
US7417717B2 (en) System and method for improving lidar data fidelity using pixel-aligned lidar/electro-optic data
US9562764B2 (en) Use of a sky polarization sensor for absolute orientation determination in position determining systems
CN111065980A (en) System and method for centimeter-accurate positioning using camera-based sub-maps and LIDAR-based global maps
JP2018527554A (en) Unmanned aircraft depth image acquisition method, acquisition device, and unmanned aircraft
CN105245846A (en) Multi-unmanned aerial vehicle cooperative tracking type shooting system and shooting method
WO2017084240A1 (en) Target positioning and tracking system, device, and positioning and tracking method
KR101214081B1 (en) Image expression mapping system using space image and numeric information
CN110297234B (en) Networked large-area passive air target intersection determination method and system
US10708572B2 (en) Photogrammetric system and photogrammetric method
US10337863B2 (en) Survey system
CN109269525B (en) Optical measurement system and method for take-off or landing process of space probe
CN108007426B (en) Camera ranging method
US20190369202A1 (en) Geolocation Based On Radio Frequency Communication And Video Imagery
CN103645745A (en) Method and device for adjusting optical axis parallelism of transmitting and a receiving optical system of dual-axis laser ceilometer
CN109883398A (en) The system and method that the green amount of plant based on unmanned plane oblique photograph is extracted
Jóźków et al. Georeferencing experiments with UAS imagery
CN104049257A (en) Multi-camera space target laser three-dimensional imaging device and method
CN111103899A (en) Holder positioning method and device
CN112995524A (en) High-precision acquisition vehicle, and photo exposure information generation system, method and synchronization device thereof
CN104296726A (en) Double-area array push-broom three-dimensional surveying and mapping method and system
US9268005B2 (en) Image recording system with relational tracking
CN112764052A (en) Air defense missile flight monitoring system

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15900868

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 15900868

Country of ref document: EP

Kind code of ref document: A1