WO2021212499A1 - Target calibration method, apparatus, and system, and remote control terminal of movable platform - Google Patents

Target calibration method, apparatus, and system, and remote control terminal of movable platform Download PDF

Info

Publication number
WO2021212499A1
WO2021212499A1 PCT/CN2020/086793 CN2020086793W WO2021212499A1 WO 2021212499 A1 WO2021212499 A1 WO 2021212499A1 CN 2020086793 W CN2020086793 W CN 2020086793W WO 2021212499 A1 WO2021212499 A1 WO 2021212499A1
Authority
WO
WIPO (PCT)
Prior art keywords
target object
image transmission
transmission screen
lens
movable platform
Prior art date
Application number
PCT/CN2020/086793
Other languages
French (fr)
Chinese (zh)
Inventor
温亚停
方馨月
陈晨
Original Assignee
深圳市大疆创新科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市大疆创新科技有限公司 filed Critical 深圳市大疆创新科技有限公司
Priority to CN202080021661.6A priority Critical patent/CN113597596A/en
Priority to PCT/CN2020/086793 priority patent/WO2021212499A1/en
Publication of WO2021212499A1 publication Critical patent/WO2021212499A1/en

Links

Images

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range

Definitions

  • This application relates to the field of interaction, and in particular to a target calibration method, device and system, and a remote control terminal of a movable platform.
  • This application provides a target calibration method, device and system, and a remote control terminal of a movable platform.
  • an embodiment of the present application provides a target calibration method, which is applicable to a remote control terminal, the remote control terminal communicates with a movable platform, the movable platform includes a first lens and a second lens, and the method includes :
  • the target object is The second position information in the second video transmission picture acquired by the second lens.
  • an embodiment of the present application provides a target calibration device, the target calibration device is provided in a remote control terminal, the remote control terminal communicates with a movable platform, and the movable platform includes a first lens and a second lens,
  • the device includes:
  • Storage device for storing program instructions
  • One or more processors call program instructions stored in the storage device, and when the program instructions are executed, the one or more processors are individually or collectively configured to implement the following operations:
  • the target object is The second position information in the second video transmission picture acquired by the second lens.
  • an embodiment of the present application provides a remote control terminal, the remote control terminal communicates with a movable platform, the movable platform includes a first lens and a second lens, and the remote control terminal includes:
  • the target calibration device is supported by the main body;
  • the target calibration device includes:
  • Storage device for storing program instructions
  • One or more processors call program instructions stored in the storage device, and when the program instructions are executed, the one or more processors are individually or collectively configured to implement the following operations:
  • the target object is The second position information in the second video transmission picture acquired by the second lens.
  • the embodiments of the present application provide a target calibration system, including:
  • a remote control terminal including a main body and a target calibration device, the target calibration device being supported by the main body;
  • a movable platform communicating with the remote control terminal, the movable platform including a first lens and a second lens;
  • the target calibration device includes:
  • Storage device for storing program instructions
  • One or more processors call program instructions stored in the storage device, and when the program instructions are executed, the one or more processors are individually or collectively configured to implement the following operations:
  • the target object is The second position information in the second video transmission picture acquired by the second lens.
  • an embodiment of the present application provides a computer-readable storage medium on which a computer program is stored, and when the program is executed by a processor, the following steps are implemented:
  • the target object is The second position information in the second video transmission picture acquired by the second lens.
  • an embodiment of the present application provides a target calibration method, which is applicable to a remote control terminal that communicates with a movable platform on which a camera is mounted, and the method includes:
  • the target object is marked on the image transmission screen.
  • an embodiment of the present application provides a target calibration device, the target calibration device is provided in a remote control terminal, the remote control terminal communicates with a movable platform, the movable platform is equipped with a camera, the device include:
  • Storage device for storing program instructions
  • One or more processors call program instructions stored in the storage device, and when the program instructions are executed, the one or more processors are individually or collectively configured to implement the following operations:
  • the target object is marked on the image transmission screen.
  • an embodiment of the present application provides a remote control terminal, the remote control terminal communicates with a movable platform, the movable platform is equipped with a photographing device, and the remote control terminal includes:
  • the target calibration device is supported by the main body;
  • the target calibration device includes:
  • Storage device for storing program instructions
  • One or more processors call program instructions stored in the storage device, and when the program instructions are executed, the one or more processors are individually or collectively configured to implement the following operations:
  • the target object is marked on the image transmission screen.
  • an embodiment of the present application provides a target calibration system, including:
  • a remote control terminal comprising a main body and a target calibration device, the target calibration device being supported by the main body;
  • a movable platform that communicates with the remote control terminal, and a camera is mounted on the movable platform;
  • the target calibration device includes:
  • Storage device for storing program instructions
  • One or more processors call program instructions stored in the storage device, and when the program instructions are executed, the one or more processors are individually or collectively configured to implement the following operations:
  • the target object is marked on the image transmission screen.
  • an embodiment of the present application provides a computer-readable storage medium on which a computer program is stored, and when the program is executed by a processor, the following steps are implemented:
  • the target object is marked on the image transmission screen.
  • the technical solution provided by the embodiments of the present application according to the first position information of the target object in the first image transmission screen, the relative positional relationship between the first lens and the second lens, the shooting parameters of the first lens, and the second lens Shooting parameters, you can get the second location information of the target object in the second image transmission screen, so that the target object marked on the first image transmission screen can be shared with the second image transmission screen based on the second location information , It realizes the sharing of target calibration results between the image transmission images acquired by multiple lenses, which is beneficial to reduce communication costs when multi-person collaborative control of the movable platform works, and improves the efficiency of coordinated operations.
  • Fig. 1A is an application scenario diagram of a target calibration method in an embodiment of the present application
  • FIG. 1B is a structural block diagram of a movable platform in an embodiment of the present application.
  • FIG. 2 is a schematic diagram of the method flow of the target calibration method in an embodiment of the present application.
  • 3A is a schematic diagram of an interactive interface displaying a picture transmission screen in an embodiment of the present application.
  • 3B is a schematic diagram of an interactive interface in an embodiment of the present application displaying an image transmission screen under an intelligent tracking strategy
  • 4A is a schematic diagram of an interactive interface in an embodiment of the present application displaying an image transmission screen under a dot positioning strategy
  • 4B is a schematic diagram of an interactive interface in another embodiment of the present application displaying a map corresponding to the first image transmission screen;
  • FIG. 5 is a schematic diagram of an interactive interface in another embodiment of the present application displaying an image transmission screen under the laser ranging strategy
  • Fig. 6 is a schematic diagram of a flight guidance compass in an embodiment of the present application.
  • Fig. 7 is a structural block diagram of a target calibration device in an embodiment of the present application.
  • FIG. 8 is a schematic diagram of the method flow of the target calibration method in another embodiment of the present application.
  • pilot 1 performs operations by viewing the image transmission screen obtained by lens 1
  • pilot 2 performs operations by viewing the image transmission screen obtained by lens 2.
  • Pilots usually calibrate the targets that need to be focused on in the operation area. For example, if pilot 1 finds a large obstacle in the operation area through the image transmission screen obtained by lens 1, he can calibrate on the image transmission screen obtained by lens 1. The large obstacle avoids collision during operation.
  • the present application can be based on the first position information of the target object in the first image transmission screen, the relative position relationship between the first lens and the second lens, the shooting parameters of the first lens, and the shooting parameters of the second lens.
  • the sharing of the target calibration results between the acquired image transmission screens is beneficial to reduce communication costs when multiple people collaborate to control the operation of the movable platform, and improve the efficiency of coordination operations.
  • the target object is a suspect to be arrested, and if the location of the suspect cannot be demarcated accurately, the arrest process will be greatly troubled.
  • the position information of the target object obtained from the movable platform includes the distance of the target object relative to the movable platform. Based on the distance of the target object relative to the movable platform, the target object can be quickly calibrated. Positioning, when multiple people collaborate to control the work of the movable platform, it can quickly notify the partner of the coordinated work to arrive at the destination.
  • the target calibration method of the embodiment of the present application is applicable to a remote control terminal that communicates with a movable platform.
  • the remote control terminal of the embodiment of the present application may be a remote control of a movable platform, a smart terminal (such as a mobile phone, a tablet computer, etc.), or other terminal equipment capable of remotely controlling the movable platform.
  • the movable platform in the embodiment of the present application may be a drone, an unmanned vehicle or a ground mobile robot; of course, the movable platform in the embodiment of the present application may also be other types of movable platforms, such as a manned aircraft.
  • the movable platform includes a first lens and a second lens.
  • the movable platform includes a photographing device including multiple lenses, the first lens is one of the multiple lenses included in the photographing device, and the second lens includes multiple lenses included in the photographing device.
  • the movable platform includes a plurality of photographing devices, the first lens is a lens of one of the photographing devices, and the second lens includes a lens of other photographing devices.
  • the multiple shooting devices include a FPV (First Person View) camera.
  • the camera is mounted on the body of the movable platform via a pan-tilt; in some embodiments, the camera is directly fixed on the body of the movable platform.
  • the photographing device includes a dual-lens lens, such as a wide-angle lens and a zoom lens.
  • the first lens is one of a wide-angle lens and a zoom lens
  • the second lens is the other of a wide-angle lens and a zoom lens.
  • the photographing device includes a three-lens lens, such as a wide-angle lens, a zoom lens, and an infrared lens.
  • the first lens is one of a zoom lens, a wide-angle lens, and an infrared lens
  • the second lens includes a zoom lens, a wide-angle lens, and an infrared lens. The other shots in the shot.
  • the movable platform includes an FPV camera and a first imaging device
  • the first imaging device includes the above-mentioned dual-lens and/or triple-lens imaging device.
  • the first lens is one of the lens of the FPV camera and the lens of the first photographing device
  • the second lens includes the lens of the FPV camera and the other lens of the lens of the first photographing device.
  • the target calibration method in the embodiment of the present application may include S201 to S205.
  • the image transmission images of the first lens and the second lens are acquired through the remote control terminal, and the first image transmission image acquired by the first lens is displayed on the interactive interface of the remote control terminal.
  • the image transmission screen obtained by the first lens and the second lens will be transmitted back to the remote control terminal.
  • the logo corresponding to the first lens and the logo corresponding to the second lens are displayed on the interactive interface.
  • the user can select the first lens and the second lens by operating the logo corresponding to each lens (such as clicking, double-clicking, or long-pressing)
  • One of the image transmission screens is displayed on the interactive interface.
  • the first lens is a zoom lens
  • the second lens includes an infrared lens, a wide-angle lens, and an FPV lens.
  • the zoom lens corresponds to the first logo 11
  • the infrared lens corresponds to the second logo 12
  • the wide-angle lens corresponds to the third logo 13.
  • the lens of the FPV camera corresponds to the fourth mark 14.
  • the user can click on one of the first logo 11, the second logo 12, the third logo 13, and the fourth logo 14, so that the image transmission screen of the lens corresponding to the currently clicked logo is displayed on the interactive interface.
  • a first user instruction is acquired, where the first user instruction is used to instruct the target object to be calibrated in the first image transmission screen.
  • the first user instruction is also used to instruct a positioning strategy for positioning the target object to be calibrated (hereinafter referred to as the target object), and the remote control terminal obtains the position information of the target object from the movable platform according to the positioning strategy (ie, the following Said third position information) to calibrate the target object.
  • the remote control terminal obtains the third position information obtained by positioning the target object by the movable platform according to the positioning strategy in the first user instruction from the movable platform.
  • the third position information can be used to indicate the position of the target object in the world coordinate system, or it can be used to indicate the position of the target object in the image coordinate system, or to indicate the target object. Position in other coordinate systems.
  • the third position information includes at least one of the latitude, longitude and height of the target object; of course, the third position information may also include others, such as the distance of the target object relative to the movable platform.
  • the third position information is determined according to the position information of the movable platform and the distance of the target object relative to the movable platform.
  • the third position information includes relative position information and/or absolute position information of the target object. Both the position information and the absolute position information are determined according to the position information of the movable platform and the distance of the target object relative to the movable platform.
  • the positioning strategy may include one or more.
  • the positioning strategy includes smart tracking strategy (also called Smarttrack), dot positioning strategy (also called PIN Point) and laser ranging strategy (also called Range). );
  • the positioning strategy can also include others. It should be noted that when there are multiple positioning strategies, each positioning strategy is independent of each other.
  • the positioning strategy includes an intelligent tracking strategy, a dot positioning strategy, and a laser ranging strategy.
  • the movable platform can locate the target object through a navigation and/or laser ranging device.
  • Navigation can be GPS or other.
  • the third location information obtained from the mobile platform may be different for different positioning strategies.
  • the third location information may include the latitude, longitude and/or height of the target object, or the position of the target object in the image coordinate system.
  • the third position information may include the latitude, longitude and/or height of the target object and/or the distance of the target object relative to the movable platform; for the laser ranging strategy, the third position information may include the latitude, longitude and/or distance of the target object / Or the height and / or the distance of the target object relative to the movable platform.
  • the interactive interface displays the identification corresponding to each positioning strategy, and the user can operate (such as clicking, double-clicking, or long-pressing, etc.) the identification corresponding to each positioning strategy to select the corresponding positioning strategy.
  • the interactive interface displays a fifth indicator 21 corresponding to the smart tracking strategy, a sixth indicator 22 corresponding to the dot positioning strategy, and a seventh indicator 23 corresponding to the laser ranging strategy.
  • the user can operate one of the fifth identifier 21, the sixth identifier 22, and the seventh identifier 23 at the same time, so that the positioning strategy corresponding to the currently operated identifier is in the trigger state, and the remote control terminal will be based on the current status
  • the positioning identifier in the triggered state obtains the third position information from the movable platform.
  • the positioning strategy can default to one of an intelligent tracking strategy, a dot positioning strategy, and a laser ranging strategy.
  • the positioning strategy needs to be switched, the corresponding identification can be operated.
  • the first user instruction may be generated when the user clicks or box-selects an object in the first image transmission screen, or the first user instruction may also be generated when the user clicks the logo corresponding to the positioning strategy.
  • the first user instruction is generated when the user clicks or box selects an object in the first image transmission screen, which is suitable for use scenarios where the positioning strategy is the default positioning strategy.
  • the positioning strategy is the default intelligent tracking strategy.
  • the objects in the first image transmission screen (such as people, cars, boats, etc.) can be identified through the control device of the movable platform, and the control will be marked on the interactive interface. For the recognition results of the device (the first object 31, the second object 32, and the third object 33 in FIG.
  • the first user instruction is generated when the user clicks the object corresponding to the recognition result.
  • Click includes one of single click and double click, and can also include the other. Exemplarily, please refer to FIG. 3A again.
  • the target object is the second object 32.
  • the first user instruction is generated when the user clicks the logo corresponding to the positioning strategy displayed on the first image transmission screen.
  • the first user instruction is generated when the user clicks the mark corresponding to the dot positioning strategy displayed on the first image transmission screen, or the first user instruction is generated when the user clicks the laser ranging strategy displayed on the first image transmission screen Generated when marking.
  • the first location information is the pixel coordinates of the target object on the first image transmission screen.
  • the first position information of the target object on the first image transmission screen can be obtained by using an existing image recognition algorithm, which is not described in the embodiment of the present application.
  • the positioning strategy is an intelligent tracking strategy.
  • the first instruction is sent Information to a mobile platform.
  • the first indication information is used to instruct the movable platform to adjust the posture of the first lens, so that the target object in the first image transmission screen moves to the first specific position of the first image transmission screen.
  • the first location information is location information of the first specific location.
  • the first specific position includes the center position of the first video transmission screen; of course, the first specific position may also be other positions of the first video transmission screen.
  • the movable platform controls the shooting device through the control device to adjust the posture of the shooting device, thereby adjusting the posture of the first lens.
  • the control device may adjust at least one of the yaw attitude, pitch attitude, and roll attitude of the camera to achieve the purpose of adjusting the attitude of the camera.
  • the camera is mounted on a movable platform through a pan-tilt, and the attitude of the camera can be adjusted by adjusting the attitude of the pan-tilt.
  • the first indication information is also used to instruct the movable platform to adjust the shooting parameters of the first lens, so that the size of the target object in the first image transmission screen in the first image transmission screen is a preset size, which is convenient for the user Observe the target object.
  • the size of the preset size can be set as required.
  • the first indication information is also used to instruct the movable platform to adjust the zoom factor of the first lens, so that the size of the target object in the first image transmission screen is a preset size.
  • FIGS. 3A and 3B Exemplarily, please combine FIGS. 3A and 3B.
  • the user selects (by clicking or box selection or other operation methods) the second object 32 in the first image transmission screen shown in FIG. 3A as the target object, and the remote control terminal will Send the first instruction information to the movable platform.
  • the movable platform adjusts the posture of the first lens through the control device so that the second object 32 moves to the center of the first image transmission screen and controls
  • the device adjusts the zoom factor of the first lens so that the second object 32 is enlarged by a preset factor so that the size of the target object in the first image transmission screen is the preset size, as shown in FIG. 3B.
  • the user only needs to perform the target selection operation, and the user can observe the target object clearly, intuitively, and in real time without unnecessary operations.
  • the intelligent tracking strategy can obtain the real-time location information of the target object. Therefore, the intelligent tracking strategy is more suitable for calibrating and tracking the moving target object. If the target object is a suspect, the location of the suspect can be obtained in real time through the intelligent tracking strategy The arrest operation.
  • the third location information corresponding to the smart tracking strategy may include the latitude, longitude and height of the target object, where the latitude and longitude of the target object is determined according to the latitude and longitude of the movable platform and the height of the movable platform, and the height of the target object is based on The height of the movable platform is determined. That is, the third position information corresponding to the smart tracking strategy can obtain the relative position of the target object.
  • the positioning strategy is a dot positioning strategy
  • the target object is an object at a second specific position on the first video transmission screen.
  • the second specific position includes the center position of the first image transmission screen; of course, the second specific position may also be other positions of the first image transmission screen.
  • the user Before locating the target object through the dot positioning strategy, if the object as the target object in the first image transmission screen is not currently in the second specific position, you need to move the object as the target object in the first image transmission image to the second specific position Position; if the object as the target object in the first image transmission screen is currently in the second specific position, the user can directly operate the mark corresponding to the dot positioning strategy to select the dot positioning strategy as the positioning strategy used for the calibration target.
  • the strategy for moving the object that is the target object in the first image transmission screen to the second specific position may include, but is not limited to, the following two strategies:
  • the second indication information is used to instruct the user to adjust the pose of the first lens through the control device of the movable platform, so that the target object in the first image transmission screen is at the second specific position.
  • control device and the remote control terminal may be the same device or different devices; for example, the control device is a remote controller of a movable platform, and the remote control terminal is a mobile phone.
  • the user can adjust at least one of the poses of the movable platform and the shooting device by operating the control device to adjust the pose of the first lens.
  • the purpose of moving the target object in the first image transmission screen to the second specific position of the first image transmission screen can be achieved by manually controlling the joystick of the remote control to adjust the pose of the aircraft.
  • the second user instruction Before the first user instruction is acquired, the second user instruction is acquired, and the third instruction information is sent to the movable platform according to the second user instruction.
  • the second user instruction is used to instruct the object in the first image transmission screen to be moved to the second specific position.
  • the second user instruction is for the user to double-click the object to be moved to the second specific position in the first image transmission screen.
  • the third indication information is used to instruct the movable platform to automatically adjust the pose of the first lens, so that the object to be moved to the second specific position moves to the second specific position. It should be noted that, in this application, various instruction information can be output in the form of a dialog box, or various instruction information can be output in other ways.
  • the second object 32 needs to be calibrated, that is, the second object 32 is the target object, and the second object 32 is not currently in the center position of the first image transmission screen.
  • click the mark corresponding to the dot positioning strategy dot the center position of the first image transmission screen, and record the third position information of the second object 32.
  • augmented reality Augmented Reality
  • dynamic or static dot method may be used to dot the ZTE position of the first image transmission screen.
  • the third position information is determined according to the position information of the movable platform and the distance between the target object and the movable platform.
  • the relative position and absolute position of the target object can be determined, that is, the third position information may include At least one of relative position information and absolute position information of the target object. It should be noted that the distance between the target object and the movable platform can be detected by the laser ranging device of the movable platform.
  • the positioning strategy is a laser ranging strategy
  • the target object is an object at a fourth specific position on the first image transmission frame.
  • the fourth specific position includes the center position of the first image transmission screen; of course, the fourth specific position may also be other positions of the first image transmission screen.
  • the “calibrating” mark is displayed in the center of the first image transmission screen, indicating that it is currently aligned with the first image transmission screen. To obtain the distance of the target object relative to the movable platform and the latitude, longitude and height of the target object.
  • the target object is marked on the first image transmission screen according to the first location information.
  • the annotation may include the icon and the third position information of the target object, but it is not limited to this.
  • the icon when the target object is marked, the icon is displayed on the target object, that is, the pixels of the icon cover at least part of the pixels of the target object.
  • the icon may include at least one of graphics, numbers, and symbols, and the icon may also include others.
  • the target calibration method may further include: when the icon on the target object is in a triggered state, displaying third position information on the icon. Further, in some embodiments, the target calibration method may further include: hiding the third position information when the icon on the target object is in a non-triggered state. It should be noted that when the icon is operated, the icon is in a triggered state; when the icon is not operated, the icon is in a non-triggered state. Among them, the icon being operated may include the icon being clicked, such as clicking, double-clicking, or long-pressing.
  • the labeled icons corresponding to different target objects of the same positioning strategy are different to distinguish the target objects; in some embodiments, the labeled icons corresponding to different target objects of the same positioning strategy are the same.
  • the labeled icons corresponding to different positioning strategies are different to distinguish the positioning strategies of the target object; in some embodiments, the labeled icons corresponding to different positioning strategies are the same.
  • the different icons may include at least one of different icon size, icon shape, and icon color.
  • the same icon means that the icon size, icon shape, and icon color are all the same.
  • the smart tracking strategy is used to mark the target object 1 and the target object 2 in the first image transmission screen, the marked icon corresponding to the target object 1 is a green circle, and the marked icon corresponding to the target object 2 is a green square. frame.
  • the marked icons corresponding to different target objects of the same positioning strategy are the same, and the marked icons corresponding to different positioning strategies are different.
  • the marked icon corresponding to the smart tracking strategy is a green "+”
  • the marked icon corresponding to the dot positioning strategy is a green " ⁇ ”
  • the marked icon corresponding to the laser ranging strategy is a red "+”.
  • the target object is at the center of the first image transmission screen
  • the marked icon of the target object is the intelligent tracking strategy and Corresponding marked icon.
  • that the target object is at the center position of the first video transmission screen means that the center of the target object coincides with the center position of the first video transmission screen. It should be understood that when the deviation between the center of the target object and the center position of the first video transmission screen is less than the preset deviation threshold, it can also be considered that the center of the target object coincides with the center position of the first video transmission screen.
  • the intelligent tracking strategy and the laser ranging strategy are used to locate the third position information of the target object at the same time, since the laser ranging strategy can obtain the distance of the target object relative to the movable platform, it is combined with the intelligent tracking strategy
  • the obtained real-time position information of the target object and the distance of the target object relative to the movable platform obtained by the laser ranging strategy can determine the real-time absolute position of the target object, so that accurate tracking of the target object can be achieved.
  • the third location information contained in the label corresponding to the smart tracking strategy will change as the position of the target object changes in the real world, and the third location information contained in the label corresponding to the dot positioning strategy will not change.
  • the third position information includes absolute position information of the target object.
  • the implementation process of marking the target object on the first image transmission screen can be Including: according to the absolute position information contained in the first position information and the third position information, an augmented reality AR projection label is performed on the target object on the first image transmission screen, and the AR projection label is more eye-catching.
  • the dot calibration operation can also be performed on the map corresponding to the first image transmission screen.
  • the interactive interface also displays the eighth mark 41 corresponding to the map corresponding to the first image transmission screen.
  • the mark 41 makes the eighth mark in the triggered state
  • the map corresponding to the first image transmission screen will be displayed on the interactive interface, as shown in FIG. 4B.
  • the map corresponding to the first image transmission screen is a map around the current location of the movable platform, and the user can operate the interactive interface to zoom in or zoom out the map.
  • a third user instruction is obtained, where the third user instruction is generated when the user operates the mark corresponding to the dot positioning strategy displayed on the map;
  • the sixth indicator 22 corresponding to the dot positioning strategy will be displayed on the map.
  • the first image transmission screen 1 and the image transmission screen 2 corresponding to the FPV camera are also displayed on the map.
  • the user can watch the image transmission screen while watching the map, which is conducive to the intuitive presentation of information.
  • the image transmission images of different lenses may be obtained by different lenses of the same shooting device, or may be obtained by different shooting devices.
  • the photographing device includes a zoom lens and a wide-angle lens.
  • the first image transmission picture may be a picture transmission picture obtained by a zoom lens or a picture transmission picture obtained by a wide-angle lens;
  • the photographing device includes a zoom lens, a wide-angle lens and Infrared lens, the first image transmission image can be the image transmission image obtained by the zoom lens, the image transmission image obtained by the wide-angle lens, or the image transmission image obtained by the infrared lens;
  • the movable platform includes the first image
  • the first image transmission picture may be a picture transmission picture obtained by the first camera, or a picture transmission picture obtained by the FPV camera.
  • the icon corresponding to the annotation on the map when the icon corresponding to the annotation on the map is triggered, if the fourth user instruction is obtained , According to the fourth user instruction, modify and/or delete the height in the third position information contained in the annotation.
  • the icon corresponding to the label on the map can be triggered by a user operation (such as clicking or box selection) of the icon corresponding to the label, and the fourth user instruction can be generated when the user operates the virtual keyboard and/or virtual mouse on the interactive interface .
  • the target object at the third specific location on the map is marked according to the third user instruction
  • the icon corresponding to the mark on the map is triggered
  • the fifth user instruction instructs the user to perform the first operation on the icon first, and then perform the second operation on the icon;
  • the first operation includes continuously clicking the icon for longer than the preset period of time, and the second operation includes dragging. icon.
  • the size of the preset duration can be set as required, for example, the preset duration can be 5 seconds or other sizes. It should be understood that the fifth user instruction may also include other operations performed by the user on the icon, and the first operation and the second operation may also be of other types.
  • the target calibration method may further include: obtaining the distance of the target object relative to the movable platform obtained by positioning the target object.
  • the implementation process of labeling the target object on the first image transmission screen may include: according to the first location information and the distance of the target object relative to the movable platform, matching on the first image transmission screen The target object is labeled.
  • the third position information corresponding to the annotation includes the distance of the target object relative to the movable platform, and the user can determine the distance of the target object relative to the movable platform through the annotation, so that the absolute position of the target object can be determined.
  • the postures of the first lens and the second lens are approximately the same and the distance is less than a preset threshold, it can be considered that the positions of the two are coincident.
  • the shooting parameters include the shooting angle of view FOV; of course, the shooting parameters may also include others.
  • the target object on the second image transmission screen After determining the second position information of the target object in the second image transmission screen obtained by the second lens, mark the target object on the second image transmission screen according to the second position information.
  • the purpose of simultaneously calibrating the target object on the first image transmission screen and the second image transmission screen is realized, thereby realizing the sharing of the calibration results when the target object is calibrated on different image transmission screens.
  • the pilot 1 views the first image transmission screen through the interactive interface of the remote control terminal 1 to perform operations
  • the pilot 2 views the second image transmission screen through the interactive interface of the remote control terminal 2 to perform operations.
  • the pilot 1 calibrates a target object 1 on the first image transmission screen
  • the pilot 2 may also see the information that the target object 1 is calibrated on the second image transmission screen.
  • the label of the target object on the first image transmission screen is the same as the label of the target object on the second image transmission screen; of course, in other embodiments, the label of the target object on the first image transmission screen
  • the label on the second image transmission screen may be different from that of the target object.
  • the positioning strategy is a laser ranging strategy
  • the second position information of the target object in the second image transmission image obtained by the second lens if the second position information is not in the second On the image transmission screen, the label of the target object is displayed on the edge of the second image transmission screen.
  • the position of the edge relative to the center position of the second video transmission screen is used to indicate the position of the target object relative to the center position of the second video transmission screen. In this way, the user can be informed of the location of the target object.
  • the target calibration method may further include: marking the target object on the map corresponding to the first image transmission screen according to the third location information.
  • the target calibration method may further include: marking the target object on the map corresponding to the first image transmission screen according to the third location information.
  • the target calibration method may further include: synchronizing the annotations to the map corresponding to the external device and/or the image transmission screen and/or the operation guide page of the movable platform.
  • the external device is a background monitoring device, or may be HSI, other web platforms, etc.
  • the external device is a background monitoring device (usually used by the commander), and the calibration result of the pilot calibration target through the remote control terminal can be shared with the background monitoring device, which realizes the synchronization of information between the pilot and the commander, and the command The officer can schedule multiple pilots based on these synchronized information to improve operational efficiency.
  • the operation guide page is used to indicate the operation status of the movable platform.
  • the movable platform is a drone
  • the operation guide page is the flight guide page of the drone
  • the flight guide page is described.
  • the flight guide page is displayed on the display device of the remote control terminal or the display device connected to the remote control terminal, so that the user can know the flight status of the drone.
  • the flight guide page includes a flight guide compass, which is used to simultaneously identify the position of the drone that is in communication with the remote control terminal and the position of the drone's gimbal.
  • the flight guide page also displays the drone's position.
  • the flight guidance compass includes any one of the attitude ball and the horizontal status indicator (Horizontal Situation Indicator, HSI).
  • the display position of the flight guidance compass can be set according to the actual situation, which is not specifically limited in this application. For example, The lower middle area of the flight guide page displays the flight guide compass.
  • the flight guidance compass is an azimuth indication mark indicating the azimuth on the flight guidance page, and it can be a square, a circle, an ellipse, or other shapes that can indicate the azimuth.
  • the flight guidance compass is a square, the four corners of the direction are set to four directions: east, west, south, north, and the current position of the drone and the pan/tilt can be indicated in the square compass.
  • the flight guidance compass is circular as an example for description.
  • the flight guidance compass rotates with the rotation of the drone, and the center area of the flight guidance compass displays a drone icon.
  • the drone icon is used to indicate the drone, and the drone icon does not follow.
  • the edge area of the flight guidance compass shows the corresponding indicator characters for the true east, west, south and true north directions.
  • the edge area of the flight guidance compass also shows clouds.
  • PTZ icon the PTZ icon is used to represent the PTZ of the drone.
  • the position of the PTZ icon in the edge area is determined according to the direction of the Yaw axis of the PTZ.
  • the position of the PTZ icon in the edge area follows The direction of the pan-tilt changes.
  • the user can know the position and position of the gimbal based on the displayed flight guidance compass.
  • the position of the drone is convenient for the user to control the attitude of the drone's gimbal and the attitude of the drone.
  • the drone icon, pan/tilt icon, and indicator characters can be set according to actual conditions. This application does not specifically limit this.
  • the indicator characters corresponding to the direction of due east, west, south and north are respectively E, W, S, and N.
  • the drone icon is an arrow, circle, triangle, or other shapes
  • the gimbal icon is a triangle, quadrilateral, pentagon, or other shapes.
  • the angle value corresponding to the nose of the drone is displayed near the flight guidance compass, and the displayed angle value is used to indicate the nose of the drone, where the angle value is that of the drone.
  • the angle of the nose with respect to true north, true south, true west, or true east.
  • the drone icon is an arrow icon
  • the arrow icon is fixed to the top of the flight guide page, and the direction of the arrow icon is consistent with the nose of the drone; when the orientation of the drone changes,
  • the edge area of the flight guidance compass displays the corresponding gimbal icon for each gimbal, and the color of each gimbal icon is different, the flight guidance compass
  • the edge area of also displays multiple angle scale lines and the corresponding angle value of each angle scale line. Among them, the angle value is the angle deviating from the true north direction.
  • the user can be accurate and clear based on the displayed flight guidance compass Knowing the position of the gimbal and the position of the drone is convenient for the user to control the attitude of the gimbal of the drone and the attitude of the drone.
  • the flight guidance compass also includes a follow icon, which is used to indicate the object that the drone follows.
  • the position of the follow icon on the flight guidance compass is based on the direction and distance of the object followed by the drone relative to the drone. Confirmed; when the distance of the object followed by the drone relative to the drone is less than the preset distance, the follow icon is located inside the flight guidance compass, and the distance of the object followed by the drone relative to the drone is greater than or equal to the preset distance.
  • the follow icon is located inside the edge area of the flight guidance compass; the mark point icon and the distance of the marked space point relative to the drone are also displayed near the flight guidance compass.
  • the follow icon can be set based on actual conditions, and this application does not specifically limit this.
  • the follow icon is
  • the flight guide page also displays an object follow button.
  • the drone automatically recognizes people, vehicles, and ships and other objects, and adjusts the camera's focus so that objects such as people, vehicles, and ships are in the center of the screen.
  • a follow icon is displayed on the flight guidance compass.
  • the home point icon of the drone is displayed inside the flight guidance compass
  • the home point icon is displayed near the lower right side of the flight guidance compass
  • the distance from the home point of the drone to the drone is 10m
  • the inner side of the edge area of the flight guidance compass is displayed with a marker icon
  • a marker icon is displayed near the lower left side of the flight guidance compass
  • the distance from the marked space point to the drone is 45m
  • the follow icon is displayed inside the flight guidance compass
  • a follow icon is displayed near the upper left side of the flight guidance compass
  • the distance from the following object to the drone is 5m.
  • the target calibration method of the embodiment of the present application can track and synchronize information for "dynamic targets” and “static targets”, realize multi-platform closed-loop operation, and be suitable for industries such as security and emergency.
  • an embodiment of the present application also provides a target calibration device.
  • the target calibration device is provided in a remote control terminal.
  • the target calibration device may include a storage device and one or more Processors.
  • the storage device is used to store program instructions.
  • One or more processors call the program instructions stored in the storage device.
  • the one or more processors are individually or collectively configured to perform the following operations: Obtain the first shot through the remote control terminal And the image transmission screen of the second lens, the first image transmission screen acquired by the first lens is displayed on the interactive interface of the remote control terminal; the first user instruction is obtained, wherein the first user instruction is used to instruct the first image transmission screen
  • the target object to be calibrated obtain the first position information of the target object on the first image transmission screen; mark the target object on the first image transmission screen according to the first position information; according to the first position information, the first lens and The relative positional relationship between the second lenses, the shooting parameters of the first lens, and the shooting parameters of the second lens determine the second position information of the target object in the second video image obtained by the second lens.
  • the processor of this embodiment can implement the target calibration method of the embodiment shown in FIG. 2 of the present application, and reference may be made to the description of the corresponding part in the foregoing embodiment.
  • an embodiment of the present application also provides a remote control terminal, the remote control terminal communicates with a movable platform, the movable platform includes a first lens and a second lens, the remote control terminal includes a main body and The target calibration device is supported by the main body.
  • an embodiment of the present application also provides a target calibration system, which includes a remote control terminal and a movable platform.
  • the remote control terminal includes a main body and the target calibration device of the foregoing embodiment, and the target calibration device is supported by the main body.
  • the movable platform communicates with the remote control terminal, and the movable platform includes a first lens and a second lens.
  • an embodiment of the present application also provides a computer-readable storage medium on which a computer program is stored, and when the program is executed by a processor, the steps of the target calibration method in the second embodiment are realized.
  • FIG. 8 is a method flow diagram of a target calibration method in another embodiment of the present application; the execution subject of the target calibration method in the embodiment of the present application is a remote control terminal.
  • the target calibration method in the embodiment of the present application may include S801 to S804.
  • the image transmission screen acquired by the camera is displayed on the interactive interface of the remote control terminal.
  • the camera is mounted on a movable platform, and the camera can include one or more lenses.
  • the image transmission image may be an image transmission image obtained by any one of the multiple lenses.
  • the image transmission picture is a picture transmission picture obtained by the first lens of the movable platform.
  • the image transmission screen will be sent back to the remote control terminal.
  • a first user instruction is obtained, where the first user instruction is used to instruct the target object to be calibrated in the image transmission screen and a positioning strategy for positioning the target object.
  • the location information in the embodiment of the present application is equivalent to the third location information in the first embodiment.
  • the positioning strategy in the embodiment of the present application includes at least one of a dot positioning strategy and a laser ranging strategy.
  • the position information of the target object is obtained from the movable platform, where the position information includes the distance of the target object relative to the movable platform.
  • the position information can be used to indicate the position of the target object in the world coordinate system, and can also be used to indicate the position of the target object in the image coordinate system, or used to indicate the position of the target object in other coordinate systems.
  • the target object is marked on the image transmission screen according to the location information.
  • the label includes an icon and location information.
  • the location information further includes at least one of the latitude, longitude and height of the target object.
  • the target calibration method further includes: when the icon is in a triggered state, displaying position information on the icon.
  • the target calibration method further includes: hiding the position information when the icon is in a non-triggered state.
  • the positioning strategy includes a dot positioning strategy
  • the first user instruction is generated when the user clicks the mark corresponding to the dot positioning strategy displayed on the image transmission screen.
  • the target object is an object at a first specific position on the image transmission screen.
  • the first specific position includes the center position of the image transmission screen.
  • the method further includes: before acquiring the location information, outputting first indication information; the first indication information is used to instruct the user to adjust the posture of the shooting device through the control device of the movable platform, so that the image transmission screen The target object is in the first specific position.
  • the method further includes: obtaining a second user instruction, where the second user instruction is used to instruct the object to be moved to the first specific position in the image transmission screen; and according to the second user instruction, sending The second instruction information is to the movable platform; wherein, the second instruction information is used to instruct the movable platform to adjust the posture of the photographing device so that the object to be moved to the first specific position moves to the first specific position.
  • the position information is determined according to the position information of the movable platform and the distance of the target object relative to the movable platform.
  • the method further includes: displaying a map corresponding to the image transmission screen on the interactive interface; acquiring a third user instruction, where the third user instruction is generated when the user operates the mark corresponding to the dot positioning strategy displayed on the map ;According to the dot positioning strategy, obtain the location information of the target object from the movable platform; according to the location information, mark the target object at the second specific location on the map.
  • the target object at the second specific location on the map after labeling the target object at the second specific location on the map according to the location information, it further includes: when the icon corresponding to the label on the map is triggered, if a fourth user instruction is obtained, then according to the fourth user instruction.
  • User instructions to modify and/or delete the height in the position information contained in the label After labeling the target object at the second specific location on the map according to the location information, it further includes: when the icon corresponding to the label on the map is triggered, if a fourth user instruction is obtained, then according to the fourth user instruction.
  • the target object at the second specific location on the map after labeling the target object at the second specific location on the map according to the location information, it further includes: when the icon corresponding to the label on the map is triggered, if the fifth user instruction is obtained, then according to the fifth user instruction.
  • the user instructs to move the position of the icon on the map, and replace the longitude and latitude in the position information contained in the label with the longitude and latitude corresponding to the position of the moved icon.
  • the fifth user instruction instructs the user to perform the first operation on the icon first, and then perform the second operation on the icon.
  • the first operation includes: the duration of continuously clicking the icon is greater than a preset duration
  • the second operation includes: dragging the icon.
  • the positioning strategy includes a laser ranging strategy
  • the first user instruction is generated when the user clicks the mark corresponding to the laser ranging strategy displayed on the image transmission screen.
  • the target object is an object at a third specific position on the image transmission screen.
  • the third specific position includes the center position of the image transmission screen.
  • the target calibration method further includes: synchronizing the annotations to the map corresponding to the external device and/or the image transmission screen and/or the operation guide page of the movable platform;
  • the operation guide page is used to indicate the operation status of the movable platform.
  • an embodiment of the present application also provides a target calibration device, the target calibration device is set in the remote control terminal, please refer to FIG. 7, the target calibration device may include a storage device and one or more Processors.
  • the storage device is used to store program instructions.
  • One or more processors call program instructions stored in the storage device. When the program instructions are executed, one or more processors are individually or collectively configured to implement the following operations: On the interactive interface of the remote control terminal Display the image transmission screen obtained by the camera; obtain the first user instruction, where the first user instruction is used to instruct the target object to be calibrated in the image transmission screen and the positioning strategy of the target object; The mobile platform obtains the location information of the target object, and the location information includes the distance of the target object relative to the movable platform; according to the location information, the target object is marked on the image transmission screen.
  • the processor of this embodiment can implement the target calibration method of the embodiment shown in FIG. 8 of the present application, and reference may be made to the description of the corresponding part in the foregoing embodiment.
  • the storage device of the foregoing embodiment stores the executable instruction computer program of the target calibration method.
  • the storage device may include at least one type of storage medium.
  • the storage medium includes flash memory, hard disk, multimedia card, card-type memory (for example, SD Or DX memory, etc.), random access memory (RAM), static random access memory (SRAM), read only memory (ROM), electrically erasable programmable read only memory (EEPROM), programmable read only memory (PROM) , Magnetic storage, magnetic disks, optical disks, etc.
  • the target calibration device may cooperate with a network storage device that performs the storage function of the memory through a network connection.
  • the memory may be an internal storage unit of the target calibration device, such as the hard disk or memory of the target calibration device.
  • the memory can also be an external storage device of the target calibration device, such as plug-in hard disks equipped on the target calibration device, Smart Media Card (SMC), Secure Digital (SD) card, Flash Card )Wait. Further, the memory may also include both an internal storage unit of the target calibration device and an external storage device. The memory is used to store computer programs and other programs and data required by the device. The memory can also be used to temporarily store data that has been output or will be output.
  • SMC Smart Media Card
  • SD Secure Digital
  • Flash Card Flash Card
  • the processor of the foregoing embodiment may be a central processing unit (Central Processing Unit, CPU), or other general-purpose processors, digital signal processors (Digital Signal Processor, DSP), and Application Specific Integrated Circuit (ASIC) , Field-Programmable Gate Array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components, etc.
  • the general-purpose processor may be a microprocessor or the processor may also be any conventional processor or the like.
  • an embodiment of the present application also provides a remote control terminal, the remote control terminal communicates with a movable platform, the movable platform is equipped with a photographing device, the remote control terminal includes a main body and the target calibration of the second embodiment above Device, the target calibration device is supported by the main body.
  • an embodiment of the present application also provides a target calibration system, including a remote control terminal and a movable platform.
  • the remote control terminal includes a main body and the target calibration device of the second embodiment above, and the target calibration device is supported by the main body.
  • the movable platform communicates with the remote control terminal, and a camera is mounted on the movable platform.
  • an embodiment of the present application also provides a computer-readable storage medium on which a computer program is stored, and when the program is executed by a processor, the steps of the target calibration method in the second embodiment are realized.
  • the computer-readable storage medium may be an internal storage unit of the remote control terminal described in any of the foregoing embodiments, such as a hard disk or a memory.
  • the computer-readable storage medium may also be an external storage device of the remote control terminal, such as a plug-in hard disk, a smart media card (SMC), an SD card, a flash memory card (Flash Card), etc. equipped on the device .
  • the computer-readable storage medium may also include both an internal storage unit of the remote control terminal and an external storage device.
  • the computer-readable storage medium is used to store the computer program and other programs and data required by the remote control terminal, and can also be used to temporarily store data that has been output or will be output.
  • the program can be stored in a computer readable storage medium. During execution, it may include the procedures of the above-mentioned method embodiments.
  • the storage medium may be a magnetic disk, an optical disc, a read-only memory (Read-Only Memory, ROM), or a random access memory (Random Access Memory, RAM), etc.

Abstract

A target calibration method, apparatus, and system, and a remote control terminal of a movable platform, the method comprising: by means of a remote control terminal, acquiring an image transmission picture of a first lens and a second lens, and displaying a first image transmission picture acquired by the first lens on an interactive interface of the remote control terminal (S201); acquiring a first user command, the first user command being used for indicating a target object to be calibrated in the first image transmission picture (S202); acquiring first position information of the target object in the first image transmission picture (S203); on the basis of the first position information, marking the target object on the first image transmission picture (S204); and, on the basis of the first position information, relative positional information of the first lens and the second lens, photography parameters of the first lens, and photography parameters of the second lens, determining second position information of the target object in a second image transmission picture acquired by the second lens (S205). The present method implements sharing of target calibration results between the image transmission pictures acquired by multiple lenses, reducing communication costs when multiple people collaborate to control the movable platform operations, and increasing the efficiency of collaborative operations.

Description

目标标定方法、装置和系统及可移动平台的遥控终端Target calibration method, device and system and remote control terminal of movable platform 技术领域Technical field
本申请涉及交互领域,尤其涉及一种目标标定方法、装置和系统及可移动平台的遥控终端。This application relates to the field of interaction, and in particular to a target calibration method, device and system, and a remote control terminal of a movable platform.
背景技术Background technique
目前,可移动平台大都使用单镜头,现有存在一些软件支持用户在单镜头获取的图传画面上进行目标的标定。一些可移动平台具有多个镜头,现有软件仅支持用户对不同镜头获取的图传画面分别进行目标标定,且不同镜头获取的图传画面上的目标标定结果之间不能共享,在多人协作控制可移动平台进行作业时,这种目标标定方式会导致用户间的沟通成本增加、作业效率降低。At present, most of the mobile platforms use a single lens, and there are some softwares that support users to perform target calibration on the image transmission screen acquired by a single lens. Some mobile platforms have multiple lenses. Existing software only supports users to perform target calibration on the image transmission screens acquired by different lenses, and the target calibration results on the image transmission screens acquired by different lenses cannot be shared. In multi-person collaboration When controlling the movable platform to perform operations, this target calibration method will increase the communication cost between users and decrease the operation efficiency.
发明内容Summary of the invention
本申请提供一种目标标定方法、装置和系统及可移动平台的遥控终端。This application provides a target calibration method, device and system, and a remote control terminal of a movable platform.
第一方面,本申请实施例提供一种目标标定方法,适用于一遥控终端,所述遥控终端与一可移动平台通信,所述可移动平台包括第一镜头和第二镜头,所述方法包括:In the first aspect, an embodiment of the present application provides a target calibration method, which is applicable to a remote control terminal, the remote control terminal communicates with a movable platform, the movable platform includes a first lens and a second lens, and the method includes :
通过所述遥控终端获取所述第一镜头和第二镜头的图传画面,在所述遥控终端的交互界面上显示所述第一镜头获取的第一图传画面;Acquiring the image transmission images of the first lens and the second lens through the remote control terminal, and displaying the first image transmission image acquired by the first lens on the interactive interface of the remote control terminal;
获取到第一用户指令,其中,所述第一用户指令用于指示所述第一图传画面中待标定的目标对象;Acquiring a first user instruction, where the first user instruction is used to instruct the target object to be calibrated in the first image transmission screen;
获取所述目标对象在所述第一图传画面的第一位置信息;Acquiring first position information of the target object on the first image transmission screen;
根据所述第一位置信息,在所述第一图传画面上对所述目标对象进行标注;Mark the target object on the first image transmission screen according to the first location information;
根据所述第一位置信息、所述第一镜头与所述第二镜头之间的相对位置关系、所述第一镜头的拍摄参数以及所述第二镜头的拍摄参数,确定所述目标对象在所述第二镜头获取的第二图传画面中的第二位置信息。According to the first position information, the relative positional relationship between the first lens and the second lens, the shooting parameters of the first lens, and the shooting parameters of the second lens, it is determined that the target object is The second position information in the second video transmission picture acquired by the second lens.
第二方面,本申请实施例提供一种目标标定装置,所述目标标定装置设于遥控终端,所述遥控终端与一可移动平台通信,所述可移动平台包括第一镜头和第二镜头,所述装置包括:In a second aspect, an embodiment of the present application provides a target calibration device, the target calibration device is provided in a remote control terminal, the remote control terminal communicates with a movable platform, and the movable platform includes a first lens and a second lens, The device includes:
存储装置,用于存储程序指令;以及Storage device for storing program instructions; and
一个或多个处理器,调用所述存储装置中存储的程序指令,当所述程序指令被执行时,所述一个或多个处理器单独地或共同地被配置成用于实施如下操作:One or more processors call program instructions stored in the storage device, and when the program instructions are executed, the one or more processors are individually or collectively configured to implement the following operations:
通过所述遥控终端获取所述第一镜头和第二镜头的图传画面,在所述遥控终端的 交互界面上显示所述第一镜头获取的第一图传画面;Acquiring the image transmission images of the first lens and the second lens through the remote control terminal, and displaying the first image transmission image acquired by the first lens on the interactive interface of the remote control terminal;
获取到第一用户指令,其中,所述第一用户指令用于指示所述第一图传画面中待标定的目标对象;Acquiring a first user instruction, where the first user instruction is used to instruct the target object to be calibrated in the first image transmission screen;
获取所述目标对象在所述第一图传画面的第一位置信息;Acquiring first position information of the target object on the first image transmission screen;
根据所述第一位置信息,在所述第一图传画面上对所述目标对象进行标注;Mark the target object on the first image transmission screen according to the first location information;
根据所述第一位置信息、所述第一镜头与所述第二镜头之间的相对位置关系、所述第一镜头的拍摄参数以及所述第二镜头的拍摄参数,确定所述目标对象在所述第二镜头获取的第二图传画面中的第二位置信息。According to the first position information, the relative positional relationship between the first lens and the second lens, the shooting parameters of the first lens, and the shooting parameters of the second lens, it is determined that the target object is The second position information in the second video transmission picture acquired by the second lens.
第三方面,本申请实施例提供一种遥控终端,所述遥控终端与一可移动平台通信,所述可移动平台包括第一镜头和第二镜头,所述遥控终端包括:In a third aspect, an embodiment of the present application provides a remote control terminal, the remote control terminal communicates with a movable platform, the movable platform includes a first lens and a second lens, and the remote control terminal includes:
主体;和Subject; and
目标标定装置,由所述主体支撑;The target calibration device is supported by the main body;
其中,所述目标标定装置包括:Wherein, the target calibration device includes:
存储装置,用于存储程序指令;以及Storage device for storing program instructions; and
一个或多个处理器,调用所述存储装置中存储的程序指令,当所述程序指令被执行时,所述一个或多个处理器单独地或共同地被配置成用于实施如下操作:One or more processors call program instructions stored in the storage device, and when the program instructions are executed, the one or more processors are individually or collectively configured to implement the following operations:
通过所述遥控终端获取所述第一镜头和第二镜头的图传画面,在所述遥控终端的交互界面上显示所述第一镜头获取的第一图传画面;Acquiring the image transmission images of the first lens and the second lens through the remote control terminal, and displaying the first image transmission image acquired by the first lens on the interactive interface of the remote control terminal;
获取到第一用户指令,其中,所述第一用户指令用于指示所述第一图传画面中待标定的目标对象;Acquiring a first user instruction, where the first user instruction is used to instruct the target object to be calibrated in the first image transmission screen;
获取所述目标对象在所述第一图传画面的第一位置信息;Acquiring first position information of the target object on the first image transmission screen;
根据所述第一位置信息,在所述第一图传画面上对所述目标对象进行标注;Mark the target object on the first image transmission screen according to the first location information;
根据所述第一位置信息、所述第一镜头与所述第二镜头之间的相对位置关系、所述第一镜头的拍摄参数以及所述第二镜头的拍摄参数,确定所述目标对象在所述第二镜头获取的第二图传画面中的第二位置信息。According to the first position information, the relative positional relationship between the first lens and the second lens, the shooting parameters of the first lens, and the shooting parameters of the second lens, it is determined that the target object is The second position information in the second video transmission picture acquired by the second lens.
第四方面本申请实施例提供一种目标标定系统,包括:In a fourth aspect, the embodiments of the present application provide a target calibration system, including:
遥控终端,所述遥控终端包括主体和目标标定装置,所述目标标定装置由所述主体支撑;和A remote control terminal, the remote control terminal including a main body and a target calibration device, the target calibration device being supported by the main body; and
可移动平台,与所述遥控终端通信,所述可移动平台包括第一镜头和第二镜头;A movable platform, communicating with the remote control terminal, the movable platform including a first lens and a second lens;
其中,所述目标标定装置包括:Wherein, the target calibration device includes:
存储装置,用于存储程序指令;以及Storage device for storing program instructions; and
一个或多个处理器,调用所述存储装置中存储的程序指令,当所述程序指令被执行时,所述一个或多个处理器单独地或共同地被配置成用于实施如下操作:One or more processors call program instructions stored in the storage device, and when the program instructions are executed, the one or more processors are individually or collectively configured to implement the following operations:
通过所述遥控终端获取所述第一镜头和第二镜头的图传画面,在所述遥控终端的交互界面上显示所述第一镜头获取的第一图传画面;Acquiring the image transmission images of the first lens and the second lens through the remote control terminal, and displaying the first image transmission image acquired by the first lens on the interactive interface of the remote control terminal;
获取到第一用户指令,其中,所述第一用户指令用于指示所述第一图传画面中待标定的目标对象;Acquiring a first user instruction, where the first user instruction is used to instruct the target object to be calibrated in the first image transmission screen;
获取所述目标对象在所述第一图传画面的第一位置信息;Acquiring first position information of the target object on the first image transmission screen;
根据所述第一位置信息,在所述第一图传画面上对所述目标对象进行标注;Mark the target object on the first image transmission screen according to the first location information;
根据所述第一位置信息、所述第一镜头与所述第二镜头之间的相对位置关系、所述第一镜头的拍摄参数以及所述第二镜头的拍摄参数,确定所述目标对象在所述第二镜头获取的第二图传画面中的第二位置信息。According to the first position information, the relative positional relationship between the first lens and the second lens, the shooting parameters of the first lens, and the shooting parameters of the second lens, it is determined that the target object is The second position information in the second video transmission picture acquired by the second lens.
第五方面,本申请实施例提供一种计算机可读存储介质,其上存储有计算机程序,该程序被处理器执行时实现如下步骤:In a fifth aspect, an embodiment of the present application provides a computer-readable storage medium on which a computer program is stored, and when the program is executed by a processor, the following steps are implemented:
通过所述遥控终端获取所述第一镜头和第二镜头的图传画面,在所述遥控终端的交互界面上显示所述第一镜头获取的第一图传画面;Acquiring the image transmission images of the first lens and the second lens through the remote control terminal, and displaying the first image transmission image acquired by the first lens on the interactive interface of the remote control terminal;
获取到第一用户指令,其中,所述第一用户指令用于指示所述第一图传画面中待标定的目标对象;Acquiring a first user instruction, where the first user instruction is used to instruct the target object to be calibrated in the first image transmission screen;
获取所述目标对象在所述第一图传画面的第一位置信息;Acquiring first position information of the target object on the first image transmission screen;
根据所述第一位置信息,在所述第一图传画面上对所述目标对象进行标注;Mark the target object on the first image transmission screen according to the first location information;
根据所述第一位置信息、所述第一镜头与所述第二镜头之间的相对位置关系、所述第一镜头的拍摄参数以及所述第二镜头的拍摄参数,确定所述目标对象在所述第二镜头获取的第二图传画面中的第二位置信息。According to the first position information, the relative positional relationship between the first lens and the second lens, the shooting parameters of the first lens, and the shooting parameters of the second lens, it is determined that the target object is The second position information in the second video transmission picture acquired by the second lens.
第六方面,本申请实施例提供一种目标标定方法,适用于一遥控终端,所述遥控终端与一可移动平台通信,所述可移动平台上搭载有拍摄装置,所述方法包括:In a sixth aspect, an embodiment of the present application provides a target calibration method, which is applicable to a remote control terminal that communicates with a movable platform on which a camera is mounted, and the method includes:
在所述遥控终端的交互界面上显示所述拍摄装置获取的图传画面;Displaying the image transmission screen acquired by the photographing device on the interactive interface of the remote control terminal;
获取到第一用户指令,其中,所述第一用户指令用于指示对所述图传画面中待标定的目标对象和所述目标对象进行定位的定位策略;Acquiring a first user instruction, where the first user instruction is used to instruct the target object to be calibrated in the image transmission screen and a positioning strategy for positioning the target object;
根据所述定位策略,从所述可移动平台获取所述目标对象的位置信息,所述位置信息包含所述目标对象相对所述可移动平台的距离;Obtaining the position information of the target object from the movable platform according to the positioning strategy, where the position information includes the distance of the target object relative to the movable platform;
根据所述位置信息,在所述图传画面上对所述目标对象进行标注。。According to the location information, the target object is marked on the image transmission screen. .
第七方面,本申请实施例提供一种目标标定装置,所述目标标定装置设于遥控终端,所述遥控终端与一可移动平台通信,所述可移动平台上搭载有拍摄装置,所述装置包括:In a seventh aspect, an embodiment of the present application provides a target calibration device, the target calibration device is provided in a remote control terminal, the remote control terminal communicates with a movable platform, the movable platform is equipped with a camera, the device include:
存储装置,用于存储程序指令;以及Storage device for storing program instructions; and
一个或多个处理器,调用所述存储装置中存储的程序指令,当所述程序指令被执行时,所述一个或多个处理器单独地或共同地被配置成用于实施如下操作:One or more processors call program instructions stored in the storage device, and when the program instructions are executed, the one or more processors are individually or collectively configured to implement the following operations:
在所述遥控终端的交互界面上显示所述拍摄装置获取的图传画面;Displaying the image transmission screen acquired by the photographing device on the interactive interface of the remote control terminal;
获取到第一用户指令,其中,所述第一用户指令用于指示对所述图传画面中待标定的目标对象和所述目标对象进行定位的定位策略;Acquiring a first user instruction, where the first user instruction is used to instruct the target object to be calibrated in the image transmission screen and a positioning strategy for positioning the target object;
根据所述定位策略,从所述可移动平台获取所述目标对象的位置信息,所述位置信息包含所述目标对象相对所述可移动平台的距离;Obtaining the position information of the target object from the movable platform according to the positioning strategy, where the position information includes the distance of the target object relative to the movable platform;
根据所述位置信息,在所述图传画面上对所述目标对象进行标注。According to the location information, the target object is marked on the image transmission screen.
第八方面,本申请实施例提供一种遥控终端,所述遥控终端与一可移动平台通信,所述可移动平台上搭载有拍摄装置,所述遥控终端包括:In an eighth aspect, an embodiment of the present application provides a remote control terminal, the remote control terminal communicates with a movable platform, the movable platform is equipped with a photographing device, and the remote control terminal includes:
主体;和Subject; and
目标标定装置,由所述主体支撑;The target calibration device is supported by the main body;
其中,所述目标标定装置包括:Wherein, the target calibration device includes:
存储装置,用于存储程序指令;以及Storage device for storing program instructions; and
一个或多个处理器,调用所述存储装置中存储的程序指令,当所述程序指令被执行时,所述一个或多个处理器单独地或共同地被配置成用于实施如下操作:One or more processors call program instructions stored in the storage device, and when the program instructions are executed, the one or more processors are individually or collectively configured to implement the following operations:
在所述遥控终端的交互界面上显示所述拍摄装置获取的图传画面;Displaying the image transmission screen acquired by the photographing device on the interactive interface of the remote control terminal;
获取到第一用户指令,其中,所述第一用户指令用于指示对所述图传画面中待标定的目标对象和所述目标对象进行定位的定位策略;Acquiring a first user instruction, where the first user instruction is used to instruct the target object to be calibrated in the image transmission screen and a positioning strategy for positioning the target object;
根据所述定位策略,从所述可移动平台获取所述目标对象的位置信息,所述位置信息包含所述目标对象相对所述可移动平台的距离;Obtaining the position information of the target object from the movable platform according to the positioning strategy, where the position information includes the distance of the target object relative to the movable platform;
根据所述位置信息,在所述图传画面上对所述目标对象进行标注。According to the location information, the target object is marked on the image transmission screen.
第九方面本申请实施例提供一种目标标定系统,包括:In a ninth aspect, an embodiment of the present application provides a target calibration system, including:
遥控终端,所述遥控终端包括主体和目标标定装置,所述目标标定装置,由所述主体支撑;和A remote control terminal, the remote control terminal comprising a main body and a target calibration device, the target calibration device being supported by the main body; and
可移动平台,与所述遥控终端通信,所述可移动平台上搭载有拍摄装置;A movable platform that communicates with the remote control terminal, and a camera is mounted on the movable platform;
其中,所述目标标定装置包括:Wherein, the target calibration device includes:
存储装置,用于存储程序指令;以及Storage device for storing program instructions; and
一个或多个处理器,调用所述存储装置中存储的程序指令,当所述程序指令被执行时,所述一个或多个处理器单独地或共同地被配置成用于实施如下操作:One or more processors call program instructions stored in the storage device, and when the program instructions are executed, the one or more processors are individually or collectively configured to implement the following operations:
在所述遥控终端的交互界面上显示所述拍摄装置获取的图传画面;Displaying the image transmission screen acquired by the photographing device on the interactive interface of the remote control terminal;
获取到第一用户指令,其中,所述第一用户指令用于指示对所述图传画面中待标定的目标对象和所述目标对象进行定位的定位策略;Acquiring a first user instruction, where the first user instruction is used to instruct the target object to be calibrated in the image transmission screen and a positioning strategy for positioning the target object;
根据所述定位策略,从所述可移动平台获取所述目标对象的位置信息,所述位置信息包含所述目标对象相对所述可移动平台的距离;Obtaining the position information of the target object from the movable platform according to the positioning strategy, where the position information includes the distance of the target object relative to the movable platform;
根据所述位置信息,在所述图传画面上对所述目标对象进行标注。According to the location information, the target object is marked on the image transmission screen.
第十方面,本申请实施例提供一种计算机可读存储介质,其上存储有计算机程序,该程序被处理器执行时实现如下步骤:In a tenth aspect, an embodiment of the present application provides a computer-readable storage medium on which a computer program is stored, and when the program is executed by a processor, the following steps are implemented:
在所述遥控终端的交互界面上显示所述拍摄装置获取的图传画面;Displaying the image transmission screen acquired by the photographing device on the interactive interface of the remote control terminal;
获取到第一用户指令,其中,所述第一用户指令用于指示对所述图传画面中待标定的目标对象和所述目标对象进行定位的定位策略;Acquiring a first user instruction, where the first user instruction is used to instruct the target object to be calibrated in the image transmission screen and a positioning strategy for positioning the target object;
根据所述定位策略,从所述可移动平台获取所述目标对象的位置信息,所述位置信息包含所述目标对象相对所述可移动平台的距离;Obtaining the position information of the target object from the movable platform according to the positioning strategy, where the position information includes the distance of the target object relative to the movable platform;
根据所述位置信息,在所述图传画面上对所述目标对象进行标注。According to the location information, the target object is marked on the image transmission screen.
根据本申请实施例提供的技术方案,根据目标对象在第一图传画面的第一位置信息、第一镜头与第二镜头之间的相对位置关系、第一镜头的拍摄参数以及第二镜头的拍摄参数,即可得到该目标对象在第二图传画面中的第二位置信息,如此便可以根据第二位置信息,将在第一图传画面上标注的目标对象共享给第二图传画面,实现了多镜头获取的图传画面之间目标标定结果的共享,有利于在多人协作控制可移动平台作业时减少沟通成本,并提高了协调作业效率。According to the technical solution provided by the embodiments of the present application, according to the first position information of the target object in the first image transmission screen, the relative positional relationship between the first lens and the second lens, the shooting parameters of the first lens, and the second lens Shooting parameters, you can get the second location information of the target object in the second image transmission screen, so that the target object marked on the first image transmission screen can be shared with the second image transmission screen based on the second location information , It realizes the sharing of target calibration results between the image transmission images acquired by multiple lenses, which is beneficial to reduce communication costs when multi-person collaborative control of the movable platform works, and improves the efficiency of coordinated operations.
附图说明Description of the drawings
为了更清楚地说明本申请实施例中的技术方案,下面将对实施例描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本申请的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动性的前提下,还可以根据这些附图获得其他的附图。In order to more clearly describe the technical solutions in the embodiments of the present application, the following will briefly introduce the drawings that need to be used in the description of the embodiments. Obviously, the drawings in the following description are only some embodiments of the present application. For those of ordinary skill in the art, other drawings can be obtained from these drawings without creative labor.
图1A是本申请一实施例中的目标标定方法的应用场景图;Fig. 1A is an application scenario diagram of a target calibration method in an embodiment of the present application;
图1B是本申请一实施例中的可移动平台的结构框图;FIG. 1B is a structural block diagram of a movable platform in an embodiment of the present application;
图2是本申请一实施例中的目标标定方法的方法流程示意图;2 is a schematic diagram of the method flow of the target calibration method in an embodiment of the present application;
图3A是本申请一实施例中的交互界面显示图传画面的示意图;3A is a schematic diagram of an interactive interface displaying a picture transmission screen in an embodiment of the present application;
图3B是本申请一实施例中的一种交互界面显示智能跟踪策略下的图传画面的示意图;3B is a schematic diagram of an interactive interface in an embodiment of the present application displaying an image transmission screen under an intelligent tracking strategy;
图4A是本申请一实施例中的一种交互界面显示打点定位策略下的图传画面的示意图;4A is a schematic diagram of an interactive interface in an embodiment of the present application displaying an image transmission screen under a dot positioning strategy;
图4B是本申请另一实施例中的交互界面显示第一图传画面对应的地图的示意图;4B is a schematic diagram of an interactive interface in another embodiment of the present application displaying a map corresponding to the first image transmission screen;
图5是本申请另一实施例中的交互界面显示激光测距策略下的图传画面的示意图;FIG. 5 is a schematic diagram of an interactive interface in another embodiment of the present application displaying an image transmission screen under the laser ranging strategy;
图6是本申请一实施例中的飞行指引罗盘的示意图;Fig. 6 is a schematic diagram of a flight guidance compass in an embodiment of the present application;
图7是本申请一实施例中的目标标定装置的结构框图;Fig. 7 is a structural block diagram of a target calibration device in an embodiment of the present application;
图8是本申请另一实施例中的目标标定方法的方法流程示意图。FIG. 8 is a schematic diagram of the method flow of the target calibration method in another embodiment of the present application.
具体实施方式Detailed ways
目前,一些可移动平台具有多个镜头,现有软件仅支持用户对不同镜头获取的图传画面分别进行目标标定,且不同镜头获取的图传画面上的目标标定结果之间不能共享。示例性的,在多人协作控制可移动平台进行作业时,飞手1通过观看镜头1获取的图传画面进行作业,飞手2通过观看镜头2获取的图传画面进行作业,在作业过程中,飞手通常会对作业区域需要重点关注的目标进行标定,例如,飞手1通过镜头1获取的图传画面发现作业区域存在一大型障碍物,则可以在镜头1获取的图传画面上标定该大型障碍物,避免作业时碰撞。然而,飞手1在镜头1获取的图传画面标定的目标的信息无法共享到镜头2获取的图传画面上,飞手2也就没办法及时获得该大型障碍物的信息,故现有目标标定方式会导致用户间的沟通成本增加、作业效率降低。对于此,本申请根据目标对象在第一图传画面的第一位置信息、第一镜头与第二镜头之间的相对位置关系、第一镜头的拍摄参数以及第二镜头的拍摄参数,即可得到该目标对象在第二图传画面中的第二位置信息,如此便可以根据第二位置信息,将在第一图传画面上标注的目标对象共享给第二图传画面,实现了多镜头获取的图传画面之间目标标定结果的共享,有利于在多人协作控制可移动平台作业时减少沟通成本,并提高了协调作业效率。At present, some mobile platforms have multiple lenses, and the existing software only supports users to perform target calibration on the image transmission screens acquired by different lenses, and the target calibration results on the image transmission screens acquired by different lenses cannot be shared. Exemplarily, when multiple people cooperate to control a mobile platform to perform operations, pilot 1 performs operations by viewing the image transmission screen obtained by lens 1, and pilot 2 performs operations by viewing the image transmission screen obtained by lens 2. During the operation , Pilots usually calibrate the targets that need to be focused on in the operation area. For example, if pilot 1 finds a large obstacle in the operation area through the image transmission screen obtained by lens 1, he can calibrate on the image transmission screen obtained by lens 1. The large obstacle avoids collision during operation. However, the information of the target calibrated on the image transmission screen obtained by the pilot 1 on the lens 1 cannot be shared on the image transmission screen obtained by the lens 2, and the pilot 2 cannot obtain the information of the large obstacle in time, so the existing target The calibration method will increase the communication cost between users and reduce the operating efficiency. In this regard, the present application can be based on the first position information of the target object in the first image transmission screen, the relative position relationship between the first lens and the second lens, the shooting parameters of the first lens, and the shooting parameters of the second lens. Obtain the second location information of the target object in the second image transmission screen, so that the target object marked on the first image transmission screen can be shared with the second image transmission screen based on the second location information, realizing multi-camera The sharing of the target calibration results between the acquired image transmission screens is beneficial to reduce communication costs when multiple people collaborate to control the operation of the movable platform, and improve the efficiency of coordination operations.
另一方面,现有在进行目标标定时,获取的目标对象的位置信息大都基于可移动平台的导航检测获得,无法标定出精确的目标对象的位置。示例性的,目标对象为待抓捕的嫌疑犯,如无法标定出精确的嫌疑犯的位置,则会对抓捕过程造成极大地困扰。对于此,本申请在进行目标标定时,从可移动平台获取的目标对象的位置信息中包含目标对象相对可移动平台的距离,基于目标对象相对可移动平台的距离,可以实现对 目标对象的快速定位,在多人协作控制可移动平台作业时,可快速通知协调作业的伙伴到达目的地。On the other hand, during the current target calibration, most of the acquired position information of the target object is obtained based on the navigation detection of the movable platform, and it is impossible to calibrate the precise position of the target object. Exemplarily, the target object is a suspect to be arrested, and if the location of the suspect cannot be demarcated accurately, the arrest process will be greatly troubled. In this regard, when the application is performing target calibration, the position information of the target object obtained from the movable platform includes the distance of the target object relative to the movable platform. Based on the distance of the target object relative to the movable platform, the target object can be quickly calibrated. Positioning, when multiple people collaborate to control the work of the movable platform, it can quickly notify the partner of the coordinated work to arrive at the destination.
下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本申请一部分实施例,而不是全部的实施例。基于本申请中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本申请保护的范围。The technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in this application, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the protection scope of this application.
需要说明的是,在不冲突的情况下,下述的实施例及实施方式中的特征可以相互组合。It should be noted that, in the case of no conflict, the following embodiments and features in the implementation can be combined with each other.
请参见图1A,本申请实施例的目标标定方法适用于一遥控终端,该遥控终端与一可移动平台通信。本申请实施例的遥控终端可以为可移动平台的遥控器、智能终端(如手机、平板电脑等)或其他能够遥控可移动平台的终端设备。本申请实施例的可移动平台可以为无人机,也可以为无人车或地面移动机器人;当然,本申请实施例的可移动平台还可以为其他类型的可移动平台,如有人飞行器。Referring to FIG. 1A, the target calibration method of the embodiment of the present application is applicable to a remote control terminal that communicates with a movable platform. The remote control terminal of the embodiment of the present application may be a remote control of a movable platform, a smart terminal (such as a mobile phone, a tablet computer, etc.), or other terminal equipment capable of remotely controlling the movable platform. The movable platform in the embodiment of the present application may be a drone, an unmanned vehicle or a ground mobile robot; of course, the movable platform in the embodiment of the present application may also be other types of movable platforms, such as a manned aircraft.
请参见图1B,在一些实施例中,可移动平台包括第一镜头和第二镜头。Referring to FIG. 1B, in some embodiments, the movable platform includes a first lens and a second lens.
示例性的,在一些实施例中,可移动平台包括一个拍摄装置,该拍摄装置包括多个镜头,第一镜头为拍摄装置包括的多个镜头中的一个,第二镜头包括拍摄装置包括的多个镜头中的其他镜头。在一些实施例中,可移动平台包括多个拍摄装置,第一镜头为其中一个拍摄装置的镜头,第二镜头包括其他拍摄装置的镜头。可选的,多个拍摄装置包括第一人称视角FPV(First Person View)相机。Exemplarily, in some embodiments, the movable platform includes a photographing device including multiple lenses, the first lens is one of the multiple lenses included in the photographing device, and the second lens includes multiple lenses included in the photographing device. The other shots of the shots. In some embodiments, the movable platform includes a plurality of photographing devices, the first lens is a lens of one of the photographing devices, and the second lens includes a lens of other photographing devices. Optionally, the multiple shooting devices include a FPV (First Person View) camera.
其中,在一些实施例中,拍摄装置通过云台搭载在可移动平台的机体上;在一些实施例中,拍摄装置直接固定在可移动平台的机体上。Among them, in some embodiments, the camera is mounted on the body of the movable platform via a pan-tilt; in some embodiments, the camera is directly fixed on the body of the movable platform.
示例性的,在一些实施例中,拍摄装置包括双光镜头,如广角镜头和变焦镜头,可选地,第一镜头为广角镜头和变焦镜头中的一个,第二镜头为广角镜头和变焦镜头中的另一个。在一些实施例中,拍摄装置包括三光镜头,如广角镜头、变焦镜头和红外镜头,可选的,第一镜头为变焦镜头、广角镜头和红外镜头中的一个,第二镜头包括变焦镜头、广角镜头和红外镜头中的其他镜头。在一些实施例中,可移动平台包括FPV相机以及第一拍摄装置,第一拍摄装置包括上述双光镜头和/或三光镜头的拍摄装置。可选的,第一镜头为FPV相机的镜头和第一拍摄装置的镜头中的一个,第二镜头包括FPV相机的镜头和第一拍摄装置的镜头中的其他镜头。Exemplarily, in some embodiments, the photographing device includes a dual-lens lens, such as a wide-angle lens and a zoom lens. Optionally, the first lens is one of a wide-angle lens and a zoom lens, and the second lens is the other of a wide-angle lens and a zoom lens. one. In some embodiments, the photographing device includes a three-lens lens, such as a wide-angle lens, a zoom lens, and an infrared lens. Optionally, the first lens is one of a zoom lens, a wide-angle lens, and an infrared lens, and the second lens includes a zoom lens, a wide-angle lens, and an infrared lens. The other shots in the shot. In some embodiments, the movable platform includes an FPV camera and a first imaging device, and the first imaging device includes the above-mentioned dual-lens and/or triple-lens imaging device. Optionally, the first lens is one of the lens of the FPV camera and the lens of the first photographing device, and the second lens includes the lens of the FPV camera and the other lens of the lens of the first photographing device.
实施例一Example one
图2是本申请一实施例中的目标标定方法的方法流程示意图;本申请实施例的目标标定方法的执行主体为遥控终端。请参见图2,本申请实施例的目标标定方法可以包括S201~S205。2 is a schematic diagram of the method flow of the target calibration method in an embodiment of the present application; the execution subject of the target calibration method in the embodiment of the present application is a remote control terminal. Referring to FIG. 2, the target calibration method in the embodiment of the present application may include S201 to S205.
其中,在S201中、通过遥控终端获取第一镜头和第二镜头的图传画面,在遥控终端的交互界面上显示第一镜头获取的第一图传画面。Wherein, in S201, the image transmission images of the first lens and the second lens are acquired through the remote control terminal, and the first image transmission image acquired by the first lens is displayed on the interactive interface of the remote control terminal.
本申请实施例中,可移动平台在运行过程中,会将第一镜头和第二镜头获取的图传画面回传给遥控终端。In the embodiment of the present application, during the operation of the movable platform, the image transmission screen obtained by the first lens and the second lens will be transmitted back to the remote control terminal.
交互界面上显示有第一镜头对应的标识以及第二镜头对应的标识,用户可以通过操作(如单击、双击或长按等点击操作)各镜头对应的标识来选择第一镜头和第二镜头的图传画面中的一幅图传画面显示在交互界面上。示例性的,请参见图3A,第一镜头为变焦镜头,第二镜头包括红外镜头、广角镜头和FPV镜头,变焦镜头对应第一标识11,红外镜头对应第二标识12,广角镜头对应第三标识13,FPV相机的镜头对应第四标识14。用户可以点击第一标识11、第二标识12、第三标识13和第四标识14中的一个,使得交互界面上显示当前被点击的标识对应的镜头的图传画面。如图3A中,用户点击第一标识11,交互界面上显示变焦镜头对应的图传画面。The logo corresponding to the first lens and the logo corresponding to the second lens are displayed on the interactive interface. The user can select the first lens and the second lens by operating the logo corresponding to each lens (such as clicking, double-clicking, or long-pressing) One of the image transmission screens is displayed on the interactive interface. For example, please refer to Figure 3A, the first lens is a zoom lens, the second lens includes an infrared lens, a wide-angle lens, and an FPV lens. The zoom lens corresponds to the first logo 11, the infrared lens corresponds to the second logo 12, and the wide-angle lens corresponds to the third logo 13. , The lens of the FPV camera corresponds to the fourth mark 14. The user can click on one of the first logo 11, the second logo 12, the third logo 13, and the fourth logo 14, so that the image transmission screen of the lens corresponding to the currently clicked logo is displayed on the interactive interface. As shown in Fig. 3A, the user clicks on the first sign 11, and the image transmission screen corresponding to the zoom lens is displayed on the interactive interface.
在S202中、获取到第一用户指令,其中,第一用户指令用于指示第一图传画面中待标定的目标对象。In S202, a first user instruction is acquired, where the first user instruction is used to instruct the target object to be calibrated in the first image transmission screen.
本申请实施例中,第一用户指令还用于指示对待标定的目标对象(以下简称目标对象)进行定位的定位策略,遥控终端根据该定位策略从可移动平台获取目标对象的位置信息(即下述第三位置信息)以对目标对象进行标定。本申请实施例中,遥控终端从可移动平台获取该可移动平台根据第一用户指令中的定位策略对目标对象进行定位获得的第三位置信息。需要说明的是,本申请实施例中,第三位置信息可以用于指示目标对象在世界坐标系中的位置,也可以用于指示目标对象在图像坐标系中的位置,或者用于指示目标对象在其他坐标系中的位置。In the embodiment of the present application, the first user instruction is also used to instruct a positioning strategy for positioning the target object to be calibrated (hereinafter referred to as the target object), and the remote control terminal obtains the position information of the target object from the movable platform according to the positioning strategy (ie, the following Said third position information) to calibrate the target object. In the embodiment of the present application, the remote control terminal obtains the third position information obtained by positioning the target object by the movable platform according to the positioning strategy in the first user instruction from the movable platform. It should be noted that in this embodiment of the application, the third position information can be used to indicate the position of the target object in the world coordinate system, or it can be used to indicate the position of the target object in the image coordinate system, or to indicate the target object. Position in other coordinate systems.
示例性的,第三位置信息包括目标对象的经纬度和高度中的至少一种;当然,第三位置信息也可以包括其他,如目标对象相对可移动平台的距离。示例性的,第三位置信息为根据可移动平台的位置信息和目标对象相对可移动平台的距离确定,可选的,第三位置信息包括目标对象的相对位置信息和/或绝对位置信息,相对位置信息和绝对位置信息均为根据可移动平台的位置信息和目标对象相对可移动平台的距离确定。Exemplarily, the third position information includes at least one of the latitude, longitude and height of the target object; of course, the third position information may also include others, such as the distance of the target object relative to the movable platform. Exemplarily, the third position information is determined according to the position information of the movable platform and the distance of the target object relative to the movable platform. Optionally, the third position information includes relative position information and/or absolute position information of the target object. Both the position information and the absolute position information are determined according to the position information of the movable platform and the distance of the target object relative to the movable platform.
定位策略可以包括一个或多个,示例性的,定位策略包括智能跟踪策略(也可以称为Smart track)、打点定位策略(也可以称为PIN Point)和激光测距策略(也可以称为Range)中的至少一种;当然,定位策略还可以包括其他。需要说明的是,定位策略包括多个时,各个定位策略之间是相互独立的。The positioning strategy may include one or more. For example, the positioning strategy includes smart tracking strategy (also called Smarttrack), dot positioning strategy (also called PIN Point) and laser ranging strategy (also called Range). ); Of course, the positioning strategy can also include others. It should be noted that when there are multiple positioning strategies, each positioning strategy is independent of each other.
示例性的,定位策略包括智能跟踪策略、打点定位策略和激光测距策略。其中,可移动平台可以通过导航和/或激光测距装置对目标对象进行定位。导航可以为GPS,也可以为其他。不同的定位策略,从可移动平台获取的第三位置信息可能不同,例如,对于智能跟踪策略,第三位置信息可以包括目标对象的经纬度和/或高度,或者目标对 象在图像坐标系中的位置信息;对于打点定位策略,第三位置信息可以包括目标对象的经纬度和/或高度和/或目标对象相对可移动平台的距离;对于激光测距策略,第三位置信息可以包括目标对象的经纬度和/或高度和/或目标对象相对可移动平台的距离。Exemplarily, the positioning strategy includes an intelligent tracking strategy, a dot positioning strategy, and a laser ranging strategy. Among them, the movable platform can locate the target object through a navigation and/or laser ranging device. Navigation can be GPS or other. The third location information obtained from the mobile platform may be different for different positioning strategies. For example, for smart tracking strategies, the third location information may include the latitude, longitude and/or height of the target object, or the position of the target object in the image coordinate system. Information; for the dot positioning strategy, the third position information may include the latitude, longitude and/or height of the target object and/or the distance of the target object relative to the movable platform; for the laser ranging strategy, the third position information may include the latitude, longitude and/or distance of the target object / Or the height and / or the distance of the target object relative to the movable platform.
交互界面显示有各定位策略对应的标识,用户可以操作(如单击、双击或长按等点击操作)各定位策略对应的标识来选择对应的定位策略。示例性的,请参见图3A,交互界面显示有智能跟踪策略对应的第五标识21、打点定位策略对应的第六标识22和激光测距策略对应的第七标识23。在进行目标标定时,同一时刻,用户可以操作第五标识21、第六标识22和第七标识23中的一个,使得当前被操作的标识对应的定位策略处于触发状态,遥控终端会根据当前处于触发状态的定位标识从可移动平台获取第三位置信息。The interactive interface displays the identification corresponding to each positioning strategy, and the user can operate (such as clicking, double-clicking, or long-pressing, etc.) the identification corresponding to each positioning strategy to select the corresponding positioning strategy. Exemplarily, referring to FIG. 3A, the interactive interface displays a fifth indicator 21 corresponding to the smart tracking strategy, a sixth indicator 22 corresponding to the dot positioning strategy, and a seventh indicator 23 corresponding to the laser ranging strategy. During target calibration, the user can operate one of the fifth identifier 21, the sixth identifier 22, and the seventh identifier 23 at the same time, so that the positioning strategy corresponding to the currently operated identifier is in the trigger state, and the remote control terminal will be based on the current status The positioning identifier in the triggered state obtains the third position information from the movable platform.
可选的,定位策略可以默认为智能跟踪策略、打点定位策略和激光测距策略中的一个,在需要切换定位策略时,通过操作对应的标识即可。Optionally, the positioning strategy can default to one of an intelligent tracking strategy, a dot positioning strategy, and a laser ranging strategy. When the positioning strategy needs to be switched, the corresponding identification can be operated.
第一用户指令可以为用户点击或框选第一图传画面中的物体时生成,或者第一用户指令也可以为用户点击定位策略对应的标识时生成。例如,在一些实施例中,第一用户指令为用户点击或框选第一图传画面中的物体时生成,这适用于定位策略为默认定位策略的使用场景。示例性的,定位策略为默认的智能跟踪策略,可以通过可移动平台的控制装置对第一图传画面中的物体(如人、车、船等物体)进行识别,交互界面上会标识出控制装置的识别结果(如图3A中的第一物体31、第二物体32和第三物体33),第一用户指令为用户点击上述识别结果对应的物体时生成。点击包括单击和双击中的一种,也可以包括其他。示例性的,请再次参见图3A,当用户点击第二物体32时,目标对象即为第二物体32。The first user instruction may be generated when the user clicks or box-selects an object in the first image transmission screen, or the first user instruction may also be generated when the user clicks the logo corresponding to the positioning strategy. For example, in some embodiments, the first user instruction is generated when the user clicks or box selects an object in the first image transmission screen, which is suitable for use scenarios where the positioning strategy is the default positioning strategy. Exemplarily, the positioning strategy is the default intelligent tracking strategy. The objects in the first image transmission screen (such as people, cars, boats, etc.) can be identified through the control device of the movable platform, and the control will be marked on the interactive interface. For the recognition results of the device (the first object 31, the second object 32, and the third object 33 in FIG. 3A), the first user instruction is generated when the user clicks the object corresponding to the recognition result. Click includes one of single click and double click, and can also include the other. Exemplarily, please refer to FIG. 3A again. When the user clicks on the second object 32, the target object is the second object 32.
在一些实施例中,第一用户指令为用户点击第一图传画面上显示的定位策略对应的标识时生成。可选的,第一用户指令为用户点击第一图传画面上显示的打点定位策略对应的标识时生成,或者第一用户指令为用户点击第一图传画面上显示的激光测距策略对应的标识时生成。In some embodiments, the first user instruction is generated when the user clicks the logo corresponding to the positioning strategy displayed on the first image transmission screen. Optionally, the first user instruction is generated when the user clicks the mark corresponding to the dot positioning strategy displayed on the first image transmission screen, or the first user instruction is generated when the user clicks the laser ranging strategy displayed on the first image transmission screen Generated when marking.
在S203中、获取目标对象在第一图传画面的第一位置信息。In S203, first position information of the target object on the first image transmission screen is acquired.
示例性的,第一位置信息为目标对象在第一图传画面的像素坐标。Exemplarily, the first location information is the pixel coordinates of the target object on the first image transmission screen.
其中,目标对象在第一图传画面的第一位置信息可以采用现有图像识别算法获取,本申请实施例对此不作说明。Wherein, the first position information of the target object on the first image transmission screen can be obtained by using an existing image recognition algorithm, which is not described in the embodiment of the present application.
示例性的,在一些实施例中,定位策略为智能跟踪策略,可选的,在获取到第一用户指令之后,获取目标对象在第一图传画面的第一位置信息之前,发送第一指示信息至可移动平台。本实施例中,第一指示信息用于指示可移动平台调整第一镜头的姿态,使得第一图传画面中的目标对象移动至第一图传画面的第一特定位置处,本实施例的第一位置信息为第一特定位置的位置信息。示例性的,第一特定位置包括第一图 传画面的中心位置;当然,第一特定位置也可以为第一图传画面的其他位置。Exemplarily, in some embodiments, the positioning strategy is an intelligent tracking strategy. Optionally, after obtaining the first user instruction, before obtaining the first position information of the target object in the first image transmission screen, the first instruction is sent Information to a mobile platform. In this embodiment, the first indication information is used to instruct the movable platform to adjust the posture of the first lens, so that the target object in the first image transmission screen moves to the first specific position of the first image transmission screen. The first location information is location information of the first specific location. Exemplarily, the first specific position includes the center position of the first video transmission screen; of course, the first specific position may also be other positions of the first video transmission screen.
示例性的,可移动平台在接收到第一指示信息后,通过控制装置控制拍摄装置,调整拍摄装置的姿态,从而调整第一镜头的姿态。示例性的,控制装置可以调整拍摄装置偏航姿态、俯仰姿态和横滚姿态中的至少一个,以达到调整拍摄装置的姿态的目的。Exemplarily, after receiving the first instruction information, the movable platform controls the shooting device through the control device to adjust the posture of the shooting device, thereby adjusting the posture of the first lens. Exemplarily, the control device may adjust at least one of the yaw attitude, pitch attitude, and roll attitude of the camera to achieve the purpose of adjusting the attitude of the camera.
示例性的,拍摄装置通过云台搭载在可移动平台上,可以通过调整云台的姿态来实现对拍摄装置的姿态的调整。Exemplarily, the camera is mounted on a movable platform through a pan-tilt, and the attitude of the camera can be adjusted by adjusting the attitude of the pan-tilt.
进一步可选的,第一指示信息还用于指示可移动平台调整第一镜头的拍摄参数,使得第一图传画面中的目标对象在第一图传画面中的尺寸为预设尺寸,便于用户观察目标对象。其中,预设尺寸的大小可以根据需要设置。示例性的,第一指示信息还用于指示可移动平台调整第一镜头的变焦倍数,使得目标对象在第一图传画面中的尺寸为预设尺寸。Further optionally, the first indication information is also used to instruct the movable platform to adjust the shooting parameters of the first lens, so that the size of the target object in the first image transmission screen in the first image transmission screen is a preset size, which is convenient for the user Observe the target object. Among them, the size of the preset size can be set as required. Exemplarily, the first indication information is also used to instruct the movable platform to adjust the zoom factor of the first lens, so that the size of the target object in the first image transmission screen is a preset size.
示例性的,请结合图3A和图3B,用户在图3A所示的第一图传画面中选中(可以通过单击或框选或其他操作方式)第二物体32作为目标对象,遥控终端会发送第一指示信息至可移动平台,可移动平台在接收到第一指示信息后,通过控制装置调整第一镜头的姿态,使得第二物体32移动至第一图传画面的中心,并通过控制装置调整第一镜头的变焦倍数,使得第二物体32放大预设倍数而使得目标对象在第一图传画面中的尺寸为预设尺寸,如图3B所示。用户仅需进行目标选中操作,用户便可清晰、直观、实时的观察目标对象,无需多余操作。Exemplarily, please combine FIGS. 3A and 3B. The user selects (by clicking or box selection or other operation methods) the second object 32 in the first image transmission screen shown in FIG. 3A as the target object, and the remote control terminal will Send the first instruction information to the movable platform. After receiving the first instruction information, the movable platform adjusts the posture of the first lens through the control device so that the second object 32 moves to the center of the first image transmission screen and controls The device adjusts the zoom factor of the first lens so that the second object 32 is enlarged by a preset factor so that the size of the target object in the first image transmission screen is the preset size, as shown in FIG. 3B. The user only needs to perform the target selection operation, and the user can observe the target object clearly, intuitively, and in real time without unnecessary operations.
智能跟踪策略可以获得的目标对象的实时位置信息,因此,智能跟踪策略比较适用于对移动的目标对象进行标定并追踪,如目标对象为嫌疑犯,通过智能跟踪策略可以实时获取嫌疑犯的位置,有利于抓捕行动。The intelligent tracking strategy can obtain the real-time location information of the target object. Therefore, the intelligent tracking strategy is more suitable for calibrating and tracking the moving target object. If the target object is a suspect, the location of the suspect can be obtained in real time through the intelligent tracking strategy The arrest operation.
需要说明的是,智能跟踪策略对应的第三位置信息可以包括目标对象的经纬度和高度,其中,目标对象的经纬度为根据可移动平台的经纬度和可移动平台的高度确定,目标对象的高度为根据可移动平台的高度确定。也即,智能跟踪策略对应的第三位置信息能够获得目标对象的相对位置。It should be noted that the third location information corresponding to the smart tracking strategy may include the latitude, longitude and height of the target object, where the latitude and longitude of the target object is determined according to the latitude and longitude of the movable platform and the height of the movable platform, and the height of the target object is based on The height of the movable platform is determined. That is, the third position information corresponding to the smart tracking strategy can obtain the relative position of the target object.
在一些实施例中,定位策略为打点定位策略,目标对象为第一图传画面的第二特定位置处的物体。示例性的,第二特定位置包括第一图传画面的中心位置;当然,第二特定位置也可以为第一图传画面的其他位置。In some embodiments, the positioning strategy is a dot positioning strategy, and the target object is an object at a second specific position on the first video transmission screen. Exemplarily, the second specific position includes the center position of the first image transmission screen; of course, the second specific position may also be other positions of the first image transmission screen.
在通过打点定位策略对目标对象进行定位之前,若第一图传画面中作为目标对象的物体当前不在第二特定位置,则需要将第一图传画面中作为目标对象的物体移动至第二特定位置;若第一图传画面中作为目标对象的物体当前处于第二特定位置,用户则可以直接操作打点定位策略对应的标识,从而选择打点定位策略作为标定目标使用的定位策略。Before locating the target object through the dot positioning strategy, if the object as the target object in the first image transmission screen is not currently in the second specific position, you need to move the object as the target object in the first image transmission image to the second specific position Position; if the object as the target object in the first image transmission screen is currently in the second specific position, the user can directly operate the mark corresponding to the dot positioning strategy to select the dot positioning strategy as the positioning strategy used for the calibration target.
其中,将第一图传画面中作为目标对象的物体移动至第二特定位置的策略可以包括但不限于如下两种:Among them, the strategy for moving the object that is the target object in the first image transmission screen to the second specific position may include, but is not limited to, the following two strategies:
(1)、在获取第三位置信息之前,输出第二指示信息。其中,第二指示信息用于指示用户通过可移动平台的控制装置调整第一镜头的位姿,以使得第一图传画面中的目标对象处于第二特定位置。(1) Before acquiring the third location information, output the second indication information. The second indication information is used to instruct the user to adjust the pose of the first lens through the control device of the movable platform, so that the target object in the first image transmission screen is at the second specific position.
需要说明的是,控制装置与遥控终端可以为同一装置,也可以为不同装置;示例性的,控制装置为可移动平台的遥控器,遥控终端为手机。It should be noted that the control device and the remote control terminal may be the same device or different devices; for example, the control device is a remote controller of a movable platform, and the remote control terminal is a mobile phone.
其中,用户可以通过操作控制装置来调整可移动平台的和拍摄装置的位姿中的至少一种,以调整第一镜头的位姿。如此,通过手动控制遥控器的摇杆以调整飞机位姿的方式实现将第一图传画面中的目标对象移动至第一图传画面的第二特定位置的目的。Wherein, the user can adjust at least one of the poses of the movable platform and the shooting device by operating the control device to adjust the pose of the first lens. In this way, the purpose of moving the target object in the first image transmission screen to the second specific position of the first image transmission screen can be achieved by manually controlling the joystick of the remote control to adjust the pose of the aircraft.
(2)、获取到第一用户指令之前,获取到第二用户指令,根据第二用户指令,发送第三指示信息至可移动平台。其中,第二用户指令用于指示第一图传画面中待移动至第二特定位置的物体,示例性的,第二用户指令为用户双击第一图传画面中待移动至第二特定位置的物体时产生;应当理解的,第二用户指令的产生方式也可以为其他。第三指示信息用于指示可移动平台自动调整第一镜头的位姿,使得待移动至第二特定位置的物体移动至第二特定位置处。需要说明的是,本申请中,可以通过对话框形式输出各种指示信息,也可以通过其他方式输出各种指示信息。(2) Before the first user instruction is acquired, the second user instruction is acquired, and the third instruction information is sent to the movable platform according to the second user instruction. Wherein, the second user instruction is used to instruct the object in the first image transmission screen to be moved to the second specific position. Exemplarily, the second user instruction is for the user to double-click the object to be moved to the second specific position in the first image transmission screen. It should be understood that the second user instruction can also be generated in other ways. The third indication information is used to instruct the movable platform to automatically adjust the pose of the first lens, so that the object to be moved to the second specific position moves to the second specific position. It should be noted that, in this application, various instruction information can be output in the form of a dialog box, or various instruction information can be output in other ways.
如此,通过自动方式实现将第一图传画面中的目标对象移动至第一图传画面的第二特定位置的目的。In this way, the purpose of moving the target object in the first image transmission screen to the second specific position of the first image transmission screen is realized in an automatic manner.
示例性的,请参见图4A,需要对第二物体32进行标定,即第二物体32为目标对象,第二物体32当前不在第一图传画面的中心位置,可以通过(1)或(2)的操作将第二物体32移动至第一图传画面的中心位置。并在第二物体32移动至第一图传画面的中心位置后,点击打点定位策略对应的标识,在第一图传画面的中心位置上打点,记录第二物体32的第三位置信息。示例的,可以采用增强现实AR(Augmented Reality)、动态或静态打点方式在第一图传画面的中兴位置打点。另外,可以在第一图传画面上打多个点。For example, referring to Fig. 4A, the second object 32 needs to be calibrated, that is, the second object 32 is the target object, and the second object 32 is not currently in the center position of the first image transmission screen. You can pass (1) or (2) ) Moves the second object 32 to the center position of the first image transmission screen. And after the second object 32 moves to the center position of the first image transmission screen, click the mark corresponding to the dot positioning strategy, dot the center position of the first image transmission screen, and record the third position information of the second object 32. For example, augmented reality (Augmented Reality), dynamic or static dot method may be used to dot the ZTE position of the first image transmission screen. In addition, you can click multiple dots on the first image transmission screen.
本实施例中,第三位置信息为根据可移动平台的位置信息和目标对象相对可移动平台的距离确定,如此,可以确定目标对象的相对位置和绝对位置,也即,第三位置信息可以包括目标对象的相对位置信息和绝对位置信息中的至少一种。需要说明的是,目标对象相对可移动平台的距离可以通过可移动平台的激光测距装置检测获得。In this embodiment, the third position information is determined according to the position information of the movable platform and the distance between the target object and the movable platform. In this way, the relative position and absolute position of the target object can be determined, that is, the third position information may include At least one of relative position information and absolute position information of the target object. It should be noted that the distance between the target object and the movable platform can be detected by the laser ranging device of the movable platform.
在一些实施例中,定位策略为激光测距策略,目标对象为第一图传画面的第四特定位置处的物体。示例性的,第四特定位置包括第一图传画面的中心位置;当然,第四特定位置也可以为第一图传画面的其他位置。In some embodiments, the positioning strategy is a laser ranging strategy, and the target object is an object at a fourth specific position on the first image transmission frame. Exemplarily, the fourth specific position includes the center position of the first image transmission screen; of course, the fourth specific position may also be other positions of the first image transmission screen.
示例性的,请参见图5,当激光测距策略对应的第七标识23被触发时,在第一图传画面的中心位置显示“正在标定”的标识,表示当前对准第一图传画面的中心位置处的目标对象,以获得目标对象相对可移动平台的距离以及目标对象的经纬度和高度。Exemplarily, please refer to Fig. 5. When the seventh mark 23 corresponding to the laser ranging strategy is triggered, the “calibrating” mark is displayed in the center of the first image transmission screen, indicating that it is currently aligned with the first image transmission screen. To obtain the distance of the target object relative to the movable platform and the latitude, longitude and height of the target object.
在S204中、根据第一位置信息,在第一图传画面上对目标对象进行标注。In S204, the target object is marked on the first image transmission screen according to the first location information.
如此,实现了在第一图传画面标定目标对象的目的。In this way, the goal of calibrating the target object on the first image transmission screen is achieved.
本申请实施例中,标注可以包括图标和目标对象的第三位置信息,但不限于此。In the embodiment of the present application, the annotation may include the icon and the third position information of the target object, but it is not limited to this.
本申请实施例中,在对目标对象进行标注时,图标显示在目标对象上,也即,图标的像素覆盖至少部分目标对象的像素。其中,图标可以包括图形、数字和符号中的至少一种,图标也可以包括其他。In the embodiment of the present application, when the target object is marked, the icon is displayed on the target object, that is, the pixels of the icon cover at least part of the pixels of the target object. The icon may include at least one of graphics, numbers, and symbols, and the icon may also include others.
示例性的,在一些实施例中,目标标定方法还可以包括:当目标对象上的图标处于触发状态时,在图标上显示第三位置信息。进一步的,在一些实施例中,目标标定方法还可以包括:当目标对象上的图标处于非触发状态时,隐藏第三位置信息。需要说明的是,当图标被操作时,图标处于触发状态;当图标未被操作时,图标处于非触发状态。其中,图标被操作可以包括图标被点击,如单击、双击或长按等点击操作。Exemplarily, in some embodiments, the target calibration method may further include: when the icon on the target object is in a triggered state, displaying third position information on the icon. Further, in some embodiments, the target calibration method may further include: hiding the third position information when the icon on the target object is in a non-triggered state. It should be noted that when the icon is operated, the icon is in a triggered state; when the icon is not operated, the icon is in a non-triggered state. Among them, the icon being operated may include the icon being clicked, such as clicking, double-clicking, or long-pressing.
可选的,在一些实施例中,同一定位策略不同目标对象对应的标注的图标不同,以对目标对象进行区分;在一些实施例中,同一定位策略不同目标对象对应的标注的图标相同。Optionally, in some embodiments, the labeled icons corresponding to different target objects of the same positioning strategy are different to distinguish the target objects; in some embodiments, the labeled icons corresponding to different target objects of the same positioning strategy are the same.
可选的,定位策略包括多个,在一些实施例中,不同定位策略对应的标注的图标不同,以区分目标对象的定位策略;在一些实施例中,不同定位策略对应的标注的图标相同。Optionally, there are multiple positioning strategies. In some embodiments, the labeled icons corresponding to different positioning strategies are different to distinguish the positioning strategies of the target object; in some embodiments, the labeled icons corresponding to different positioning strategies are the same.
示例性的,图标不同可以包括图标尺寸、图标形状、图标颜色中至少一个不同,图标相同是指图标尺寸、图标形状和图标颜色均相同。示例性的,采用智能跟踪策略在第一图传画面中标定了目标对象1和目标对象2,目标对象1对应的标注的图标为绿色的圆,目标对象2对应的标注的图标为绿色的方框。Exemplarily, the different icons may include at least one of different icon size, icon shape, and icon color. The same icon means that the icon size, icon shape, and icon color are all the same. Exemplarily, the smart tracking strategy is used to mark the target object 1 and the target object 2 in the first image transmission screen, the marked icon corresponding to the target object 1 is a green circle, and the marked icon corresponding to the target object 2 is a green square. frame.
本申请实施例中,同一定位策略不同目标对象对应的标注的图标相同,不同定位策略对应的标注的图标不同。比如,智能跟踪策略对应的标注的图标为绿色的“+”,打点定位策略对应的标注的图标为绿色的“◇”,激光测距策略对应的标注的图标为红色的“+”。In the embodiments of the present application, the marked icons corresponding to different target objects of the same positioning strategy are the same, and the marked icons corresponding to different positioning strategies are different. For example, the marked icon corresponding to the smart tracking strategy is a green "+", the marked icon corresponding to the dot positioning strategy is a green "◇", and the marked icon corresponding to the laser ranging strategy is a red "+".
进一步的,当通过智能跟踪策略和激光测距策略在第一图传画面上标定同一目标对象时,目标对象处于第一图传画面的中心位置,且目标对象的标注的图标为智能跟踪策略和对应的标注的图标。示例性的,目标对象处于第一图传画面的中心位置是指目标对象的中心与第一图传画面的中心位置重合。应当理解的,当目标对象的中心与第一图传画面的中心位置的偏差小于预设偏差阈值时,也可以认为目标对象的中心与 第一图传画面的中心位置重合。Further, when the same target object is calibrated on the first image transmission screen through the intelligent tracking strategy and the laser ranging strategy, the target object is at the center of the first image transmission screen, and the marked icon of the target object is the intelligent tracking strategy and Corresponding marked icon. Exemplarily, that the target object is at the center position of the first video transmission screen means that the center of the target object coincides with the center position of the first video transmission screen. It should be understood that when the deviation between the center of the target object and the center position of the first video transmission screen is less than the preset deviation threshold, it can also be considered that the center of the target object coincides with the center position of the first video transmission screen.
另外,在标定目标对象时,若同时使用智能跟踪策略和激光测距策略定位目标对象的第三位置信息,由于激光测距策略能够获得目标对象相对可移动平台的距离,因此,结合智能跟踪策略获得的目标对象的实时位置信息和激光测距策略获得的目标对象相对可移动平台的距离,可以确定目标对象的实时绝对位置,如此,便可实现对目标对象的精确追踪。In addition, when calibrating the target object, if the intelligent tracking strategy and the laser ranging strategy are used to locate the third position information of the target object at the same time, since the laser ranging strategy can obtain the distance of the target object relative to the movable platform, it is combined with the intelligent tracking strategy The obtained real-time position information of the target object and the distance of the target object relative to the movable platform obtained by the laser ranging strategy can determine the real-time absolute position of the target object, so that accurate tracking of the target object can be achieved.
示例性的,通过智能跟踪策略标定现实世界中可移动的物体(如人、动物、车辆等物体),通过打点定位策略标定现实世界中静止不动的物体(如建筑、高山、河流等物体),因此,智能跟踪策略对应的标注包含的第三位置信息会随着目标对象在现实世界中的位置改变而变化的,打点定位策略对应的标注包含的第三位置信息则不会变化。Exemplarily, use intelligent tracking strategies to calibrate movable objects in the real world (such as people, animals, vehicles, etc.), and use dot positioning strategies to calibrate stationary objects in the real world (such as buildings, mountains, rivers, etc.) Therefore, the third location information contained in the label corresponding to the smart tracking strategy will change as the position of the target object changes in the real world, and the third location information contained in the label corresponding to the dot positioning strategy will not change.
在一些实施例中,当定位策略为激光测距策略时,第三位置信息包括目标对象的绝对位置信息,根据第一位置信息,在第一图传画面上对目标对象进行标注的实现过程可以包括:根据第一位置信息和第三位置信息包含的绝对位置信息,在第一图传画面上对目标对象进行增强现实AR投影标注,AR投影标注更醒目。In some embodiments, when the positioning strategy is a laser ranging strategy, the third position information includes absolute position information of the target object. According to the first position information, the implementation process of marking the target object on the first image transmission screen can be Including: according to the absolute position information contained in the first position information and the third position information, an augmented reality AR projection label is performed on the target object on the first image transmission screen, and the AR projection label is more eye-catching.
另外,当定位策略为激光测距策略时,还可以在第一图传画面对应的地图上进行打点标定操作。请再次参见图3A、3B和图4A,当交互界面上显示第一图传画面时,交互界面上还显示有第一图传画面对应的地图所对应的第八标识41,当用户操作第八标识41使得第八标识处于触发状态时,交互界面上会显示第一图传画面对应的地图,如图4B所示。In addition, when the positioning strategy is a laser ranging strategy, the dot calibration operation can also be performed on the map corresponding to the first image transmission screen. Please refer to Figures 3A, 3B and 4A again. When the first image transmission screen is displayed on the interactive interface, the interactive interface also displays the eighth mark 41 corresponding to the map corresponding to the first image transmission screen. When the user operates the eighth image When the mark 41 makes the eighth mark in the triggered state, the map corresponding to the first image transmission screen will be displayed on the interactive interface, as shown in FIG. 4B.
下面,将具体阐述在第一图传画面对应的地图上进行打点标定操作的实现过程:In the following, the implementation process of marking and calibrating on the map corresponding to the first image transmission screen will be explained in detail:
(1)、在交互界面上显示第一图传画面对应的地图;(1) Display the map corresponding to the first image transmission screen on the interactive interface;
示例性的,第一图传画面对应的地图为可移动平台当前位置周围的地图,用户可以操作交互界面以对地图进行放大或缩小。Exemplarily, the map corresponding to the first image transmission screen is a map around the current location of the movable platform, and the user can operate the interactive interface to zoom in or zoom out the map.
(2)、获取到第三用户指令,其中,第三用户指令由用户操作地图上显示的打点定位策略对应的标识时产生;(2) A third user instruction is obtained, where the third user instruction is generated when the user operates the mark corresponding to the dot positioning strategy displayed on the map;
请参见图4B,当交互界面显示第一图传画面对应的地图时,地图上会显示有打点定位策略对应的第六标识22。进一步的,地图上还显示有第一图传画面1和FPV相机对应的图传画面2用户可以在观看地图的同时,观看图传画面,有利于信息的直观呈现。需要说明的是,本申请实施例中,不同镜头的图传画面可以由同一拍摄装置的不同镜头获得,也可以由不同的拍摄装置获得。示例性的,拍摄装置包括变焦镜头、和广角镜头,第一图传画面可以是变焦镜头获取的图传画面,也可以是广角镜头获取的图传画面;示例性的,拍摄装置包括变焦镜头、广角镜头和红外镜头,第一图传画面 可以是变焦镜头获取的图传画面,也可以是广角镜头获取的图传画面,还可以是红外镜头获取的图传画面;示例性的,可移动平台包括第一拍摄装置和FPV相机,第一图传画面可以是第一拍摄装置获取的图传画面,也可以是FPV相机获取的图传画面。Referring to FIG. 4B, when the interactive interface displays the map corresponding to the first image transmission screen, the sixth indicator 22 corresponding to the dot positioning strategy will be displayed on the map. Further, the first image transmission screen 1 and the image transmission screen 2 corresponding to the FPV camera are also displayed on the map. The user can watch the image transmission screen while watching the map, which is conducive to the intuitive presentation of information. It should be noted that, in the embodiments of the present application, the image transmission images of different lenses may be obtained by different lenses of the same shooting device, or may be obtained by different shooting devices. Exemplarily, the photographing device includes a zoom lens and a wide-angle lens. The first image transmission picture may be a picture transmission picture obtained by a zoom lens or a picture transmission picture obtained by a wide-angle lens; exemplary, the photographing device includes a zoom lens, a wide-angle lens and Infrared lens, the first image transmission image can be the image transmission image obtained by the zoom lens, the image transmission image obtained by the wide-angle lens, or the image transmission image obtained by the infrared lens; exemplary, the movable platform includes the first image The device and the FPV camera, the first image transmission picture may be a picture transmission picture obtained by the first camera, or a picture transmission picture obtained by the FPV camera.
(3)、根据第三用户指令,对地图的第三特定位置处的目标对象进行标注。(3) Mark the target object at the third specific location on the map according to the third user instruction.
如此,实现了在第一图传画面对应的地图上标定目标对象的目的。In this way, the purpose of marking the target object on the map corresponding to the first image transmission screen is achieved.
进一步的,在一些实施例中,在根据第三用户指令,对地图的第三特定位置处的目标对象进行标注之后,当地图上的标注对应的图标被触发时,若获取到第四用户指令,则根据第四用户指令,对标注包含的第三位置信息中的高度进行修改和/或删除。其中,地图上的标注对应的图标被触发可以通过用户操作(如点击或框选)该标注对应的图标实现,第四用户指令可以为用户操作交互界面上的虚拟键盘和/或虚拟鼠标时产生。通过修改功能,提高目标标定的精确度;通过删除功能,满足不同的用户需求。Further, in some embodiments, after marking the target object at the third specific location on the map according to the third user instruction, when the icon corresponding to the annotation on the map is triggered, if the fourth user instruction is obtained , According to the fourth user instruction, modify and/or delete the height in the third position information contained in the annotation. Wherein, the icon corresponding to the label on the map can be triggered by a user operation (such as clicking or box selection) of the icon corresponding to the label, and the fourth user instruction can be generated when the user operates the virtual keyboard and/or virtual mouse on the interactive interface . By modifying the function, the accuracy of target calibration is improved; by deleting the function, different user needs can be met.
进一步的,在一些实施例中,在根据第三用户指令,对地图的第三特定位置处的目标对象进行标注之后,当地图上的标注对应的图标被触发时,若获取到第五用户指令,则根据第五用户指令,在地图上移动图标的位置,并将标注包含的第三位置信息中的经纬度替换为移动后的图标的位置对应的经纬度,以满足不同的用户需求。示例性的,第五用户指令指示用户先对图标执行第一操作,再对图标执行第二操作;示例性的,第一操作包括持续点击图标的时长大于预设时长,第二操作包括拖动图标。预设时长的大小可以根据需要设置,例如,预设时长可以为5秒或其他大小。应当理解的,第五用户指令也可以包括用户对图标执行的其他操作,第一操作、第二操作也可以为其他类型。Further, in some embodiments, after the target object at the third specific location on the map is marked according to the third user instruction, when the icon corresponding to the mark on the map is triggered, if the fifth user instruction is obtained , Move the position of the icon on the map according to the fifth user instruction, and replace the longitude and latitude in the third position information contained in the annotation with the longitude and latitude corresponding to the position of the moved icon to meet different user needs. Exemplarily, the fifth user instruction instructs the user to perform the first operation on the icon first, and then perform the second operation on the icon; exemplary, the first operation includes continuously clicking the icon for longer than the preset period of time, and the second operation includes dragging. icon. The size of the preset duration can be set as required, for example, the preset duration can be 5 seconds or other sizes. It should be understood that the fifth user instruction may also include other operations performed by the user on the icon, and the first operation and the second operation may also be of other types.
当定位策略为激光测距策略时,目标标定方法还可以包括:获取对目标对象定位获得的目标对象相对可移动平台的距离。进一步的,根据第一位置信息,在第一图传画面上对目标对象进行标注的实现过程可以包括:根据第一位置信息和目标对象相对可移动平台的距离,在第一图传画面上对目标对象进行标注。示例性的,标注对应的第三位置信息包括目标对象相对可移动平台的距离,用户通过标注便可确定目标对象相对可移动平台的距离,从而可以确定目标对象的绝对位置。When the positioning strategy is a laser ranging strategy, the target calibration method may further include: obtaining the distance of the target object relative to the movable platform obtained by positioning the target object. Further, according to the first location information, the implementation process of labeling the target object on the first image transmission screen may include: according to the first location information and the distance of the target object relative to the movable platform, matching on the first image transmission screen The target object is labeled. Exemplarily, the third position information corresponding to the annotation includes the distance of the target object relative to the movable platform, and the user can determine the distance of the target object relative to the movable platform through the annotation, so that the absolute position of the target object can be determined.
在S205中、根据第一位置信息、第一镜头与第二镜头之间的相对位置关系、第一镜头的拍摄参数以及第二镜头的拍摄参数,确定目标对象在第二镜头获取的第二图传画面中的第二位置信息。In S205, according to the first position information, the relative positional relationship between the first lens and the second lens, the shooting parameters of the first lens, and the shooting parameters of the second lens, the second image acquired by the target object in the second lens is determined Pass the second position information in the screen.
当所述第一镜头与所述第二镜头的姿态大致一致,且距离小于预设的阈值时,可以认为两者的位置重合。这时,仅需要获知第一镜头的拍摄参数以及第二镜头的拍摄参数(例如,两者的FOV),即可确定目标对象在第二镜头获取的第二图传画面中的第二位置信息。When the postures of the first lens and the second lens are approximately the same and the distance is less than a preset threshold, it can be considered that the positions of the two are coincident. At this time, it is only necessary to know the shooting parameters of the first lens and the shooting parameters of the second lens (for example, the FOV of both) to determine the second position information of the target object in the second image transmission image obtained by the second lens .
可选的,拍摄参数包括拍摄视角FOV;当然,拍摄参数也可以包括其他。Optionally, the shooting parameters include the shooting angle of view FOV; of course, the shooting parameters may also include others.
进一步的,在确定目标对象在第二镜头获取的第二图传画面中的第二位置信息之后,根据第二位置信息,在第二图传画面上标注目标对象。通过用户在第一图传画面的操作,实现了在第一图传画面和第二图传画面同时标定目标对象的目的,从而实现了在不同图传画面标定目标对象时的标定结果的共享,提高标定效率,并且在多人协作操作可移动平台时,提高了协作效率。Further, after determining the second position information of the target object in the second image transmission screen obtained by the second lens, mark the target object on the second image transmission screen according to the second position information. Through the operation of the user on the first image transmission screen, the purpose of simultaneously calibrating the target object on the first image transmission screen and the second image transmission screen is realized, thereby realizing the sharing of the calibration results when the target object is calibrated on different image transmission screens. Improve the efficiency of calibration, and improve the efficiency of collaboration when multi-person collaborative operation of the mobile platform.
示例性的,飞手1通过遥控终端1的交互界面观看第一图传画面以进行作业,飞手2通过遥控终端2的交互界面观看第二图传画面以进行作业。当飞手1在第一图传画面上标定了一个目标对象1时,飞手2在第二图传画面上也可能观看到目标对象1被标定的信息。Exemplarily, the pilot 1 views the first image transmission screen through the interactive interface of the remote control terminal 1 to perform operations, and the pilot 2 views the second image transmission screen through the interactive interface of the remote control terminal 2 to perform operations. When the pilot 1 calibrates a target object 1 on the first image transmission screen, the pilot 2 may also see the information that the target object 1 is calibrated on the second image transmission screen.
本申请实施例中,目标对象在第一图传画面上的标注与目标对象在第二图传画面上的标注相同;当然,在其他实施例中,目标对象在第一图传画面上的标注与目标对象在第二图传画面上的标注也可以不相同。In the embodiment of this application, the label of the target object on the first image transmission screen is the same as the label of the target object on the second image transmission screen; of course, in other embodiments, the label of the target object on the first image transmission screen The label on the second image transmission screen may be different from that of the target object.
进一步的,在一些实施例中,当定位策略为激光测距策略时,在确定目标对象在第二镜头获取的第二图传画面中的第二位置信息之后,若第二位置信息不在第二图传画面上,则在第二图传画面的边缘显示目标对象的标注。其中,边缘相对第二图传画面的中心位置的方位用于指示目标对象相对第二图传画面的中心位置的方位。如此,可以告知用户目标对象的方位。Further, in some embodiments, when the positioning strategy is a laser ranging strategy, after determining the second position information of the target object in the second image transmission image obtained by the second lens, if the second position information is not in the second On the image transmission screen, the label of the target object is displayed on the edge of the second image transmission screen. Wherein, the position of the edge relative to the center position of the second video transmission screen is used to indicate the position of the target object relative to the center position of the second video transmission screen. In this way, the user can be informed of the location of the target object.
进一步的,在一些实施例中,目标标定方法还可以包括:根据第三位置信息,在第一图传画面对应的地图上对目标对象进行标注。如此,通过用户在第一图传画面的操作,实现了在第一图传画面和第一图传画面对应的地图同时标定目标对象的目的,也即,在图传画面标定目标对象后,在地图共享标定结果,提高标定效率,并且在多人协作操作可移动平台时,让协作能够更加顺畅,提高了协作效率。应当理解的,在地图上标注的目标对象,也可以同步共享至图传画面。Further, in some embodiments, the target calibration method may further include: marking the target object on the map corresponding to the first image transmission screen according to the third location information. In this way, through the user's operation on the first image transmission screen, the goal of simultaneously calibrating the target object on the first image transmission screen and the map corresponding to the first image transmission screen is realized, that is, after the image transmission screen is calibrated for the target object, The map shares the calibration results to improve the efficiency of calibration, and when multiple people collaborate to operate the movable platform, the collaboration can be smoother and the efficiency of collaboration is improved. It should be understood that the target object marked on the map can also be shared to the image transmission screen synchronously.
进一步的,在一些实施例中,目标标定方法还可以包括:将标注同步至外部设备和/或图传画面对应的地图和/或可移动平台的运行指引页面。可选的,外部设备为后台监管设备,也可以为HSI、其他web平台等。示例性的,外部设备为后台监管设备(通常为指挥官使用),可以将飞手通过遥控终端标定目标的标定结果共享给后台监管设备,实现了飞手和指挥官之间的信息同步,指挥官可以根据这些同步的信息,对多个飞手进行调度,提高作业效率。运行指引页面用于指示可移动平台的运行状况。Further, in some embodiments, the target calibration method may further include: synchronizing the annotations to the map corresponding to the external device and/or the image transmission screen and/or the operation guide page of the movable platform. Optionally, the external device is a background monitoring device, or may be HSI, other web platforms, etc. Exemplarily, the external device is a background monitoring device (usually used by the commander), and the calibration result of the pilot calibration target through the remote control terminal can be shared with the background monitoring device, which realizes the synchronization of information between the pilot and the commander, and the command The officer can schedule multiple pilots based on these synchronized information to improve operational efficiency. The operation guide page is used to indicate the operation status of the movable platform.
示例性的,可移动平台为无人机,运行指引页面即为无人机的飞行指引页面,对飞行指引页面进行说明。在用户通过遥控终端控制无人机飞行的过程中,在遥控终端的显示装置或者与遥控终端连接的显示设备上显示飞行指引页面,便于用户知晓无人机的飞行情况。其中,该飞行指引页面包括飞行指引罗盘,该飞行指引罗盘用于同时标识与遥控终端通信连接的无人机的方位和无人机的云台的方位,飞行指引页面还显 示有无人机的拍摄装置的当前画面。其中,飞行指引罗盘包括姿态球和水平状态指示器(Horizontal Situation Indicator,HSI)中的任一项,飞行指引罗盘的显示位置可以根据实际情况进行设置,本申请对此不作具体限定,例如,在飞行指引页面的下侧中部区域显示飞行指引罗盘。通过标识无人机的方位和无人机的云台的方位,便于用户控制无人机的云台的姿态以及无人机的姿态,可以控制无人机拍摄得到用户想要的照片或视频。所述飞行指引罗盘为在所述飞行指引页面指示方位的方位指示标识,其可以为方形、圆形、椭圆形以及其他可以表示方位的形状。例如,当所述飞行指引罗盘为方形时,所述方向的四个角设为东西南北四个方位,可以在所述方形罗盘内指示当前所述无人机和云台的方位。下面,将以飞行指引罗盘为圆形为例进行说明。Exemplarily, the movable platform is a drone, and the operation guide page is the flight guide page of the drone, and the flight guide page is described. When the user controls the flight of the drone through the remote control terminal, the flight guide page is displayed on the display device of the remote control terminal or the display device connected to the remote control terminal, so that the user can know the flight status of the drone. Among them, the flight guide page includes a flight guide compass, which is used to simultaneously identify the position of the drone that is in communication with the remote control terminal and the position of the drone's gimbal. The flight guide page also displays the drone's position. The current screen of the camera. Wherein, the flight guidance compass includes any one of the attitude ball and the horizontal status indicator (Horizontal Situation Indicator, HSI). The display position of the flight guidance compass can be set according to the actual situation, which is not specifically limited in this application. For example, The lower middle area of the flight guide page displays the flight guide compass. By identifying the position of the drone and the position of the drone's pan/tilt, it is convenient for the user to control the attitude of the drone's pan/tilt and the attitude of the drone, and can control the drone to take photos or videos that the user wants. The flight guidance compass is an azimuth indication mark indicating the azimuth on the flight guidance page, and it can be a square, a circle, an ellipse, or other shapes that can indicate the azimuth. For example, when the flight guidance compass is a square, the four corners of the direction are set to four directions: east, west, south, north, and the current position of the drone and the pan/tilt can be indicated in the square compass. In the following, the flight guidance compass is circular as an example for description.
在一些实施方式中,该飞行指引罗盘随着无人机的旋转而发生旋转,飞行指引罗盘的中心区域显示有无人机图标,无人机图标用于表示无人机,无人机图标不随着无人机的旋转而发生旋转,该飞行指引罗盘的边缘区域显示有正东方向、正西方向、正南方向和正北方向各自对应的指示字符,该飞行指引罗盘的边缘区域还显示有云台图标,该云台图标用于表示无人机的云台,该云台图标在边缘区域中的位置是根据云台的Yaw轴的朝向确定的,云台图标在边缘区域中的位置随着云台的方位的变化而发生变化。通过在飞行指引罗盘上显示无人机图标、云台图标和正东方向、正西方向、正南方向和正北方向各自对应的指示字符,使得用户能够基于显示的飞行指引罗盘知晓云台的方位和无人机的方位,便于用户控制无人机的云台的姿态以及无人机的姿态。In some embodiments, the flight guidance compass rotates with the rotation of the drone, and the center area of the flight guidance compass displays a drone icon. The drone icon is used to indicate the drone, and the drone icon does not follow. As the drone rotates and rotates, the edge area of the flight guidance compass shows the corresponding indicator characters for the true east, west, south and true north directions. The edge area of the flight guidance compass also shows clouds. PTZ icon, the PTZ icon is used to represent the PTZ of the drone. The position of the PTZ icon in the edge area is determined according to the direction of the Yaw axis of the PTZ. The position of the PTZ icon in the edge area follows The direction of the pan-tilt changes. By displaying the drone icon, the gimbal icon, and the corresponding indication characters of the true east, true west, true south and true north directions on the flight guidance compass, the user can know the position and position of the gimbal based on the displayed flight guidance compass. The position of the drone is convenient for the user to control the attitude of the drone's gimbal and the attitude of the drone.
其中,无人机图标、云台图标和指示字符可以根据实际情况进行设置,本申请对此不作具体限定,例如,正东方向、正西方向、正南方向和正北方向各自对应的指示字符分别为E、W、S和N,无人机图标为箭头、圆形、三角形或其他形状等,云台图标为三角形、四边形、五边形或其他形状等。Among them, the drone icon, pan/tilt icon, and indicator characters can be set according to actual conditions. This application does not specifically limit this. For example, the indicator characters corresponding to the direction of due east, west, south and north are respectively E, W, S, and N. The drone icon is an arrow, circle, triangle, or other shapes, and the gimbal icon is a triangle, quadrilateral, pentagon, or other shapes.
在一些实施方式中,该飞行指引罗盘的附近显示有无人机的机头朝向对应的角度数值,显示的角度数值用于指示无人机的机头朝向,其中,角度数值是无人机的机头朝向相对于正北方向、正南方向、正西方向或者正东方向的角度。通过在飞行指引罗盘显示无人机的机头朝向对应的角度数值,使得用户能够基于显示的角度数值知晓无人机的机头朝向相对于正北方向、正南方向、正西方向或者正东方向的角度,便于用户控制无人机。In some embodiments, the angle value corresponding to the nose of the drone is displayed near the flight guidance compass, and the displayed angle value is used to indicate the nose of the drone, where the angle value is that of the drone. The angle of the nose with respect to true north, true south, true west, or true east. By displaying the corresponding angle value of the drone's nose on the flight guidance compass, the user can know the drone's nose orientation relative to true north, true south, true west, or true east based on the displayed angle value. The angle of direction is convenient for the user to control the drone.
在一些实施方式中,无人机图标为箭头图标,该箭头图标固定指向飞行指引页面的上方,该箭头图标的朝向与无人机的机头朝向一致;当无人机的方位发生变化时,该飞行指引罗盘发生转动,无人机包括多个云台时,飞行指引罗盘的边缘区域显示有每个云台各自对应的云台图标,且每个云台图标的颜色不同,该飞行指引罗盘的边缘区域还显示有多条角度刻度线和每条角度刻度线各自对应的角度数值。其中,该角度数值是偏离正北方向的角度。通过在飞行指引罗盘上以不同的颜色显示每个云台各自对应的云台图标以及多条角度刻度线和每条角度刻度线各自对应的角度数值,使得用 户能够基于显示的飞行指引罗盘准确清晰地知晓云台的方位和无人机的方位,便于用户控制无人机的云台的姿态以及无人机的姿态。In some embodiments, the drone icon is an arrow icon, the arrow icon is fixed to the top of the flight guide page, and the direction of the arrow icon is consistent with the nose of the drone; when the orientation of the drone changes, When the flight guidance compass rotates and the drone includes multiple gimbals, the edge area of the flight guidance compass displays the corresponding gimbal icon for each gimbal, and the color of each gimbal icon is different, the flight guidance compass The edge area of also displays multiple angle scale lines and the corresponding angle value of each angle scale line. Among them, the angle value is the angle deviating from the true north direction. By displaying the corresponding gimbal icon of each gimbal and multiple angle scale lines and the corresponding angle value of each angle scale line in different colors on the flight guidance compass, the user can be accurate and clear based on the displayed flight guidance compass Knowing the position of the gimbal and the position of the drone is convenient for the user to control the attitude of the gimbal of the drone and the attitude of the drone.
该飞行指引罗盘还包括跟随图标,该跟随图标用于表示无人机跟随的对象,该跟随图标在该飞行指引罗盘上的位置是根据无人机跟随的对象相对于无人机的方向和距离确定的;在无人机跟随的对象相对于无人机的距离小于预设距离时,跟随图标位于飞行指引罗盘的内部,在无人机跟随的对象相对于无人机的距离大于或等于预设距离时,跟随图标位于飞行指引罗盘的边缘区域的内侧;该飞行指引罗盘的附近还显示标记点图标和标记的空间点相对于无人机的距离。其中,跟随图标可基于实际情况进行设置,本申请对此不做具体限定,例如,跟随图标为
Figure PCTCN2020086793-appb-000001
飞行指引页面还显示有对象跟随按钮,当用户对该对象跟随按钮进行触控时,无人机自动识别人车船等对象,并调整相机的焦距,使得人车船等对象位于画面中央,当用户选择跟随的对象后,根据跟随的对象相对于无人机的方向和距离,在飞行指引罗盘上显示跟随图标。
The flight guidance compass also includes a follow icon, which is used to indicate the object that the drone follows. The position of the follow icon on the flight guidance compass is based on the direction and distance of the object followed by the drone relative to the drone. Confirmed; when the distance of the object followed by the drone relative to the drone is less than the preset distance, the follow icon is located inside the flight guidance compass, and the distance of the object followed by the drone relative to the drone is greater than or equal to the preset distance. When setting the distance, the follow icon is located inside the edge area of the flight guidance compass; the mark point icon and the distance of the marked space point relative to the drone are also displayed near the flight guidance compass. Among them, the follow icon can be set based on actual conditions, and this application does not specifically limit this. For example, the follow icon is
Figure PCTCN2020086793-appb-000001
The flight guide page also displays an object follow button. When the user touches the object follow button, the drone automatically recognizes people, vehicles, and ships and other objects, and adjusts the camera's focus so that objects such as people, vehicles, and ships are in the center of the screen. When the user selects After the following object, according to the direction and distance of the following object relative to the drone, a follow icon is displayed on the flight guidance compass.
如图6所示,该飞行指引罗盘的内部显示有无人机的返航点图标
Figure PCTCN2020086793-appb-000002
同时该飞行指引罗盘的右下侧的附近显示有返航点图标
Figure PCTCN2020086793-appb-000003
和无人机的返航点相对于无人机的距离10m;该飞行指引罗盘的边缘区域的内侧显示有标记点图标
Figure PCTCN2020086793-appb-000004
同时该飞行指引罗盘的左下侧的附近显示有标记点图标
Figure PCTCN2020086793-appb-000005
和标记的空间点相对于无人机的距离45m;该飞行指引罗盘的内部显示有跟随图标
Figure PCTCN2020086793-appb-000006
同时该飞行指引罗盘的左上侧的附近显示有跟随图标
Figure PCTCN2020086793-appb-000007
和跟随的对象相对于无人机的距离5m。
As shown in Figure 6, the home point icon of the drone is displayed inside the flight guidance compass
Figure PCTCN2020086793-appb-000002
At the same time, the home point icon is displayed near the lower right side of the flight guidance compass
Figure PCTCN2020086793-appb-000003
The distance from the home point of the drone to the drone is 10m; the inner side of the edge area of the flight guidance compass is displayed with a marker icon
Figure PCTCN2020086793-appb-000004
At the same time, a marker icon is displayed near the lower left side of the flight guidance compass
Figure PCTCN2020086793-appb-000005
The distance from the marked space point to the drone is 45m; the follow icon is displayed inside the flight guidance compass
Figure PCTCN2020086793-appb-000006
At the same time, a follow icon is displayed near the upper left side of the flight guidance compass
Figure PCTCN2020086793-appb-000007
The distance from the following object to the drone is 5m.
本申请实施例的目标标定方法,可以针对“动态目标”和“静态目标”进行追踪和信息同步,实现了多平台的闭环操作,适用于安防、应急等行业。The target calibration method of the embodiment of the present application can track and synchronize information for "dynamic targets" and "static targets", realize multi-platform closed-loop operation, and be suitable for industries such as security and emergency.
对应于上述实施例的目标标定方法,本申请实施例还提供一种目标标定装置,所述目标标定装置设于遥控终端,请参见图7,所述目标标定装置可以包括存储装置和一个或多个处理器。Corresponding to the target calibration method of the above-mentioned embodiment, an embodiment of the present application also provides a target calibration device. The target calibration device is provided in a remote control terminal. Referring to FIG. 7, the target calibration device may include a storage device and one or more Processors.
其中,存储装置,用于存储程序指令。Among them, the storage device is used to store program instructions.
一个或多个处理器,调用存储装置中存储的程序指令,当程序指令被执行时,一个或多个处理器单独地或共同地被配置成用于实施如下操作:通过遥控终端获取第一镜头和第二镜头的图传画面,在遥控终端的交互界面上显示第一镜头获取的第一图传画面;获取到第一用户指令,其中,第一用户指令用于指示第一图传画面中待标定的目标对象;获取目标对象在第一图传画面的第一位置信息;根据第一位置信息,在第一图传画面上对目标对象进行标注;根据第一位置信息、第一镜头与第二镜头之间的相对位置关系、第一镜头的拍摄参数以及第二镜头的拍摄参数,确定目标对象在第二镜头获取的第二图传画面中的第二位置信息。One or more processors call the program instructions stored in the storage device. When the program instructions are executed, the one or more processors are individually or collectively configured to perform the following operations: Obtain the first shot through the remote control terminal And the image transmission screen of the second lens, the first image transmission screen acquired by the first lens is displayed on the interactive interface of the remote control terminal; the first user instruction is obtained, wherein the first user instruction is used to instruct the first image transmission screen The target object to be calibrated; obtain the first position information of the target object on the first image transmission screen; mark the target object on the first image transmission screen according to the first position information; according to the first position information, the first lens and The relative positional relationship between the second lenses, the shooting parameters of the first lens, and the shooting parameters of the second lens determine the second position information of the target object in the second video image obtained by the second lens.
本实施例的处理器可以实现如本申请图2所示实施例的目标标定方法,可参见上述实施例中相应部分的描述。The processor of this embodiment can implement the target calibration method of the embodiment shown in FIG. 2 of the present application, and reference may be made to the description of the corresponding part in the foregoing embodiment.
进一步的,本申请实施例还提供一种遥控终端,所述遥控终端与一可移动平台通信,所述可移动平台包括第一镜头和第二镜头,所述遥控终端包括主体和上述实施例的目标标定装置,所述目标标定装置由所述主体支撑。Further, an embodiment of the present application also provides a remote control terminal, the remote control terminal communicates with a movable platform, the movable platform includes a first lens and a second lens, the remote control terminal includes a main body and The target calibration device is supported by the main body.
进一步的,本申请实施例还提供一种目标标定系统,包括遥控终端和可移动平台,遥控终端包括主体和上述实施例的目标标定装置,目标标定装置由所述主体支撑。可移动平台与所述遥控终端通信,可移动平台包括第一镜头和第二镜头。Further, an embodiment of the present application also provides a target calibration system, which includes a remote control terminal and a movable platform. The remote control terminal includes a main body and the target calibration device of the foregoing embodiment, and the target calibration device is supported by the main body. The movable platform communicates with the remote control terminal, and the movable platform includes a first lens and a second lens.
此外,本申请实施例还提供一种计算机可读存储介质,其上存储有计算机程序,该程序被处理器执行时实现上述实施例二的目标标定方法的步骤。In addition, an embodiment of the present application also provides a computer-readable storage medium on which a computer program is stored, and when the program is executed by a processor, the steps of the target calibration method in the second embodiment are realized.
实施例二Example two
图8是本申请另一实施例中的目标标定方法的方法流程示意图;本申请实施例的目标标定方法的执行主体为遥控终端。请参见图8,本申请实施例的目标标定方法可以包括S801~S804。FIG. 8 is a method flow diagram of a target calibration method in another embodiment of the present application; the execution subject of the target calibration method in the embodiment of the present application is a remote control terminal. Referring to FIG. 8, the target calibration method in the embodiment of the present application may include S801 to S804.
其中,在S801中、在遥控终端的交互界面上显示拍摄装置获取的图传画面。Wherein, in S801, the image transmission screen acquired by the camera is displayed on the interactive interface of the remote control terminal.
拍摄装置搭载在可移动平台上,拍摄装置可以包括一个或多个镜头。其中,当拍摄装置包括多个镜头时,图传画面可以为多个镜头中任一个镜头获取的图传画面。示例性的,图传画面为可移动平台的第一镜头获取的图传画面。The camera is mounted on a movable platform, and the camera can include one or more lenses. Wherein, when the photographing device includes multiple lenses, the image transmission image may be an image transmission image obtained by any one of the multiple lenses. Exemplarily, the image transmission picture is a picture transmission picture obtained by the first lens of the movable platform.
可移动平台在运行过程中,会将图传画面回传给遥控终端。During the operation of the mobile platform, the image transmission screen will be sent back to the remote control terminal.
在S802中、获取到第一用户指令,其中,第一用户指令用于指示对图传画面中待标定的目标对象和目标对象进行定位的定位策略。In S802, a first user instruction is obtained, where the first user instruction is used to instruct the target object to be calibrated in the image transmission screen and a positioning strategy for positioning the target object.
需要说明的是,本申请实施例的位置信息相当于实施例一种的第三位置信息。另外,与实施例一不同的是,本申请实施例的定位策略包括打点定位策略和激光测距策略中的至少一种。It should be noted that the location information in the embodiment of the present application is equivalent to the third location information in the first embodiment. In addition, different from the first embodiment, the positioning strategy in the embodiment of the present application includes at least one of a dot positioning strategy and a laser ranging strategy.
在S803中、根据定位策略,从可移动平台获取目标对象的位置信息,所述位置信息包含所述目标对象相对所述可移动平台的距离。In S803, according to the positioning strategy, the position information of the target object is obtained from the movable platform, where the position information includes the distance of the target object relative to the movable platform.
本申请实施例中,位置信息可以用于指示目标对象在世界坐标系中的位置,也可以用于指示目标对象在图像坐标系中的位置,或者用于指示目标对象在其他坐标系中的位置。In the embodiment of the present application, the position information can be used to indicate the position of the target object in the world coordinate system, and can also be used to indicate the position of the target object in the image coordinate system, or used to indicate the position of the target object in other coordinate systems. .
在S804中、根据位置信息,在图传画面上对目标对象进行标注。In S804, the target object is marked on the image transmission screen according to the location information.
可选的,标注包括图标和位置信息。Optionally, the label includes an icon and location information.
可选的,位置信息还包括目标对象的经纬度和高度中的至少一种。Optionally, the location information further includes at least one of the latitude, longitude and height of the target object.
可选的,目标标定方法还包括:当图标处于触发状态时,在图标上显示位置信息。Optionally, the target calibration method further includes: when the icon is in a triggered state, displaying position information on the icon.
可选的,目标标定方法还包括:当图标处于非触发状态时,隐藏位置信息。Optionally, the target calibration method further includes: hiding the position information when the icon is in a non-triggered state.
可选的,定位策略包括打点定位策略,第一用户指令为用户点击图传画面上显示的打点定位策略对应的标识时生成。Optionally, the positioning strategy includes a dot positioning strategy, and the first user instruction is generated when the user clicks the mark corresponding to the dot positioning strategy displayed on the image transmission screen.
可选的,目标对象为图传画面的第一特定位置处的物体。Optionally, the target object is an object at a first specific position on the image transmission screen.
可选的,第一特定位置包括图传画面的中心位置。Optionally, the first specific position includes the center position of the image transmission screen.
可选的,所述方法还包括:在获取位置信息之前,输出第一指示信息;第一指示信息用于指示用户通过可移动平台的控制装置调整拍摄装置的姿态,以使得图传画面中的目标对象处于第一特定位置。Optionally, the method further includes: before acquiring the location information, outputting first indication information; the first indication information is used to instruct the user to adjust the posture of the shooting device through the control device of the movable platform, so that the image transmission screen The target object is in the first specific position.
可选的,获取到第一用户指令之前,还包括:获取到第二用户指令,第二用户指令用于指示图传画面中待移动至第一特定位置的物体;根据第二用户指令,发送第二指示信息至可移动平台;其中,第二指示信息用于指示可移动平台调整拍摄装置的姿态,使得待移动至第一特定位置的物体移动至第一特定位置处。Optionally, before obtaining the first user instruction, the method further includes: obtaining a second user instruction, where the second user instruction is used to instruct the object to be moved to the first specific position in the image transmission screen; and according to the second user instruction, sending The second instruction information is to the movable platform; wherein, the second instruction information is used to instruct the movable platform to adjust the posture of the photographing device so that the object to be moved to the first specific position moves to the first specific position.
可选的,位置信息为根据可移动平台的位置信息和目标对象相对可移动平台的距离确定。Optionally, the position information is determined according to the position information of the movable platform and the distance of the target object relative to the movable platform.
可选的,位置信息包括目标对象的绝对位置信息,根据位置信息,在图传画面上对目标对象进行标注,包括:根据位置信息包含的绝对位置信息,在图传画面上对目标对象进行增强现实AR投影标注。Optionally, the position information includes the absolute position information of the target object. Marking the target object on the image transmission screen according to the position information includes: enhancing the target object on the image transmission screen according to the absolute position information contained in the position information Realistic AR projection annotation.
可选的,所述方法还包括:在交互界面上显示图传画面对应的地图;获取到第三用户指令,其中,第三用户指令由用户操作地图上显示的打点定位策略对应的标识时产生;根据打点定位策略,从可移动平台获取目标对象的位置信息;根据位置信息,对地图的第二特定位置处的目标对象进行标注。Optionally, the method further includes: displaying a map corresponding to the image transmission screen on the interactive interface; acquiring a third user instruction, where the third user instruction is generated when the user operates the mark corresponding to the dot positioning strategy displayed on the map ;According to the dot positioning strategy, obtain the location information of the target object from the movable platform; according to the location information, mark the target object at the second specific location on the map.
可选的,根据位置信息,对地图的第二特定位置处的目标对象进行标注之后,还包括:当地图上的标注对应的图标被触发时,若获取到第四用户指令,则根据第四用户指令,对标注包含的位置信息中的高度进行修改和/或删除。Optionally, after labeling the target object at the second specific location on the map according to the location information, it further includes: when the icon corresponding to the label on the map is triggered, if a fourth user instruction is obtained, then according to the fourth user instruction. User instructions to modify and/or delete the height in the position information contained in the label.
可选的,根据位置信息,对地图的第二特定位置处的目标对象进行标注之后,还包括:当地图上的标注对应的图标被触发时,若获取到第五用户指令,则根据第五用户指令,在地图上移动图标的位置,并将标注包含的位置信息中的经纬度替换为移动后的图标的位置对应的经纬度。Optionally, after labeling the target object at the second specific location on the map according to the location information, it further includes: when the icon corresponding to the label on the map is triggered, if the fifth user instruction is obtained, then according to the fifth user instruction. The user instructs to move the position of the icon on the map, and replace the longitude and latitude in the position information contained in the label with the longitude and latitude corresponding to the position of the moved icon.
可选的,第五用户指令指示用户先对图标执行第一操作,再对图标执行第二操作。Optionally, the fifth user instruction instructs the user to perform the first operation on the icon first, and then perform the second operation on the icon.
可选的,第一操作包括:持续点击图标的时长大于预设时长,第二操作包括:拖动图标。Optionally, the first operation includes: the duration of continuously clicking the icon is greater than a preset duration, and the second operation includes: dragging the icon.
可选的,定位策略包括激光测距策略,第一用户指令为用户点击图传画面上显示 的激光测距策略对应的标识时生成。Optionally, the positioning strategy includes a laser ranging strategy, and the first user instruction is generated when the user clicks the mark corresponding to the laser ranging strategy displayed on the image transmission screen.
可选的,目标对象为图传画面的第三特定位置处的物体。Optionally, the target object is an object at a third specific position on the image transmission screen.
可选的,第三特定位置包括图传画面的中心位置。Optionally, the third specific position includes the center position of the image transmission screen.
可选的,目标标定方法还包括:将标注同步至外部设备和/或图传画面对应的地图和/或可移动平台的运行指引页面;Optionally, the target calibration method further includes: synchronizing the annotations to the map corresponding to the external device and/or the image transmission screen and/or the operation guide page of the movable platform;
运行指引页面用于指示可移动平台的运行状况。The operation guide page is used to indicate the operation status of the movable platform.
其余未展开的部分可以参见上述实施例一中相应部分的描述,此处不再赘述。For the remaining unexpanded parts, please refer to the description of the corresponding parts in the above-mentioned embodiment 1, which will not be repeated here.
对应于实施例二的目标标定方法,本申请实施例还提供一种目标标定装置,所述目标标定装置设于遥控终端,请参见图7,所述目标标定装置可以包括存储装置和一个或多个处理器。Corresponding to the target calibration method of the second embodiment, an embodiment of the present application also provides a target calibration device, the target calibration device is set in the remote control terminal, please refer to FIG. 7, the target calibration device may include a storage device and one or more Processors.
其中,存储装置,用于存储程序指令。Among them, the storage device is used to store program instructions.
一个或多个处理器,调用存储装置中存储的程序指令,当程序指令被执行时,一个或多个处理器单独地或共同地被配置成用于实施如下操作:在遥控终端的交互界面上显示拍摄装置获取的图传画面;获取到第一用户指令,其中,第一用户指令用于指示对图传画面中待标定的目标对象和目标对象进行定位的定位策略;根据定位策略,从可移动平台获取目标对象的位置信息,位置信息包含目标对象相对可移动平台的距离;根据位置信息,在图传画面上对目标对象进行标注。One or more processors call program instructions stored in the storage device. When the program instructions are executed, one or more processors are individually or collectively configured to implement the following operations: On the interactive interface of the remote control terminal Display the image transmission screen obtained by the camera; obtain the first user instruction, where the first user instruction is used to instruct the target object to be calibrated in the image transmission screen and the positioning strategy of the target object; The mobile platform obtains the location information of the target object, and the location information includes the distance of the target object relative to the movable platform; according to the location information, the target object is marked on the image transmission screen.
本实施例的处理器可以实现如本申请图8所示实施例的目标标定方法,可参见上述实施例中相应部分的描述。The processor of this embodiment can implement the target calibration method of the embodiment shown in FIG. 8 of the present application, and reference may be made to the description of the corresponding part in the foregoing embodiment.
上述实施例的存储装置存储所述目标标定方法的可执行指令计算机程序,所述存储装置可以包括至少一种类型的存储介质,存储介质包括闪存、硬盘、多媒体卡、卡型存储器(例如,SD或DX存储器等等)、随机访问存储器(RAM)、静态随机访问存储器(SRAM)、只读存储器(ROM)、电可擦除可编程只读存储器(EEPROM)、可编程只读存储器(PROM)、磁性存储器、磁盘、光盘等等。而且,所述目标标定装置可以与通过网络连接执行存储器的存储功能的网络存储装置协作。存储器可以是目标标定装置的内部存储单元,例如目标标定装置的硬盘或内存。存储器也可以是目标标定装置的外部存储设备,例如目标标定装置上配备的插接式硬盘,智能存储卡(Smart Media Card,SMC),安全数字(Secure Digital,SD)卡,闪存卡(Flash Card)等。进一步的,存储器还可以既包括目标标定装置的内部存储单元也包括外部存储设备。存储器用于存储计算机程序以及设备所需的其他程序和数据。存储器还可以用于暂时地存储已经输出或者将要输出的数据。The storage device of the foregoing embodiment stores the executable instruction computer program of the target calibration method. The storage device may include at least one type of storage medium. The storage medium includes flash memory, hard disk, multimedia card, card-type memory (for example, SD Or DX memory, etc.), random access memory (RAM), static random access memory (SRAM), read only memory (ROM), electrically erasable programmable read only memory (EEPROM), programmable read only memory (PROM) , Magnetic storage, magnetic disks, optical disks, etc. Moreover, the target calibration device may cooperate with a network storage device that performs the storage function of the memory through a network connection. The memory may be an internal storage unit of the target calibration device, such as the hard disk or memory of the target calibration device. The memory can also be an external storage device of the target calibration device, such as plug-in hard disks equipped on the target calibration device, Smart Media Card (SMC), Secure Digital (SD) card, Flash Card )Wait. Further, the memory may also include both an internal storage unit of the target calibration device and an external storage device. The memory is used to store computer programs and other programs and data required by the device. The memory can also be used to temporarily store data that has been output or will be output.
上述实施例的处理器可以是中央处理单元(Central Processing Unit,CPU),还可以是其他通用处理器、数字信号处理器(Digital Signal Processor,DSP)、专用集成电 路(Application Specific Integrated Circuit,ASIC)、现场可编程门阵列(Field-Programmable Gate Array,FPGA)或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件等。通用处理器可以是微处理器或者该处理器也可以是任何常规的处理器等。The processor of the foregoing embodiment may be a central processing unit (Central Processing Unit, CPU), or other general-purpose processors, digital signal processors (Digital Signal Processor, DSP), and Application Specific Integrated Circuit (ASIC) , Field-Programmable Gate Array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or the processor may also be any conventional processor or the like.
进一步的,本申请实施例还提供一种遥控终端,所述遥控终端与一可移动平台通信,所述可移动平台上搭载有拍摄装置,所述遥控终端包括主体和上述实施例二的目标标定装置,所述目标标定装置由所述主体支撑。Further, an embodiment of the present application also provides a remote control terminal, the remote control terminal communicates with a movable platform, the movable platform is equipped with a photographing device, the remote control terminal includes a main body and the target calibration of the second embodiment above Device, the target calibration device is supported by the main body.
进一步的,本申请实施例还提供一种目标标定系统,包括遥控终端和可移动平台,遥控终端包括主体和上述实施例二的目标标定装置,目标标定装置由所述主体支撑。可移动平台与所述遥控终端通信,可移动平台上搭载有拍摄装置。Further, an embodiment of the present application also provides a target calibration system, including a remote control terminal and a movable platform. The remote control terminal includes a main body and the target calibration device of the second embodiment above, and the target calibration device is supported by the main body. The movable platform communicates with the remote control terminal, and a camera is mounted on the movable platform.
此外,本申请实施例还提供一种计算机可读存储介质,其上存储有计算机程序,该程序被处理器执行时实现上述实施例二的目标标定方法的步骤。In addition, an embodiment of the present application also provides a computer-readable storage medium on which a computer program is stored, and when the program is executed by a processor, the steps of the target calibration method in the second embodiment are realized.
所述计算机可读存储介质可以是前述任一实施例所述的遥控终端的内部存储单元,例如硬盘或内存。所述计算机可读存储介质也可以是遥控终端的外部存储设备,例如所述设备上配备的插接式硬盘、智能存储卡(Smart Media Card,SMC)、SD卡、闪存卡(Flash Card)等。进一步的,所述计算机可读存储介质还可以既包括遥控终端的内部存储单元也包括外部存储设备。所述计算机可读存储介质用于存储所述计算机程序以及所述遥控终端所需的其他程序和数据,还可以用于暂时地存储已经输出或者将要输出的数据。The computer-readable storage medium may be an internal storage unit of the remote control terminal described in any of the foregoing embodiments, such as a hard disk or a memory. The computer-readable storage medium may also be an external storage device of the remote control terminal, such as a plug-in hard disk, a smart media card (SMC), an SD card, a flash memory card (Flash Card), etc. equipped on the device . Further, the computer-readable storage medium may also include both an internal storage unit of the remote control terminal and an external storage device. The computer-readable storage medium is used to store the computer program and other programs and data required by the remote control terminal, and can also be used to temporarily store data that has been output or will be output.
本领域普通技术人员可以理解实现上述实施例方法中的全部或部分流程,是可以通过计算机程序来指令相关的硬件来完成,所述的程序可存储于一计算机可读取存储介质中,该程序在执行时,可包括如上述各方法的实施例的流程。其中,所述的存储介质可为磁碟、光盘、只读存储记忆体(Read-Only Memory,ROM)或随机存储记忆体(Random Access Memory,RAM)等。A person of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be implemented by instructing relevant hardware through a computer program. The program can be stored in a computer readable storage medium. During execution, it may include the procedures of the above-mentioned method embodiments. Wherein, the storage medium may be a magnetic disk, an optical disc, a read-only memory (Read-Only Memory, ROM), or a random access memory (Random Access Memory, RAM), etc.
以上所揭露的仅为本申请部分实施例而已,当然不能以此来限定本申请之权利范围,因此依本申请权利要求所作的等同变化,仍属本申请所涵盖的范围。The above-disclosed are only some of the embodiments of this application, which of course cannot be used to limit the scope of rights of this application. Therefore, equivalent changes made in accordance with the claims of this application still fall within the scope of this application.

Claims (126)

  1. 一种目标标定方法,其特征在于,适用于一遥控终端,所述遥控终端与一可移动平台通信,所述可移动平台包括第一镜头和第二镜头,所述方法包括:A target calibration method, characterized in that it is suitable for a remote control terminal, the remote control terminal communicates with a movable platform, the movable platform includes a first lens and a second lens, and the method includes:
    通过所述遥控终端获取所述第一镜头和第二镜头的图传画面,在所述遥控终端的交互界面上显示所述第一镜头获取的第一图传画面;Acquiring the image transmission images of the first lens and the second lens through the remote control terminal, and displaying the first image transmission image acquired by the first lens on the interactive interface of the remote control terminal;
    获取到第一用户指令,其中,所述第一用户指令用于指示所述第一图传画面中待标定的目标对象;Acquiring a first user instruction, where the first user instruction is used to instruct the target object to be calibrated in the first image transmission screen;
    获取所述目标对象在所述第一图传画面的第一位置信息;Acquiring first position information of the target object on the first image transmission screen;
    根据所述第一位置信息,在所述第一图传画面上对所述目标对象进行标注;Mark the target object on the first image transmission screen according to the first location information;
    根据所述第一位置信息、所述第一镜头与所述第二镜头之间的相对位置关系、所述第一镜头的拍摄参数以及所述第二镜头的拍摄参数,确定所述目标对象在所述第二镜头获取的第二图传画面中的第二位置信息。According to the first position information, the relative positional relationship between the first lens and the second lens, the shooting parameters of the first lens, and the shooting parameters of the second lens, it is determined that the target object is The second position information in the second video transmission picture acquired by the second lens.
  2. 根据权利要求1所述的方法,其特征在于,所述拍摄参数包括拍摄视角FOV。The method according to claim 1, wherein the shooting parameter includes a shooting angle of view (FOV).
  3. 根据权利要求1所述的方法,其特征在于,所述可移动平台包括一个拍摄装置,所述拍摄装置包括多个镜头,所述第一镜头为所述拍摄装置包括的多个所述镜头中的一个,所述第二镜头包括所述拍摄装置包括的多个所述镜头中的其他镜头;或者,The method according to claim 1, wherein the movable platform includes a photographing device, the photographing device includes a plurality of lenses, and the first lens is one of the plurality of lenses included in the photographing device. One of, the second lens includes another lens of the plurality of lenses included in the photographing device; or,
    所述可移动平台包括多个拍摄装置,所述第一镜头为其中一个所述拍摄装置的镜头,所述第二镜头包括其他拍摄装置的镜头。The movable platform includes a plurality of photographing devices, the first lens is a lens of one of the photographing devices, and the second lens includes a lens of another photographing device.
  4. 根据权利要求1所述的方法,其特征在于,所述确定所述目标对象在所述第二镜头获取的第二图传画面中的第二位置信息之后,还包括:The method according to claim 1, wherein after the determining the second position information of the target object in the second video transmission image obtained by the second lens, the method further comprises:
    根据所述第二位置信息,在所述第二图传画面上标注所述目标对象。Mark the target object on the second image transmission screen according to the second location information.
  5. 根据权利要求4所述的方法,其特征在于,所述目标对象在所述第一图传画面上的标注与所述目标对象在所述第二图传画面上的标注相同。The method according to claim 4, wherein the label of the target object on the first image transmission screen is the same as the label of the target object on the second image transmission screen.
  6. 根据权利要求1或4所述的方法,其特征在于,所述标注包括图标和所述目标对象的第三位置信息。The method according to claim 1 or 4, wherein the label includes an icon and third position information of the target object.
  7. 根据权利要求6所述的方法,其特征在于,所述第三位置信息包括所述目标对象的经纬度和高度中的至少一种。The method according to claim 6, wherein the third location information includes at least one of the longitude, latitude and height of the target object.
  8. 根据权利要求6所述的方法,其特征在于,所述方法还包括:The method according to claim 6, wherein the method further comprises:
    当所述图标处于触发状态时,在所述图标上显示所述第三位置信息。When the icon is in the triggered state, the third position information is displayed on the icon.
  9. 根据权利要求6所述的方法,其特征在于,所述方法还包括:The method according to claim 6, wherein the method further comprises:
    当所述图标处于非触发状态时,隐藏所述第三位置信息。When the icon is in a non-triggered state, the third position information is hidden.
  10. 根据权利要求6所述的方法,其特征在于,所述第一用户指令还用于指示对所述目标对象进行定位的定位策略;The method according to claim 6, wherein the first user instruction is also used to indicate a positioning strategy for positioning the target object;
    所述第三位置信息为所述可移动平台根据所述定位策略定位获得。The third position information is obtained by positioning the movable platform according to the positioning strategy.
  11. 根据权利要求10所述的方法,其特征在于,所述定位策略包括智能跟踪策略。The method according to claim 10, wherein the positioning strategy comprises an intelligent tracking strategy.
  12. 根据权利要求11所述的方法,其特征在于,所述获取到第一用户指令之后, 获取所述目标对象在所述第一图传画面的第一位置信息之前,还包括:The method according to claim 11, wherein after obtaining the first user instruction, before obtaining the first position information of the target object in the first image transmission screen, the method further comprises:
    发送第一指示信息至所述可移动平台,所述第一指示信息用于指示所述可移动平台调整所述第一镜头的姿态,使得所述第一图传画面中的所述目标对象移动至所述第一图传画面的第一特定位置处;Send first instruction information to the movable platform, where the first instruction information is used to instruct the movable platform to adjust the posture of the first lens so that the target object in the first image transmission screen moves To the first specific position of the first image transmission screen;
    所述第一位置信息为所述第一特定位置的位置信息。The first location information is location information of the first specific location.
  13. 根据权利要求12所述的方法,其特征在于,所述第一特定位置包括所述第一图传画面的中心位置。The method according to claim 12, wherein the first specific position comprises a center position of the first image transmission screen.
  14. 根据权利要求12所述的方法,其特征在于,所述第一指示信息还用于指示所述可移动平台调整所述第一镜头的拍摄参数,使得所述第一图传画面中的所述目标对象在所述第一图传画面中的尺寸为预设尺寸。The method according to claim 12, wherein the first indication information is further used to instruct the movable platform to adjust the shooting parameters of the first lens so that the The size of the target object in the first image transmission screen is a preset size.
  15. 根据权利要求1所述的方法,其特征在于,所述第一用户指令为用户点击或框选所述第一图传画面中的物体时生成。The method according to claim 1, wherein the first user instruction is generated when the user clicks or box selects an object in the first image transmission screen.
  16. 根据权利要求15所述的方法,其特征在于,所述点击包括单击和双击中的一种。The method according to claim 15, wherein the click includes one of a single click and a double click.
  17. 根据权利要求10所述的方法,其特征在于,所述定位策略包括打点定位策略。The method according to claim 10, wherein the positioning strategy comprises a dot positioning strategy.
  18. 根据权利要求17所述的方法,其特征在于,所述第一用户指令为用户点击所述第一图传画面上显示的所述打点定位策略对应的标识时生成。The method according to claim 17, wherein the first user instruction is generated when the user clicks the mark corresponding to the dot positioning strategy displayed on the first image transmission screen.
  19. 根据权利要求18所述的方法,其特征在于,所述目标对象为所述第一图传画面的第二特定位置处的物体。18. The method according to claim 18, wherein the target object is an object at a second specific position of the first image transmission screen.
  20. 根据权利要求19所述的方法,其特征在于,所述第二特定位置包括所述第一图传画面的中心位置。The method according to claim 19, wherein the second specific position comprises a center position of the first image transmission screen.
  21. 根据权利要求19所述的方法,其特征在于,所述方法还包括:The method according to claim 19, wherein the method further comprises:
    在获取所述第三位置信息之前,输出第二指示信息;Before acquiring the third location information, output second indication information;
    所述第二指示信息用于指示用户通过所述可移动平台的控制装置调整所述第一镜头的姿态,以使得所述第一图传画面中的所述目标对象处于所述第二特定位置。The second indication information is used to instruct the user to adjust the posture of the first lens through the control device of the movable platform, so that the target object in the first image transmission screen is at the second specific position .
  22. 根据权利要求19所述的方法,其特征在于,所述获取到第一用户指令之前,还包括:The method according to claim 19, wherein before the obtaining the first user instruction, the method further comprises:
    获取到第二用户指令,所述第二用户指令用于指示所述第一图传画面中待移动至所述第二特定位置的物体;Acquiring a second user instruction, where the second user instruction is used to instruct an object to be moved to the second specific position in the first image transmission screen;
    根据所述第二用户指令,发送第三指示信息至所述可移动平台;Sending third instruction information to the movable platform according to the second user instruction;
    其中,所述第三指示信息用于指示所述可移动平台调整所述第一镜头的姿态,使得所述待移动至所述第二特定位置的物体移动至所述第二特定位置处。Wherein, the third indication information is used to instruct the movable platform to adjust the posture of the first lens, so that the object to be moved to the second specific position moves to the second specific position.
  23. 根据权利要求17所述的方法,其特征在于,所述第三位置信息为根据所述可移动平台的位置信息和所述目标对象相对所述可移动平台的距离确定。The method according to claim 17, wherein the third position information is determined based on the position information of the movable platform and the distance of the target object relative to the movable platform.
  24. 根据权利要求23所述的方法,其特征在于,所述第三位置信息包括所述目标对象的绝对位置信息,所述根据所述第一位置信息,在所述第一图传画面上对所述目 标对象进行标注,包括:23. The method according to claim 23, wherein the third position information includes absolute position information of the target object, and according to the first position information, the first image transmission screen The target object is labeled, including:
    根据所述第一位置信息和所述第三位置信息包含的所述绝对位置信息,在所述第一图传画面上对所述目标对象进行增强现实AR投影标注。According to the absolute position information contained in the first position information and the third position information, an augmented reality AR projection annotation is performed on the target object on the first image transmission screen.
  25. 根据权利要求17所述的方法,其特征在于,所述方法还包括:The method according to claim 17, wherein the method further comprises:
    在所述交互界面上显示所述第一图传画面对应的地图;Displaying a map corresponding to the first image transmission screen on the interactive interface;
    获取到第三用户指令,其中,所述第三用户指令由用户操作所述地图上显示的所述打点定位策略对应的标识时产生;Acquiring a third user instruction, where the third user instruction is generated when the user operates the mark corresponding to the dot positioning strategy displayed on the map;
    根据所述第三用户指令,对所述地图的第三特定位置处的目标对象进行标注。According to the third user instruction, mark the target object at the third specific position on the map.
  26. 根据权利要求25所述的方法,其特征在于,所述根据所述第三用户指令,对所述地图的第三特定位置处的目标对象进行标注之后,还包括:The method according to claim 25, wherein after the marking the target object at the third specific position on the map according to the third user instruction, the method further comprises:
    当所述地图上的标注对应的图标被触发时,若获取到第四用户指令,则根据所述第四用户指令,对所述标注包含的第三位置信息中的高度进行修改和/或删除。When the icon corresponding to the label on the map is triggered, if a fourth user instruction is obtained, modify and/or delete the height in the third location information contained in the label according to the fourth user instruction .
  27. 根据权利要求25所述的方法,其特征在于,所述根据所述第三用户指令,对所述地图的第三特定位置处的目标对象进行标注之后,还包括:The method according to claim 25, wherein after the marking the target object at the third specific position on the map according to the third user instruction, the method further comprises:
    当所述地图上的标注对应的图标被触发时,若获取到第五用户指令,则根据所述第五用户指令,在所述地图上移动所述图标的位置,并将所述标注包含的第三位置信息中的经纬度替换为移动后的所述图标的位置对应的经纬度。When the icon corresponding to the label on the map is triggered, if a fifth user instruction is obtained, the position of the icon is moved on the map according to the fifth user instruction, and the label included The longitude and latitude in the third position information is replaced with the longitude and latitude corresponding to the position of the icon after the movement.
  28. 根据权利要求27所述的方法,其特征在于,所述第五用户指令指示用户先对所述图标执行第一操作,再对所述图标执行第二操作。The method according to claim 27, wherein the fifth user instruction instructs the user to perform a first operation on the icon first, and then perform a second operation on the icon.
  29. 根据权利要求28所述的方法,其特征在于,所述第一操作包括:持续点击所述图标的时长大于预设时长,所述第二操作包括:拖动所述图标。The method according to claim 28, wherein the first operation comprises: continuously clicking the icon for a duration greater than a preset duration, and the second operation comprises: dragging the icon.
  30. 根据权利要求10所述的方法,其特征在于,所述定位策略包括激光测距策略。The method according to claim 10, wherein the positioning strategy comprises a laser ranging strategy.
  31. 根据权利要求30所述的方法,其特征在于,所述方法还包括:The method according to claim 30, wherein the method further comprises:
    获取所述目标对象定位获得的所述目标对象相对所述可移动平台的距离;Acquiring the distance of the target object relative to the movable platform obtained by positioning the target object;
    所述根据所述第一位置信息,在所述第一图传画面上对所述目标对象进行标注,包括:The marking the target object on the first image transmission screen according to the first location information includes:
    根据所述第一位置信息和所述目标对象相对所述可移动平台的距离,在所述第一图传画面上对所述目标对象进行标注。Mark the target object on the first image transmission screen according to the first position information and the distance of the target object relative to the movable platform.
  32. 根据权利要求30所述的方法,其特征在于,所述第一用户指令为用户点击所述第一图传画面上显示的激光测距策略对应的标识时生成。The method according to claim 30, wherein the first user instruction is generated when the user clicks the mark corresponding to the laser ranging strategy displayed on the first image transmission screen.
  33. 根据权利要求32所述的方法,其特征在于,所述目标对象为所述第一图传画面的第四特定位置处的物体。The method according to claim 32, wherein the target object is an object at a fourth specific position on the first image transmission screen.
  34. 根据权利要求33所述的方法,其特征在于,所述第四特定位置包括所述第一图传画面的中心位置。The method according to claim 33, wherein the fourth specific position comprises a center position of the first image transmission screen.
  35. 根据权利要求30所述的方法,其特征在于,所述确定所述目标对象在所述第二镜头获取的第二图传画面中的第二位置信息之后,还包括:The method according to claim 30, wherein after the determining the second position information of the target object in the second video transmission image obtained by the second lens, the method further comprises:
    若所述第二位置信息不在所述第二图传画面上,则在所述第二图传画面的边缘显示所述目标对象的标注;If the second location information is not on the second image transmission screen, display the label of the target object on the edge of the second image transmission screen;
    其中,所述边缘相对所述第二图传画面的中心位置的方位用于指示所述目标对象相对所述第二图传画面的中心位置的方位。Wherein, the position of the edge relative to the center position of the second video transmission screen is used to indicate the position of the target object relative to the center position of the second video transmission screen.
  36. 根据权利要求10所述的方法,其特征在于,所述定位策略包括多个,不同定位策略对应的标注的图标不同。The method according to claim 10, wherein the positioning strategy includes a plurality of positioning strategies, and the marked icons corresponding to different positioning strategies are different.
  37. 根据权利要求36所述的方法,其特征在于,当通过所述定位策略中的智能跟踪策略和激光测距策略在所述第一图传画面中标定所述目标对象时,所述目标对象处于所述第一图传画面的中心位置,且所述目标对象的标注的图标为所述智能跟踪策略和对应的标注的图标。The method according to claim 36, wherein when the target object is calibrated in the first image transmission screen through the intelligent tracking strategy and the laser ranging strategy in the positioning strategy, the target object is in The center position of the first image transmission screen, and the marked icon of the target object is the smart tracking strategy and the corresponding marked icon.
  38. 根据权利要求6所述的方法,其特征在于,所述方法还包括:The method according to claim 6, wherein the method further comprises:
    根据所述第三位置信息,在所述第一图传画面对应的地图上对所述目标对象进行标注。According to the third location information, the target object is marked on the map corresponding to the first image transmission screen.
  39. 根据权利要求1所述的方法,其特征在于,所述方法还包括:The method according to claim 1, wherein the method further comprises:
    将所述标注同步至外部设备和/或所述图传画面对应的地图和/或所述可移动平台的运行指引页面;Synchronizing the annotation to the external device and/or the map corresponding to the image transmission screen and/or the operation guide page of the movable platform;
    所述运行指引页面用于指示所述可移动平台的运行状况。The operation guide page is used to indicate the operation status of the movable platform.
  40. 一种目标标定装置,其特征在于,所述目标标定装置设于遥控终端,所述遥控终端与一可移动平台通信,所述可移动平台包括第一镜头和第二镜头,所述装置包括:A target calibration device, characterized in that the target calibration device is provided in a remote control terminal, the remote control terminal communicates with a movable platform, the movable platform includes a first lens and a second lens, and the device includes:
    存储装置,用于存储程序指令;以及Storage device for storing program instructions; and
    一个或多个处理器,调用所述存储装置中存储的程序指令,当所述程序指令被执行时,所述一个或多个处理器单独地或共同地被配置成用于实施如下操作:One or more processors call program instructions stored in the storage device, and when the program instructions are executed, the one or more processors are individually or collectively configured to implement the following operations:
    通过所述遥控终端获取所述第一镜头和第二镜头的图传画面,在所述遥控终端的交互界面上显示所述第一镜头获取的第一图传画面;Acquiring the image transmission images of the first lens and the second lens through the remote control terminal, and displaying the first image transmission image acquired by the first lens on the interactive interface of the remote control terminal;
    获取到第一用户指令,其中,所述第一用户指令用于指示所述第一图传画面中待标定的目标对象;Acquiring a first user instruction, where the first user instruction is used to instruct the target object to be calibrated in the first image transmission screen;
    获取所述目标对象在所述第一图传画面的第一位置信息;Acquiring first position information of the target object on the first image transmission screen;
    根据所述第一位置信息,在所述第一图传画面上对所述目标对象进行标注;Mark the target object on the first image transmission screen according to the first location information;
    根据所述第一位置信息、所述第一镜头与所述第二镜头之间的相对位置关系、所述第一镜头的拍摄参数以及所述第二镜头的拍摄参数,确定所述目标对象在所述第二镜头获取的第二图传画面中的第二位置信息。According to the first position information, the relative positional relationship between the first lens and the second lens, the shooting parameters of the first lens, and the shooting parameters of the second lens, it is determined that the target object is The second position information in the second video transmission picture acquired by the second lens.
  41. 根据权利要求40所述的装置,其特征在于,所述拍摄参数包括拍摄视角FOV。The device of claim 40, wherein the shooting parameter includes a shooting angle of view (FOV).
  42. 根据权利要求40所述的装置,其特征在于,所述可移动平台包括一个拍摄装置,所述拍摄装置包括多个镜头,所述第一镜头为所述拍摄装置包括的多个所述镜头中的一个,所述第二镜头包括所述拍摄装置包括的多个所述镜头中的其他镜头;或者,The device according to claim 40, wherein the movable platform comprises a photographing device, the photographing device comprises a plurality of lenses, and the first lens is one of the plurality of lenses included in the photographing device One of, the second lens includes another lens of the plurality of lenses included in the photographing device; or,
    所述可移动平台包括多个拍摄装置,所述第一镜头为其中一个所述拍摄装置的镜头,所述第二镜头包括其他拍摄装置的镜头。The movable platform includes a plurality of photographing devices, the first lens is a lens of one of the photographing devices, and the second lens includes a lens of another photographing device.
  43. 根据权利要求40所述的装置,其特征在于,所述一个或多个处理器在确定所述目标对象在所述第二镜头获取的第二图传画面中的第二位置信息之后,单独地或共同地还被配置成用于实施如下操作:The device according to claim 40, wherein the one or more processors separately determine the second position information of the target object in the second image transmission screen obtained by the second lens Or collectively also configured to perform the following operations:
    根据所述第二位置信息,在所述第二图传画面上标注所述目标对象。Mark the target object on the second image transmission screen according to the second location information.
  44. 根据权利要求43所述的装置,其特征在于,所述目标对象在所述第一图传画面上的标注与所述目标对象在所述第二图传画面上的标注相同。The device according to claim 43, wherein the label of the target object on the first image transmission screen is the same as the label of the target object on the second image transmission screen.
  45. 根据权利要求40或43所述的装置,其特征在于,所述标注包括图标和所述目标对象的第三位置信息。The device according to claim 40 or 43, wherein the label includes an icon and third position information of the target object.
  46. 根据权利要求45所述的装置,其特征在于,所述第三位置信息包括所述目标对象的经纬度和高度中的至少一种。The device according to claim 45, wherein the third location information includes at least one of the longitude, latitude, and height of the target object.
  47. 根据权利要求45所述的装置,其特征在于,所述一个或多个处理器单独地或共同地还被配置成用于实施如下操作:The device according to claim 45, wherein the one or more processors, individually or collectively, are further configured to perform the following operations:
    当所述图标处于触发状态时,在所述图标上显示所述第三位置信息。When the icon is in the triggered state, the third position information is displayed on the icon.
  48. 根据权利要求45所述的装置,其特征在于,所述一个或多个处理器单独地或共同地还被配置成用于实施如下操作:The device according to claim 45, wherein the one or more processors, individually or collectively, are further configured to perform the following operations:
    当所述图标处于非触发状态时,隐藏所述第三位置信息。When the icon is in a non-triggered state, the third position information is hidden.
  49. 根据权利要求45所述的装置,其特征在于,所述第一用户指令还用于指示对所述目标对象进行定位的定位策略;The device according to claim 45, wherein the first user instruction is further used to indicate a positioning strategy for positioning the target object;
    所述第三位置信息为所述可移动平台根据所述定位策略定位获得。The third position information is obtained by positioning the movable platform according to the positioning strategy.
  50. 根据权利要求49所述的装置,其特征在于,所述定位策略包括智能跟踪策略。The device according to claim 49, wherein the positioning strategy comprises an intelligent tracking strategy.
  51. 根据权利要求50所述的装置,其特征在于,所述一个或多个处理器在获取到第一用户指令之后,获取所述目标对象在所述第一图传画面的第一位置信息之前,单独地或共同地还被配置成用于实施如下操作:The device according to claim 50, wherein after the one or more processors obtain the first user instruction, before obtaining the first position information of the target object in the first image transmission screen, Separately or collectively, it is also configured to perform the following operations:
    发送第一指示信息至所述可移动平台,所述第一指示信息用于指示所述可移动平台调整所述第一镜头的姿态,使得所述第一图传画面中的所述目标对象移动至所述第一图传画面的第一特定位置处;Send first instruction information to the movable platform, where the first instruction information is used to instruct the movable platform to adjust the posture of the first lens so that the target object in the first image transmission screen moves To the first specific position of the first image transmission screen;
    所述第一位置信息为所述第一特定位置的位置信息。The first location information is location information of the first specific location.
  52. 根据权利要求51所述的装置,其特征在于,所述第一特定位置包括所述第一图传画面的中心位置。The device of claim 51, wherein the first specific position comprises a center position of the first image transmission screen.
  53. 根据权利要求51所述的装置,其特征在于,所述第一指示信息还用于指示所述可移动平台调整所述第一镜头的拍摄参数,使得所述第一图传画面中的所述目标对象在所述第一图传画面中的尺寸为预设尺寸。The device according to claim 51, wherein the first indication information is further used to instruct the movable platform to adjust the shooting parameters of the first lens so that the The size of the target object in the first image transmission screen is a preset size.
  54. 根据权利要求40所述的装置,其特征在于,所述第一用户指令为用户点击或框选所述第一图传画面中的物体时生成。The device according to claim 40, wherein the first user instruction is generated when the user clicks or box selects an object in the first image transmission screen.
  55. 根据权利要求54所述的装置,其特征在于,所述点击包括单击和双击中的一种。The device according to claim 54, wherein the click includes one of a single click and a double click.
  56. 根据权利要求49所述的装置,其特征在于,所述定位策略包括打点定位策略。The device according to claim 49, wherein the positioning strategy comprises a dot positioning strategy.
  57. 根据权利要求56所述的装置,其特征在于,所述第一用户指令为用户点击所述第一图传画面上显示的所述打点定位策略对应的标识时生成。The device according to claim 56, wherein the first user instruction is generated when the user clicks the mark corresponding to the dot positioning strategy displayed on the first image transmission screen.
  58. 根据权利要求57所述的装置,其特征在于,所述目标对象为所述第一图传画面的第二特定位置处的物体。The device of claim 57, wherein the target object is an object at a second specific position of the first image transmission screen.
  59. 根据权利要求58所述的装置,其特征在于,所述第二特定位置包括所述第一图传画面的中心位置。The device of claim 58, wherein the second specific position comprises a center position of the first image transmission screen.
  60. 根据权利要求58所述的装置,其特征在于,所述一个或多个处理器单独地或共同地还被配置成用于实施如下操作:The apparatus according to claim 58, wherein the one or more processors, individually or collectively, are further configured to perform the following operations:
    在获取所述第三位置信息之前,输出第二指示信息;Before acquiring the third location information, output second indication information;
    所述第二指示信息用于指示用户通过所述可移动平台的控制装置调整所述第一镜头的姿态,以使得所述第一图传画面中的所述目标对象处于所述第二特定位置。The second indication information is used to instruct the user to adjust the posture of the first lens through the control device of the movable platform, so that the target object in the first image transmission screen is at the second specific position .
  61. 根据权利要求58所述的装置,其特征在于,所述一个或多个处理器在获取到第一用户指令之前,单独地或共同地还被配置成用于实施如下操作:The device according to claim 58, wherein the one or more processors are separately or collectively configured to perform the following operations before acquiring the first user instruction:
    获取到第二用户指令,所述第二用户指令用于指示所述第一图传画面中待移动至所述第二特定位置的物体;Acquiring a second user instruction, where the second user instruction is used to instruct an object to be moved to the second specific position in the first image transmission screen;
    根据所述第二用户指令,发送第三指示信息至所述可移动平台;Sending third instruction information to the movable platform according to the second user instruction;
    其中,所述第三指示信息用于指示所述可移动平台调整所述第一镜头的姿态,使得所述待移动至所述第二特定位置的物体移动至所述第二特定位置处。Wherein, the third indication information is used to instruct the movable platform to adjust the posture of the first lens, so that the object to be moved to the second specific position moves to the second specific position.
  62. 根据权利要求56所述的装置,其特征在于,所述第三位置信息为根据所述可移动平台的位置信息和所述目标对象相对所述可移动平台的距离确定。The device according to claim 56, wherein the third position information is determined based on the position information of the movable platform and the distance of the target object relative to the movable platform.
  63. 根据权利要求62所述的装置,其特征在于,所述第三位置信息包括所述目标对象的绝对位置信息,所述一个或多个处理器在根据所述第一位置信息,在所述第一图传画面上对所述目标对象进行标注时,单独地或共同地被进一步配置成用于实施如下操作:The apparatus according to claim 62, wherein the third position information includes absolute position information of the target object, and the one or more processors are in the first position information according to the first position information. When annotating the target object on an image transmission screen, it is separately or collectively further configured to perform the following operations:
    根据所述第一位置信息和所述第三位置信息包含的所述绝对位置信息,在所述第一图传画面上对所述目标对象进行增强现实AR投影标注。According to the absolute position information contained in the first position information and the third position information, an augmented reality AR projection annotation is performed on the target object on the first image transmission screen.
  64. 根据权利要求56所述的装置,其特征在于,所述一个或多个处理器单独地或共同地还被配置成用于实施如下操作:The device according to claim 56, wherein the one or more processors, individually or collectively, are further configured to perform the following operations:
    在所述交互界面上显示所述第一图传画面对应的地图;Displaying a map corresponding to the first image transmission screen on the interactive interface;
    获取到第三用户指令,其中,所述第三用户指令由用户操作所述地图上显示的所述打点定位策略对应的标识时产生;Acquiring a third user instruction, where the third user instruction is generated when the user operates the mark corresponding to the dot positioning strategy displayed on the map;
    根据所述第三用户指令,对所述地图的第三特定位置处的目标对象进行标注。According to the third user instruction, mark the target object at the third specific position on the map.
  65. 根据权利要求64所述的装置,其特征在于,所述一个或多个处理器在根据所 述第三用户指令,对所述地图的第三特定位置处的目标对象进行标注之后,单独地或共同地还被配置成用于实施如下操作:The device according to claim 64, wherein the one or more processors individually or after marking the target object at the third specific position of the map according to the third user instruction It is also collectively configured to implement the following operations:
    当所述地图上的标注对应的图标被触发时,若获取到第四用户指令,则根据所述第四用户指令,对所述标注包含的第三位置信息中的高度进行修改和/或删除。When the icon corresponding to the label on the map is triggered, if a fourth user instruction is obtained, modify and/or delete the height in the third location information contained in the label according to the fourth user instruction .
  66. 根据权利要求64所述的装置,其特征在于,所述一个或多个处理器在根据所述第三用户指令,对所述地图的第三特定位置处的目标对象进行标注之后,单独地或共同地还被配置成用于实施如下操作:The device according to claim 64, wherein the one or more processors individually or after marking the target object at the third specific position of the map according to the third user instruction It is also collectively configured to implement the following operations:
    当所述地图上的标注对应的图标被触发时,若获取到第五用户指令,则根据所述第五用户指令,在所述地图上移动所述图标的位置,并将所述标注包含的第三位置信息中的经纬度替换为移动后的所述图标的位置对应的经纬度。When the icon corresponding to the label on the map is triggered, if a fifth user instruction is obtained, the position of the icon is moved on the map according to the fifth user instruction, and the label included The longitude and latitude in the third position information is replaced with the longitude and latitude corresponding to the position of the icon after the movement.
  67. 根据权利要求66所述的装置,其特征在于,所述第五用户指令指示用户先对所述图标执行第一操作,再对所述图标执行第二操作。The device of claim 66, wherein the fifth user instruction instructs the user to perform a first operation on the icon first, and then perform a second operation on the icon.
  68. 根据权利要求67所述的装置,其特征在于,所述第一操作包括:持续点击所述图标的时长大于预设时长,所述第二操作包括:拖动所述图标。The device according to claim 67, wherein the first operation comprises: continuously clicking on the icon for a duration greater than a preset duration, and the second operation comprises: dragging the icon.
  69. 根据权利要求49所述的装置,其特征在于,所述定位策略包括激光测距策略。The device of claim 49, wherein the positioning strategy comprises a laser ranging strategy.
  70. 根据权利要求69所述的装置,其特征在于,所述一个或多个处理器单独地或共同地还被配置成用于实施如下操作:The device according to claim 69, wherein the one or more processors, individually or collectively, are further configured to perform the following operations:
    获取所述目标对象定位获得的所述目标对象相对所述可移动平台的距离;Acquiring the distance of the target object relative to the movable platform obtained by positioning the target object;
    所述一个或多个处理器在根据所述第一位置信息,在所述第一图传画面上对所述目标对象进行标注时,单独地或共同地被进一步配置成用于实施如下操作:When the one or more processors mark the target object on the first image transmission screen according to the first location information, individually or collectively, they are further configured to perform the following operations:
    根据所述第一位置信息和所述目标对象相对所述可移动平台的距离,在所述第一图传画面上对所述目标对象进行标注。Mark the target object on the first image transmission screen according to the first position information and the distance of the target object relative to the movable platform.
  71. 根据权利要求69所述的装置,其特征在于,所述第一用户指令为用户点击所述第一图传画面上显示的激光测距策略对应的标识时生成。The device according to claim 69, wherein the first user instruction is generated when the user clicks the mark corresponding to the laser ranging strategy displayed on the first image transmission screen.
  72. 根据权利要求71所述的装置,其特征在于,所述目标对象为所述第一图传画面的第四特定位置处的物体。The device according to claim 71, wherein the target object is an object at a fourth specific position on the first image transmission screen.
  73. 根据权利要求72所述的装置,其特征在于,所述第四特定位置包括所述第一图传画面的中心位置。The device of claim 72, wherein the fourth specific position comprises a center position of the first image transmission screen.
  74. 根据权利要求69所述的装置,其特征在于,所述一个或多个处理器在确定所述目标对象在所述第二镜头获取的第二图传画面中的第二位置信息之后,单独地或共同地还被配置成用于实施如下操作:The device according to claim 69, wherein the one or more processors separately determine the second position information of the target object in the second image transmission frame obtained by the second lens Or collectively also configured to perform the following operations:
    若所述第二位置信息不在所述第二图传画面上,则在所述第二图传画面的边缘显示所述目标对象的标注;If the second location information is not on the second image transmission screen, display the label of the target object on the edge of the second image transmission screen;
    其中,所述边缘相对所述第二图传画面的中心位置的方位用于指示所述目标对象相对所述第二图传画面的中心位置的方位。Wherein, the position of the edge relative to the center position of the second video transmission screen is used to indicate the position of the target object relative to the center position of the second video transmission screen.
  75. 根据权利要求49所述的装置,其特征在于,所述定位策略包括多个,不同定 位策略对应的标注的图标不同。The device according to claim 49, wherein the positioning strategy comprises a plurality of positioning strategies, and the marked icons corresponding to different positioning strategies are different.
  76. 根据权利要求75所述的装置,其特征在于,当通过所述定位策略中的智能跟踪策略和激光测距策略在所述第一图传画面中标定所述目标对象时,所述目标对象处于所述第一图传画面的中心位置,且所述目标对象的标注的图标为所述智能跟踪策略和对应的标注的图标。The device according to claim 75, wherein when the target object is calibrated in the first image transmission screen through the intelligent tracking strategy and the laser ranging strategy in the positioning strategy, the target object is in The center position of the first image transmission screen, and the marked icon of the target object is the smart tracking strategy and the corresponding marked icon.
  77. 根据权利要求45所述的装置,其特征在于,所述一个或多个处理器单独地或共同地还被配置成用于实施如下操作:The device according to claim 45, wherein the one or more processors, individually or collectively, are further configured to perform the following operations:
    根据所述第三位置信息,在所述第一图传画面对应的地图上对所述目标对象进行标注。According to the third location information, the target object is marked on the map corresponding to the first image transmission screen.
  78. 根据权利要求40所述的装置,其特征在于,所述一个或多个处理器单独地或共同地还被配置成用于实施如下操作:The device according to claim 40, wherein the one or more processors, individually or collectively, are further configured to perform the following operations:
    将所述标注同步至外部设备和/或所述图传画面对应的地图和/或所述可移动平台的运行指引页面;Synchronizing the annotation to the external device and/or the map corresponding to the image transmission screen and/or the operation guide page of the movable platform;
    所述运行指引页面用于指示所述可移动平台的运行状况。The operation guide page is used to indicate the operation status of the movable platform.
  79. 一种遥控终端,其特征在于,所述遥控终端与一可移动平台通信,所述可移动平台包括第一镜头和第二镜头,所述遥控终端包括:A remote control terminal, characterized in that the remote control terminal communicates with a movable platform, the movable platform includes a first lens and a second lens, and the remote control terminal includes:
    主体;和Subject; and
    权利要求40至78任一项所述的目标标定装置,由所述主体支撑。The target calibration device according to any one of claims 40 to 78, which is supported by the main body.
  80. 一种目标标定系统,其特征在于,包括:A target calibration system is characterized in that it comprises:
    遥控终端;和Remote control terminal; and
    可移动平台,与所述遥控终端通信,所述可移动平台包括第一镜头和第二镜头;A movable platform, communicating with the remote control terminal, the movable platform including a first lens and a second lens;
    其中,所述遥控终端包括主体和权利要求40至78任一项所述的目标标定装置,所述目标标定装置由所述主体支撑。Wherein, the remote control terminal includes a main body and the target calibration device according to any one of claims 40 to 78, and the target calibration device is supported by the main body.
  81. 一种计算机可读存储介质,其上存储有计算机程序,其特征在于,该程序被处理器执行时实现权利要求1至39任一项所述的目标标定方法。A computer-readable storage medium with a computer program stored thereon, wherein the program is characterized in that when the program is executed by a processor, the target calibration method according to any one of claims 1 to 39 is realized.
  82. 一种目标标定方法,其特征在于,适用于一遥控终端,所述遥控终端与一可移动平台通信,所述可移动平台上搭载有拍摄装置,所述方法包括:A target calibration method, characterized in that it is suitable for a remote control terminal, the remote control terminal communicates with a movable platform on which a photographing device is mounted, and the method includes:
    在所述遥控终端的交互界面上显示所述拍摄装置获取的图传画面;Displaying the image transmission screen acquired by the photographing device on the interactive interface of the remote control terminal;
    获取到第一用户指令,其中,所述第一用户指令用于指示对所述图传画面中待标定的目标对象和所述目标对象进行定位的定位策略;Acquiring a first user instruction, where the first user instruction is used to instruct the target object to be calibrated in the image transmission screen and a positioning strategy for positioning the target object;
    根据所述定位策略,从所述可移动平台获取所述目标对象的位置信息,所述位置信息包含所述目标对象相对所述可移动平台的距离;Obtaining the position information of the target object from the movable platform according to the positioning strategy, where the position information includes the distance of the target object relative to the movable platform;
    根据所述位置信息,在所述图传画面上对所述目标对象进行标注。According to the location information, the target object is marked on the image transmission screen.
  83. 根据权利要求82所述的方法,其特征在于,所述标注包括图标和所述位置信息。The method according to claim 82, wherein the label includes an icon and the location information.
  84. 根据权利要求83所述的方法,其特征在于,所述位置信息还包括所述目标对 象的经纬度和高度中的至少一种。The method according to claim 83, wherein the position information further includes at least one of the latitude, longitude and height of the target object.
  85. 根据权利要求83所述的方法,其特征在于,所述方法还包括:The method of claim 83, wherein the method further comprises:
    当所述图标处于触发状态时,在所述图标上显示所述位置信息。When the icon is in a triggered state, the location information is displayed on the icon.
  86. 根据权利要求83所述的方法,其特征在于,所述方法还包括:The method of claim 83, wherein the method further comprises:
    当所述图标处于非触发状态时,隐藏所述位置信息。When the icon is in a non-triggered state, hide the location information.
  87. 根据权利要求82所述的方法,其特征在于,所述定位策略包括打点定位策略,所述第一用户指令为用户点击所述图传画面上显示的所述打点定位策略对应的标识时生成。The method according to claim 82, wherein the positioning strategy comprises a dot positioning strategy, and the first user instruction is generated when the user clicks the mark corresponding to the dot positioning strategy displayed on the image transmission screen.
  88. 根据权利要求87所述的方法,其特征在于,所述目标对象为所述图传画面的第一特定位置处的物体。The method according to claim 87, wherein the target object is an object at a first specific position of the image transmission screen.
  89. 根据权利要求88所述的方法,其特征在于,所述第一特定位置包括所述图传画面的中心位置。The method according to claim 88, wherein the first specific position comprises a center position of the image transmission screen.
  90. 根据权利要求88所述的方法,其特征在于,所述方法还包括:The method of claim 88, wherein the method further comprises:
    在获取所述位置信息之前,输出第一指示信息;Before acquiring the location information, output first indication information;
    所述第一指示信息用于指示用户通过所述可移动平台的控制装置调整所述拍摄装置的姿态,以使得所述图传画面中的所述目标对象处于所述第一特定位置。The first indication information is used to instruct the user to adjust the posture of the photographing device through the control device of the movable platform, so that the target object in the image transmission screen is at the first specific position.
  91. 根据权利要求88所述的方法,其特征在于,所述获取到第一用户指令之前,还包括:The method according to claim 88, wherein before the obtaining the first user instruction, the method further comprises:
    获取到第二用户指令,所述第二用户指令用于指示所述图传画面中待移动至所述第一特定位置的物体;Acquiring a second user instruction, where the second user instruction is used to instruct an object in the image transmission screen to be moved to the first specific position;
    根据所述第二用户指令,发送第二指示信息至所述可移动平台;Sending second instruction information to the movable platform according to the second user instruction;
    其中,所述第二指示信息用于指示所述可移动平台调整所述拍摄装置的姿态,使得所述待移动至所述第一特定位置的物体移动至所述第一特定位置处。The second indication information is used to instruct the movable platform to adjust the posture of the photographing device, so that the object to be moved to the first specific position moves to the first specific position.
  92. 根据权利要求87所述的方法,其特征在于,所述位置信息为根据所述可移动平台的位置信息和所述目标对象相对所述可移动平台的距离确定。The method according to claim 87, wherein the position information is determined based on the position information of the movable platform and the distance of the target object relative to the movable platform.
  93. 根据权利要求92所述的方法,其特征在于,所述位置信息包括所述目标对象的绝对位置信息,所述根据所述位置信息,在所述图传画面上对所述目标对象进行标注,包括:The method according to claim 92, wherein the position information includes absolute position information of the target object, and the target object is marked on the image transmission screen according to the position information, include:
    根据所述位置信息包含的所述绝对位置信息,在所述图传画面上对所述目标对象进行增强现实AR投影标注。According to the absolute position information included in the position information, an augmented reality AR projection annotation is performed on the target object on the image transmission screen.
  94. 根据权利要求87所述的方法,其特征在于,所述方法还包括:The method according to claim 87, wherein the method further comprises:
    在所述交互界面上显示所述图传画面对应的地图;Displaying a map corresponding to the image transmission screen on the interactive interface;
    获取到第三用户指令,其中,所述第三用户指令由用户操作所述地图上显示的所述打点定位策略对应的标识时产生;Acquiring a third user instruction, where the third user instruction is generated when the user operates the mark corresponding to the dot positioning strategy displayed on the map;
    根据所述打点定位策略,从所述可移动平台获取所述目标对象的位置信息;Obtaining the position information of the target object from the movable platform according to the positioning and positioning strategy;
    根据所述位置信息,对所述地图的第二特定位置处的目标对象进行标注。According to the location information, mark the target object at the second specific location on the map.
  95. 根据权利要求94所述的方法,其特征在于,所述根据所述位置信息,对所述地图的第二特定位置处的目标对象进行标注之后,还包括:The method according to claim 94, wherein after the marking the target object at the second specific position on the map according to the position information, the method further comprises:
    当所述地图上的标注对应的图标被触发时,若获取到第四用户指令,则根据所述第四用户指令,对所述标注包含的位置信息中的高度进行修改和/或删除。When the icon corresponding to the label on the map is triggered, if a fourth user instruction is obtained, the height in the location information included in the label is modified and/or deleted according to the fourth user instruction.
  96. 根据权利要求94所述的方法,其特征在于,所述根据所述位置信息,对所述地图的第二特定位置处的目标对象进行标注之后,还包括:The method according to claim 94, wherein after the marking the target object at the second specific position on the map according to the position information, the method further comprises:
    当所述地图上的标注对应的图标被触发时,若获取到第五用户指令,则根据所述第五用户指令,在所述地图上移动所述图标的位置,并将所述标注包含的位置信息中的经纬度替换为移动后的所述图标的位置对应的经纬度。When the icon corresponding to the label on the map is triggered, if a fifth user instruction is obtained, the position of the icon is moved on the map according to the fifth user instruction, and the label included The longitude and latitude in the location information are replaced with the longitude and latitude corresponding to the position of the icon after the movement.
  97. 根据权利要求96所述的方法,其特征在于,所述第五用户指令指示用户先对所述图标执行第一操作,再对所述图标执行第二操作。The method of claim 96, wherein the fifth user instruction instructs the user to perform a first operation on the icon first, and then perform a second operation on the icon.
  98. 根据权利要求97所述的方法,其特征在于,所述第一操作包括:持续点击所述图标的时长大于预设时长,所述第二操作包括:拖动所述图标。The method according to claim 97, wherein the first operation comprises: continuously clicking the icon for a duration greater than a preset duration, and the second operation comprises: dragging the icon.
  99. 根据权利要求82所述的方法,其特征在于,所述定位策略包括激光测距策略,所述第一用户指令为用户点击所述图传画面上显示的激光测距策略对应的标识时生成。The method according to claim 82, wherein the positioning strategy comprises a laser ranging strategy, and the first user instruction is generated when the user clicks the mark corresponding to the laser ranging strategy displayed on the image transmission screen.
  100. 根据权利要求99所述的方法,其特征在于,所述目标对象为所述图传画面的第三特定位置处的物体。The method according to claim 99, wherein the target object is an object at a third specific position of the image transmission screen.
  101. 根据权利要求100所述的方法,其特征在于,所述第三特定位置包括所述图传画面的中心位置。The method according to claim 100, wherein the third specific position comprises a center position of the image transmission screen.
  102. 根据权利要求82所述的方法,其特征在于,所述方法还包括:The method according to claim 82, wherein the method further comprises:
    将所述标注同步至外部设备和/或所述图传画面对应的地图和/或所述可移动平台的运行指引页面;Synchronizing the annotation to the external device and/or the map corresponding to the image transmission screen and/or the operation guide page of the movable platform;
    所述运行指引页面用于指示所述可移动平台的运行状况。The operation guide page is used to indicate the operation status of the movable platform.
  103. 一种目标标定装置,其特征在于,所述目标标定装置设于遥控终端,所述遥控终端与一可移动平台通信,所述可移动平台上搭载有拍摄装置,所述装置包括:A target calibration device, characterized in that the target calibration device is provided in a remote control terminal, the remote control terminal communicates with a movable platform, the movable platform is equipped with a photographing device, and the device includes:
    存储装置,用于存储程序指令;以及Storage device for storing program instructions; and
    一个或多个处理器,调用所述存储装置中存储的程序指令,当所述程序指令被执行时,所述一个或多个处理器单独地或共同地被配置成用于实施如下操作:One or more processors call program instructions stored in the storage device, and when the program instructions are executed, the one or more processors are individually or collectively configured to implement the following operations:
    在所述遥控终端的交互界面上显示所述拍摄装置获取的图传画面;Displaying the image transmission screen acquired by the photographing device on the interactive interface of the remote control terminal;
    获取到第一用户指令,其中,所述第一用户指令用于指示对所述图传画面中待标定的目标对象和所述目标对象进行定位的定位策略;Acquiring a first user instruction, where the first user instruction is used to instruct the target object to be calibrated in the image transmission screen and a positioning strategy for positioning the target object;
    根据所述定位策略,从所述可移动平台获取所述目标对象的位置信息,所述位置信息包含所述目标对象相对所述可移动平台的距离;Obtaining the position information of the target object from the movable platform according to the positioning strategy, where the position information includes the distance of the target object relative to the movable platform;
    根据所述位置信息,在所述图传画面上对所述目标对象进行标注。According to the location information, the target object is marked on the image transmission screen.
  104. 根据权利要求103所述的装置,其特征在于,所述标注包括图标和所述位置 信息。The device of claim 103, wherein the label includes an icon and the location information.
  105. 根据权利要求104所述的装置,其特征在于,所述位置信息还包括所述目标对象的经纬度和高度中的至少一种。The device according to claim 104, wherein the location information further comprises at least one of the longitude, latitude and height of the target object.
  106. 根据权利要求104所述的装置,其特征在于,所述一个或多个处理器单独地或共同地还被配置成用于实施如下操作:The apparatus according to claim 104, wherein the one or more processors, individually or collectively, are further configured to perform the following operations:
    当所述图标处于触发状态时,在所述图标上显示所述位置信息。When the icon is in a triggered state, the location information is displayed on the icon.
  107. 根据权利要求104所述的装置,其特征在于,所述一个或多个处理器单独地或共同地还被配置成用于实施如下操作:The apparatus according to claim 104, wherein the one or more processors, individually or collectively, are further configured to perform the following operations:
    当所述图标处于非触发状态时,隐藏所述位置信息。When the icon is in a non-triggered state, hide the location information.
  108. 根据权利要求103所述的装置,其特征在于,所述定位策略包括打点定位策略,所述第一用户指令为用户点击所述图传画面上显示的所述打点定位策略对应的标识时生成。The device according to claim 103, wherein the positioning strategy comprises a dot positioning strategy, and the first user instruction is generated when the user clicks the mark corresponding to the dot positioning strategy displayed on the image transmission screen.
  109. 根据权利要求108所述的装置,其特征在于,所述目标对象为所述图传画面的第一特定位置处的物体。The device of claim 108, wherein the target object is an object at a first specific position on the image transmission screen.
  110. 根据权利要求109所述的装置,其特征在于,所述第一特定位置包括所述图传画面的中心位置。The device of claim 109, wherein the first specific position comprises a center position of the image transmission screen.
  111. 根据权利要求109所述的装置,其特征在于,所述一个或多个处理器单独地或共同地还被配置成用于实施如下操作:The apparatus according to claim 109, wherein the one or more processors, individually or collectively, are further configured to perform the following operations:
    在获取所述位置信息之前,输出第一指示信息;Before acquiring the location information, output first indication information;
    所述第一指示信息用于指示用户通过所述可移动平台的控制装置调整所述拍摄装置的姿态,以使得所述图传画面中的所述目标对象处于所述第一特定位置。The first indication information is used to instruct the user to adjust the posture of the photographing device through the control device of the movable platform, so that the target object in the image transmission screen is at the first specific position.
  112. 根据权利要求109所述的装置,其特征在于,所述一个或多个处理器在获取到第一用户指令之前,单独地或共同地还被配置成用于实施如下操作:The device according to claim 109, wherein the one or more processors are separately or collectively configured to perform the following operations before acquiring the first user instruction:
    获取到第二用户指令,所述第二用户指令用于指示所述图传画面中待移动至所述第一特定位置的物体;Acquiring a second user instruction, where the second user instruction is used to instruct an object in the image transmission screen to be moved to the first specific position;
    根据所述第二用户指令,发送第二指示信息至所述可移动平台;Sending second instruction information to the movable platform according to the second user instruction;
    其中,所述第二指示信息用于指示所述可移动平台调整所述拍摄装置的姿态,使得所述待移动至所述第一特定位置的物体移动至所述第一特定位置处。The second indication information is used to instruct the movable platform to adjust the posture of the photographing device, so that the object to be moved to the first specific position moves to the first specific position.
  113. 根据权利要求108所述的装置,其特征在于,所述位置信息为根据所述可移动平台的位置信息和所述目标对象相对所述可移动平台的距离确定。The device according to claim 108, wherein the position information is determined based on the position information of the movable platform and the distance of the target object relative to the movable platform.
  114. 根据权利要求113所述的装置,其特征在于,所述位置信息包括所述目标对象的绝对位置信息,所述一个或多个处理器在根据所述位置信息,在所述图传画面上对所述目标对象进行标注时,单独地或共同地被进一步配置成用于实施如下操作:The device according to claim 113, wherein the position information includes absolute position information of the target object, and the one or more processors perform a comparison on the image transmission screen according to the position information. When the target objects are annotated, they are separately or collectively further configured to implement the following operations:
    根据所述位置信息包含的所述绝对位置信息,在所述图传画面上对所述目标对象进行增强现实AR投影标注。According to the absolute position information included in the position information, an augmented reality AR projection annotation is performed on the target object on the image transmission screen.
  115. 根据权利要求108所述的装置,其特征在于,所述一个或多个处理器单独地 或共同地还被配置成用于实施如下操作:The apparatus according to claim 108, wherein the one or more processors, individually or collectively, are further configured to perform the following operations:
    在所述交互界面上显示所述图传画面对应的地图;Displaying a map corresponding to the image transmission screen on the interactive interface;
    获取到第三用户指令,其中,所述第三用户指令由用户操作所述地图上显示的所述打点定位策略对应的标识时产生;Acquiring a third user instruction, where the third user instruction is generated when the user operates the mark corresponding to the dot positioning strategy displayed on the map;
    根据所述打点定位策略,从所述可移动平台获取所述目标对象的位置信息;Obtaining the position information of the target object from the movable platform according to the positioning and positioning strategy;
    根据所述位置信息,对所述地图的第二特定位置处的目标对象进行标注。According to the location information, mark the target object at the second specific location on the map.
  116. 根据权利要求115所述的装置,其特征在于,所述一个或多个处理器在根据所述位置信息,对所述地图的第二特定位置处的目标对象进行标注之后,单独地或共同地还被配置成用于实施如下操作:The device according to claim 115, wherein the one or more processors individually or collectively mark the target object at the second specific position of the map according to the position information It is also configured to perform the following operations:
    当所述地图上的标注对应的图标被触发时,若获取到第四用户指令,则根据所述第四用户指令,对所述标注包含的位置信息中的高度进行修改和/或删除。When the icon corresponding to the label on the map is triggered, if a fourth user instruction is obtained, the height in the location information included in the label is modified and/or deleted according to the fourth user instruction.
  117. 根据权利要求115所述的装置,其特征在于,所述一个或多个处理器在根据所述位置信息,对所述地图的第二特定位置处的目标对象进行标注之后,单独地或共同地还被配置成用于实施如下操作:The device according to claim 115, wherein the one or more processors individually or collectively mark the target object at the second specific position of the map according to the position information It is also configured to perform the following operations:
    当所述地图上的标注对应的图标被触发时,若获取到第五用户指令,则根据所述第五用户指令,在所述地图上移动所述图标的位置,并将所述标注包含的位置信息中的经纬度替换为移动后的所述图标的位置对应的经纬度。When the icon corresponding to the label on the map is triggered, if a fifth user instruction is obtained, the position of the icon is moved on the map according to the fifth user instruction, and the label included The longitude and latitude in the location information are replaced with the longitude and latitude corresponding to the position of the icon after the movement.
  118. 根据权利要求117所述的装置,其特征在于,所述第五用户指令指示用户先对所述图标执行第一操作,再对所述图标执行第二操作。The apparatus of claim 117, wherein the fifth user instruction instructs the user to perform a first operation on the icon first, and then perform a second operation on the icon.
  119. 根据权利要求118所述的装置,其特征在于,所述第一操作包括:持续点击所述图标的时长大于预设时长,所述第二操作包括:拖动所述图标。The device according to claim 118, wherein the first operation comprises: continuously clicking on the icon for longer than a preset time period, and the second operation comprises: dragging the icon.
  120. 根据权利要求103所述的装置,其特征在于,所述定位策略包括激光测距策略,所述第一用户指令为用户点击所述图传画面上显示的激光测距策略对应的标识时生成。The device according to claim 103, wherein the positioning strategy comprises a laser ranging strategy, and the first user instruction is generated when the user clicks the mark corresponding to the laser ranging strategy displayed on the image transmission screen.
  121. 根据权利要求120所述的装置,其特征在于,所述目标对象为所述图传画面的第三特定位置处的物体。The device of claim 120, wherein the target object is an object at a third specific position on the image transmission screen.
  122. 根据权利要求121所述的装置,其特征在于,所述第三特定位置包括所述图传画面的中心位置。The device of claim 121, wherein the third specific position comprises a center position of the image transmission screen.
  123. 根据权利要求103所述的装置,其特征在于,所述一个或多个处理器单独地或共同地还被配置成用于实施如下操作:The apparatus according to claim 103, wherein the one or more processors, individually or collectively, are further configured to perform the following operations:
    将所述标注同步至外部设备和/或所述图传画面对应的地图和/或所述可移动平台的运行指引页面;Synchronizing the annotation to the external device and/or the map corresponding to the image transmission screen and/or the operation guide page of the movable platform;
    所述运行指引页面用于指示所述可移动平台的运行状况。The operation guide page is used to indicate the operation status of the movable platform.
  124. 一种遥控终端,其特征在于,所述遥控终端与一可移动平台通信,所述可移动平台上搭载有拍摄装置,所述遥控终端包括:A remote control terminal, characterized in that the remote control terminal communicates with a movable platform, the movable platform is equipped with a photographing device, and the remote control terminal includes:
    主体;和Subject; and
    权利要求103至123任一项所述的目标标定装置,由所述主体支撑。The target calibration device according to any one of claims 103 to 123, which is supported by the main body.
  125. 一种目标标定系统,其特征在于,包括:A target calibration system is characterized in that it comprises:
    遥控终端;和Remote control terminal; and
    可移动平台,与所述遥控终端通信,所述可移动平台上搭载有拍摄装置;A movable platform that communicates with the remote control terminal, and a camera is mounted on the movable platform;
    其中,所述遥控终端包括主体和权利要求103至123任一项所述的目标标定装置,所述目标标定装置由所述主体支撑。Wherein, the remote control terminal includes a main body and the target calibration device according to any one of claims 103 to 123, and the target calibration device is supported by the main body.
  126. 一种计算机可读存储介质,其上存储有计算机程序,其特征在于,该程序被处理器执行时实现权利要求82至102任一项所述的目标标定方法。A computer-readable storage medium with a computer program stored thereon, wherein the program is characterized in that when the program is executed by a processor, the target calibration method according to any one of claims 82 to 102 is realized.
PCT/CN2020/086793 2020-04-24 2020-04-24 Target calibration method, apparatus, and system, and remote control terminal of movable platform WO2021212499A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN202080021661.6A CN113597596A (en) 2020-04-24 2020-04-24 Target calibration method, device and system and remote control terminal of movable platform
PCT/CN2020/086793 WO2021212499A1 (en) 2020-04-24 2020-04-24 Target calibration method, apparatus, and system, and remote control terminal of movable platform

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2020/086793 WO2021212499A1 (en) 2020-04-24 2020-04-24 Target calibration method, apparatus, and system, and remote control terminal of movable platform

Publications (1)

Publication Number Publication Date
WO2021212499A1 true WO2021212499A1 (en) 2021-10-28

Family

ID=78237890

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/086793 WO2021212499A1 (en) 2020-04-24 2020-04-24 Target calibration method, apparatus, and system, and remote control terminal of movable platform

Country Status (2)

Country Link
CN (1) CN113597596A (en)
WO (1) WO2021212499A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114301571A (en) * 2022-02-14 2022-04-08 中国人民解放军陆军工程大学 Multi-rotor unmanned aerial vehicle counter-braking method and system

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080099678A1 (en) * 2004-12-03 2008-05-01 Johnson Kirk R Camera with visible light and infrared image blending
CN102148965A (en) * 2011-05-09 2011-08-10 上海芯启电子科技有限公司 Video monitoring system for multi-target tracking close-up shooting
CN104038737A (en) * 2014-05-30 2014-09-10 西安交通大学 Double-camera system and method for actively acquiring high-resolution image of interested target
CN109154874A (en) * 2017-10-31 2019-01-04 深圳市大疆创新科技有限公司 Image display method, control method and relevant device
CN109618131A (en) * 2018-11-22 2019-04-12 亮风台(上海)信息科技有限公司 A kind of method and apparatus of information to aid in decision for rendering

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080099678A1 (en) * 2004-12-03 2008-05-01 Johnson Kirk R Camera with visible light and infrared image blending
CN102148965A (en) * 2011-05-09 2011-08-10 上海芯启电子科技有限公司 Video monitoring system for multi-target tracking close-up shooting
CN104038737A (en) * 2014-05-30 2014-09-10 西安交通大学 Double-camera system and method for actively acquiring high-resolution image of interested target
CN109154874A (en) * 2017-10-31 2019-01-04 深圳市大疆创新科技有限公司 Image display method, control method and relevant device
CN109618131A (en) * 2018-11-22 2019-04-12 亮风台(上海)信息科技有限公司 A kind of method and apparatus of information to aid in decision for rendering

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114301571A (en) * 2022-02-14 2022-04-08 中国人民解放军陆军工程大学 Multi-rotor unmanned aerial vehicle counter-braking method and system
CN114301571B (en) * 2022-02-14 2024-03-12 中国人民解放军陆军工程大学 Multi-rotor unmanned aerial vehicle countering method and system

Also Published As

Publication number Publication date
CN113597596A (en) 2021-11-02

Similar Documents

Publication Publication Date Title
US11165959B2 (en) Connecting and using building data acquired from mobile devices
US10354407B2 (en) Camera for locating hidden objects
JP5740884B2 (en) AR navigation for repeated shooting and system, method and program for difference extraction
CN108702444B (en) Image processing method, unmanned aerial vehicle and system
US9560274B2 (en) Image generation apparatus and image generation method
US9729788B2 (en) Image generation apparatus and image generation method
WO2018214078A1 (en) Photographing control method and device
US10284776B2 (en) Image generation apparatus and image generation method
US9736368B2 (en) Camera in a headframe for object tracking
US9894272B2 (en) Image generation apparatus and image generation method
KR20210104684A (en) Surveying and mapping systems, surveying and mapping methods, devices and instruments
US20180262789A1 (en) System for georeferenced, geo-oriented realtime video streams
WO2020103020A1 (en) Surveying sample point planning method and apparatus, control terminal, and storage medium
US11668577B1 (en) Methods and systems for response vehicle deployment
KR101959366B1 (en) Mutual recognition method between UAV and wireless device
JP2004056664A (en) Cooperative photography system
US11024090B2 (en) Virtual frame for guided image composition
WO2020103023A1 (en) Surveying and mapping system, surveying and mapping method, apparatus, device and medium
WO2021212499A1 (en) Target calibration method, apparatus, and system, and remote control terminal of movable platform
WO2020103021A1 (en) Planning method and apparatus for surveying and mapping sampling points, control terminal and storage medium
CN113906481A (en) Imaging display method, remote control terminal, device, system and storage medium
KR20210106422A (en) Job control system, job control method, device and instrument
WO2021212501A1 (en) Trajectory generation method, remote control terminal, mobile platform, system, and computer-readable storage medium
JP7081198B2 (en) Shooting system and shooting control device
CN115439635B (en) Method and equipment for presenting marking information of target object

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20932746

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20932746

Country of ref document: EP

Kind code of ref document: A1