WO2020147085A1 - 拍摄控制方法及可移动平台 - Google Patents
拍摄控制方法及可移动平台 Download PDFInfo
- Publication number
- WO2020147085A1 WO2020147085A1 PCT/CN2019/072231 CN2019072231W WO2020147085A1 WO 2020147085 A1 WO2020147085 A1 WO 2020147085A1 CN 2019072231 W CN2019072231 W CN 2019072231W WO 2020147085 A1 WO2020147085 A1 WO 2020147085A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- shooting
- mobile platform
- sample image
- target object
- real
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 72
- 238000005070 sampling Methods 0.000 claims description 5
- 238000004590 computer program Methods 0.000 claims description 4
- 230000005484 gravity Effects 0.000 description 10
- 238000010586 diagram Methods 0.000 description 6
- 238000007689 inspection Methods 0.000 description 6
- 230000006870 function Effects 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000003252 repetitive effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
- G05D1/0094—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots involving pointing a payload, e.g. camera, weapon, sensor, towards a fixed or moving target
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D3/00—Control of position or direction
- G05D3/12—Control of position or direction using feedback
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/62—Control of parameters via user interfaces
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/63—Control of cameras or camera modules by using electronic viewfinders
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/64—Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/67—Focus control based on electronic image sensor signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/69—Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B64—AIRCRAFT; AVIATION; COSMONAUTICS
- B64U—UNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR
- B64U10/00—Type of UAV
- B64U10/10—Rotorcrafts
- B64U10/13—Flying platforms
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B64—AIRCRAFT; AVIATION; COSMONAUTICS
- B64U—UNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR
- B64U2101/00—UAVs specially adapted for particular uses or applications
- B64U2101/30—UAVs specially adapted for particular uses or applications for imaging, photography or videography
Definitions
- the invention relates to the field of shooting, in particular to a shooting control method and a movable platform.
- mobile platforms are used to perform shooting tasks.
- the mobile platform needs to be far away from the target object for a certain safety distance, and the camera on the mobile platform usually takes a long focal length to shoot.
- the mobile platform repeats the flight for operation, due to the small field of view and the position and posture of the mobile platform, etc. Error, it is impossible to guarantee the repeatability of the image obtained by the shooting device repeatedly shooting at the same shooting point.
- the target object may not be in the image or deviate from the expected position of the image, resulting in poor repeatability of image capture.
- the invention provides a shooting control method and a movable platform.
- a shooting control method including:
- the first control parameter of the shooting device is adjusted, so that the shooting device can shoot the target object.
- a mobile platform comprising:
- a photographing device mounted on the main body of the platform.
- the controller is electrically coupled to the photographing device, and the controller is configured to perform the following operations:
- the first control parameter of the shooting device is adjusted, so that the shooting device can shoot the target object.
- a computer-readable storage medium on which a computer program is stored, characterized in that the program is executed by a processor to implement the steps of the shooting control method described in the first aspect.
- the shooting device is exposed to the shooting device through the real-time shooting screen of the shooting device and the pre-stored sample image of the preset shooting point. Make adjustments to ensure the repetitive accuracy of image collection during repeated flight operations through the image comparison function.
- FIG. 1 is a method flowchart of a shooting control method in an embodiment of the present invention
- 2A is a specific method flowchart of a shooting control method in an embodiment of the present invention.
- FIG. 2B is a diagram of an application scenario for comparing a real-time shooting screen with a sample image in the shooting control method of the embodiment shown in FIG. 2A;
- FIG. 2C is another application scene diagram for comparing a real-time shooting screen with a sample image in the shooting control method of the embodiment shown in FIG. 2A;
- 3A is a flowchart of another specific method of the shooting control method in an embodiment of the present invention.
- FIG. 3B is a diagram of an application scenario for comparing real-time shooting pictures and sample images in the shooting control method of the embodiment shown in FIG. 3A;
- FIG. 3C is another application scenario diagram for comparing the real-time shooting screen and the sample image in the shooting control method of the embodiment shown in FIG. 3A;
- Figure 4 is a schematic structural diagram of a mobile platform in an embodiment of the present invention.
- Fig. 5 is a structural block diagram of a mobile platform in an embodiment of the present invention.
- the mobile platform of the embodiment of the present invention may include a platform main body and a photographing device mounted on the platform main body.
- the mobile platform may be an unmanned aerial vehicle, other unmanned aerial vehicles, or other mobile equipment.
- FIG. 1 is a method flowchart of a shooting control method in an embodiment of the present invention. As shown in Fig. 1, the shooting control method may include the following steps:
- the mobile platform is controlled by the user to move.
- S101 specifically includes: receiving a user instruction sent by a ground terminal device; and controlling the mobile platform to fly according to the user instruction.
- the ground terminal equipment can be a remote control, a terminal (such as a mobile terminal or a fixed terminal) that controls a mobile platform, a smart wearable device, or others.
- the mobile platform needs to determine one or more preset shooting points.
- the mobile platform flies autonomously.
- S101 specifically includes: controlling the mobile platform to fly according to preset route information.
- the preset route information may include location information of at least one waypoint.
- the preset route information may further include: position information of the mobile platform at the preset shooting point and second control parameters of the mobile platform at the preset shooting point.
- the preset shooting point may be at least partially the same as the waypoint, or the preset shooting point may be completely different from the waypoint.
- the inspection operation is changed into an automated process instead of manual flight, which saves manpower and improves the efficiency of the inspection operation.
- the mobile platform pre-stores preset route information, and after receiving the movement trigger signal, calls the preset route information, and then controls the mobile platform to fly according to the preset route information.
- the mobile trigger signal may be a start signal, a start signal generated by a user operating a start button on a mobile platform, or a start signal sent by the user through a ground terminal device.
- the mobile platform needs to determine preset route information before performing step S101.
- the process of determining the preset shooting point includes: receiving user instructions sent by the ground-end equipment; controlling the flight of the mobile platform according to the user instructions; during the flight of the mobile platform, if the shooting point sent by the ground-end equipment is received, it is determined Instruction, the current position of the mobile platform is determined as the preset shooting point; the location information of the preset shooting point is acquired and saved.
- the user directly inputs the location information of the preset shooting point through the APP, the APP will send the location information of the preset shooting point to the mobile platform, and the mobile platform receives and saves the location information of the preset shooting point sent by the APP.
- the preset route information can be determined by the user controlling the movement of the mobile platform, or can be set by the user on the APP.
- the second control parameter may include: the posture of the mobile platform, the shooting posture of the camera, and/or the shooting parameters of the camera. It can be understood that the second control parameter is not limited to the above-listed ones, and can also include other parameters of the mobile platform. .
- the process of acquiring the second control parameter includes: receiving a user instruction sent by the ground terminal device; controlling the flight of the mobile platform according to the user instruction; during the flight of the mobile platform, if a shooting point determination instruction sent by the ground terminal device is received , The current position, the posture of the mobile platform, the shooting posture of the camera, and/or the shooting parameters of the camera are acquired; the current position, the posture of the mobile platform, the shooting posture of the camera, and/or the shooting parameters of the camera are taken as The second control parameter of the mobile platform at the preset shooting point.
- the mobile platform acquires the current position, the posture of the mobile platform, the posture of the camera, and/or the shooting parameters of the camera after receiving the shooting point determination instruction sent by the ground-end equipment.
- the shooting posture and/or the shooting parameters of the shooting device are replaced with: the posture of the mobile platform after adjusting the parameters, the shooting posture of the shooting device and/or the shooting parameters of the shooting device.
- the attitude of the mobile platform, the shooting attitude of the camera, and/or the shooting parameters of the camera For example, after receiving the shooting point determination instruction sent by the ground-end equipment, before acquiring the current position, the attitude of the mobile platform, the shooting attitude of the camera, and/or the shooting parameters of the camera, if the adjustment parameters sent by the ground-end equipment are received ; According to the adjustment parameters, only the posture of the mobile platform is adjusted. At the current position, the posture of the mobile platform is replaced with the posture of the mobile platform after adjusting the parameters. At the current position, the shooting attitude of the camera and/or the shooting parameters of the camera are It is still the shooting posture and/or shooting parameters of the shooting device when the mobile platform receives the shooting point determination instruction sent by the ground-end equipment.
- controlling the flight of the mobile platform according to the preset route information further includes: when the mobile platform is at the preset shooting point, controlling the real-time posture of the mobile platform, the real-time shooting posture of the camera, and/or according to the second control parameter. Or the real-time shooting parameters of the camera.
- controlling the real-time posture of the mobile platform, the real-time shooting posture of the camera, and/or according to the second control parameter it can control the real-time posture of the mobile platform, the real-time shooting posture of the camera, and/or the real-time shooting parameters of the camera according to the second control parameter to be approximately the same, ensuring that the camera is in the The preset shooting points can meet shooting needs.
- the process of determining the preset shooting point is similar to the process of determining the preset shooting point in S101, and will not be repeated here.
- the process of pre-storing sample images of preset shooting points may include: receiving user instructions sent by ground-end equipment; controlling the flight of the mobile platform according to the user instructions; during the flight of the mobile platform, if a shooting point determination instruction sent by the ground-end equipment is received , The current position of the mobile platform is determined as the preset shooting point; at the preset shooting point, the shooting device on the mobile platform is controlled to obtain sample images in a preset configuration; the location information of the preset shooting point is obtained; the preset shooting is saved Point location information and sample images of preset shooting points.
- the preset configuration includes: the target object is at a preset position of the shooting frame of the shooting device, such as the center of the shooting frame or other positions.
- the preset configuration includes: the size of the target object in the shooting screen of the shooting device is a preset size, for example, in an image with a resolution of 640 ⁇ 480, the size of the target object in the shooting screen of the shooting device is 320 ⁇ 240 .
- the location information of the preset shooting point and the sample image of the preset shooting point are saved in one-to-one correspondence.
- the location information of the preset shooting point 1 and the sample image of the preset shooting point 1 are saved in one-to-one correspondence. Database or other preset applications.
- saving the location information of the preset shooting point and the sample image of the preset shooting point specifically includes: saving the location information of the preset shooting point on a mobile platform or ground-end equipment; saving the sample image on the shooting device or the ground On the end device.
- the location information of the preset shooting point is stored on the mobile platform or the ground terminal device, so that the mobile platform can obtain the location information of the preset shooting point, and then control the mobile platform to collect the image of the target object at the preset shooting point.
- the sample image is saved on the shooting device or the ground-side equipment, and the real-time shooting screen and the sample image can be compared by the shooting device or the ground-side equipment, and then the mobile platform can adjust the first control parameter of the shooting device according to the comparison result.
- the shooting device is allowed to shoot the target object.
- the comparison process is carried out on the photographing device or the ground-end equipment to reduce the burden of data processing on the mobile platform.
- the camera compares the real-time shooting screen with the image database in the SD card, and then According to the comparison result, the PTZ is fine-tuned to the same field of view position as the preset shooting point when the sample image is collected to ensure the repeatability of the collected image.
- the resolution of the sample image does not need to be too large, and the mobile platform only needs to determine image parameters such as the position and/or size of the target object in the sample image. Therefore, the mobile platform will down-sample the sample images before saving the sample images on the camera or ground-end equipment.
- the mobile platform of this embodiment saves the sample image after down-sampling processing on the shooting device or the ground terminal equipment to reduce the amount of stored data.
- the sample images of each preset shooting point are down-sampled to VGA (Video Graphics Array, video transmission standard) or other image types with smaller resolution.
- controlling the flight of the mobile platform specifically includes: controlling the shooting device according to user instructions
- the real-time height between the lens and the target object is greater than or equal to the preset height threshold.
- the preset height threshold may be 20 meters or other values.
- S103 Adjust the first control parameter of the shooting device according to the real-time shooting picture and the sample image of the shooting device on the mobile platform, so that the shooting device can shoot the target object.
- adjusting the first control parameter of the shooting device so that the shooting device captures the target image specifically includes: adjusting the first control parameter of the shooting device so that the image parameter of the target object in the real-time shooting screen tends to the target object.
- the image parameters in the sample images ensure the repeatability of the image collected by the mobile platform at the preset shooting point each time.
- the image parameters of the target object in the real-time shooting frame may include: the position and/or size of the target object in the real-time shooting frame.
- the mobile platform needs to adjust the first control parameter of the shooting device, so that the position of the target object in the real-time shooting picture tends to the position of the target object in the sample image.
- the mobile platform needs to adjust the first control parameter of the shooting device, so that the size of the target object in the real-time shooting picture tends to the size of the target object in the sample image.
- the target object is in the center of the sample image, and the size of the target object in the sample image is 320 ⁇ 240.
- the mobile platform of this embodiment needs to adjust the first control parameter of the camera to make the target object in real time.
- the center of the shooting frame and the size of the target object in the real-time shooting frame is 320 ⁇ 240.
- the first control parameter may include: the shooting posture of the shooting device and/or the shooting parameters of the shooting device. It can be understood that the first control parameter is not limited to this, and may also include other control parameters of the camera.
- S103 can be replaced by S201-S202.
- S103 can be replaced by S301-S302.
- the position of the target object in the real-time shooting screen and the position of the target object in the sample image are used to adjust the posture of the shooting device so that The position of the target object in the real-time shooting screen tends to the position of the target object in the sample image.
- the camera is mounted on the platform main body of the mobile platform through a pan-tilt to stabilize the camera.
- the pan/tilt in this embodiment may be a two-axis pan/tilt or a three-axis pan/tilt.
- FIG. 2A is a specific method flow chart of the shooting control method in an embodiment of the present invention. As shown in FIG. 2A, the mobile platform adjusts the first control parameter of the shooting device according to the real-time shooting picture and sample images of the shooting device.
- S201 Compare the real-time shooting picture with the sample image, and obtain first position information of the target object in the real-time shooting picture and second position information of the target object in the sample image;
- S202 According to the first position information and the second position information, adjust the shooting posture of the shooting device by controlling the pan-tilt on the mobile platform, so that the position of the target object in the real-time shooting screen tends to the position of the target object in the sample image .
- adjusting the shooting attitude of the shooting device according to the first position information and the second position information specifically includes: determining a position deviation according to the first position information and the second position information; according to the position deviation, by controlling the attitude of the pan/tilt, Adjust the shooting posture of the camera.
- control the pan-tilt posture so that the position of the target object in the real-time shooting picture is the same as the position of the target object in the sample image.
- control the pan-tilt posture so that the position of the target object in the real-time shooting picture is approximately the same as the position of the target object in the sample image.
- the target object includes one target object.
- the target object includes target object 21.
- the first position information is the center of gravity (x1', y1') of the target object 21 in the real-time shooting image
- the second position information is the center of gravity (x1, y1) of the target object 21 in the sample image.
- the width and height of the sample images are equal.
- the mobile platform needs to move the center of gravity of the target object 21 in the real-time shooting image from (x1', y1') to (x1, y1).
- the yaw attitude of the pan/tilt can be adjusted to make the target object 21 in the real-time shooting image
- the abscissa of the center of gravity x1' is adjusted to x1
- the vertical coordinate of the center of gravity of the target object 21 in the real-time shooting frame is adjusted from y1' to y1 by adjusting the pitch posture of the pan/tilt.
- the target object includes multiple target objects.
- the target object includes target object 22, target object 23, and target object 24.
- the first position information is the center of gravity (x2', y2') of the three target objects in the real-time shooting screen, the target object 22, the target object 23, and the target object 24.
- the second position information is the target object 22, the target object 23, and the target.
- Object 24 is the center of gravity (x2, y2) of the three target objects in the sample image. It is assumed that the width and height of the real-time shooting image are equal to the width and height of the sample image.
- the mobile platform needs to move the center of gravity of the target object 22, target object 23, and target object 24 in the real-time shooting screen from (x2', y2') to (x2, y2), which can be adjusted by adjusting the PTZ
- the yaw attitude makes the center of gravity x2' of the three target objects of the target object 22, the target object 23, and the target object 24 adjusted to x2 in the real-time shooting picture, and the pitch attitude of the pan/tilt is adjusted so that the target object 22,
- the ordinate of the center of gravity of the three target objects, the target object 23 and the target object 24, in the real-time shooting picture is adjusted from y2' to y2.
- the size of the target object in the real-time shooting screen and the size of the target object in the sample image are used to adjust the zoom of the shooting device so that The size of the target object in the real-time shooting screen tends to the size of the target object in the sample image.
- FIG. 3A is a flowchart of another specific method of the shooting control method in an embodiment of the present invention. As shown in FIG. 3A, the mobile platform adjusts the first control parameter of the shooting device according to the real-time shooting picture and the sample image of the shooting device. :
- S301 Compare the real-time shooting screen with the sample image, and obtain the size of the target object in the real-time shooting screen and the size of the target object in the sample image;
- S302 According to the size of the target object in the real-time shooting frame and the size of the target object in the sample image, control the shooting device to zoom so that the size of the target object in the shooting frame tends to the size of the target object in the sample image.
- controlling the shooting device to zoom specifically includes: according to the size of the target object in the real-time shooting screen and the size of the target object in the sample image
- the size determines the zoom parameter of the camera; according to the zoom parameter, the camera is controlled to zoom.
- the size of the target object in the real-time shooting frame is the size of the target frame surrounded by the width and height of the target object in the real-time shooting frame, and the target frame can completely enclose the target object.
- the camera is controlled to zoom so that the size of the target object in the real-time shooting frame is equal to the size of the target object in the sample image.
- the camera is controlled to zoom so that the size of the target object in the real-time shooting frame is approximately equal to the size of the target object in the sample image.
- the target object includes one target object.
- the target object includes the target object 31, and the size of the target object 31 in the real-time shooting frame is the size of the target frame M1' (ie width * height),
- the size of the target object 31 in the sample image is the size of the target frame M1
- the scaling parameter the size of the target frame M1/the size of the target frame M1'.
- the mobile platform can control the shooting device to zoom according to the scaling parameter so that the target object is The size in the shooting screen tends to be the size of the target object in the sample image.
- the target object includes multiple target objects.
- the target object includes target object 32, target object 33, and target object 34.
- the sample image of the preset shooting point is stored in the shooting device, and the execution subject for comparing the real-time shooting screen and the sample image is the shooting device.
- the sample image of the preset shooting point is stored in the ground-end device, and the execution subject for comparing the real-time shooting image and the sample image is the ground-end device. Put the comparison process on the camera or ground terminal equipment to reduce the burden of data processing on the mobile platform.
- the mobile platform adjusts the first control parameters of the camera according to the real-time shooting screen and sample images, so that the camera can shoot the target object, it also needs to save the image taken by the camera at the preset shooting point to realize automatic The purpose of inspection.
- S102 and S103 are executed when the mobile platform is in a hovering state, which reduces the control requirements on the mobile platform.
- the shooting device is adjusted through the real-time shooting screen of the shooting device and the pre-stored sample images of the preset shooting point,
- the image comparison function ensures the repeatability of image acquisition during repeated flight operations.
- an embodiment of the present invention also provides a mobile platform.
- the mobile platform includes a platform main body, a photographing device mounted on the platform main body, and a controller, wherein the controller is electrically coupled to the photographing device.
- the controller of this embodiment is used to perform the shooting control method of the embodiments described in FIG. 1, FIG. 2A, and FIG. 3A.
- the controller is used to perform the following operations: control the movement of the mobile platform; when the mobile platform is located at the preset shooting point, obtain pre-stored sample images of the preset shooting point; according to the real-time shooting pictures and sample images of the shooting device on the mobile platform , Adjust the first control parameter of the camera, so that the camera can shoot the target object.
- the controller may be a central processing unit (CPU).
- the controller may further include a hardware chip.
- the aforementioned hardware chip may be an application-specific integrated circuit (ASIC), a programmable logic device (PLD) or a combination thereof.
- the PLD may be a complex programmable logic device (complex programmable logic device, CPLD), a field programmable logic gate array (field-programmable gate array, FPGA), a general array logic (generic array logic, GAL), or any combination thereof.
- the mobile platform of this embodiment may further include a pan/tilt, through which the camera is fixed on the platform main body.
- the photographing device is directly electrically coupled to the controller.
- the photographing device is electrically coupled to the controller via the pan-tilt.
- the main body of the platform is the body of the drone.
- the drone can be a multi-rotor drone or a fixed-wing drone.
- an embodiment of the present invention also provides a computer-readable storage medium on which a computer program is stored, and when the program is executed by a processor, the steps of the shooting control method in any of the above embodiments are implemented.
- the storage medium may be a magnetic disk, an optical disc, a read-only memory (Read-Only Memory, ROM), or a random access memory (Random Access Memory, RAM), etc.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Automation & Control Theory (AREA)
- Aviation & Aerospace Engineering (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Human Computer Interaction (AREA)
- Studio Devices (AREA)
Abstract
一种拍摄控制方法及可移动平台,所述方法包括:控制移动平台移动;当所述移动平台位于预设拍摄点时,获取预存的所述预设拍摄点的样本图像;根据所述移动平台上的拍摄装置的实时拍摄画面以及所述样本图像,调节所述拍摄装置的第一控制参数,以使得所述拍摄装置对目标对象进行拍摄。在移动平台作业过程中,当移动平台位于预设拍摄点时,通过拍摄装置的实时拍摄画面以及预存的该预设拍摄点的样本图像对拍摄装置进行调整,通过图像对比功能保证重复飞行作业时图像采集的重复精度。
Description
本发明涉及拍摄领域,尤其涉及一种拍摄控制方法及可移动平台。
在某些领域如巡检领域,会采用移动平台执行拍摄任务。通常,移动平台需要远离目标对象一定安全距离,并且移动平台上的拍摄装置通常会以长焦时长去拍摄,移动平台重复飞行进行作业时,由于视场角较小以及移动平台的位置、姿态等误差,无法保证拍摄装置在同一拍摄点进行重复拍摄获得的图像的重复精度,目标对象可能不在图像中或者偏离图像的预期位置,导致图像采集的重复性较差。
发明内容
本发明提供一种拍摄控制方法及可移动平台。
具体地,本发明是通过如下技术方案实现的:
根据本发明第一方面,提供一种拍摄控制方法,所述方法包括:
控制移动平台移动;
当所述移动平台位于预设拍摄点时,获取预存的所述预设拍摄点的样本图像;
根据所述移动平台上的拍摄装置的实时拍摄画面以及所述样本图像,调节所述拍摄装置的第一控制参数,以使得所述拍摄装置对目标对象进行拍摄。
根据本发明第二方面,提供一种移动平台,所述移动平台包括:
平台主体;
搭载在所述平台主体上的拍摄装置;以及
控制器,与所述拍摄装置电耦合连接,所述控制器用于进行如下操作:
控制移动平台移动;
当所述移动平台位于预设拍摄点时,获取预存的所述预设拍摄点的样本图像;
根据所述移动平台上的拍摄装置的实时拍摄画面以及所述样本图像,调节所述拍摄装置的第一控制参数,以使得所述拍摄装置对目标对象进行拍摄。
根据本发明第三方面,提供一种计算机可读存储介质,其上存储有计算机程序,其特征在于,该程序被处理器执行时实现第一方面所述的拍摄控制方法的步骤。
由以上本发明实施例提供的技术方案可见,在移动平台作业过程中,当移动平 台位于预设拍摄点时,通过拍摄装置的实时拍摄画面以及预存的该预设拍摄点的样本图像对拍摄装置进行调整,通过图像对比功能保证重复飞行作业时图像采集的重复精度。
为了更清楚地说明本发明实施例中的技术方案,下面将对实施例描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本发明的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动性的前提下,还可以根据这些附图获得其他的附图。
图1是本发明一实施例中的拍摄控制方法的方法流程图;
图2A是本发明一实施例中的拍摄控制方法的一具体方法流程图;
图2B是图2A所示实施例的拍摄控制方法中对实时拍摄画面和样本图像进行比对的一种应用场景图;
图2C是图2A所示实施例的拍摄控制方法中对实时拍摄画面和样本图像进行比对的另一种应用场景图;
图3A是本发明一实施例中的拍摄控制方法的另一具体方法流程图;
图3B是图3A所示实施例的拍摄控制方法中对实时拍摄画面和样本图像进行比对的一种应用场景图;
图3C是图3A所示实施例的拍摄控制方法中对实时拍摄画面和样本图像进行比对的另一种应用场景图;
图4是本发明一实施例中的移动平台的结构示意图;
图5是本发明一实施例中的移动平台的结构框图。
下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。
本发明实施例的移动平台可包括平台主体和搭载在该平台主体上的拍摄装置,该移动平台可为无人机,也可为其他无人飞行器,或者其他移动设备。
下面结合附图,对本发明的拍摄控制方法及可移动平台进行详细说明。在不冲突的情况下,下述的实施例及实施方式中的特征可以相互组合。
图1是本发明一实施例中的拍摄控制方法的方法流程图。如图1所示,该拍摄 控制方法可包括如下步骤:
S101:控制移动平台移动;
可选的,在一实施例中,移动平台由用户控制而移动。S101具体包括:接收地面端设备发送的用户指令;根据用户指令,控制移动平台飞行。该地面端设备可为遥控器、控制移动平台的终端(如可移动终端或固定终端)、智能穿戴设备或其他。可选的,移动平台在执行步骤S101之前,需确定一个或多个预设拍摄点。
在另一实施例中,移动平台自主飞行。S101具体包括:根据预设的航线信息,控制移动平台飞行。其中,预设的航线信息可包括至少一个航点的位置信息。进一步的,预设的航线信息还可包括:移动平台在预设拍摄点的位置信息以及移动平台在预设拍摄点的第二控制参数。预设拍摄点可与航点至少部分相同,或者预设拍摄点与航点完全不同。本实施例通过将巡检作业变为自动化流程,而非人工飞行,节省人力,提高巡检作业的效率。本实施例中,移动平台会预先存储预设的航线信息,并在接收到移动触发信号后,调用预设的航线信息,再根据预设的航线信息,控制移动平台飞行。移动触发信号可以为开机信号、用户操作移动平台上的启动按键产生的启动信号或用户通过地面端设备发送的启动信号。可选的,移动平台在执行步骤S101之前,需确定预设的航线信息。
上述实施例中,预设拍摄点的确定过程包括:接收地面端设备发送的用户指令;根据用户指令,控制移动平台飞行;在移动平台飞行过程中,若接收到地面端设备发送的拍摄点确定指令,则将移动平台的当前位置确定为预设拍摄点;获取预设拍摄点的位置信息并保存。可选的,用户直接通过APP输入预设拍摄点的位置信息,APP会将预设拍摄点的位置信息发送给移动平台,移动平台接收APP发送的预设拍摄点的位置信息并保存。
预设的航线信息可由用户控制移动平台移动确定,也可由用户在APP上设置。
第二控制参数可包括:移动平台的姿态、拍摄装置的拍摄姿态和/或拍摄装置的拍摄参数,可以理解,第二控制参数并不限于上述列举的几种,还可包括移动平台的其他参数。可选的,第二控制参数的获取过程包括:接收地面端设备发送的用户指令;根据用户指令,控制移动平台飞行;在移动平台飞行过程中,若接收到地面端设备发送的拍摄点确定指令,则获取当前位置处,移动平台的姿态、拍摄装置的拍摄姿态和/或拍摄装置的拍摄参数;将当前位置处,移动平台的姿态、拍摄装置的拍摄姿态和/或拍摄装置的拍摄参数作为移动平台在预设拍摄点的第二控制参数。
进一步可选的,在一些例子中,移动平台在接收到地面端设备发送的拍摄点确定指令之后,获取当前位置处,移动平台的姿态、拍摄装置的拍摄姿态和/或拍摄装置的拍摄参数之前,还可包括:接收地面端设备发送的调节参数;根据调节参数,调节移动平台的姿态、拍摄装置的拍摄姿态和/或拍摄装置的拍摄参数;当前位置处,移动 平台的姿态、拍摄装置的拍摄姿态和/或拍摄装置的拍摄参数则替换为:调节参数后的移动平台的姿态、拍摄装置的拍摄姿态和/或拍摄装置的拍摄参数。
例如,在接收到地面端设备发送的拍摄点确定指令之后,获取当前位置处,移动平台的姿态、拍摄装置的拍摄姿态和/或拍摄装置的拍摄参数之前,若接收地面端设备发送的调节参数;根据调节参数,仅调节移动平台的姿态,当前位置处,移动平台的姿态则替换为调节参数后的移动平台的姿态,当前位置处,拍摄装置的拍摄姿态和/或拍摄装置的拍摄参数则仍为移动平台接收到地面端设备发送的拍摄点确定指令时的拍摄装置的拍摄姿态和/或拍摄装置的拍摄参数。
本实施例中,根据预设的航线信息,控制移动平台飞行进一步包括:当移动平台处于预设拍摄点时,根据第二控制参数,控制移动平台的实时姿态、拍摄装置的实时拍摄姿态和/或拍摄装置的实时拍摄参数。移动平台每次到达该预设拍摄点时,均可根据第二控制参数控制移动平台的实时姿态、拍摄装置的实时拍摄姿态和/或拍摄装置的实时拍摄参数大致相同,保证拍摄装置每次在该预设拍摄点都能够满足拍摄需求。
S102:当移动平台位于预设拍摄点时,获取预存的预设拍摄点的样本图像;
该步骤中,预设拍摄点的确定过程与S101中预设拍摄点的确定过程相类似,此处不再赘述。
预存预设拍摄点的样本图像的过程可包括:接收地面端设备发送的用户指令;根据用户指令,控制移动平台飞行;在移动平台飞行过程中,若接收到地面端设备发送的拍摄点确定指令,则将移动平台的当前位置确定为预设拍摄点;在预设拍摄点处,控制移动平台上的拍摄装置以预设配置获取样本图像;获取预设拍摄点的位置信息;保存预设拍摄点的位置信息及预设拍摄点的样本图像。可选的,预设配置包括:目标对象处于拍摄装置的拍摄画面的预设位置,如拍摄画面的中心或其他位置。可选的,预设配置包括:目标对象在拍摄装置的拍摄画面中大小为预设大小,如在分辨率为640×480的图像中,目标对象在拍摄装置的拍摄画面中大小为320×240。
可选的,预设拍摄点的位置信息及预设拍摄点的样本图像是一一对应保存的,如将预设拍摄点1的位置信息和预设拍摄点1的样本图像一一对应保存在数据库或者其他预设应用中。
可选的,保存预设拍摄点的位置信息及预设拍摄点的样本图像具体包括:将预设拍摄点的位置信息保存在移动平台或地面端设备上;将样本图像保存在拍摄装置或地面端设备上。本实施例将预设拍摄点的位置信息保存在移动平台或地面端设备上,便于移动平台获取预设拍摄点的位置信息,再控制移动平台在预设拍摄点采集目标对象的图像。并且,将样本图像保存在拍摄装置或地面端设备上,可由拍摄装置或地面端设备对实时拍摄画面和样本图像进行比对,再由移动平台根据比对结果调整拍摄装置的第一控制参数,使得拍摄装置对目标对象进行拍摄。本实施例将比对过程放在拍 摄装置或地面端设备进行,减轻移动平台处理数据的负担。可选的,将样本图像保存在拍摄装置的SD卡中,移动平台作业过程中,每次飞行到预设拍摄点时,拍摄装置对实时拍摄画面和SD卡中的图像数据库进行比对,再根据比对结果将云台微调到与采集样本图像时该预设拍摄点相同的视场位置,确保采集图像的重复性。
进一步的,在一些实施例中,样本图像的分辨率不需要太大,移动平台只需要确定目标对象在样本图像中位置和/或大小等图像参数即可。因此,移动平台在将样本图像保存在拍摄装置或地面端设备上之前,还会将样本图像进行下采样处理。本实施例的移动平台是将下采样处理后的样本图像保存在拍摄装置或地面端设备上的,减小存储数据量。可选的,将每个预设拍摄点的样本图像下采样至VGA(Video Graphics Array,视频传输标准)或其他分辨率较小的图像类型。
在巡检领域,移动平台的拍摄装置需要远离目标对象一定安全距离(如20米)对目标对象进行拍摄,因此上述实施例中,无论是在确定预设拍摄点的过程中,还是在确定预设的航线信息的过程中,抑或是在预存预设拍摄点的样本图像的过程中,还是在实际巡检过程中,根据用户指令,控制移动平台飞行具体包括:根据用户指令,控制拍摄装置的镜头与目标对象之间的实时高度大于或等于预设高度阈值。其中,预设高度阈值可为20米或其他数值。
S103:根据移动平台上的拍摄装置的实时拍摄画面以及样本图像,调节拍摄装置的第一控制参数,以使得拍摄装置对目标对象进行拍摄。
可选的,调节拍摄装置的第一控制参数,以使得拍摄装置对目标图像进行拍摄具体包括:调节拍摄装置的第一控制参数,以使得目标对象在实时拍摄画面中的图像参数趋于目标对象在样本图像中的图像参数,确保移动平台每次在预设拍摄点采集图像的重复精度。其中,目标对象在实时拍摄画面中的图像参数可包括:目标对象在实时拍摄画面中的位置和/或大小。可选的,移动平台需调节拍摄装置的第一控制参数,以使得目标对象在实时拍摄画面中的位置趋于目标对象在样本图像中的位置。可选的,移动平台需调节拍摄装置的第一控制参数,以使得目标对象在实时拍摄画面中的大小趋于目标对象在样本图像中的大小。本实施例中,目标对象处于样本图像中的中心,且目标对象在样本图像中的大小为320×240,本实施例的移动平台需调节拍摄装置的第一控制参数,以使得目标对象处于实时拍摄画面的中心并且目标对象在实时拍摄画面中的大小为320×240。
第一控制参数可包括:拍摄装置的拍摄姿态和/或拍摄装置的拍摄参数。可以理解,第一控制参数不限于此,还可包括拍摄装置的其他控制参数。
下面,将通过下述图2A和图3A对应的实施例对上述S103中,根据拍摄装置的实时拍摄画面以及样本图像,调节拍摄装置的第一控制参数进行详细的说明。示例的,在图2A所示的实施例中,S103可以通过S201-S202替换。在图3A所示的实施 例中,S103可以通过S301-S302替换。
在图2A所示实施例中,移动平台在将实时拍摄画面以及样本图像进行比对后,通过目标对象在实时拍摄画面的位置和目标对象在样本图像中的位置,调节拍摄装置的姿态,使得目标对象在实时拍摄画面的位置趋于目标对象在样本图像中的位置。本实施例中,拍摄装置通过云台搭载在移动平台的平台主体上,以对拍摄装置进行增稳。本实施例的云台可为两轴云台,也可为三轴云台。
图2A是本发明一实施例中的拍摄控制方法的一具体方法流程图,如图2A所示,移动平台根据拍摄装置的实时拍摄画面以及样本图像,调节拍摄装置的第一控制参数具体包括:
S201:将实时拍摄画面以及样本图像进行比对,获取目标对象在实时拍摄画面中的第一位置信息以及目标对象在样本图像中的第二位置信息;
S202:根据第一位置信息和第二位置信息,通过控制移动平台上的云台以调节拍摄装置的拍摄姿态,以使得目标对象在实时拍摄画面中的位置趋向于目标对象在样本图像中的位置。
可选的,根据第一位置信息和第二位置信息,调节拍摄装置的拍摄姿态具体包括:根据第一位置信息和第二位置信息,确定位置偏差;根据位置偏差,通过控制云台的姿态,调节拍摄装置的拍摄姿态。可选的,根据位置偏差,控制云台姿态,使得目标对象在实时拍摄画面中的位置与目标对象在样本图像中的位置相同。可选的,根据位置偏差,控制云台姿态,使得目标对象在实时拍摄画面中的位置与目标对象在样本图像中的位置大致相同。
作为一种具体的实现方式,目标对象包括一个,如图2B所示,目标对象包括目标对象21。第一位置信息为目标对象21在实时拍摄画面中的重心(x1’,y1’),第二位置信息为目标对象21在样本图像中的重心(x1,y1),假设实时拍摄画面宽高和样本图像的宽高相等。移动平台需要将目标对象21在实时拍摄画面中的重心由(x1’,y1’)移动至(x1,y1),具体可通过调整云台的偏航姿态,使得目标对象21在实时拍摄画面中的重心横坐标x1’调整至x1,并通过调整云台的俯仰姿态,使得目标对象21在实时拍摄画面中的重心纵坐标由y1’调整至y1。
作为另一种具体的实现方式,目标对象包括多个,如图2C所示,目标对象包括目标对象22、目标对象23和目标对象24。第一位置信息为目标对象22、目标对象23和目标对象24这三个目标对象在实时拍摄画面中的重心(x2’,y2’),第二位置信息为目标对象22、目标对象23和目标对象24这三个目标对象在样本图像中的重心(x2,y2),假设实时拍摄画面宽高和样本图像的宽高相等。移动平台需要将目标对象22、目标对象23和目标对象24这三个目标对象在实时拍摄画面中的重心由(x2’,y2’)移动至(x2,y2),具体可通过调整云台的偏航姿态,使得目标对象22、目标对象23 和目标对象24这三个目标对象在实时拍摄画面中的重心横坐标x2’调整至x2,并通过调整云台的俯仰姿态,使得目标对象22、目标对象23和目标对象24这三个目标对象在实时拍摄画面中的重心纵坐标由y2’调整至y2。
在图3A所示实施例中,移动平台在将实时拍摄画面以及样本图像进行比对后,通过目标对象在实时拍摄画面的大小和目标对象在样本图像中的大小,调节拍摄装置进行缩放,使得目标对象在实时拍摄画面的大小趋于目标对象在样本图像中的大小。
图3A是本发明一实施例中的拍摄控制方法的另一具体方法流程图,如图3A所示,移动平台根据拍摄装置的实时拍摄画面以及样本图像,调节拍摄装置的第一控制参数具体包括:
S301:将实时拍摄画面以及样本图像进行比对,获取目标对象在实时拍摄画面中的大小以及目标对象在样本图像中的大小;
S302:根据目标对象在实时拍摄画面中的大小以及目标对象在样本图像中的大小,控制拍摄装置进行变焦,以使得目标对象在拍摄画面中的大小趋向于目标对象在样本图像中的大小。
可选的,根据目标对象在实时拍摄画面中的大小以及目标对象在样本图像中的大小,控制拍摄装置进行变焦具体包括:根据目标对象在实时拍摄画面中的大小以及目标对象在样本图像中的大小,确定拍摄装置的缩放参数;根据缩放参数,控制拍摄装置进行变焦。本实施例中,缩放参数=目标对象在样本图像中的大小/目标对象在实时拍摄画面中的大小。可选的,目标对象在实时拍摄画面中的大小为目标对象在实时拍摄画面中的宽度和高度包围形成的目标框大小,目标框能够完全包围住目标对象。可选的,根据缩放参数,控制拍摄装置进行变焦,使得目标对象在实时拍摄画面中的大小与目标对象在样本图像中的大小相等。可选的,根据缩放参数,控制拍摄装置进行变焦,使得目标对象在实时拍摄画面中的大小与目标对象在样本图像中的大小大致相等。
作为一种具体的实现方式,目标对象包括一个,如图3B所示,目标对象包括目标对象31,目标对象31在实时拍摄画面中的大小为目标框M1’的大小(即宽度*高度),目标对象31在样本图像中的大小为目标框M1的大小,缩放参数=目标框M1的大小/目标框M1’的大小,移动平台可根据该缩放参数,控制拍摄装置进行变焦,使得目标对象在拍摄画面中的大小趋向于目标对象在样本图像中的大小。
作为另一种具体的实现方式,目标对象包括多个,如图3C所示,目标对象包括目标对象32、目标对象33和目标对象34。目标对象32、目标对象33和目标对象34在实时拍摄画面中的大小为目标框M2’的大小(即宽度*高度),目标对象32、目标对象33和目标对象34在样本图像中的大小为目标框M2的大小,缩放参数=目标框M2的大小/目标框M2’的大小,移动平台可根据该缩放参数,控制拍摄装置进行变焦, 使得目标对象在拍摄画面中的大小趋向于目标对象在样本图像中的大小。
在一实施例中,预设拍摄点的样本图像存储在拍摄装置中,将实时拍摄画面以及样本图像进行比对的执行主体为拍摄装置。在另一实施例中,预设拍摄点的样本图像存储在地面端设备中,将实时拍摄画面以及样本图像进行比对的执行主体为地面端设备。将比对过程放在拍摄装置或地面端设备进行,减轻移动平台处理数据的负担。
此外,移动平台在根据实时拍摄画面以及样本图像,调节拍摄装置的第一控制参数,以使得拍摄装置对目标对象进行拍摄之后,还需要保存拍摄装置在预设拍摄点所拍摄的图像,实现自动巡检的目的。
可选的,S102以及S103是在移动平台处于悬停状态下执行的,降低对移动平台的控制要求。
本发明实施例的拍摄控制方法,在移动平台作业过程中,当移动平台位于预设拍摄点时,通过拍摄装置的实时拍摄画面以及预存的该预设拍摄点的样本图像对拍摄装置进行调整,通过图像对比功能保证重复飞行作业时图像采集的重复精度。
对应于上述实施例的拍摄控制方法,本发明实施例还提供一种移动平台。结合图4和图5,该移动平台包括平台主体、搭载在平台主体上的拍摄装置以及控制器,其中,控制器与拍摄装置电耦合连接。
本实施例的控制器用于进行如图1、图2A以及图3A所述实施例的拍摄控制方法。
具体的,控制器用于进行如下操作:控制移动平台移动;当移动平台位于预设拍摄点时,获取预存的预设拍摄点的样本图像;根据移动平台上的拍摄装置的实时拍摄画面以及样本图像,调节拍摄装置的第一控制参数,以使得拍摄装置对目标对象进行拍摄。
在本实施例中,控制器可以是中央处理器(central processing unit,CPU)。控制器还可以进一步包括硬件芯片。上述硬件芯片可以是专用集成电路(application-specific integrated circuit,ASIC),可编程逻辑器件(programmable logic device,PLD)或其组合。上述PLD可以是复杂可编程逻辑器件(complex programmable logic device,CPLD),现场可编程逻辑门阵列(field-programmable gate array,FPGA),通用阵列逻辑(generic array logic,GAL)或其任意组合。
进一步参见图4,本实施例的移动平台还可包括云台,拍摄装置通过该云台固定在平台主体上。可选的,拍摄装置直接与控制器电耦合连接。可选的,拍摄装置经云台与控制器电耦合连接。
本实施例中,当移动平台为无人机时,平台主体为无人机的机身。该无人机可以为多旋翼无人机,也可为固定翼无人机。
此外,本发明实施例还提供一种计算机可读存储介质,其上存储有计算机程序,该程序被处理器执行时实现上述任一实施例的拍摄控制方法的步骤。
本领域普通技术人员可以理解实现上述实施例方法中的全部或部分流程,是可以通过计算机程序来指令相关的硬件来完成,所述的程序可存储于一计算机可读取存储介质中,该程序在执行时,可包括如上述各方法的实施例的流程。其中,所述的存储介质可为磁碟、光盘、只读存储记忆体(Read-Only Memory,ROM)或随机存储记忆体(Random Access Memory,RAM)等。
以上所揭露的仅为本发明部分实施例而已,当然不能以此来限定本发明之权利范围,因此依本发明权利要求所作的等同变化,仍属本发明所涵盖的范围。
Claims (39)
- 一种拍摄控制方法,其特征在于,所述方法包括:控制移动平台移动;当所述移动平台位于预设拍摄点时,获取预存的所述预设拍摄点的样本图像;根据所述移动平台上的拍摄装置的实时拍摄画面以及所述样本图像,调节所述拍摄装置的第一控制参数,以使得所述拍摄装置对目标对象进行拍摄。
- 根据权利要求1所述的方法,其特征在于,所述调节所述拍摄装置的第一控制参数,以使得所述拍摄装置对目标图像进行拍摄,包括:调节所述拍摄装置的第一控制参数,以使得所述目标对象在所述实时拍摄画面中的图像参数趋于所述目标对象在所述样本图像中的图像参数。
- 根据权利要求2所述的方法,其特征在于,所述目标对象在所述实时拍摄画面中的图像参数包括:所述目标对象在所述实时拍摄画面中的位置和/或大小。
- 根据权利要求1所述的方法,其特征在于,所述第一控制参数包括:所述拍摄装置的拍摄姿态和/或所述拍摄装置的拍摄参数。
- 根据权利要求4所述的方法,其特征在于,所述根据所述拍摄装置的实时拍摄画面以及所述样本图像,调节所述拍摄装置的第一控制参数,包括:将所述实时拍摄画面以及所述样本图像进行比对,获取所述目标对象在所述实时拍摄画面中的第一位置信息以及所述目标对象在所述样本图像中的第二位置信息;根据所述第一位置信息和所述第二位置信息,通过控制所述移动平台上的云台以调节所述拍摄装置的拍摄姿态,以使得所述目标对象在所述实时拍摄画面中的位置趋向于所述目标对象在所述样本图像中的位置。
- 根据权利要求5所述的方法,其特征在于,所述根据所述第一位置信息和所述第二位置信息,调节所述拍摄装置的拍摄姿态,包括:根据所述第一位置信息和所述第二位置信息,确定位置偏差;根据所述位置偏差,通过控制所述移动平台上的云台的姿态,调节所述拍摄装置的拍摄姿态。
- 根据权利要求4所述的方法,其特征在于,所述根据所述拍摄装置的实时拍摄画面以及所述样本图像,调节所述拍摄装置的第一控制参数,包括:将所述实时拍摄画面以及所述样本图像进行比对,获取所述目标对象在所述实时拍摄画面中的大小以及所述目标对象在所述样本图像中的大小;根据所述目标对象在所述实时拍摄画面中的大小以及所述目标对象在所述样本图像中的大小,控制所述拍摄装置进行变焦,以使得所述目标对象在所述拍摄画面中的 大小趋向于所述目标对象在所述样本图像中的大小。
- 根据权利要求7所述的方法,其特征在于,所述根据所述目标对象在所述实时拍摄画面中的大小以及所述目标对象在所述样本图像中的大小,控制所述拍摄装置进行变焦,包括:根据所述目标对象在所述实时拍摄画面中的大小以及所述目标对象在所述样本图像中的大小,确定所述拍摄装置的缩放参数;根据所述缩放参数,控制所述拍摄装置进行变焦。
- 根据权利要求5或7所述的方法,其特征在于,所述预设拍摄点的样本图像存储在所述拍摄装置中,所述将所述实时拍摄画面以及所述样本图像进行比对的执行主体为所述拍摄装置;或者,所述预设拍摄点的样本图像存储在地面端设备中,所述将所述实时拍摄画面以及所述样本图像进行比对的执行主体为所述地面端设备。
- 根据权利要求1所述的方法,其特征在于,预存所述预设拍摄点的样本图像的过程包括:接收地面端设备发送的用户指令;根据所述用户指令,控制所述移动平台飞行;在所述移动平台飞行过程中,若接收到地面端设备发送的拍摄点确定指令,则将所述移动平台的当前位置确定为所述预设拍摄点;在所述预设拍摄点处,控制所述移动平台上的拍摄装置以预设配置获取样本图像;获取所述预设拍摄点的位置信息;保存所述预设拍摄点的位置信息及所述预设拍摄点的样本图像。
- 根据权利要求10所述的方法,其特征在于,所述根据所述用户指令,控制所述移动平台飞行,包括:根据所述用户指令,控制所述拍摄装置的镜头与所述目标对象之间的实时高度大于或等于预设高度阈值。
- 根据权利要求10所述的方法,其特征在于,所述保存所述预设拍摄点的位置信息及所述预设拍摄点的样本图像,包括:将所述预设拍摄点的位置信息保存在所述移动平台或地面端设备上;将所述样本图像保存在所述拍摄装置或所述地面端设备上。
- 根据权利要求12所述的方法,其特征在于,所述将所述样本图像保存在所述拍摄装置或所述地面端设备上之前,还包括:将所述样本图像进行下采样处理;所述将所述样本图像保存在所述拍摄装置或所述地面端设备上,包括:将下采样处理后的样本图像保存在所述拍摄装置或所述地面端设备上。
- 根据权利要求1所述的方法,其特征在于,所述控制移动平台飞行,包括:根据预设的航线信息,控制所述移动平台飞行,其中所述预设的航线信息包括:所述移动平台在所述预设拍摄点的位置信息以及所述移动平台在所述预设拍摄点的第二控制参数;或者所述控制移动平台飞行,包括:接收地面端设备发送的用户指令;根据所述用户指令,控制所述移动平台飞行。
- 根据权利要求14所述的方法,其特征在于,所述第二控制参数包括:所述移动平台的姿态、所述拍摄装置的拍摄姿态和/或所述拍摄装置的拍摄参数。
- 根据权利要求15所述的方法,其特征在于,所述根据预设的航线信息,控制所述移动平台飞行,进一步包括:当所述移动平台处于所述预设拍摄点时,根据所述第二控制参数,控制所述移动平台的实时姿态、所述拍摄装置的实时拍摄姿态和/或所述拍摄装置的实时拍摄参数。
- 根据权利要求15所述的方法,其特征在于,所述第二控制参数的获取过程包括:接收地面端设备发送的用户指令;根据所述用户指令,控制所述移动平台飞行;在所述移动平台飞行过程中,若接收到地面端设备发送的拍摄点确定指令,则获取当前位置处,所述移动平台的姿态、所述拍摄装置的拍摄姿态和/或所述拍摄装置的拍摄参数;将所述当前位置处,所述移动平台的姿态、所述拍摄装置的拍摄姿态和/或所述拍摄装置的拍摄参数作为所述移动平台在所述预设拍摄点的第二控制参数。
- 根据权利要求17所述的方法,其特征在于,所述接收到地面端设备发送的拍摄点确定指令之后,获取所述当前位置处,所述移动平台的姿态、所述拍摄装置的拍摄姿态和/或所述拍摄装置的拍摄参数之前,还包括:接收所述地面端设备发送的调节参数;根据所述调节参数,调节所述移动平台的姿态、所述拍摄装置的拍摄姿态和/或所述拍摄装置的拍摄参数;所述当前位置处,所述移动平台的姿态、所述拍摄装置的拍摄姿态和/或所述拍摄装置的拍摄参数为:调节参数后的所述移动平台的姿态、所述拍摄装置的拍摄姿态和/或所述拍摄装置的拍摄参数。
- 根据权利要求1所述的方法,其特征在于,所述根据所述实时拍摄画面以及 所述样本图像,调节所述拍摄装置的第一控制参数,以使得所述拍摄装置对目标对象进行拍摄之后,还包括:保存所述拍摄装置在所述预设拍摄点所拍摄的图像。
- 一种移动平台,其特征在于,所述移动平台包括:平台主体;搭载在所述平台主体上的拍摄装置;以及控制器,与所述拍摄装置电耦合连接,所述控制器用于进行如下操作:控制移动平台移动;当所述移动平台位于预设拍摄点时,获取预存的所述预设拍摄点的样本图像;根据所述移动平台上的拍摄装置的实时拍摄画面以及所述样本图像,调节所述拍摄装置的第一控制参数,以使得所述拍摄装置对目标对象进行拍摄。
- 根据权利要求20所述的移动平台,其特征在于,所述控制器在调节所述拍摄装置的第一控制参数,以使得所述拍摄装置对目标图像进行拍摄时,具体用于:调节所述拍摄装置的第一控制参数,以使得所述目标对象在所述实时拍摄画面中的图像参数趋于所述目标对象在所述样本图像中的图像参数。
- 根据权利要求21所述的移动平台,其特征在于,所述目标对象在所述实时拍摄画面中的图像参数包括:所述目标对象在所述实时拍摄画面中的位置和/或大小。
- 根据权利要求20所述的移动平台,其特征在于,所述第一控制参数包括:所述拍摄装置的拍摄姿态和/或所述拍摄装置的拍摄参数。
- 根据权利要求23所述的移动平台,其特征在于,所述移动平台还包括云台,所述拍摄装置通过所述云台搭载在所述平台主体上;所述控制器在根据所述拍摄装置的实时拍摄画面以及所述样本图像,调节所述拍摄装置的第一控制参数时,具体用于:将所述实时拍摄画面以及所述样本图像进行比对,获取所述目标对象在所述实时拍摄画面中的第一位置信息以及所述目标对象在所述样本图像中的第二位置信息;根据所述第一位置信息和所述第二位置信息,通过控制所述移动平台上的云台以调节所述拍摄装置的拍摄姿态,以使得所述目标对象在所述实时拍摄画面中的位置趋向于所述目标对象在所述样本图像中的位置。
- 根据权利要求24所述的移动平台,其特征在于,所述控制器在根据所述第一位置信息和所述第二位置信息,调节所述拍摄装置的拍摄姿态时,具体用于:根据所述第一位置信息和所述第二位置信息,确定位置偏差;根据所述位置偏差,通过控制所述移动平台上的云台的姿态,调节所述拍摄装置的拍摄姿态。
- 根据权利要求23所述的移动平台,其特征在于,所述控制器在根据所述拍摄装置的实时拍摄画面以及所述样本图像,调节所述拍摄装置的第一控制参数时,具体用于:将所述实时拍摄画面以及所述样本图像进行比对,获取所述目标对象在所述实时拍摄画面中的大小以及所述目标对象在所述样本图像中的大小;根据所述目标对象在所述实时拍摄画面中的大小以及所述目标对象在所述样本图像中的大小,控制所述拍摄装置进行变焦,以使得所述目标对象在所述拍摄画面中的大小趋向于所述目标对象在所述样本图像中的大小。
- 根据权利要求26所述的移动平台,其特征在于,所述控制器在根据所述目标对象在所述实时拍摄画面中的大小以及所述目标对象在所述样本图像中的大小,控制所述拍摄装置进行变焦时,具体用于:根据所述目标对象在所述实时拍摄画面中的大小以及所述目标对象在所述样本图像中的大小,确定所述拍摄装置的缩放参数;根据所述缩放参数,控制所述拍摄装置进行变焦。
- 根据权利要求24或26所述的移动平台,其特征在于,所述预设拍摄点的样本图像存储在所述拍摄装置中,所述将所述实时拍摄画面以及所述样本图像进行比对的执行主体为所述拍摄装置;或者,所述预设拍摄点的样本图像存储在地面端设备中,所述将所述实时拍摄画面以及所述样本图像进行比对的执行主体为所述地面端设备。
- 根据权利要求20所述的移动平台,其特征在于,所述控制器在预存所述预设拍摄点的样本图像时,具体用于:接收地面端设备发送的用户指令;根据所述用户指令,控制所述移动平台飞行;在所述移动平台飞行过程中,若接收到地面端设备发送的拍摄点确定指令,则将所述移动平台的当前位置确定为所述预设拍摄点;在所述预设拍摄点处,控制所述移动平台上的拍摄装置以预设配置获取样本图像;获取所述预设拍摄点的位置信息;保存所述预设拍摄点的位置信息及所述预设拍摄点的样本图像。
- 根据权利要求29所述的移动平台,其特征在于,所述控制器在根据所述用户指令,控制所述移动平台飞行时,具体用于:根据所述用户指令,控制所述拍摄装置的镜头与所述目标对象之间的实时高度大于或等于预设高度阈值。
- 根据权利要求29所述的移动平台,其特征在于,所述控制器在保存所述预设 拍摄点的位置信息及所述预设拍摄点的样本图像时,具体用于:将所述预设拍摄点的位置信息保存在所述移动平台或地面端设备上;将所述样本图像保存在所述拍摄装置或所述地面端设备上。
- 根据权利要求31所述的移动平台,其特征在于,所述控制器在将所述样本图像保存在所述拍摄装置或所述地面端设备上之前,还用于:将所述样本图像进行下采样处理;所述控制器在将所述样本图像保存在所述拍摄装置或所述地面端设备上时,具体用于:将下采样处理后的样本图像保存在所述拍摄装置或所述地面端设备上。
- 根据权利要求20所述的移动平台,其特征在于,所述控制器在控制移动平台飞行时,具体用于:根据预设的航线信息,控制所述移动平台飞行,其中所述预设的航线信息包括:所述移动平台在所述预设拍摄点的位置信息以及所述移动平台在所述预设拍摄点的第二控制参数;或者所述控制器在控制移动平台飞行时,具体用于:接收地面端设备发送的用户指令;根据所述用户指令,控制所述移动平台飞行。
- 根据权利要求33所述的移动平台,其特征在于,所述第二控制参数包括:所述移动平台的姿态、所述拍摄装置的拍摄姿态和/或所述拍摄装置的拍摄参数。
- 根据权利要求34所述的移动平台,其特征在于,所述控制器在根据预设的航线信息,控制所述移动平台飞行时,具体用于:当所述移动平台处于所述预设拍摄点时,根据所述第二控制参数,控制所述移动平台的实时姿态、所述拍摄装置的实时拍摄姿态和/或所述拍摄装置的实时拍摄参数。
- 根据权利要求34所述的移动平台,其特征在于,所述控制器在获取第二控制参数时,具体用于:接收地面端设备发送的用户指令;根据所述用户指令,控制所述移动平台飞行;在所述移动平台飞行过程中,若接收到地面端设备发送的拍摄点确定指令,则获取当前位置处,所述移动平台的姿态、所述拍摄装置的拍摄姿态和/或所述拍摄装置的拍摄参数;将所述当前位置处,所述移动平台的姿态、所述拍摄装置的拍摄姿态和/或所述拍摄装置的拍摄参数作为所述移动平台在所述预设拍摄点的第二控制参数。
- 根据权利要求36所述的移动平台,其特征在于,所述控制器在接收到地面端设备发送的拍摄点确定指令之后,获取所述当前位置处,所述移动平台的姿态、所述拍摄装置的拍摄姿态和/或所述拍摄装置的拍摄参数之前,还用于:接收所述地面端设备发送的调节参数;根据所述调节参数,调节所述移动平台的姿态、所述拍摄装置的拍摄姿态和/或所述拍摄装置的拍摄参数;所述当前位置处,所述移动平台的姿态、所述拍摄装置的拍摄姿态和/或所述拍摄装置的拍摄参数为:调节参数后的所述移动平台的姿态、所述拍摄装置的拍摄姿态和/或所述拍摄装置的拍摄参数。
- 根据权利要求20所述的移动平台,其特征在于,所述控制器在根据所述实时拍摄画面以及所述样本图像,调节所述拍摄装置的第一控制参数,以使得所述拍摄装置对目标对象进行拍摄之后,还用于:保存所述拍摄装置在所述预设拍摄点所拍摄的图像。
- 一种计算机可读存储介质,其上存储有计算机程序,其特征在于,该程序被处理器执行时实现权利要求1至19任一项所述的拍摄控制方法的步骤。
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201980005397.4A CN111316632A (zh) | 2019-01-17 | 2019-01-17 | 拍摄控制方法及可移动平台 |
PCT/CN2019/072231 WO2020147085A1 (zh) | 2019-01-17 | 2019-01-17 | 拍摄控制方法及可移动平台 |
US17/375,616 US20210341924A1 (en) | 2019-01-17 | 2021-07-14 | Photography control method and mobile platform |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/CN2019/072231 WO2020147085A1 (zh) | 2019-01-17 | 2019-01-17 | 拍摄控制方法及可移动平台 |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US17/375,616 Continuation US20210341924A1 (en) | 2019-01-17 | 2021-07-14 | Photography control method and mobile platform |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2020147085A1 true WO2020147085A1 (zh) | 2020-07-23 |
Family
ID=71147704
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2019/072231 WO2020147085A1 (zh) | 2019-01-17 | 2019-01-17 | 拍摄控制方法及可移动平台 |
Country Status (3)
Country | Link |
---|---|
US (1) | US20210341924A1 (zh) |
CN (1) | CN111316632A (zh) |
WO (1) | WO2020147085A1 (zh) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN116916166A (zh) * | 2023-09-12 | 2023-10-20 | 湖南湘银河传感科技有限公司 | 一种基于ai图像解析的遥测终端机 |
Families Citing this family (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2022067637A1 (zh) * | 2020-09-30 | 2022-04-07 | 深圳市大疆创新科技有限公司 | 一种拍摄控制方法、拍摄装置及存储介质 |
WO2022141123A1 (zh) * | 2020-12-29 | 2022-07-07 | 深圳市大疆创新科技有限公司 | 可移动平台及其控制方法、装置、终端设备和存储介质 |
CN114173060A (zh) * | 2021-12-10 | 2022-03-11 | 北京瞰瞰智能科技有限公司 | 智能移动拍摄方法、装置以及控制器 |
CN114326771A (zh) * | 2021-12-31 | 2022-04-12 | 国网湖北省电力有限公司超高压公司 | 一种基于图像识别的无人机拍摄航线生成方法及系统 |
CN117975658A (zh) * | 2024-04-01 | 2024-05-03 | 江苏征途电气科技有限公司 | 基于人工智能的监控分析报警系统 |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104917966A (zh) * | 2015-05-28 | 2015-09-16 | 小米科技有限责任公司 | 飞行拍摄方法及装置 |
CN105391939A (zh) * | 2015-11-04 | 2016-03-09 | 腾讯科技(深圳)有限公司 | 无人机拍摄控制方法和装置、无人机拍摄方法和无人机 |
CN106468918A (zh) * | 2015-08-18 | 2017-03-01 | 航天图景(北京)科技有限公司 | 一种线路巡检的标准化数据采集方法及系统 |
US20170235018A1 (en) * | 2016-01-08 | 2017-08-17 | Pictometry International Corp. | Systems and methods for taking, processing, retrieving, and displaying images from unmanned aerial vehicles |
Family Cites Families (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8542287B2 (en) * | 2009-03-19 | 2013-09-24 | Digitaloptics Corporation | Dual sensor camera |
US9087269B2 (en) * | 2012-08-24 | 2015-07-21 | Google Inc. | Providing image search templates |
CN205263655U (zh) * | 2015-08-03 | 2016-05-25 | 余江 | 一种用于自动生成全景照片的系统、无人飞行器及地面站 |
CN105606073A (zh) * | 2016-01-11 | 2016-05-25 | 谭圆圆 | 无人飞行器处理系统及其飞行状态数据处理方法 |
CN105959625B (zh) * | 2016-05-04 | 2020-04-14 | 北京博瑞云飞科技发展有限公司 | 控制无人机追踪拍摄的方法及装置 |
CN107749957A (zh) * | 2017-11-07 | 2018-03-02 | 高域(北京)智能科技研究院有限公司 | 无人机航拍画面显示系统和方法 |
-
2019
- 2019-01-17 CN CN201980005397.4A patent/CN111316632A/zh active Pending
- 2019-01-17 WO PCT/CN2019/072231 patent/WO2020147085A1/zh active Application Filing
-
2021
- 2021-07-14 US US17/375,616 patent/US20210341924A1/en not_active Abandoned
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104917966A (zh) * | 2015-05-28 | 2015-09-16 | 小米科技有限责任公司 | 飞行拍摄方法及装置 |
CN106468918A (zh) * | 2015-08-18 | 2017-03-01 | 航天图景(北京)科技有限公司 | 一种线路巡检的标准化数据采集方法及系统 |
CN105391939A (zh) * | 2015-11-04 | 2016-03-09 | 腾讯科技(深圳)有限公司 | 无人机拍摄控制方法和装置、无人机拍摄方法和无人机 |
US20170235018A1 (en) * | 2016-01-08 | 2017-08-17 | Pictometry International Corp. | Systems and methods for taking, processing, retrieving, and displaying images from unmanned aerial vehicles |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN116916166A (zh) * | 2023-09-12 | 2023-10-20 | 湖南湘银河传感科技有限公司 | 一种基于ai图像解析的遥测终端机 |
CN116916166B (zh) * | 2023-09-12 | 2023-11-17 | 湖南湘银河传感科技有限公司 | 一种基于ai图像解析的遥测终端机 |
Also Published As
Publication number | Publication date |
---|---|
US20210341924A1 (en) | 2021-11-04 |
CN111316632A (zh) | 2020-06-19 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2020147085A1 (zh) | 拍摄控制方法及可移动平台 | |
US20210112207A1 (en) | Method, control apparatus and control system for controlling an image capture of movable device | |
CN112154649A (zh) | 航测方法、拍摄控制方法、飞行器、终端、系统及存储介质 | |
WO2019227441A1 (zh) | 可移动平台的拍摄控制方法和设备 | |
US20180275659A1 (en) | Route generation apparatus, route control system and route generation method | |
CN108351650B (zh) | 一种对飞行器的飞行控制方法、装置及飞行器 | |
WO2021212445A1 (zh) | 拍摄方法、可移动平台、控制设备和存储介质 | |
CN105956081B (zh) | 地面站地图更新方法及装置 | |
CN106586011A (zh) | 航拍无人飞行器的对准方法及其航拍无人飞行器 | |
CN106708070B (zh) | 一种航拍控制方法和装置 | |
CN113747071B (zh) | 一种无人机拍摄方法、装置、无人机及存储介质 | |
WO2018163571A1 (ja) | 情報処理装置、情報処理方法および情報処理プログラム | |
WO2020237422A1 (zh) | 航测方法、飞行器及存储介质 | |
WO2021135824A1 (zh) | 图像曝光方法及装置、无人机 | |
WO2021016907A1 (zh) | 确定环绕航线的方法、航拍方法、终端、无人飞行器及系统 | |
JP2015002522A (ja) | 監視カメラ及び監視カメラの制御方法 | |
WO2020014953A1 (zh) | 一种图像处理方法及设备 | |
CN110933297B (zh) | 智能摄影系统的摄影控制方法、装置、存储介质及系统 | |
WO2019140695A1 (zh) | 控制飞行器飞行的方法及设备 | |
CN110741626B (zh) | 拍摄控制方法、可移动平台、控制设备及存储介质 | |
JP2021096865A (ja) | 情報処理装置、飛行制御指示方法、プログラム、及び記録媒体 | |
WO2021036947A1 (zh) | 一种辅助对焦方法、装置及无人飞行器 | |
WO2022000138A1 (zh) | 拍摄控制方法和装置、云台、拍摄系统 | |
WO2021217408A1 (zh) | 无人机系统及其控制方法和装置 | |
CN111345031B (zh) | 无人机及其拍摄控制方法 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 19910343 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 19910343 Country of ref document: EP Kind code of ref document: A1 |