WO2023123254A1 - Control method and device for unmanned aerial vehicle, unmanned aerial vehicle, and storage medium - Google Patents

Control method and device for unmanned aerial vehicle, unmanned aerial vehicle, and storage medium Download PDF

Info

Publication number
WO2023123254A1
WO2023123254A1 PCT/CN2021/143273 CN2021143273W WO2023123254A1 WO 2023123254 A1 WO2023123254 A1 WO 2023123254A1 CN 2021143273 W CN2021143273 W CN 2021143273W WO 2023123254 A1 WO2023123254 A1 WO 2023123254A1
Authority
WO
WIPO (PCT)
Prior art keywords
target object
shooting
uav
aerial vehicle
unmanned aerial
Prior art date
Application number
PCT/CN2021/143273
Other languages
French (fr)
Chinese (zh)
Inventor
张伟
邬奇峰
秦罗霄
Original Assignee
深圳市大疆创新科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市大疆创新科技有限公司 filed Critical 深圳市大疆创新科技有限公司
Priority to CN202180100395.0A priority Critical patent/CN117751580A/en
Priority to PCT/CN2021/143273 priority patent/WO2023123254A1/en
Publication of WO2023123254A1 publication Critical patent/WO2023123254A1/en

Links

Images

Classifications

    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/08Control of attitude, i.e. control of roll, pitch, or yaw
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/10Simultaneous control of position or course in three dimensions

Definitions

  • the present application relates to the technical field of drones, and in particular to a control method and device for drones, drones and storage media.
  • embodiments of the present application provide a method and device for controlling a drone, a drone and a storage medium, aiming at improving the convenience of video shooting.
  • the embodiment of the present application provides a method for controlling a drone, the drone is equipped with a shooting device, and the method includes:
  • a second target object of a preset category is identified in the image captured by the shooting device towards the first target object, or a second target object of a preset category is detected relative to the UAV or the The position of the first target object satisfies the preset condition, and the shooting device is controlled to switch from shooting toward the first target object to shooting toward the second target object, and the second target object is different from the first target object. a target object.
  • the embodiment of the present application also provides a method for controlling a drone, the drone is equipped with a shooting device, and the method includes:
  • the embodiment of the present application also provides a method for controlling an unmanned aerial vehicle, wherein the unmanned aerial vehicle is equipped with a photographing device, and the method includes:
  • the orientation of the shooting device is adjusted so that the image area of the target object in the time-lapse shooting image moves from the center of the frame to the edge of the frame.
  • the embodiment of the present application also provides a method for controlling a drone, the drone is equipped with a shooting device, and the method includes:
  • the relative position information determine the target circle angle and/or target circle direction of the UAV
  • the relative orientation of the first target object and the second target object in the image captured by the photographing device changes as the UAV flies around the first target object.
  • the embodiment of the present application also provides a control device for an unmanned aerial vehicle, wherein the unmanned aerial vehicle is equipped with a shooting device, and the control device includes a memory and a processor;
  • the memory is used to store computer programs
  • the processor is configured to execute the computer program and implement the following steps when executing the computer program:
  • a second target object of a preset category is identified in the image captured by the shooting device towards the first target object, or a second target object of a preset category is detected relative to the UAV or the The position of the first target object satisfies the preset condition, and the shooting device is controlled to switch from shooting toward the first target object to shooting toward the second target object, and the second target object is different from the first target object. a target object.
  • the embodiment of the present application also provides a control device for a drone, wherein the drone is equipped with a shooting device, and the control device includes a memory and a processor;
  • the memory is used to store computer programs
  • the processor is configured to execute the computer program and implement the following steps when executing the computer program:
  • a control device for a drone characterized in that the drone is equipped with a shooting device, and the control device includes a memory and a processor;
  • the memory is used to store computer programs
  • the processor is configured to execute the computer program and implement the following steps when executing the computer program:
  • the orientation of the shooting device is adjusted so that the image area of the target object in the time-lapse shooting image moves from the center of the frame to the edge of the frame.
  • a control device for a drone characterized in that the drone is equipped with a shooting device, and the control device includes a memory and a processor;
  • the memory is used to store computer programs
  • the processor is configured to execute the computer program and implement the following steps when executing the computer program:
  • the relative position information determine the target circle angle and/or target circle direction of the UAV
  • the relative orientation of the first target object and the second target object in the image captured by the photographing device changes as the UAV flies around the first target object.
  • the embodiment of the present application also provides a drone, including:
  • the power system is arranged on the body and is used to provide flight power for the unmanned aerial vehicle;
  • a photographing device the photographing device is fixedly or detachably connected to the body;
  • control device of the drone as described in the fifth aspect, the sixth aspect, the seventh aspect or the eighth aspect.
  • the embodiment of the present application also provides a computer-readable storage medium, the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the processor implements the above first aspect , the steps of the control method of the drone described in the second aspect, the third aspect or the fourth aspect.
  • the embodiment of the present application provides a method and device for controlling a drone, a drone and a storage medium.
  • controlling the drone to follow the first target object and controlling the shooting device to shoot toward the first target object, if the shooting The device recognizes a second target object of a preset category in the image taken by the device towards the first target object, or detects that the position of a second target object of a preset category relative to the drone or the first target object satisfies a preset condition, Then control the shooting device to shoot towards the second target object to realize automatic mirror movement, so that the captured video can show the effect of the subject gradually transitioning from the first target object to the second target object, and the entire shooting process does not require manual control by the user Drones and shooting devices have greatly improved the simplicity of video shooting.
  • FIG. 1 is a schematic diagram of a scene implementing a method for controlling a drone provided in an embodiment of the present application
  • Fig. 2 is a schematic diagram of a scene in which a UAV performs in-camera shooting in the embodiment of the present application;
  • Fig. 3 is a schematic diagram of a scene of a close-up shot by a drone in the embodiment of the present application;
  • Fig. 4 is a schematic diagram of a scene where the drone performs automatic mirror movement in the embodiment of the present application
  • Fig. 5 is a schematic diagram of a scene of time-lapse shooting by a UAV in the embodiment of the present application
  • FIG. 6 is a schematic flow chart of the steps of a method for controlling a drone provided in an embodiment of the present application
  • Fig. 7 is a schematic flowchart of the sub-steps of the control method of the UAV in Fig. 6;
  • Fig. 8 is a schematic diagram of a scene where the UAV in the embodiment of the present application performs automatic mirror movement and surround shooting;
  • FIG. 9 is a schematic flowchart of steps of another method for controlling a drone provided in an embodiment of the present application.
  • FIG. 10 is a schematic diagram of another scene of close-up shooting by a drone in the embodiment of the present application.
  • Fig. 11 is a schematic flowchart of the steps of another method for controlling a drone provided in the embodiment of the present application.
  • FIG. 12 is a schematic diagram of another scene of time-lapse shooting by a UAV in the embodiment of the present application.
  • Fig. 13 is a schematic flowchart of the steps of another method for controlling a drone provided in the embodiment of the present application.
  • Fig. 14 is a schematic diagram of a scene where the UAV in the embodiment of the present application performs surround shooting
  • Fig. 15 is a schematic structural block diagram of a control device for an unmanned aerial vehicle provided by an embodiment of the present application.
  • Fig. 16 is a schematic structural block diagram of an unmanned aerial vehicle provided by an embodiment of the present application.
  • FIG. 1 is a schematic diagram of a scene for implementing a control method for a drone provided by an embodiment of the present application.
  • the scene includes a drone 100 and a remote control device 200, the remote control device 200 is connected to the drone 100 in communication, the remote control device 200 is used to control the drone 100, and the drone 100 is used to transfer the photographed The image is sent to the remote control device 200 for display.
  • the UAV 100 includes a body 110, a power system 120, a camera 130 and a control system (not shown in FIG. Provide flight power for the UAV 100 , the camera 130 is used to take images, and the control system is set in the body 110 .
  • the photographing device 130 is fixedly connected or detachably connected to the body 110, that is, the photographing device 130 can be coupled and mounted on the pan/tilt of the UAV 100, or can be integrated on the body 110 of the UAV 100 for image collection.
  • the photographing device 130 may include one camera, that is, a monocular photographing solution, or may include two cameras, that is, a binocular photographing solution.
  • the number of shooting devices 130 can also be one or more. When there are multiple shooting devices 130, they can be distributed in multiple positions of the body 110, and multiple shooting devices 130 can work independently or in linkage.
  • the power system 120 may include one or more propellers 121 , one or more motors 122 corresponding to the one or more propellers, and one or more electronic governors (referred to as ESCs for short).
  • the motor 122 is connected between the electronic governor and the propeller 121, and the motor 122 and the propeller 121 are arranged on the body 110 of the UAV 100; the electronic governor is used to receive the driving signal generated by the control device, and provide a driving current according to the driving signal to the motor 122 to control the speed of the motor 122.
  • the motor 122 is used to drive the propeller 121 to rotate, so as to provide power for the flight of the UAV 100 , and the power enables the UAV 100 to realize movement of one or more degrees of freedom.
  • drone 100 may rotate about one or more axes of rotation.
  • the aforementioned rotation axes may include a roll axis, a yaw axis, and a pitch axis.
  • the motor 122 may be a DC motor or an AC motor.
  • the motor 122 may be a brushless motor or a brushed motor.
  • the control system may include a controller and a sensing system.
  • the sensing system can be used to measure the pose information and motion information of the movable platform, such as three-dimensional position, three-dimensional angle, three-dimensional velocity, three-dimensional acceleration and three-dimensional angular velocity, etc.
  • the pose information is the position information of the UAV 100 in space and attitude information.
  • the sensing system may include, for example, at least one of sensors such as a gyroscope, an ultrasonic sensor, an electronic compass, an inertial measurement unit (Inertial Measurement Unit, IMU), a visual sensor, a global navigation satellite system, and a barometer.
  • the global navigation satellite system may be the Global Positioning System (GPS).
  • the controller is used to control the flight of the UAV 100, for example, the flight of the UAV 100 can be controlled according to the pose information and/or the pose information measured by the sensor system. It should be understood that the controller can automatically control the UAV 100 according to pre-programmed instructions.
  • the remote control device 200 is in communication connection with the display device 210 , and the display device 210 is used to display the image collected by the camera device 130 sent by the UAV 100 .
  • the display device 210 includes a display screen arranged on the remote control device 200 or a display independent of the remote control device 200.
  • the display independent of the remote control device 200 may include a mobile phone, a tablet computer or a personal computer, etc., or may also be a Other electronic devices with display screens.
  • the display screen includes an LED display screen, an OLED display screen, an LCD display screen and the like.
  • the display device 210 displays the image collected by the shooting device 130, and the user selects a first target object in the displayed image, and the remote control device 200 obtains the position information of the first target object in the image, and The position information of a target object in the image is sent to the UAV 100, and the UAV 100 controls the shooting device 130 to perform in-camera shooting, close-up shooting, automatic mirror movement and/or according to the position information of the first target object in the image. Timelapse.
  • the position information of the first target object collected by the GPS positioning device is sent to the UAV 100, and the UAV controls the shooting device according to the position information 130 for in-frame shooting, close-up shooting, automatic mirror movement and/or time-lapse shooting.
  • the UAV 100 follows the first target object according to the position information of the first target object, and controls the photographing device 130 to shoot toward the first target object. Further, as shown in FIG. 2 , the position of the drone 100 can be adjusted so that the drone 100 is at a side front position 20 relative to the first target object, and the shooting device 130 is controlled to shoot toward the first target object, so that The captured video can present the effect of the first target object entering the mirror.
  • Close-up shooting after the in-camera shooting is finished, the UAV 100 keeps track of the first target object in a side-to-front relative orientation relative to the first target object. Include some close-ups during the in-shot, or during tracking after the in-shot. For example, the UAV 100 increases the focal length of the shooting device 130 and adjusts the posture of the shooting device so that the shooting device 130 shoots towards the head and shoulders area of the first target object to shoot the first target object at a close distance, so that the captured video can Embodies facial expressions and local details of the first target object. As shown in FIG. 3, before the focal length of the photographing device 130 is increased, the image 31 collected by the photographing device 130 may include the whole body of the first target object 10. After increasing the focal length of the photographing device 130, the image 31 collected by the photographing device 32 includes only the head and shoulders region of the first target object 10 .
  • Automatic mirror movement during the process of the UAV 100 tracking the first target object and controlling the photographing device 130 to shoot towards the first target object, if a predetermined Assuming that the second target object of the category, or detecting that the position of the second target object of the preset category relative to the UAV 100 or the first target object satisfies the preset condition, then the shooting device 130 is controlled to shoot towards the first target object Switch to shooting toward the second target object, control the UAV 100 to surround the first target object, and control the shooting device 130 to shoot the first target object and the second target object.
  • the second target object 40 of the preset category is recognized in the image taken by the shooting device towards the first target object 10, and the drone is at the position point 21, then the drone gradually moves from the position point 21 to The location point 22 is moved so that the UAV is gradually moving away from the first target object 10.
  • the orientation of the photographing device 130 is changed from facing the first target object 10 to facing the second target object 40, so as to realize automatic mirror movement , and then the UAV takes the position point 22 as the starting point to fly around the first target object 10 at 45°, so that the UAV is located at the position point 23.
  • the image includes the first target object 10 and the second target object 40 , which can reflect the changes of the second target object 40 at different viewing angles of the first target object 10 .
  • Time-lapse shooting After the UAV surrounds the first target object with a preset orbit angle, control the UAV to keep the relative orientation to the first target object at the end of the orbit and follow the first target object; after the UAV follows the first target object During the process, the shooting device is controlled to take time-lapse shooting of the first target object.
  • the UAV starts to follow the first target object 10 starting from the position point 23, and controls the shooting device to take time-lapse photography of the first target object 10, and stops when the UAV is at the position point 24 Time-lapse shooting, thereby recording the scene from sunset to evening, and at the end of the time-lapse shooting, the image area of the first target object 10 in the time-lapse shooting image moves from the center of the screen to the edge of the screen, presenting The effect of the end of shooting.
  • the UAV 100 can use at least one of the shooting methods of entering the camera, close-up shooting, automatic mirror movement and time-lapse shooting.
  • the machine can use different shooting methods to shoot according to the sequence set by the user. For example, use the camera-in shooting, close-up shooting, automatic mirror movement or time-lapse shooting alone, or for example, the drone first performs the camera-in shooting and then automatically moves the mirror, or first performs the camera-in shooting and then automatically moves the mirror, Then take a time-lapse shot.
  • the UAV 100 can edit and edit the first video clip, the second video clip, the third video clip and/or the fourth video clip to obtain one or more presentations effect, and then send the edited video to the remote control device 200.
  • the UAV 100 can also send the first video clip, the second video clip, the third video clip and/or the fourth video clip to the remote control device 200, and the first video clip, the second video clip by the remote control device 200 , the third video segment and/or the fourth video segment are edited and edited to obtain one or more videos with presentation effects.
  • the remote control device 200 displays a video editing page through the display device 210, and the video editing page includes a plurality of video editing templates; acquires the video editing template selected by the user on the video editing page, and uses the selected video editing template as the target
  • the video editing template is sent to the drone 100; the drone 100 selects one or more video clips from the first video clip, the second video clip, the third video clip and the fourth video clip based on the target video editing template; according to The target video editing template edits and clips one or more video clips to obtain one or more video presentation effects, and sends the edited video to the remote control device 200 .
  • the remote control device 200 displays a video editing page through the display device 210, and the video editing page includes a plurality of video editing templates; acquires the video editing template selected by the user on the video editing page, and uses the selected video editing template as the target Video editing template; based on the target video editing template, select one or more video clips from the stored first video clip, the second video clip, the third video clip and the fourth video clip; according to the target video editing template, one or Multiple video clips are edited and clipped to obtain a video with one or more presentation effects.
  • the UAV 100 can be, for example, a quadrotor UAV, a hexacopter UAV, or an octorotor UAV. Of course, it can also be a fixed-wing UAV, or a combination of a rotary-wing UAV and a fixed-wing UAV, which is not limited here.
  • the remote control device 200 may include, but is not limited to: smart phone/mobile phone, tablet computer, remote control with screen, and wearable device.
  • the remote control device 200 may be a handheld terminal, and the remote control device 200 may be portable.
  • the remote control device 200 may be carried by a human user. In some cases, remote control device 200 may be remote from a human user, and the user may control drone 100 using wireless and/or wired communications.
  • FIG. 6 is a schematic flowchart of steps of a method for controlling a drone provided in an embodiment of the present application.
  • the method for controlling the drone includes steps S101 to S102.
  • Step S101 controlling the drone to follow the first target object, and controlling the photographing device to shoot toward the first target object.
  • the remote control device displays the real-time image collected by the shooting device of the drone, and determines the object selected by the user in the real-time image as the first target object; obtains the position information of the first target object in the real-time image , and send the location information to the UAV; the UAV controls the UAV to follow the first target object according to the location information of the first target object in the real-time image, and controls the attitude of the shooting device, so that the shooting device Shoot towards the first target object.
  • controlling the photographing device to shoot toward the first target object may include: controlling the photographing device to face toward the first target object, so that the first target object is located at a preset position of the image captured by the photographing device.
  • the preset position may include the center position of the image captured by the shooting device, and may also include a position determined in the image captured by the shooting device based on a preset composition method.
  • the preset composition method includes but is not limited to horizontal line composition, three Divisional composition, central composition, symmetrical composition, diagonal composition, leading line composition, frame composition, nine-square composition, cross-shaped composition, and triangle composition.
  • the position of the UAV is adjusted so that the UAV is in a predetermined position relative to the first target object.
  • Set a relative orientation when the drone is at a preset relative orientation relative to the first target object, control the drone to follow the first target object, and control the photographing device to shoot towards the first target object.
  • the preset relative orientation includes: the UAV is in front of the first target object, and the UAV and the first target object have a preset angle and a preset angle.
  • the preset distance, the preset angle and the preset distance can be set based on actual conditions, which are not specifically limited in this embodiment.
  • the manner of adjusting the position of the drone may be: acquiring the relative positional relationship between the drone and the first target object; adjusting the position of the drone according to the relative positional relationship between the drone and the first target object The location of the drone, so that the drone is in a preset relative orientation relative to the first target object.
  • the focal length of the photographing device is increased and the posture of the photographing device is adjusted so that the photographing device is directed towards the first target object.
  • the shooting of the target object switches to the shooting towards the target area of the first target object.
  • the photographing device includes a zoom lens, and the focal length of the zoom lens is increased, so that the zoom lens shoots toward the target area of the first target object.
  • the first target object is a person
  • the target area includes the head and shoulder area of the person.
  • the shooting device can better capture the facial expression of the person, and then highlight the person in the captured video.
  • the first target object is a car
  • the target area includes the driver's area in the car
  • the camera can better capture the driver's facial expression , and then highlight the facial expressions and local details of the driver in the captured video.
  • the photographing device includes a first lens and a second lens, and acquires position information of the first target object in the image captured by the first lens; according to the position information of the first target object in the image captured by the first lens The location information controls the UAV to follow the first target object, and controls the second lens to shoot the first target object.
  • the first lens may include a wide-angle lens or a zoom lens
  • the second lens may include a zoom lens.
  • the flight distance and/or flight duration of the UAV following the first target object are acquired, and when the flight distance is greater than or equal to the first distance threshold and/or When the flight duration is greater than or equal to the preset duration threshold, increase the focal length of the photographing device and adjust the posture of the photographing device, so that the photographing device switches from shooting toward the first target object to toward the first target object
  • the target area is photographed, or the photographing device is controlled to zoom, so as to change the size of the first target object in the image captured by the photographing device.
  • Step S102 if the second target object of the preset category is identified in the image captured by the shooting device towards the first target object, or the distance between the second target object of the preset category relative to the drone or the first target object is detected When the position satisfies the preset condition, the shooting device is controlled to switch from shooting toward the first target object to shooting toward the second target object.
  • controlling the shooting device to shoot toward the second target object may include: controlling the shooting device to move toward the second target object, so that the second target object is located at a preset position of the image captured by the shooting device.
  • the preset position may include the center position of the image captured by the shooting device, and may also include a position determined in the image captured by the shooting device based on a preset composition method.
  • the preset composition method includes but is not limited to horizontal line composition, three Divisional composition, central composition, symmetrical composition, diagonal composition, leading line composition, frame composition, nine-square composition, cross-shaped composition, and triangle composition.
  • target recognition is performed on the image captured by the photographing device toward the first target object;
  • the shooting device is controlled to switch from shooting towards the first target object to shooting towards the second target object.
  • the first target object is different from the second target object.
  • the first target object is a person
  • the second target object is a landmark building.
  • the preset category can be set based on the actual situation, which is not specifically limited in this embodiment. For example, preset categories include mountains, lakes, seas, trees, landmarks, and more.
  • identifying a second target object of a preset category in the image captured by the photographing device toward the first target object may be a complete second target object or a part of the second target object.
  • the landmark building may be detected based on local features of the landmark building.
  • the shooting device is controlled Switching from shooting toward the first target object to shooting toward the second target object.
  • the UAV stores the position information of the second target object of the preset category, and the UAV will calculate the position information of the first target object in real time during the process of tracking the first target object.
  • the photographing device is controlled to shoot towards the second target object.
  • the UAV will send its real-time position information and/or the position information of the first target object to the remote control device, and the position information of the second target object of the preset category is stored in the remote control device, if the remote control device detects When the position of the second target object of the preset category relative to the drone or the first target object satisfies the preset condition, the remote control device sends a corresponding control instruction to the drone to control the shooting device to shoot toward the second target object.
  • target recognition is performed on the image captured by the photographing device toward the first target object;
  • the second target object of the preset category detect whether the position of the second target object of the preset category relative to the drone or the first target object meets the preset condition, if the second target object of the preset category is detected relative to
  • the shooting device is controlled to switch from shooting toward the first target object to shooting toward the second target object.
  • the preset condition may be set in actual conditions, which is not specifically limited in this embodiment.
  • the preset conditions include that the distance between the second target object of the preset category and the drone or the first target object is less than or equal to the second distance threshold, the first target object is located in the central area of the second target object, the second target object The object is located behind the first target object.
  • the shooting device includes a wide-angle lens.
  • a wider range of images can be captured through the wide-angle lens. Therefore, target recognition is performed on images captured by the wide-angle lens toward the first target object, which facilitates identification. out of the preset category of the second target audience.
  • a second target object of a preset category is identified in the image captured by the shooting device towards the first target object, or it is detected that the second target object of the preset category is relatively If the position of the target object satisfies the preset condition, then the flight distance, flight duration, or gesture of the first target object in the image collected by the drone to follow the first target object is obtained; the flight distance reaches the preset distance .
  • the flight duration reaches a preset duration or the gesture action is a preset gesture action, control the shooting device to switch from shooting toward the first target object to shooting toward the second target object.
  • the shooting device After recognizing that the second target object or the position of the second target object relative to the drone or the first target object satisfies the preset condition, it is further judged whether the condition for switching the subject is met, and after the condition for switching the subject is met, Control the shooting device to shoot towards the second target object, so that the captured video can present the effect that the shooting subject gradually transitions from the first target object to the second target object.
  • multiple wide-angle lenses and one main lens are installed on the drone, the wide-angle lens is, for example, a fisheye lens, and the main lens is, for example, a zoom lens.
  • multiple wide-angle lenses are fixedly installed on the drone, and the orientations of the multiple wide-angle lenses are different.
  • the main lens is mounted on the drone through the gimbal, and the orientation of the main lens can be changed by adjusting the attitude of the gimbal. During the process of the UAV following the first target object, the attitude of the gimbal is controlled so that the main lens is directed towards the first target object.
  • the attitude of the pan/tilt is controlled so that the main lens is switched from shooting towards the first target object to shooting towards the second target object, and the second target object is different from the first target object.
  • the recognition of the second target object can be performed based on the image captured by the wide-angle lens with a wider field of view, and the video capture is performed by the main lens with higher image quality, which can achieve more efficient recognition and higher quality video capture.
  • step S102 may include: substeps S1021 to S1022.
  • Sub-step S1021 controlling the UAV to stay away from the first target object or reducing the focal length of the photographing device.
  • the frame ratio of the second target object in the image captured by the shooting device can be changed, so that the captured video can show the continuous changes of the second target object Effect.
  • the flight distance of the UAV flying away from the first target object is determined; the UAV is controlled to stay away from the first target object according to the flight distance.
  • the UAV is controlled to stay away from the first target object according to a preset flying distance.
  • the frame ratio of the second target object in the image captured by the photographing device determine a focus adjustment value of the photographing device; according to the focal length adjustment value, reduce the focal length of the photographing device. For example, determine the difference between the frame ratio of the second target object in the image captured by the shooting device and the preset ratio; determine the focus adjustment value of the shooting device according to the difference between the frame ratio and the preset ratio.
  • Sub-step S1022 when the UAV moves away from the first target object or the focal length of the shooting device decreases, control the shooting device to switch from shooting toward the first target object to shooting toward the second target object.
  • the shooting device when the drone is far away from the first target object or the focal length of the shooting device is reduced, if it is detected that the second target object is completely present in the image captured by the shooting device, the shooting device is controlled to move towards the first target The shooting of the object is switched to shooting towards the second target object; if it is detected that the second target object is only partly presented in the image captured by the shooting device, the drone is controlled to continue to stay away from the first target object or continue to reduce the focal length of the shooting device .
  • the drone after controlling the photographing device to shoot towards the second target object, the drone is controlled to surround the first target object, and the photographing device is controlled to photograph the first target object and the second target object.
  • the first target object in the image captured by the photographing device of the first target object and the second target object, the first target object is located at the center of the image.
  • the target circle angle and target circle direction are determined according to the relative orientation of the first target object and the second target object, or the target circle angle and target circle direction are determined according to the relative orientation of the first target object and the UAV, or the target circle angle and target circle direction are determined according to the relative orientation of the unmanned aerial vehicle.
  • the relative orientation of the UAV and the second target object determines the target circling angle and target circling direction; the UAV is controlled to circle the first target object according to the target circling angle and target circling direction.
  • the relative orientations of the first target object and the second target object in the images collected by the photographing device change as the drone flies around the first target object.
  • the UAV gradually moves away from the first target object 10 along the track 51 from the position point 21.
  • the second target object 40 only partially appears in the image taken by the shooting device.
  • the control shooting device switches from shooting towards the first target object 10 to towards the second target object 10.
  • the second target object 40 is photographed, and then the drone starts from the position point 22 along the trajectory 52 to circle the first target object 10 at 45° to reach the position point 23, that is, the drone starts from the position point 22 and moves clockwise to the first target object 10.
  • a target object 10 travels around 45° to the location point 23 .
  • the shooting device is controlled to take time-lapse shots of the first target object.
  • the shooting device is controlled to take time-lapse shots of the first target object after the drone surrounds the first target object, a video with a time-lapse effect can be shot.
  • the duration of the time-lapse shooting is related to the remaining power of the drone and/or the sunset time of the area where the drone is located.
  • the duration of the time-lapse shooting can be determined by the remaining power of the drone.
  • a video with a time-lapse effect can be shot, and the time of the time-lapse shooting can be determined by the sunset time of the area where the drone is located.
  • the duration allows the captured video to show the changes of the sunset.
  • the UAV after the UAV is controlled to surround the first target object according to the preset circling angle or the target circling angle, the UAV is controlled to follow the first target object at the relative orientation with the first target object at the end of the circling;
  • the shooting device is controlled to take a time-lapse shot of the first target object.
  • the orientation of the shooting device is adjusted so that the image area of the first target object in the time-lapse shooting image moves from the center of the frame to the edge of the frame.
  • the captured image can show the effect that the first target object moves from the center of the frame to the edge of the frame to indicate the end of the shooting.
  • the duration of the time-lapse shooting and the estimated time-lapse shooting time are obtained, and when the difference between the duration and the estimated time-lapse shooting time is less than or equal to the preset difference, it is determined that the time-lapse shooting enters the end time part.
  • the estimated time-lapse shooting time is related to the remaining power of the drone and/or the sunset time of the area where the drone is located.
  • the manner of adjusting the orientation of the shooting device may be: according to the distance between the image area of the first target object in the time-lapse captured image and the edge of the image, determining the amount of change in the posture of the shooting device; Adjust the orientation of the shooting device so that the image area of the first target object in the time-lapse captured image moves from the center of the frame to the edge of the frame.
  • the method for controlling the UAV provided by the above-mentioned embodiment is to control the UAV to follow the first target object and control the shooting device to shoot toward the first target object. If the second target object of the preset category is detected, or the position of the second target object of the preset category relative to the UAV or the first target object is detected to meet the preset condition, then the shooting device is controlled to shoot towards the first target object Switch to shooting towards the second target object to realize automatic mirror movement, so that the captured video can show the effect of the subject gradually transitioning from the first target object to the second target object.
  • the entire shooting process does not require the user to manually control the unmanned camera and shooting device, which greatly improves the convenience of video shooting.
  • FIG. 9 is a schematic flowchart of steps of another method for controlling a drone provided in an embodiment of the present application.
  • the control method of the drone includes steps S201 to S202.
  • Step S201 controlling the drone to follow the target object, and controlling the photographing device to shoot towards the target object.
  • the remote control device displays the real-time image collected by the shooting device of the drone, and determines the object selected by the user in the real-time image as the target object; obtains the position information of the target object in the real-time image, and The location information is sent to the UAV; the UAV controls the UAV to follow the target object according to the location information of the target object in the real-time image, and controls the shooting device to shoot towards the target object.
  • controlling the photographing device to shoot toward the target object may include: controlling the photographing device to face the target object, so that the target object is located at a preset position of the image captured by the photographing device.
  • the preset position may include the center position of the image captured by the shooting device, and may also include a position determined in the image captured by the shooting device based on a preset composition method.
  • the preset composition method includes but is not limited to horizontal line composition, three Divisional composition, central composition, symmetrical composition, diagonal composition, leading line composition, frame composition, nine-square composition, cross-shaped composition, and triangle composition.
  • the position of the drone is adjusted so that the drone is in a preset relative orientation relative to the target object;
  • the drone is controlled to follow the target object, and the shooting device is controlled to shoot toward the target object.
  • the UAV maintains a preset relative orientation when following the target object, and the preset relative orientation includes: the UAV is in front of the target object, and the UAV and the target object have a preset angle and a preset distance, and the preset angle and the preset distance can be set based on actual conditions, which is not specifically limited in this embodiment.
  • the manner of adjusting the position of the UAV may be: acquiring the relative positional relationship between the UAV and the target object; adjusting the position of the UAV according to the relative positional relationship between the UAV and the target object, So that the UAV is in a preset relative position relative to the target object.
  • Step S202 increasing the focal length of the photographing device and adjusting the posture of the photographing device, so that the photographing device switches from photographing towards the target object to photographing towards a target area of the target object.
  • the target object is a person, and the target area includes the head and shoulder area of the person.
  • the shooting device can better capture the facial expression of the person, and then highlight the face of the person in the captured video. expressions and local details; or, the target object is a car, and the target area includes the driver’s area in the car.
  • the camera can better capture the driver’s facial expressions, thereby highlighting the The facial expressions and local details of the driver in the captured video.
  • the flight distance, flight duration, and gestures of the target object that the UAV follows are acquired.
  • the flight distance is greater than or equal to the preset distance threshold
  • the flight duration is greater than or equal to the preset duration threshold or the gesture action is a preset gesture action
  • the shooting device includes a first lens and a second lens, and acquires position information of the target object in the image captured by the first lens; according to the position information of the target object in the image captured by the first lens, control The drone follows the target object and controls the second camera to shoot towards the target object.
  • the first lens may include a wide-angle lens or a zoom lens
  • the second lens may include a zoom lens.
  • the image 61 collected by the photographing device may include the whole body of the target object; when the focal length of the photographing device is increased, the image 62 collected by the photographing device only includes the body of the target object. head and shoulders area.
  • the control method of the drone controls the drone to follow the target object, and controls the shooting device to shoot toward the target object, and then increases the focal length of the shooting device and adjusts the posture of the shooting device, so that the The shooting device switches from shooting towards the target object to shooting towards the target area of the target object, so that the captured video can reflect the facial expressions and local details of the target object.
  • FIG. 11 is a schematic flowchart of the steps of another method for controlling a drone provided in an embodiment of the present application.
  • the method for controlling the drone includes steps S301 to S302.
  • Step S301 controlling the shooting device to take time-lapse shooting of the target object.
  • the remote control device displays the real-time image collected by the shooting device of the drone, and determines the object selected by the user in the real-time image as the target object; obtains the position information of the target object in the real-time image, and The location information is sent to the drone; the drone controls the drone to follow the target object according to the location information of the target object in the real-time image, and controls the shooting device to take time-lapse shots of the target object.
  • the duration of the time-lapse shooting is related to the remaining power of the drone and/or the sunset time of the area where the drone is located.
  • the duration of the time-lapse shooting can be determined by the remaining power of the drone.
  • a video with a time-lapse effect can be shot, and the time of the time-lapse shooting can be determined by the sunset time of the area where the drone is located.
  • the duration allows the captured video to show the changes of the sunset.
  • Step S302 During the end time period of the time-lapse shooting, adjust the orientation of the shooting device so that the image area of the target object in the time-lapse shooting image moves from the center of the frame to the edge of the frame.
  • the duration of the time-lapse shooting and the estimated time-lapse shooting time are obtained, and when the difference between the duration and the estimated time-lapse shooting time is less than or equal to the preset difference, it is determined that the time-lapse shooting enters the end time part.
  • the estimated time-lapse shooting time is related to the remaining power of the drone and/or the sunset time of the area where the drone is located.
  • the manner of adjusting the orientation of the shooting device may be: according to the distance between the image area of the first target object in the time-lapse captured image and the edge of the image, determining the amount of change in the posture of the shooting device; Adjust the orientation of the shooting device so that the image area of the first target object in the time-lapse captured image moves from the center of the frame to the edge of the frame.
  • the UAV begins to follow the target object 73 starting from the position point 71, and controls the shooting device to perform delayed shooting of the target object 73, and stops the time-lapse shooting when the UAV is at the position point 72,
  • the scene from the setting sun to the evening is recorded, and the image area of the target object 73 in the time-lapse shooting image moves from the center of the screen to the edge of the screen at the end of the time-lapse shooting period, presenting the effect of the shooting end .
  • the shooting device is controlled to take time-lapse shooting of the target object, and then during the end time period of the time-lapse shooting, the orientation of the shooting device is adjusted so that the image of the target object in the time-lapse shooting The image area in the image moves from the center of the screen to the edge of the screen, so that a video based on the time-lapse effect and the effect of showing the end of shooting can be shot.
  • FIG. 13 is a schematic flowchart of the steps of another method for controlling a drone provided by an embodiment of the present application.
  • the method for controlling the drone includes steps S401 to S406.
  • Step S401 acquiring relative position information between a first target object and a second target object.
  • the remote control device displays the real-time image collected by the shooting device of the drone, and obtains the first target object and the second target object selected by the user in the real-time image; obtains the first target object in the real-time image The first position information and the second position information of the second target object in the real-time image, and send the first position information and the second position information to the drone; the drone according to the first position information and the second position information , to determine relative position information between the first target object and the second target object.
  • the first target object is different from the second target object.
  • the image captured by the shooting device is acquired, and target recognition is performed on the image; when the first target object of the first preset category and the second target object of the second preset category are recognized in the image captured by the shooting device When the target object is used, the relative position information between the first target object and the second target object is obtained.
  • the first preset category includes vehicles and people
  • the second preset category includes mountains, lakes, seas, trees, landmark buildings, and the like.
  • Step S402 according to the relative position information, determine the target circle angle and/or target circle direction of the UAV.
  • the relative position information between the first target object and the second target object includes the relative distance between the first target object and the second target object and/or the relative angle between the first target object and the second target object
  • Target wrapping directions include clockwise or counterclockwise.
  • the first mapping relationship between the pre-stored relative position information and the circling angle is acquired, and according to the relative position information and the first mapping relationship between the first target object and the second target object, determine the UAV's The angle around the target. And/or, obtain the second mapping relationship between the pre-stored relative position information and the surrounding direction, and determine the target of the drone according to the relative position information and the second mapping relationship between the first target object and the second target object Orientation around.
  • Step S403 controlling the UAV to fly around the first target object according to the target circling angle and/or target circling direction, and controlling the photographing device to photograph the first target object and the second target object.
  • the first target object is different from the second target object, and the relative orientations of the first target object and the second target object in the images collected by the photographing device change as the drone flies around the first target object.
  • the drone takes the position point 83 as a starting point to circle the first target object 81 for 40° clockwise, and when the drone circles the first target object 81, the camera is controlled to The first target object 81 and the second target object 82 are photographed.
  • the target circling angle and/or target circling direction of the UAV are determined, and the UAV is controlled. Fly around the first target object according to the target circling angle and/or target circling direction, and control the shooting device to shoot the first target object and the second target object, so that the first target object and the second target object are captured by the shooting device.
  • the relative orientation in the image changes as the UAV flies around the first target object, so that there is a position conversion effect between the first target object and the second target object in the image, and the first target object can also be obtained Video of the second target object at a different viewpoint.
  • Fig. 15 is a structural schematic block diagram of a control device for a drone provided by an embodiment of the present application.
  • control device 600 of the drone includes a processor 610 and a memory 620, and the processor 610 and the memory 620 are connected by a bus 630, such as an I2C (Inter-integrated Circuit) bus.
  • a bus 630 such as an I2C (Inter-integrated Circuit) bus.
  • the processor 610 may be a micro-controller unit (Micro-controller Unit, MCU), a central processing unit (Central Processing Unit, CPU), or a digital signal processor (Digital Signal Processor, DSP), etc.
  • MCU Micro-controller Unit
  • CPU Central Processing Unit
  • DSP Digital Signal Processor
  • the memory 620 may be a Flash chip, a read-only memory (ROM, Read-Only Memory) disk, an optical disk, a U disk, or a mobile hard disk.
  • the processor 610 is configured to run a computer program stored in the memory 620, and implement the following steps when executing the computer program:
  • a second target object of a preset category is identified in the image captured by the shooting device towards the first target object, or a second target object of a preset category is detected relative to the UAV or the The position of the first target object satisfies the preset condition, and the shooting device is controlled to switch from shooting toward the first target object to shooting toward the second target object, and the second target object is different from the first target object. a target object.
  • the processor before realizing controlling the UAV to follow the first target object, the processor is further configured to:
  • the UAV following the first target object maintains the preset relative orientation when following the first target object.
  • the preset relative orientation includes: the UAV is in front of the first target object, and the UAV has a preset angle and a preset distance from the first target object.
  • the processor realizes controlling the shooting device to shoot toward the first target object, it is used to realize:
  • the first target object is a person, and the target area includes a head and shoulder area of the person; or, the first target object is a car, and the target area includes a driver area in the car.
  • the photographing device includes a zoom lens
  • the processor is configured to implement: when increasing the focal length of the photographing device:
  • the photographing device includes a wide-angle lens, and identifying a second target object of a preset category in an image captured by the photographing device towards the first target object includes:
  • a second target object of a preset category is identified in an image captured by the wide-angle lens towards the first target object.
  • the processor before realizing controlling the photographing device to switch from photographing towards the first target object to photographing towards the second target object, the processor is further configured to implement:
  • the shooting device is controlled to switch from shooting toward the first target object to toward the first target object.
  • the second target object is photographed.
  • the processor realizes controlling the shooting device to switch from shooting toward the first target object to shooting toward the second target object, it is used to realize:
  • control the shooting device When the UAV moves away from the first target object or the focal length of the shooting device decreases, control the shooting device to switch from shooting towards the first target object to towards the second target object to shoot.
  • processor is also used to implement the following steps:
  • the UAV In the process that the UAV is far away from the first target object or the focal length of the shooting device is reduced, if it is detected that the second target object is completely present in the image captured by the shooting device, control the The photographing device switches from photographing towards the first target object to photographing towards the second target object.
  • processor is also used to implement the following steps:
  • the flight distance of the UAV when flying away from the first target object is determined.
  • the processor controls the shooting device to switch from shooting toward the first target object to shooting toward the second target object, it is further configured to:
  • controlling the UAV to surround the first target object includes:
  • the relative orientation of the first target object and the second target object in the image captured by the photographing device changes as the drone flies around the first target object.
  • processor is also used to implement the following steps:
  • the photographing device is controlled to take time-lapse photographs of the first target object.
  • processor is also used to implement the following steps:
  • the photographing device is controlled to take time-lapse photographs of the first target object.
  • processor is also used to implement the following steps:
  • the orientation of the shooting device is adjusted so that the image area of the first target object in the time-lapse shooting image moves from the center of the frame to the edge of the frame.
  • the duration of the time-lapse shooting is related to the remaining power of the drone and/or the sunset time of the area where the drone is located.
  • the processor adjusts the orientation of the shooting device, it is configured to:
  • the orientation of the photographing device is adjusted so that the image area of the first target object in the time-lapse photographed image moves from the center of the frame to the edge of the frame.
  • the processor 610 is configured to run a computer program stored in the memory 620, and implement the following steps when executing the computer program:
  • the processor 610 is configured to run a computer program stored in the memory 620, and implement the following steps when executing the computer program:
  • the orientation of the shooting device is adjusted so that the image area of the target object in the time-lapse shooting image moves from the center of the frame to the edge of the frame.
  • the processor 610 is configured to run a computer program stored in the memory 620, and implement the following steps when executing the computer program:
  • the relative position information determine the target circle angle and/or target circle direction of the UAV
  • the relative orientation of the first target object and the second target object in the image captured by the photographing device changes as the UAV flies around the first target object.
  • FIG. 16 is a schematic structural block diagram of an unmanned aerial vehicle provided by an embodiment of the present application.
  • the UAV 700 includes a body 710, a power system 720, a camera 730 and a control device 740 of the UAV, and the power system 720 is arranged on the body 710 to provide flight power for the UAV 700,
  • the photographing device 730 is fixedly connected or detachably connected with the body 710 for capturing images
  • the control device 740 of the UAV is installed in the body 710 for controlling the UAV 700 .
  • the control device 740 of the drone may be the control device 600 of the drone as shown in FIG. 15 .
  • the embodiment of the present application also provides a storage medium, the storage medium stores a computer program, the computer program includes program instructions, and the processor executes the program instructions to realize the control of the drone provided by the above-mentioned embodiments method steps.
  • the storage medium may be an internal storage unit of the control device of the drone described in any of the foregoing embodiments, such as a hard disk or a memory of the control device of the drone.
  • the storage medium can also be an external storage device of the control device of the drone, such as a plug-in hard disk equipped on the control device of the drone, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card, flash memory card (Flash Card), etc.

Landscapes

  • Engineering & Computer Science (AREA)
  • Aviation & Aerospace Engineering (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Automation & Control Theory (AREA)
  • Control Of Position, Course, Altitude, Or Attitude Of Moving Bodies (AREA)

Abstract

A control method for an unmanned aerial vehicle, comprising: controlling an unmanned aerial vehicle (100) to follow a first target object, and controlling a photographing device (130) to face and photograph the first target object (S101); and if a second target object is recognized from an image captured by the photographing device (130) which faces and photographs the first target object or if it is detected that the position of a second target object of a preset category relative to the unmanned aerial vehicle (100) or the first target object satisfies a preset condition, controlling the photographing device (130) to shift from facing and photographing the first target object to facing and photographing the second target object, the second target object being different from the first target object (S102). The invention improves the simplicity and convenience of video photographing.

Description

无人机的控制方法、装置、无人机及存储介质Control method and device of unmanned aerial vehicle, unmanned aerial vehicle and storage medium 技术领域technical field
本申请涉及无人机的技术领域,尤其涉及一种无人机的控制方法、装置、无人机及存储介质。The present application relates to the technical field of drones, and in particular to a control method and device for drones, drones and storage media.
背景技术Background technique
目前,越多的用户喜欢在社交平台上分享自己拍摄的视频,为了拍摄有趣的视频来吸引网友的关注,一些用户会使用无人机来拍摄视频。然而,要想通过无人机拍摄出震撼和更具表现力的视频,需要专业摄像师熟练的操控无人机,并进行合理的布局来拍摄,但新手用户难以通过无人机简便的拍摄出震撼和更具表现力的视频,用户体验不好。At present, more and more users like to share their own videos on social platforms. In order to capture interesting videos to attract the attention of netizens, some users will use drones to shoot videos. However, in order to shoot shocking and more expressive videos through drones, professional videographers need to skillfully control the drones and make a reasonable layout to shoot, but it is difficult for novice users to shoot with drones easily. Shocking and more expressive videos with poor user experience.
发明内容Contents of the invention
基于此,本申请实施例提供了一种无人机的控制方法、装置、无人机及存储介质,旨在提高视频拍摄的简便性。Based on this, embodiments of the present application provide a method and device for controlling a drone, a drone and a storage medium, aiming at improving the convenience of video shooting.
第一方面,本申请实施例提供了一种无人机的控制方法,所述无人机搭载有拍摄装置,所述方法包括:In the first aspect, the embodiment of the present application provides a method for controlling a drone, the drone is equipped with a shooting device, and the method includes:
控制所述无人机跟随第一目标对象,并控制所述拍摄装置朝向所述第一目标对象进行拍摄;controlling the UAV to follow the first target object, and controlling the shooting device to shoot towards the first target object;
若在所述拍摄装置朝向所述第一目标对象进行拍摄的图像中识别出预设类别的第二目标对象,或者检测到预设类别的第二目标对象相对于所述无人机或所述第一目标对象的位置满足预设条件,则控制所述拍摄装置由朝向所述第一目标对象进行拍摄转换到朝向所述第二目标对象进行拍摄,所述第二目标对象不同于所述第一目标对象。If a second target object of a preset category is identified in the image captured by the shooting device towards the first target object, or a second target object of a preset category is detected relative to the UAV or the The position of the first target object satisfies the preset condition, and the shooting device is controlled to switch from shooting toward the first target object to shooting toward the second target object, and the second target object is different from the first target object. a target object.
第二方面,本申请实施例还提供了一种无人机的控制方法,所述无人机搭载有拍摄装置,所述方法包括:In the second aspect, the embodiment of the present application also provides a method for controlling a drone, the drone is equipped with a shooting device, and the method includes:
控制所述无人机跟随目标对象,并控制所述拍摄装置朝向所述目标对象进行拍摄;Controlling the UAV to follow the target object, and controlling the shooting device to shoot towards the target object;
增大所述拍摄装置的焦距并调整所述拍摄装置的姿态,以使得所述拍摄装置由朝向所述目标对象进行拍摄转换到朝向所述目标对象的目标区域进行拍摄。Increase the focal length of the photographing device and adjust the posture of the photographing device, so that the photographing device switches from photographing towards the target object to photographing towards a target area of the target object.
第三方面,本申请实施例还提供了一种无人机的控制方法,所述无人机搭 载有拍摄装置,所述方法包括:In a third aspect, the embodiment of the present application also provides a method for controlling an unmanned aerial vehicle, wherein the unmanned aerial vehicle is equipped with a photographing device, and the method includes:
控制所述拍摄装置对目标对象进行延时拍摄;controlling the shooting device to take time-lapse shooting of the target object;
在所述延时拍摄的末尾时间段内,调整所述拍摄装置的朝向,以使得所述目标对象在所述延时拍摄的图像中的图像区域由画面中心移动到画面边缘。During the end time period of the time-lapse shooting, the orientation of the shooting device is adjusted so that the image area of the target object in the time-lapse shooting image moves from the center of the frame to the edge of the frame.
第四方面,本申请实施例还提供了一种无人机的控制方法,所述无人机搭载有拍摄装置,所述方法包括:In the fourth aspect, the embodiment of the present application also provides a method for controlling a drone, the drone is equipped with a shooting device, and the method includes:
获取第一目标对象与第二目标对象之间的相对位置信息;Acquiring relative position information between the first target object and the second target object;
根据所述相对位置信息,确定无人机的目标环绕角度和/或目标环绕方向;According to the relative position information, determine the target circle angle and/or target circle direction of the UAV;
控制所述无人机按照所述目标环绕角度和/或所述目标环绕方向环绕所述第一目标对象飞行,并控制所述拍摄装置对所述第一目标对象和所述第二目标对象进行拍摄;Controlling the UAV to fly around the first target object according to the target circling angle and/or the target circling direction, and controlling the photographing device to take pictures of the first target object and the second target object shoot;
其中,所述第一目标对象与所述第二目标对象在所述拍摄装置采集到的图像中的相对方位随着所述无人机的环绕所述第一目标对象飞行而发生变化。Wherein, the relative orientation of the first target object and the second target object in the image captured by the photographing device changes as the UAV flies around the first target object.
第五方面,本申请实施例还提供了一种无人机的控制装置,其特征在于,所述无人机搭载有拍摄装置,所述控制装置包括存储器和处理器;In the fifth aspect, the embodiment of the present application also provides a control device for an unmanned aerial vehicle, wherein the unmanned aerial vehicle is equipped with a shooting device, and the control device includes a memory and a processor;
所述存储器用于存储计算机程序;The memory is used to store computer programs;
所述处理器,用于执行所述计算机程序并在执行所述计算机程序时,实现以下步骤:The processor is configured to execute the computer program and implement the following steps when executing the computer program:
控制所述无人机跟随第一目标对象,并控制所述拍摄装置朝向所述第一目标对象进行拍摄;controlling the UAV to follow the first target object, and controlling the shooting device to shoot towards the first target object;
若在所述拍摄装置朝向所述第一目标对象进行拍摄的图像中识别出预设类别的第二目标对象,或者检测到预设类别的第二目标对象相对于所述无人机或所述第一目标对象的位置满足预设条件,则控制所述拍摄装置由朝向所述第一目标对象进行拍摄转换到朝向所述第二目标对象进行拍摄,所述第二目标对象不同于所述第一目标对象。If a second target object of a preset category is identified in the image captured by the shooting device towards the first target object, or a second target object of a preset category is detected relative to the UAV or the The position of the first target object satisfies the preset condition, and the shooting device is controlled to switch from shooting toward the first target object to shooting toward the second target object, and the second target object is different from the first target object. a target object.
第六方面,本申请实施例还提供了一种无人机的控制装置,其特征在于,所述无人机搭载有拍摄装置,所述控制装置包括存储器和处理器;In the sixth aspect, the embodiment of the present application also provides a control device for a drone, wherein the drone is equipped with a shooting device, and the control device includes a memory and a processor;
所述存储器用于存储计算机程序;The memory is used to store computer programs;
所述处理器,用于执行所述计算机程序并在执行所述计算机程序时,实现以下步骤:The processor is configured to execute the computer program and implement the following steps when executing the computer program:
控制所述无人机跟随目标对象,并控制所述拍摄装置朝向所述目标对象进行拍摄;Controlling the UAV to follow the target object, and controlling the shooting device to shoot towards the target object;
增大所述拍摄装置的焦距并调整所述拍摄装置的姿态,以使得所述拍摄装置由朝向所述目标对象进行拍摄转换到朝向所述目标对象的目标区域进行拍摄。Increase the focal length of the photographing device and adjust the posture of the photographing device, so that the photographing device switches from photographing towards the target object to photographing towards a target area of the target object.
第七方面,一种无人机的控制装置,其特征在于,所述无人机搭载有拍摄装置,所述控制装置包括存储器和处理器;In the seventh aspect, a control device for a drone, characterized in that the drone is equipped with a shooting device, and the control device includes a memory and a processor;
所述存储器用于存储计算机程序;The memory is used to store computer programs;
所述处理器,用于执行所述计算机程序并在执行所述计算机程序时,实现以下步骤:The processor is configured to execute the computer program and implement the following steps when executing the computer program:
控制所述拍摄装置对目标对象进行延时拍摄;controlling the shooting device to take time-lapse shooting of the target object;
在所述延时拍摄的末尾时间段内,调整所述拍摄装置的朝向,以使得所述目标对象在所述延时拍摄的图像中的图像区域由画面中心移动到画面边缘。During the end time period of the time-lapse shooting, the orientation of the shooting device is adjusted so that the image area of the target object in the time-lapse shooting image moves from the center of the frame to the edge of the frame.
第八方面,一种无人机的控制装置,其特征在于,所述无人机搭载有拍摄装置,所述控制装置包括存储器和处理器;In an eighth aspect, a control device for a drone, characterized in that the drone is equipped with a shooting device, and the control device includes a memory and a processor;
所述存储器用于存储计算机程序;The memory is used to store computer programs;
所述处理器,用于执行所述计算机程序并在执行所述计算机程序时,实现以下步骤:The processor is configured to execute the computer program and implement the following steps when executing the computer program:
获取第一目标对象与第二目标对象之间的相对位置信息;Acquiring relative position information between the first target object and the second target object;
根据所述相对位置信息,确定无人机的目标环绕角度和/或目标环绕方向;According to the relative position information, determine the target circle angle and/or target circle direction of the UAV;
控制所述无人机按照所述目标环绕角度和/或所述目标环绕方向环绕所述第一目标对象飞行,并控制所述拍摄装置对所述第一目标对象和所述第二目标对象进行拍摄;Controlling the UAV to fly around the first target object according to the target circling angle and/or the target circling direction, and controlling the photographing device to take pictures of the first target object and the second target object shoot;
其中,所述第一目标对象与所述第二目标对象在所述拍摄装置采集到的图像中的相对方位随着所述无人机的环绕所述第一目标对象飞行而发生变化。Wherein, the relative orientation of the first target object and the second target object in the image captured by the photographing device changes as the UAV flies around the first target object.
第九方面,本申请实施例还提供了一种无人机,包括:In the ninth aspect, the embodiment of the present application also provides a drone, including:
机体;body;
动力系统,设于所述机体上,用于为所述无人机提供飞行动力;The power system is arranged on the body and is used to provide flight power for the unmanned aerial vehicle;
拍摄装置,所述拍摄装置与所述机体固定连接或可拆卸连接;A photographing device, the photographing device is fixedly or detachably connected to the body;
如上第五方面、第六方面、第七方面或第八方面所述的无人机的控制装置。The control device of the drone as described in the fifth aspect, the sixth aspect, the seventh aspect or the eighth aspect.
第十方面,本申请实施例还提供了一种计算机可读存储介质,所述计算机可读存储介质存储有计算机程序,所述计算机程序被处理器执行时使所述处理器实现如上第一方面、第二方面、第三方面或第四方面所述的无人机的控制方法的步骤。In the tenth aspect, the embodiment of the present application also provides a computer-readable storage medium, the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the processor implements the above first aspect , the steps of the control method of the drone described in the second aspect, the third aspect or the fourth aspect.
本申请实施例提供了一种无人机的控制方法、装置、无人机及存储介质, 通过控制无人机跟随第一目标对象,并控制拍摄装置朝向第一目标对象进行拍摄,若在拍摄装置朝向第一目标对象进行拍摄的图像中识别出预设类别的第二目标对象,或者检测到预设类别的第二目标对象相对于无人机或第一目标对象的位置满足预设条件,则控制拍摄装置朝向第二目标对象进行拍摄,以实现自动运镜,使得拍摄到的视频能够呈现拍摄主体由第一目标对象逐渐过渡到第二目标对象的效果,整个拍摄过程不需要用户手动控制无人机和拍摄装置,极大地提高了视频拍摄的简便性。The embodiment of the present application provides a method and device for controlling a drone, a drone and a storage medium. By controlling the drone to follow the first target object and controlling the shooting device to shoot toward the first target object, if the shooting The device recognizes a second target object of a preset category in the image taken by the device towards the first target object, or detects that the position of a second target object of a preset category relative to the drone or the first target object satisfies a preset condition, Then control the shooting device to shoot towards the second target object to realize automatic mirror movement, so that the captured video can show the effect of the subject gradually transitioning from the first target object to the second target object, and the entire shooting process does not require manual control by the user Drones and shooting devices have greatly improved the simplicity of video shooting.
应当理解的是,以上的一般描述和后文的细节描述仅是示例性和解释性的,并不能限制本申请。It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the application.
附图说明Description of drawings
为了更清楚地说明本申请实施例技术方案,下面将对实施例描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图是本申请的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。In order to illustrate the technical solutions of the embodiments of the present application more clearly, the drawings that need to be used in the description of the embodiments will be briefly introduced below. Obviously, the drawings in the following description are some embodiments of the present application. Ordinary technicians can also obtain other drawings based on these drawings on the premise of not paying creative work.
图1是实施本申请实施例提供的无人机的控制方法的场景示意图;FIG. 1 is a schematic diagram of a scene implementing a method for controlling a drone provided in an embodiment of the present application;
图2是本申请实施例中无人机进行入镜拍摄的一场景示意图;Fig. 2 is a schematic diagram of a scene in which a UAV performs in-camera shooting in the embodiment of the present application;
图3是本申请实施例中无人机进行特写拍摄的一场景示意图;Fig. 3 is a schematic diagram of a scene of a close-up shot by a drone in the embodiment of the present application;
图4是本申请实施例中无人机进行自动运镜的一场景示意图;Fig. 4 is a schematic diagram of a scene where the drone performs automatic mirror movement in the embodiment of the present application;
图5是本申请实施例中无人机进行延时拍摄的一场景示意图;Fig. 5 is a schematic diagram of a scene of time-lapse shooting by a UAV in the embodiment of the present application;
图6是本申请实施例提供的一种无人机的控制方法的步骤示意流程图;FIG. 6 is a schematic flow chart of the steps of a method for controlling a drone provided in an embodiment of the present application;
图7是图6中的无人机的控制方法的子步骤示意流程图;Fig. 7 is a schematic flowchart of the sub-steps of the control method of the UAV in Fig. 6;
图8是本申请实施例中的无人机进行自动运镜和环绕拍摄的一场景示意图;Fig. 8 is a schematic diagram of a scene where the UAV in the embodiment of the present application performs automatic mirror movement and surround shooting;
图9是本申请实施例提供的另一种无人机的控制方法的步骤示意流程图;FIG. 9 is a schematic flowchart of steps of another method for controlling a drone provided in an embodiment of the present application;
图10是本申请实施例中无人机进行特写拍摄的另一场景示意图;FIG. 10 is a schematic diagram of another scene of close-up shooting by a drone in the embodiment of the present application;
图11是本申请实施例提供的又一种无人机的控制方法的步骤示意流程图;Fig. 11 is a schematic flowchart of the steps of another method for controlling a drone provided in the embodiment of the present application;
图12是本申请实施例中无人机进行延时拍摄的另一场景示意图;FIG. 12 is a schematic diagram of another scene of time-lapse shooting by a UAV in the embodiment of the present application;
图13是本申请实施例提供的又一种无人机的控制方法的步骤示意流程图;Fig. 13 is a schematic flowchart of the steps of another method for controlling a drone provided in the embodiment of the present application;
图14是本申请实施例中的无人机进行环绕拍摄的一场景示意图;Fig. 14 is a schematic diagram of a scene where the UAV in the embodiment of the present application performs surround shooting;
图15是本申请实施例提供的一种无人机的控制装置的结构示意性框图;Fig. 15 is a schematic structural block diagram of a control device for an unmanned aerial vehicle provided by an embodiment of the present application;
图16是本申请实施例提供的一种无人机的结构示意性框图。Fig. 16 is a schematic structural block diagram of an unmanned aerial vehicle provided by an embodiment of the present application.
具体实施方式Detailed ways
下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例是本申请一部分实施例,而不是全部的实施例。基于本申请中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本申请保护的范围。The following will clearly and completely describe the technical solutions in the embodiments of the present application with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of them. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the scope of protection of this application.
附图中所示的流程图仅是示例说明,不是必须包括所有的内容和操作/步骤,也不是必须按所描述的顺序执行。例如,有的操作/步骤还可以分解、组合或部分合并,因此实际执行的顺序有可能根据实际情况改变。The flow charts shown in the drawings are just illustrations, and do not necessarily include all contents and operations/steps, nor must they be performed in the order described. For example, some operations/steps can be decomposed, combined or partly combined, so the actual order of execution may be changed according to the actual situation.
下面结合附图,对本申请的一些实施方式作详细说明。在不冲突的情况下,下述的实施例及实施例中的特征可以相互组合。Some implementations of the present application will be described in detail below in conjunction with the accompanying drawings. In the case of no conflict, the following embodiments and features in the embodiments can be combined with each other.
请参阅图1,图1是实施本申请实施例提供的无人机的控制方法的场景示意图。如图1所示,该场景包括无人机100和遥控设备200,遥控设备200与无人机100通信连接,遥控设备200用于控制无人机100,无人机100用于将拍摄到的图像发送给遥控设备200进行显示。Please refer to FIG. 1 . FIG. 1 is a schematic diagram of a scene for implementing a control method for a drone provided by an embodiment of the present application. As shown in Figure 1, the scene includes a drone 100 and a remote control device 200, the remote control device 200 is connected to the drone 100 in communication, the remote control device 200 is used to control the drone 100, and the drone 100 is used to transfer the photographed The image is sent to the remote control device 200 for display.
在一实施例中,无人机100包括机体110、动力系统120、拍摄装置130和控制系统(图1未示出),动力系统120和拍摄装置130设于机体110上,动力系统120用于为无人机100提供飞行动力,拍摄装置130用于拍摄图像,控制系统设于机体110内。其中,拍摄装置130与机体110固定连接或可拆卸连接,即拍摄装置130可以耦合搭载在无人机100的云台上,也可以一体设置在无人机100的机体110上,用于采集图像,拍摄装置130具体可以包括一个摄像头,即单目拍摄方案;也可以包括两个摄像头,即双目拍摄方案。当然,拍摄装置130的数量也可以为一个或以上,在拍摄装置130包括多个时,可以分布在机体110的多个位置,多个拍摄装置130之间可以独立工作,也可以联动工作。In one embodiment, the UAV 100 includes a body 110, a power system 120, a camera 130 and a control system (not shown in FIG. Provide flight power for the UAV 100 , the camera 130 is used to take images, and the control system is set in the body 110 . Wherein, the photographing device 130 is fixedly connected or detachably connected to the body 110, that is, the photographing device 130 can be coupled and mounted on the pan/tilt of the UAV 100, or can be integrated on the body 110 of the UAV 100 for image collection. Specifically, the photographing device 130 may include one camera, that is, a monocular photographing solution, or may include two cameras, that is, a binocular photographing solution. Of course, the number of shooting devices 130 can also be one or more. When there are multiple shooting devices 130, they can be distributed in multiple positions of the body 110, and multiple shooting devices 130 can work independently or in linkage.
其中,动力系统120可以包括一个或多个螺旋桨121、与一个或多个螺旋桨相对应的一个或多个电机122、一个或多个电子调速器(简称为电调)。电机122连接在电子调速器与螺旋桨121之间,电机122和螺旋桨121设置在无人机100的机体110上;电子调速器用于接收控制装置产生的驱动信号,并根据驱动信号提供驱动电流给电机122,以控制电机122的转速。Wherein, the power system 120 may include one or more propellers 121 , one or more motors 122 corresponding to the one or more propellers, and one or more electronic governors (referred to as ESCs for short). The motor 122 is connected between the electronic governor and the propeller 121, and the motor 122 and the propeller 121 are arranged on the body 110 of the UAV 100; the electronic governor is used to receive the driving signal generated by the control device, and provide a driving current according to the driving signal to the motor 122 to control the speed of the motor 122.
电机122用于驱动螺旋桨121旋转,从而为无人机100的飞行提供动力,该动力使得无人机100能够实现一个或多个自由度的运动。在某些实施例中,无人机100可以围绕一个或多个旋转轴旋转。例如,上述旋转轴可以包括横滚 轴、偏航轴和俯仰轴。应理解,电机122可以是直流电机,也可以交流电机。另外,电机122可以是无刷电机,也可以是有刷电机。The motor 122 is used to drive the propeller 121 to rotate, so as to provide power for the flight of the UAV 100 , and the power enables the UAV 100 to realize movement of one or more degrees of freedom. In some embodiments, drone 100 may rotate about one or more axes of rotation. For example, the aforementioned rotation axes may include a roll axis, a yaw axis, and a pitch axis. It should be understood that the motor 122 may be a DC motor or an AC motor. In addition, the motor 122 may be a brushless motor or a brushed motor.
其中,控制系统可以包括控制器和传感系统。传感系统可以用于测量可移动平台的位姿信息和运动信息,例如,三维位置、三维角度、三维速度、三维加速度和三维角速度等其中,位姿信息即无人机100在空间的位置信息和姿态信息。传感系统例如可以包括陀螺仪、超声波传感器、电子罗盘、惯性测量单元(Inertial Measurement Unit,IMU)、视觉传感器、全球导航卫星系统和气压计等传感器中的至少一种。例如,全球导航卫星系统可以是全球定位系统(Global Positioning System,GPS)。控制器用于控制无人机100的飞行,例如,可以根据传感系统测量的位姿信息和/或位姿信息控制无人机100的飞行。应理解,控制器可以按照预先编好的程序指令自动对无人机100进行控制。Wherein, the control system may include a controller and a sensing system. The sensing system can be used to measure the pose information and motion information of the movable platform, such as three-dimensional position, three-dimensional angle, three-dimensional velocity, three-dimensional acceleration and three-dimensional angular velocity, etc. Among them, the pose information is the position information of the UAV 100 in space and attitude information. The sensing system may include, for example, at least one of sensors such as a gyroscope, an ultrasonic sensor, an electronic compass, an inertial measurement unit (Inertial Measurement Unit, IMU), a visual sensor, a global navigation satellite system, and a barometer. For example, the global navigation satellite system may be the Global Positioning System (GPS). The controller is used to control the flight of the UAV 100, for example, the flight of the UAV 100 can be controlled according to the pose information and/or the pose information measured by the sensor system. It should be understood that the controller can automatically control the UAV 100 according to pre-programmed instructions.
在一实施例中,遥控设备200与显示装置210通信连接,显示装置210用于显示无人机100发送的拍摄装置130采集到的图像。需要说明的是,显示装置210包括设置在遥控设备200上的显示屏或者独立于遥控设备200的显示器,独立于遥控设备200的显示器可以包括手机、平板电脑或者个人电脑等,或者也可以是带有显示屏的其他电子设备。其中,该显示屏包括LED显示屏、OLED显示屏、LCD显示屏等等。In one embodiment, the remote control device 200 is in communication connection with the display device 210 , and the display device 210 is used to display the image collected by the camera device 130 sent by the UAV 100 . It should be noted that the display device 210 includes a display screen arranged on the remote control device 200 or a display independent of the remote control device 200. The display independent of the remote control device 200 may include a mobile phone, a tablet computer or a personal computer, etc., or may also be a Other electronic devices with display screens. Wherein, the display screen includes an LED display screen, an OLED display screen, an LCD display screen and the like.
在一实施例中,通过显示装置210显示拍摄装置130采集到的图像,用户在显示的图像中框选第一目标对象,遥控设备200获取第一目标对象在图像中的位置信息,并将第一目标对象在图像中的位置信息发送给无人机100,无人机100按照第一目标对象在图像中的位置信息,控制拍摄装置130进行入镜拍摄、特写拍摄、自动运镜和/或延时拍摄。或者,通过第一目标对象自身携带的包含GPS定位装置的设备,将GPS定位装置采集到的第一目标对象的位置信息发送给无人机100,由无人机按照该位置信息,控制拍摄装置130进行入镜拍摄、特写拍摄、自动运镜和/或延时拍摄。In an embodiment, the display device 210 displays the image collected by the shooting device 130, and the user selects a first target object in the displayed image, and the remote control device 200 obtains the position information of the first target object in the image, and The position information of a target object in the image is sent to the UAV 100, and the UAV 100 controls the shooting device 130 to perform in-camera shooting, close-up shooting, automatic mirror movement and/or according to the position information of the first target object in the image. Timelapse. Or, through the equipment that includes the GPS positioning device carried by the first target object itself, the position information of the first target object collected by the GPS positioning device is sent to the UAV 100, and the UAV controls the shooting device according to the position information 130 for in-frame shooting, close-up shooting, automatic mirror movement and/or time-lapse shooting.
入镜拍摄:无人机100根据第一目标对象的位置信息跟随第一目标对象,控制拍摄装置130朝向第一目标对象进行拍摄。进一步地,如图2所示,可以调整无人机100的位置,以使得无人机100相对于第一目标对象处于侧前方位置20,并控制拍摄装置130朝向第一目标对象进行拍摄,使得拍摄的视频能够呈现第一目标对象入镜的效果。In-camera shooting: the UAV 100 follows the first target object according to the position information of the first target object, and controls the photographing device 130 to shoot toward the first target object. Further, as shown in FIG. 2 , the position of the drone 100 can be adjusted so that the drone 100 is at a side front position 20 relative to the first target object, and the shooting device 130 is controlled to shoot toward the first target object, so that The captured video can present the effect of the first target object entering the mirror.
特写拍摄:入镜拍摄结束后,无人机100保持相对于第一目标对象的侧前方相对方位对第一目标对象进行跟踪。在入镜拍摄的过程中,或者在入镜拍摄 后的跟踪过程中,可以加入一些特写镜头。例如,无人机100增大拍摄装置130的焦距并调整拍摄装置的姿态,以使得拍摄装置130朝向第一目标对象的头肩区域进行拍摄,以近距离拍摄第一目标对象,使得拍摄的视频能够体现第一目标对象的脸部表情与局部细节。如图3所示,未增大拍摄装置130的焦距前,拍摄装置130采集到的图像31可以包括第一目标对象10的全身,当增大拍摄装置130的焦距后,拍摄装置采集到的图像32仅包括第一目标对象10的头肩区域。Close-up shooting: after the in-camera shooting is finished, the UAV 100 keeps track of the first target object in a side-to-front relative orientation relative to the first target object. Include some close-ups during the in-shot, or during tracking after the in-shot. For example, the UAV 100 increases the focal length of the shooting device 130 and adjusts the posture of the shooting device so that the shooting device 130 shoots towards the head and shoulders area of the first target object to shoot the first target object at a close distance, so that the captured video can Embodies facial expressions and local details of the first target object. As shown in FIG. 3, before the focal length of the photographing device 130 is increased, the image 31 collected by the photographing device 130 may include the whole body of the first target object 10. After increasing the focal length of the photographing device 130, the image 31 collected by the photographing device 32 includes only the head and shoulders region of the first target object 10 .
自动运镜:在无人机100对第一目标对象进行跟踪,控制拍摄装置130朝向第一目标对象进行拍摄的过程中,若在拍摄装置130朝向第一目标对象进行拍摄的图像中识别出预设类别的第二目标对象,或者检测到预设类别的第二目标对象相对于无人机100或第一目标对象的位置满足预设条件,则控制拍摄装置130由朝向第一目标对象进行拍摄转换到朝向第二目标对象进行拍摄,控制无人机100环绕第一目标对象,并控制拍摄装置130对第一目标对象和第二目标对象进行拍摄。Automatic mirror movement: during the process of the UAV 100 tracking the first target object and controlling the photographing device 130 to shoot towards the first target object, if a predetermined Assuming that the second target object of the category, or detecting that the position of the second target object of the preset category relative to the UAV 100 or the first target object satisfies the preset condition, then the shooting device 130 is controlled to shoot towards the first target object Switch to shooting toward the second target object, control the UAV 100 to surround the first target object, and control the shooting device 130 to shoot the first target object and the second target object.
如图4所示,在拍摄装置朝向第一目标对象10进行拍摄的图像中识别到预设类别的第二目标对象40,无人机处于位置点21,则无人机由位置点21逐渐向位置点22移动,以使无人机逐渐远离第一目标对象10,在此过程中,使得拍摄装置130的朝向由朝向第一目标对象10转换为朝向第二目标对象40,以实现自动运镜,之后无人机再以位置点22为起点对第一目标对象10进行环绕45°飞行,使得无人机位于位置点23,在环绕第一目标对象10的过程中,拍摄装置130采集到的图像包括第一目标对象10和第二目标对象40,这样可以体现第一目标对象10在不同视角的第二目标对象40的变化。As shown in FIG. 4 , the second target object 40 of the preset category is recognized in the image taken by the shooting device towards the first target object 10, and the drone is at the position point 21, then the drone gradually moves from the position point 21 to The location point 22 is moved so that the UAV is gradually moving away from the first target object 10. In the process, the orientation of the photographing device 130 is changed from facing the first target object 10 to facing the second target object 40, so as to realize automatic mirror movement , and then the UAV takes the position point 22 as the starting point to fly around the first target object 10 at 45°, so that the UAV is located at the position point 23. The image includes the first target object 10 and the second target object 40 , which can reflect the changes of the second target object 40 at different viewing angles of the first target object 10 .
延时拍摄:在无人机环绕第一目标对象预设环绕角度之后,控制无人机保持环绕结束时与第一目标对象的相对方位跟随第一目标对象;在无人机跟随第一目标对象的过程中,控制拍摄装置对第一目标对象进行延时拍摄。如图5所示,无人机以位置点23为起点开始对第一目标对象10进行跟随,并控制拍摄装置对第一目标对象10进行延时拍摄,在无人机处于位置点24时停止延时拍摄,从而记录了夕阳到傍晚这一段时间的景物,且在延时拍摄的末尾时间段,第一目标对象10在延时拍摄的图像中的图像区域由画面中心移动到画面边缘,呈现拍摄结束的效果。Time-lapse shooting: After the UAV surrounds the first target object with a preset orbit angle, control the UAV to keep the relative orientation to the first target object at the end of the orbit and follow the first target object; after the UAV follows the first target object During the process, the shooting device is controlled to take time-lapse shooting of the first target object. As shown in Figure 5, the UAV starts to follow the first target object 10 starting from the position point 23, and controls the shooting device to take time-lapse photography of the first target object 10, and stops when the UAV is at the position point 24 Time-lapse shooting, thereby recording the scene from sunset to evening, and at the end of the time-lapse shooting, the image area of the first target object 10 in the time-lapse shooting image moves from the center of the screen to the edge of the screen, presenting The effect of the end of shooting.
需要说明的是,无人机100可以使用入镜拍摄、特写拍摄、自动运镜和延时拍摄中的至少一种拍摄方式进行拍摄,无人机在使用多种拍摄方式进行拍摄 时,无人机可以按照用户设定的顺序使用不同的拍摄方式进行拍摄。例如,单独使用入镜拍摄、特写拍摄、自动运镜或延时拍摄,又例如,无人机先进行入镜拍摄,再进行自动运镜,或者先进行入镜拍摄,再进行自动运镜,然后进行延时拍摄。It should be noted that the UAV 100 can use at least one of the shooting methods of entering the camera, close-up shooting, automatic mirror movement and time-lapse shooting. The machine can use different shooting methods to shoot according to the sequence set by the user. For example, use the camera-in shooting, close-up shooting, automatic mirror movement or time-lapse shooting alone, or for example, the drone first performs the camera-in shooting and then automatically moves the mirror, or first performs the camera-in shooting and then automatically moves the mirror, Then take a time-lapse shot.
通过入镜拍摄、特写拍摄、自动运镜和/或延时拍摄,可以得到入镜拍摄对应的第一视频片段、特写拍摄对应的第二视频片段、自动运镜对应的第三视频片段和/或延时拍摄对应的第四视频片段,无人机100可以对第一视频片段、第二视频片段、第三视频片段和/或第四视频片段进行编辑与剪辑,得到一种或多种呈现效果的视频,再将编辑得到的视频发送给遥控设备200。或者,无人机100也可以将第一视频片段、第二视频片段、第三视频片段和/或第四视频片段发送给遥控设备200,由遥控设备200对第一视频片段、第二视频片段、第三视频片段和/或第四视频片段进行编辑与剪辑,得到一种或多种呈现效果的视频。By taking into-camera shooting, close-up shooting, automatic mirror movement and/or time-lapse shooting, the first video segment corresponding to in-camera shooting, the second video segment corresponding to close-up shooting, the third video segment corresponding to automatic mirror movement, and/or can be obtained Or time-lapse shooting of the corresponding fourth video clip, the UAV 100 can edit and edit the first video clip, the second video clip, the third video clip and/or the fourth video clip to obtain one or more presentations effect, and then send the edited video to the remote control device 200. Or, the UAV 100 can also send the first video clip, the second video clip, the third video clip and/or the fourth video clip to the remote control device 200, and the first video clip, the second video clip by the remote control device 200 , the third video segment and/or the fourth video segment are edited and edited to obtain one or more videos with presentation effects.
示例性的,遥控设备200通过显示装置210显示视频编辑页面,该视频编辑页面包括多个视频编辑模板;获取用户在该视频编辑页面中选择的视频编辑模板,并将选择的视频编辑模板作为目标视频编辑模板发送给无人机100;无人机100基于目标视频编辑模板,从第一视频片段、第二视频片段、第三视频片段和第四视频片段中选择一个或多个视频片段;根据目标视频编辑模板,对一个或多个视频片段进行编辑与剪辑,得到一种或多种呈现效果的视频,并将编辑得到的视频发送给遥控设备200。Exemplarily, the remote control device 200 displays a video editing page through the display device 210, and the video editing page includes a plurality of video editing templates; acquires the video editing template selected by the user on the video editing page, and uses the selected video editing template as the target The video editing template is sent to the drone 100; the drone 100 selects one or more video clips from the first video clip, the second video clip, the third video clip and the fourth video clip based on the target video editing template; according to The target video editing template edits and clips one or more video clips to obtain one or more video presentation effects, and sends the edited video to the remote control device 200 .
示例性的,遥控设备200通过显示装置210显示视频编辑页面,该视频编辑页面包括多个视频编辑模板;获取用户在该视频编辑页面中选择的视频编辑模板,并将选择的视频编辑模板作为目标视频编辑模板;基于目标视频编辑模板,从存储的第一视频片段、第二视频片段、第三视频片段和第四视频片段中选择一个或多个视频片段;根据目标视频编辑模板,对一个或多个视频片段进行编辑与剪辑,得到一种或多种呈现效果的视频。Exemplarily, the remote control device 200 displays a video editing page through the display device 210, and the video editing page includes a plurality of video editing templates; acquires the video editing template selected by the user on the video editing page, and uses the selected video editing template as the target Video editing template; based on the target video editing template, select one or more video clips from the stored first video clip, the second video clip, the third video clip and the fourth video clip; according to the target video editing template, one or Multiple video clips are edited and clipped to obtain a video with one or more presentation effects.
无人机100可例如为四旋翼无人机、六旋翼无人机、八旋翼无人机。当然,也可以是固定翼无人机,还可以是旋翼型与固定翼无人机的组合,在此不作限定。遥控设备200可以包括但不限于:智能电话/手机、平板电脑、带屏遥控器、可穿戴式装置。该遥控设备200可以是手持终端,遥控设备200可以是便携式的。该遥控设备200可以由人类用户携带。在一些情况下,遥控设备200可以远离人类用户,并且用户可以使用无线和/或有线通信来控制无人机100。The UAV 100 can be, for example, a quadrotor UAV, a hexacopter UAV, or an octorotor UAV. Of course, it can also be a fixed-wing UAV, or a combination of a rotary-wing UAV and a fixed-wing UAV, which is not limited here. The remote control device 200 may include, but is not limited to: smart phone/mobile phone, tablet computer, remote control with screen, and wearable device. The remote control device 200 may be a handheld terminal, and the remote control device 200 may be portable. The remote control device 200 may be carried by a human user. In some cases, remote control device 200 may be remote from a human user, and the user may control drone 100 using wireless and/or wired communications.
以下,将结合图1-5中的场景对本申请的实施例提供的无人机的控制方法 进行详细介绍。需知,图1-5中的场景仅用于解释本申请实施例提供的无人机的控制方法,但并不构成对本申请实施例提供的无人机的控制方法应用场景的限定。Hereinafter, the method for controlling the drone provided by the embodiments of the present application will be described in detail in conjunction with the scenarios in Figures 1-5. It should be noted that the scenarios in Figures 1-5 are only used to explain the control method of the drone provided in the embodiment of the present application, but do not constitute a limitation on the application scenarios of the control method of the drone provided in the embodiment of the present application.
请参阅图6,图6是本申请实施例提供的一种无人机的控制方法的步骤示意流程图。Please refer to FIG. 6 . FIG. 6 is a schematic flowchart of steps of a method for controlling a drone provided in an embodiment of the present application.
如图6所示,该无人机的控制方法包括步骤S101至步骤S102。As shown in FIG. 6 , the method for controlling the drone includes steps S101 to S102.
步骤S101、控制无人机跟随第一目标对象,并控制拍摄装置朝向第一目标对象进行拍摄。Step S101 , controlling the drone to follow the first target object, and controlling the photographing device to shoot toward the first target object.
示例性的,遥控设备显示无人机的拍摄装置采集到的实时图像,并将用户在该实时图像中选择的对象确定为第一目标对象;获取第一目标对象在该实时图像中的位置信息,并将该位置信息发送给无人机;无人机根据第一目标对象在该实时图像中的位置信息,控制无人机跟随第一目标对象,并控制拍摄装置的姿态,以使得拍摄装置朝向第一目标对象进行拍摄。Exemplarily, the remote control device displays the real-time image collected by the shooting device of the drone, and determines the object selected by the user in the real-time image as the first target object; obtains the position information of the first target object in the real-time image , and send the location information to the UAV; the UAV controls the UAV to follow the first target object according to the location information of the first target object in the real-time image, and controls the attitude of the shooting device, so that the shooting device Shoot towards the first target object.
示例性的,控制拍摄装置朝向第一目标对象进行拍摄可以包括:控制拍摄装置朝向第一目标对象,以使第一目标对象位于拍摄装置采集到的图像的预设位置。其中,该预设位置可以包括拍摄装置采集到的图像的中心位置,也可以包括基于预设构图法在拍摄装置采集到的图像中确定的位置,预设构图法包括但不限于水平线构图、三分法构图、中心构图、对称构图、对角线构图、引导线构图、框架式构图、九宫格构图、十字形构图、三角形构图。Exemplarily, controlling the photographing device to shoot toward the first target object may include: controlling the photographing device to face toward the first target object, so that the first target object is located at a preset position of the image captured by the photographing device. Wherein, the preset position may include the center position of the image captured by the shooting device, and may also include a position determined in the image captured by the shooting device based on a preset composition method. The preset composition method includes but is not limited to horizontal line composition, three Divisional composition, central composition, symmetrical composition, diagonal composition, leading line composition, frame composition, nine-square composition, cross-shaped composition, and triangle composition.
在一实施例中,在控制无人机跟随第一目标对象,并控制拍摄装置朝向第一目标对象进行拍摄之前,调整无人机的位置,以使得无人机相对于第一目标对象处于预设相对方位;在无人机相对于第一目标对象处于预设相对方位时,控制无人机跟随第一目标对象,并控制拍摄装置朝向第一目标对象进行拍摄。其中,无人机跟随第一目标对象时保持预设相对方位,预设相对方位包括:无人机处于第一目标对象的侧前方,并且无人机与第一目标对象具有预设角度和预设距离,预设角度和预设距离可基于实际情况进行设置,本实施例对此不做具体限定。In one embodiment, before controlling the UAV to follow the first target object and controlling the photographing device to shoot towards the first target object, the position of the UAV is adjusted so that the UAV is in a predetermined position relative to the first target object. Set a relative orientation; when the drone is at a preset relative orientation relative to the first target object, control the drone to follow the first target object, and control the photographing device to shoot towards the first target object. Wherein, when the UAV follows the first target object, it maintains a preset relative orientation. The preset relative orientation includes: the UAV is in front of the first target object, and the UAV and the first target object have a preset angle and a preset angle. The preset distance, the preset angle and the preset distance can be set based on actual conditions, which are not specifically limited in this embodiment.
示例性的,调整无人机的位置的方式可以为:获取无人机与第一目标对象之间的相对位置关系;根据无人机与第一目标对象之间的相对位置关系,调整无人机的位置,以使得无人机相对于第一目标对象处于预设相对方位。Exemplarily, the manner of adjusting the position of the drone may be: acquiring the relative positional relationship between the drone and the first target object; adjusting the position of the drone according to the relative positional relationship between the drone and the first target object The location of the drone, so that the drone is in a preset relative orientation relative to the first target object.
在一实施例中,在控制拍摄装置朝向第一目标对象进行拍摄的过程中,增大所述拍摄装置的焦距并调整所述拍摄装置的姿态,以使得所述拍摄装置由朝 向所述第一目标对象进行拍摄转换到朝向第一目标对象的目标区域进行拍摄。例如,拍摄装置包括变焦镜头,增大变焦镜头的焦距,以使得变焦镜头朝向第一目标对象的目标区域进行拍摄。In an embodiment, during the process of controlling the photographing device to shoot towards the first target object, the focal length of the photographing device is increased and the posture of the photographing device is adjusted so that the photographing device is directed towards the first target object. The shooting of the target object switches to the shooting towards the target area of the first target object. For example, the photographing device includes a zoom lens, and the focal length of the zoom lens is increased, so that the zoom lens shoots toward the target area of the first target object.
其中,第一目标对象为人,目标区域包括人的头肩区域,通过对人的头肩区域进行拍摄,使得拍摄装置能够更好地捕捉人的面部表情,进而突显出拍摄到的视频中的人的面部表情与局部细节;或者,第一目标对象为车,目标区域包括车中的驾驶员区域,通过对车中的驾驶员区域进行拍摄,使得拍摄装置能够更好地捕捉驾驶员的面部表情,进而突显出拍摄到的视频中的驾驶员的面部表情与局部细节。Wherein, the first target object is a person, and the target area includes the head and shoulder area of the person. By shooting the head and shoulder area of the person, the shooting device can better capture the facial expression of the person, and then highlight the person in the captured video. or, the first target object is a car, and the target area includes the driver's area in the car, and by shooting the driver's area in the car, the camera can better capture the driver's facial expression , and then highlight the facial expressions and local details of the driver in the captured video.
在一实施例中,拍摄装置包括第一镜头和第二镜头,获取第一目标对象在第一镜头采集到的图像中的位置信息;根据第一目标对象在第一镜头采集到的图像中的位置信息,控制无人机跟随第一目标对象,并控制第二镜头对第一目标对象进行拍摄。其中,第一镜头可以包括广角镜头或变焦镜头,第二镜头可以包括变焦镜头。In one embodiment, the photographing device includes a first lens and a second lens, and acquires position information of the first target object in the image captured by the first lens; according to the position information of the first target object in the image captured by the first lens The location information controls the UAV to follow the first target object, and controls the second lens to shoot the first target object. Wherein, the first lens may include a wide-angle lens or a zoom lens, and the second lens may include a zoom lens.
在一实施例中,在跟随与拍摄第一目标对象的过程中,获取无人机跟随第一目标对象的飞行距离和/或飞行时长,在该飞行距离大于或等于第一距离阈值和/或该飞行时长大于或等于预设时长阈值时,增大拍摄装置的焦距并调整所述拍摄装置的姿态,以使得所述拍摄装置由朝向所述第一目标对象进行拍摄转换到朝向第一目标对象的目标区域进行拍摄,或者,控制拍摄装置进行变焦,以改变第一目标对象在拍摄装置采集到的图像中的尺寸。In one embodiment, during the process of following and photographing the first target object, the flight distance and/or flight duration of the UAV following the first target object are acquired, and when the flight distance is greater than or equal to the first distance threshold and/or When the flight duration is greater than or equal to the preset duration threshold, increase the focal length of the photographing device and adjust the posture of the photographing device, so that the photographing device switches from shooting toward the first target object to toward the first target object The target area is photographed, or the photographing device is controlled to zoom, so as to change the size of the first target object in the image captured by the photographing device.
步骤S102、若在拍摄装置朝向第一目标对象进行拍摄的图像中识别出预设类别的第二目标对象,或者检测到预设类别的第二目标对象相对于无人机或第一目标对象的位置满足预设条件,则控制拍摄装置由朝向第一目标对象进行拍摄转换到朝向第二目标对象进行拍摄。Step S102, if the second target object of the preset category is identified in the image captured by the shooting device towards the first target object, or the distance between the second target object of the preset category relative to the drone or the first target object is detected When the position satisfies the preset condition, the shooting device is controlled to switch from shooting toward the first target object to shooting toward the second target object.
示例性的,控制拍摄装置朝向第二目标对象进行拍摄可以包括:控制拍摄装置朝向第二目标对象,以使第二目标对象位于拍摄装置采集到的图像的预设位置。其中,该预设位置可以包括拍摄装置采集到的图像的中心位置,也可以包括基于预设构图法在拍摄装置采集到的图像中确定的位置,预设构图法包括但不限于水平线构图、三分法构图、中心构图、对称构图、对角线构图、引导线构图、框架式构图、九宫格构图、十字形构图、三角形构图。Exemplarily, controlling the shooting device to shoot toward the second target object may include: controlling the shooting device to move toward the second target object, so that the second target object is located at a preset position of the image captured by the shooting device. Wherein, the preset position may include the center position of the image captured by the shooting device, and may also include a position determined in the image captured by the shooting device based on a preset composition method. The preset composition method includes but is not limited to horizontal line composition, three Divisional composition, central composition, symmetrical composition, diagonal composition, leading line composition, frame composition, nine-square composition, cross-shaped composition, and triangle composition.
在一实施例中,在跟随与拍摄第一目标对象的过程中,对拍摄装置朝向第一目标对象进行拍摄的图像进行目标识别;若在拍摄装置朝向第一目标对象进 行拍摄的图像中识别出预设类别的第二目标对象,则控制拍摄装置由朝向第一目标对象进行拍摄转换到朝向第二目标对象进行拍摄。其中,第一目标对象不同于第二目标对象,例如,第一目标对象为人,第二目标对象为标志性建筑,预设类别可以基于实际情况进行设置,本实施例对此不做具体限定。例如,预设类别包括山、湖泊、大海、树木、标志性建筑等。需要说明的是,在拍摄装置朝向第一目标对象进行拍摄的图像中识别出预设类别的第二目标对象,可以是识别出完整的第二目标对象,也可以是部分的第二目标对象。以第二目标对象为标志性建筑为例,可以基于该标志性建筑局部的特征对该标志性建筑进行检测。In one embodiment, during the process of following and photographing the first target object, target recognition is performed on the image captured by the photographing device toward the first target object; For the second target object of the preset category, the shooting device is controlled to switch from shooting towards the first target object to shooting towards the second target object. Wherein, the first target object is different from the second target object. For example, the first target object is a person, and the second target object is a landmark building. The preset category can be set based on the actual situation, which is not specifically limited in this embodiment. For example, preset categories include mountains, lakes, seas, trees, landmarks, and more. It should be noted that identifying a second target object of a preset category in the image captured by the photographing device toward the first target object may be a complete second target object or a part of the second target object. Taking the second target object as a landmark building as an example, the landmark building may be detected based on local features of the landmark building.
在一实施例中,在跟随与拍摄第一目标对象的过程中,若检测到预设类别的第二目标对象相对于无人机或第一目标对象的位置满足预设条件,则控制拍摄装置由朝向第一目标对象进行拍摄转换到朝向第二目标对象进行拍摄。示例的,无人机中存储有预设类别的第二目标对象的位置信息,无人机在跟踪第一目标对象的过程中会实时对第一目标对象的位置信息进行计算,若检测到预设类别的第二目标对象相对于无人机或第一目标对象的位置满足预设条件,则控制拍摄装置朝向第二目标对象进行拍摄。另一示例中,无人机会将其实时位置信息和/或第一目标对象的位置信息发送给遥控设备,遥控设备中存储有预设类别的第二目标对象的位置信息,若遥控设备检测到预设类别的第二目标对象相对于无人机或第一目标对象的位置满足预设条件,则遥控设备向无人机发送相应的控制指令,以控制拍摄装置朝向第二目标对象进行拍摄。In one embodiment, during the process of following and photographing the first target object, if it is detected that the position of the second target object of the preset category relative to the drone or the first target object satisfies the preset condition, the shooting device is controlled Switching from shooting toward the first target object to shooting toward the second target object. For example, the UAV stores the position information of the second target object of the preset category, and the UAV will calculate the position information of the first target object in real time during the process of tracking the first target object. Assuming that the position of the second target object of the category relative to the drone or the first target object satisfies a preset condition, the photographing device is controlled to shoot towards the second target object. In another example, the UAV will send its real-time position information and/or the position information of the first target object to the remote control device, and the position information of the second target object of the preset category is stored in the remote control device, if the remote control device detects When the position of the second target object of the preset category relative to the drone or the first target object satisfies the preset condition, the remote control device sends a corresponding control instruction to the drone to control the shooting device to shoot toward the second target object.
在一实施例中,在跟随与拍摄第一目标对象的过程中,对拍摄装置朝向第一目标对象进行拍摄的图像进行目标识别;若在拍摄装置朝向第一目标对象进行拍摄的图像中识别出预设类别的第二目标对象,则检测预设类别的第二目标对象相对于无人机或第一目标对象的位置是否满足预设条件,若检测到预设类别的第二目标对象相对于无人机或第一目标对象的位置满足预设条件,则控制拍摄装置由朝向第一目标对象进行拍摄转换到朝向第二目标对象进行拍摄。In one embodiment, during the process of following and photographing the first target object, target recognition is performed on the image captured by the photographing device toward the first target object; The second target object of the preset category, then detect whether the position of the second target object of the preset category relative to the drone or the first target object meets the preset condition, if the second target object of the preset category is detected relative to When the position of the UAV or the first target object satisfies the preset condition, the shooting device is controlled to switch from shooting toward the first target object to shooting toward the second target object.
其中,预设条件可以实际情况进行设置,本实施例对此不做具体限定。例如,预设条件包括预设类别的第二目标对象相对于无人机或第一目标对象的距离小于或等于第二距离阈值、第一目标对象位于第二目标对象的中心区域、第二目标对象位于第一目标对象背后。Wherein, the preset condition may be set in actual conditions, which is not specifically limited in this embodiment. For example, the preset conditions include that the distance between the second target object of the preset category and the drone or the first target object is less than or equal to the second distance threshold, the first target object is located in the central area of the second target object, the second target object The object is located behind the first target object.
示例性的,拍摄装置包括广角镜头,在跟随与拍摄第一目标对象的过程中,通过广角镜头可以拍摄到更大范围的图像,因此对广角镜头朝向第一目标对象 进行拍摄的图像进行目标识别,便于识别出预设类别的第二目标对象。Exemplarily, the shooting device includes a wide-angle lens. During the process of following and shooting the first target object, a wider range of images can be captured through the wide-angle lens. Therefore, target recognition is performed on images captured by the wide-angle lens toward the first target object, which facilitates identification. out of the preset category of the second target audience.
在一实施例中,若在拍摄装置朝向第一目标对象进行拍摄的图像中识别出预设类别的第二目标对象,或者检测到预设类别的第二目标对象相对于无人机或第一目标对象的位置满足预设条件,则获取无人机跟随第一目标对象的飞行距离、飞行时长或拍摄装置采集到的图像中的第一目标对象的手势动作;在该飞行距离达到预设距离、该飞行时长达到预设时长或该手势动作为预设手势动作时,控制拍摄装置由朝向第一目标对象进行拍摄转换到朝向第二目标对象进行拍摄。通过在识别到第二目标对象或第二目标对象相对于无人机或第一目标对象的位置满足预设条件后,进一步地判断是否满足拍摄主体切换的条件,在满足拍摄主体切换的条件后,控制拍摄装置朝向第二目标对象进行拍摄,使得拍摄到的视频能够呈现拍摄主体由第一目标对象逐渐过渡到第二目标对象的效果。In an embodiment, if a second target object of a preset category is identified in the image captured by the shooting device towards the first target object, or it is detected that the second target object of the preset category is relatively If the position of the target object satisfies the preset condition, then the flight distance, flight duration, or gesture of the first target object in the image collected by the drone to follow the first target object is obtained; the flight distance reaches the preset distance . When the flight duration reaches a preset duration or the gesture action is a preset gesture action, control the shooting device to switch from shooting toward the first target object to shooting toward the second target object. After recognizing that the second target object or the position of the second target object relative to the drone or the first target object satisfies the preset condition, it is further judged whether the condition for switching the subject is met, and after the condition for switching the subject is met, Control the shooting device to shoot towards the second target object, so that the captured video can present the effect that the shooting subject gradually transitions from the first target object to the second target object.
在一实施例中,无人机上安装有多个广角镜头和一个主镜头,广角镜头例如是鱼眼镜头,主镜头例如是变焦镜头。可选的,多个广角镜头固定设置于无人机,多个广角镜头的朝向不同,主镜头通过云台挂载于无人机,通过调整云台的姿态可以改变主镜头的朝向。在无人机跟随第一目标对象的过程中,控制云台的姿态以使得主镜头朝向第一目标对象进行拍摄,若在多个广角镜头或者主镜头拍摄的图像中识别出预设类别的第二目标对象,则控制云台的姿态以使得主镜头由朝向第一目标对象进行拍摄转换到朝向第二目标对象进行拍摄,第二目标对象不同于第一目标对象。在本实施例中,可以基于视野更广的广角镜头拍摄的图像进行第二目标对象的识别,由画质更高的主镜头执行视频拍摄,可以达到更高效的识别和更高质量的视频拍摄。In one embodiment, multiple wide-angle lenses and one main lens are installed on the drone, the wide-angle lens is, for example, a fisheye lens, and the main lens is, for example, a zoom lens. Optionally, multiple wide-angle lenses are fixedly installed on the drone, and the orientations of the multiple wide-angle lenses are different. The main lens is mounted on the drone through the gimbal, and the orientation of the main lens can be changed by adjusting the attitude of the gimbal. During the process of the UAV following the first target object, the attitude of the gimbal is controlled so that the main lens is directed towards the first target object. For the target object, the attitude of the pan/tilt is controlled so that the main lens is switched from shooting towards the first target object to shooting towards the second target object, and the second target object is different from the first target object. In this embodiment, the recognition of the second target object can be performed based on the image captured by the wide-angle lens with a wider field of view, and the video capture is performed by the main lens with higher image quality, which can achieve more efficient recognition and higher quality video capture.
在一实施例中,如图7所示,步骤S102可以包括:子步骤S1021至S1022。In an embodiment, as shown in FIG. 7 , step S102 may include: substeps S1021 to S1022.
子步骤S1021、控制无人机远离第一目标对象或者减小拍摄装置的焦距。Sub-step S1021, controlling the UAV to stay away from the first target object or reducing the focal length of the photographing device.
通过控制无人机远离第一目标对象或者减小拍摄装置的焦距,可以改变第二目标对象在拍摄装置拍摄的图像中的画幅占比,使得拍摄到的视频能够呈现第二目标对象的不断变化的效果。By controlling the UAV to stay away from the first target object or reducing the focal length of the shooting device, the frame ratio of the second target object in the image captured by the shooting device can be changed, so that the captured video can show the continuous changes of the second target object Effect.
示例性的,根据第二目标对象在拍摄装置拍摄的图像中的画幅占比,确定无人机远离第一目标对象飞行时的飞行距离;控制无人机按照该飞行距离远离第一目标对象。或者,控制无人机按照预设飞行距离远离第一目标对象。Exemplarily, according to the frame ratio of the second target object in the image captured by the shooting device, the flight distance of the UAV flying away from the first target object is determined; the UAV is controlled to stay away from the first target object according to the flight distance. Alternatively, the UAV is controlled to stay away from the first target object according to a preset flying distance.
示例性的,确定第二目标对象在拍摄装置拍摄的图像中的画幅占比与预设画幅占比之间的差值;根据画幅占比与预设比例之间的差值,确定无人机远离 第一目标对象飞行时的飞行距离。Exemplarily, determine the difference between the frame ratio of the second target object in the image captured by the shooting device and the preset frame ratio; according to the difference between the frame ratio and the preset ratio, determine the UAV Flight distance when flying away from the first target object.
示例性的,根据第二目标对象在拍摄装置拍摄的图像中的画幅占比,确定拍摄装置的焦距调整值;按照该焦距调整值,减小拍摄装置的焦距。例如,确定第二目标对象在拍摄装置拍摄的图像中的画幅占比与预设比例之间的差值;根据画幅占比与预设比例之间的差值,确定拍摄装置的焦距调整值。Exemplarily, according to the frame ratio of the second target object in the image captured by the photographing device, determine a focus adjustment value of the photographing device; according to the focal length adjustment value, reduce the focal length of the photographing device. For example, determine the difference between the frame ratio of the second target object in the image captured by the shooting device and the preset ratio; determine the focus adjustment value of the shooting device according to the difference between the frame ratio and the preset ratio.
子步骤S1022、在无人机远离第一目标对象或者拍摄装置的焦距减小的过程中,控制拍摄装置由朝向第一目标对象进行拍摄转换到朝向第二目标对象进行拍摄。Sub-step S1022, when the UAV moves away from the first target object or the focal length of the shooting device decreases, control the shooting device to switch from shooting toward the first target object to shooting toward the second target object.
示例性的,在无人机远离第一目标对象或者拍摄装置的焦距减小的过程中,若检测到第二目标对象完整呈现在拍摄装置拍摄的图像中,则控制拍摄装置由朝向第一目标对象进行拍摄转换到朝向第二目标对象进行拍摄;若检测到第二目标对象仅部分呈现在拍摄装置拍摄的图像中,则控制无人机继续远离第一目标对象或者继续减小拍摄装置的焦距。Exemplarily, when the drone is far away from the first target object or the focal length of the shooting device is reduced, if it is detected that the second target object is completely present in the image captured by the shooting device, the shooting device is controlled to move towards the first target The shooting of the object is switched to shooting towards the second target object; if it is detected that the second target object is only partly presented in the image captured by the shooting device, the drone is controlled to continue to stay away from the first target object or continue to reduce the focal length of the shooting device .
在一实施例中,在控制拍摄装置朝向第二目标对象进行拍摄之后,控制无人机环绕第一目标对象,并控制拍摄装置对第一目标对象和第二目标对象进行拍摄。其中,在拍摄装置对第一目标对象和第二目标对象进行拍摄的图像中,第一目标对象位于该图像的中心位置。通过在控制无人机环绕第一目标对象的过程中,控制拍摄装置对第一目标对象和第二目标对象进行拍摄,使得拍摄装置采集到的图像中的第一目标对象与第二目标对象之间具有位置转换的效果,也可以得到第一目标对象在不同视角的第二目标对象中的视频。In an embodiment, after controlling the photographing device to shoot towards the second target object, the drone is controlled to surround the first target object, and the photographing device is controlled to photograph the first target object and the second target object. Wherein, in the image captured by the photographing device of the first target object and the second target object, the first target object is located at the center of the image. By controlling the shooting device to shoot the first target object and the second target object during the process of controlling the UAV to surround the first target object, the distance between the first target object and the second target object in the image collected by the shooting device There is an effect of position conversion between them, and the video of the first target object in the second target object at different viewing angles can also be obtained.
示例性的,根据第一目标对象和第二目标对象的相对方位确定目标环绕角度和目标环绕方向或者根据第一目标对象和无人机的相对方位确定目标环绕角度和目标环绕方向或者根据无人机和第二目标对象的相对方位确定目标环绕角度和目标环绕方向;控制无人机按照目标环绕角度和目标环绕方向环绕第一目标对象。其中,第一目标对象与第二目标对象在拍摄装置采集到的图像中的相对方位随着无人机环绕第一目标对象飞行而发生变化。Exemplarily, the target circle angle and target circle direction are determined according to the relative orientation of the first target object and the second target object, or the target circle angle and target circle direction are determined according to the relative orientation of the first target object and the UAV, or the target circle angle and target circle direction are determined according to the relative orientation of the unmanned aerial vehicle. The relative orientation of the UAV and the second target object determines the target circling angle and target circling direction; the UAV is controlled to circle the first target object according to the target circling angle and target circling direction. Wherein, the relative orientations of the first target object and the second target object in the images collected by the photographing device change as the drone flies around the first target object.
例如,如图8所示,无人机从位置点21开始沿着轨迹51逐渐远离第一目标对象10,无人机位于位置21时,第二目标对象40仅部分呈现在拍摄装置拍摄的图像,无人机从位置21飞行至位置点22的过程中,第二目标对象40在拍摄装置拍摄的图像中逐渐趋于完整,则控制拍摄装置由朝向第一目标对象10进行拍摄转换到朝向第二目标对象40进行拍摄,然后无人机从位置点22开始沿着轨迹52对第一目标对象10进行环绕45°到达位置点23,即无人机从位置 点22开始沿顺时针方向对第一目标对象10进行环绕45°到达位置点23。For example, as shown in FIG. 8 , the UAV gradually moves away from the first target object 10 along the track 51 from the position point 21. When the UAV is at the position 21, the second target object 40 only partially appears in the image taken by the shooting device. , during the flight of the UAV from position 21 to position point 22, the second target object 40 gradually tends to be complete in the image captured by the shooting device, and then the control shooting device switches from shooting towards the first target object 10 to towards the second target object 10. The second target object 40 is photographed, and then the drone starts from the position point 22 along the trajectory 52 to circle the first target object 10 at 45° to reach the position point 23, that is, the drone starts from the position point 22 and moves clockwise to the first target object 10. A target object 10 travels around 45° to the location point 23 .
在一实施例中,控制无人机按照预设环绕角度或目标环绕角度环绕第一目标对象之后,控制拍摄装置对第一目标对象进行延时拍摄。通过在无人机环绕第一目标对象之后,控制拍摄装置对第一目标对象进行延时拍摄,可以拍摄得到具有延时效果的视频。In one embodiment, after the UAV is controlled to circle the first target object according to a preset circling angle or a target circling angle, the shooting device is controlled to take time-lapse shots of the first target object. By controlling the shooting device to take time-lapse shots of the first target object after the drone surrounds the first target object, a video with a time-lapse effect can be shot.
示例性的,该延时拍摄的时长与无人机的剩余电量和/或无人机所处地区的日落时间有关。通过无人机的剩余电量可以确定延时拍摄的时长,在保证无人机安全的前提下,可以拍摄具有延时效果的视频,通过无人机所处地区的日落时间来确定延时拍摄的时长,使得拍摄到的视频能够呈现日落的变化。Exemplarily, the duration of the time-lapse shooting is related to the remaining power of the drone and/or the sunset time of the area where the drone is located. The duration of the time-lapse shooting can be determined by the remaining power of the drone. On the premise of ensuring the safety of the drone, a video with a time-lapse effect can be shot, and the time of the time-lapse shooting can be determined by the sunset time of the area where the drone is located. The duration allows the captured video to show the changes of the sunset.
在一实施例中,控制无人机按照预设环绕角度或目标环绕角度环绕第一目标对象之后,控制无人机保持环绕结束时与第一目标对象的相对方位跟随第一目标对象;在无人机跟随第一目标对象的过程中,控制拍摄装置对第一目标对象进行延时拍摄。通过控制无人机保持环绕结束时与第一目标对象的相对方位跟随第一目标对象,且控制拍摄装置对第一目标对象进行延时拍摄,可以拍摄得到跟随第一目标对象的具有延时效果的视频。In one embodiment, after the UAV is controlled to surround the first target object according to the preset circling angle or the target circling angle, the UAV is controlled to follow the first target object at the relative orientation with the first target object at the end of the circling; During the process of the man-machine following the first target object, the shooting device is controlled to take a time-lapse shot of the first target object. By controlling the UAV to keep the relative orientation with the first target object at the end of the circle to follow the first target object, and controlling the shooting device to take time-lapse shots of the first target object, the time-lapse effect of following the first target object can be obtained by shooting video.
在一实施例中,在延时拍摄的末尾时间段内,调整拍摄装置的朝向,以使得第一目标对象在延时拍摄的图像中的图像区域由画面中心移动到画面边缘。通过在延时拍摄的末尾时间段内,调整拍摄装置的朝向,使得拍摄到的图像可以呈现第一目标对象由画面中心移动到画面边缘的效果,以表示拍摄结束。In an embodiment, during the end time period of the time-lapse shooting, the orientation of the shooting device is adjusted so that the image area of the first target object in the time-lapse shooting image moves from the center of the frame to the edge of the frame. By adjusting the orientation of the shooting device during the end time period of the time-lapse shooting, the captured image can show the effect that the first target object moves from the center of the frame to the edge of the frame to indicate the end of the shooting.
示例性的,获取延时拍摄的持续时长和预估延时拍摄时长,在持续时长与预估延时拍摄时长之间的差值小于或等于预设差值时,确定延时拍摄进入末尾时间段。其中,预估延时拍摄时长与无人机的剩余电量和/或无人机所处地区的日落时间有关。Exemplarily, the duration of the time-lapse shooting and the estimated time-lapse shooting time are obtained, and when the difference between the duration and the estimated time-lapse shooting time is less than or equal to the preset difference, it is determined that the time-lapse shooting enters the end time part. Wherein, the estimated time-lapse shooting time is related to the remaining power of the drone and/or the sunset time of the area where the drone is located.
示例性的,调整拍摄装置的朝向的方式可以为:根据第一目标对象在延时拍摄的图像中的图像区域与图像的画面边缘之间的距离,确定拍摄装置的姿态变化量;根据姿态变化量,调整拍摄装置的朝向,以使得第一目标对象在延时拍摄的图像中的图像区域由画面中心移动到画面边缘。Exemplarily, the manner of adjusting the orientation of the shooting device may be: according to the distance between the image area of the first target object in the time-lapse captured image and the edge of the image, determining the amount of change in the posture of the shooting device; Adjust the orientation of the shooting device so that the image area of the first target object in the time-lapse captured image moves from the center of the frame to the edge of the frame.
上述实施例提供的无人机的控制方法,通过控制无人机跟随第一目标对象,并控制拍摄装置朝向第一目标对象进行拍摄,若在拍摄装置朝向第一目标对象进行拍摄的图像中识别出预设类别的第二目标对象,或者检测到预设类别的第二目标对象相对于无人机或第一目标对象的位置满足预设条件,则控制拍摄装置由朝向第一目标对象进行拍摄转换到朝向第二目标对象进行拍摄,以实现自 动运镜,使得拍摄到的视频能够呈现拍摄主体由第一目标对象逐渐过渡到第二目标对象的效果,整个拍摄过程不需要用户手动控制无人机和拍摄装置,极大地提高了视频拍摄的简便性。The method for controlling the UAV provided by the above-mentioned embodiment is to control the UAV to follow the first target object and control the shooting device to shoot toward the first target object. If the second target object of the preset category is detected, or the position of the second target object of the preset category relative to the UAV or the first target object is detected to meet the preset condition, then the shooting device is controlled to shoot towards the first target object Switch to shooting towards the second target object to realize automatic mirror movement, so that the captured video can show the effect of the subject gradually transitioning from the first target object to the second target object. The entire shooting process does not require the user to manually control the unmanned camera and shooting device, which greatly improves the convenience of video shooting.
请参阅图9,图9是本申请实施例提供的另一种无人机的控制方法的步骤示意流程图。Please refer to FIG. 9 . FIG. 9 is a schematic flowchart of steps of another method for controlling a drone provided in an embodiment of the present application.
如图9所示,该无人机的控制方法包括步骤S201至S202。As shown in FIG. 9 , the control method of the drone includes steps S201 to S202.
步骤S201、控制无人机跟随目标对象,并控制拍摄装置朝向目标对象进行拍摄。Step S201, controlling the drone to follow the target object, and controlling the photographing device to shoot towards the target object.
示例性的,遥控设备显示无人机的拍摄装置采集到的实时图像,并将用户在该实时图像中选择的对象确定为目标对象;获取目标对象在该实时图像中的位置信息,并将该位置信息发送给无人机;无人机根据目标对象在该实时图像中的位置信息,控制无人机跟随目标对象,并控制拍摄装置朝向目标对象进行拍摄。Exemplarily, the remote control device displays the real-time image collected by the shooting device of the drone, and determines the object selected by the user in the real-time image as the target object; obtains the position information of the target object in the real-time image, and The location information is sent to the UAV; the UAV controls the UAV to follow the target object according to the location information of the target object in the real-time image, and controls the shooting device to shoot towards the target object.
示例性的,控制拍摄装置朝向目标对象进行拍摄可以包括:控制拍摄装置朝向目标对象,以使目标对象位于拍摄装置采集到的图像的预设位置。其中,该预设位置可以包括拍摄装置采集到的图像的中心位置,也可以包括基于预设构图法在拍摄装置采集到的图像中确定的位置,预设构图法包括但不限于水平线构图、三分法构图、中心构图、对称构图、对角线构图、引导线构图、框架式构图、九宫格构图、十字形构图、三角形构图。Exemplarily, controlling the photographing device to shoot toward the target object may include: controlling the photographing device to face the target object, so that the target object is located at a preset position of the image captured by the photographing device. Wherein, the preset position may include the center position of the image captured by the shooting device, and may also include a position determined in the image captured by the shooting device based on a preset composition method. The preset composition method includes but is not limited to horizontal line composition, three Divisional composition, central composition, symmetrical composition, diagonal composition, leading line composition, frame composition, nine-square composition, cross-shaped composition, and triangle composition.
在一实施例中,在控制无人机跟随目标对象,并控制拍摄装置朝向目标对象进行拍摄之前,调整无人机的位置,以使得无人机相对于目标对象处于预设相对方位;在无人机相对于目标对象处于预设相对方位时,控制无人机跟随目标对象,并控制拍摄装置朝向目标对象进行拍摄。其中,无人机跟随目标对象时保持预设相对方位,预设相对方位包括:无人机处于目标对象的侧前方,并且无人机与目标对象具有预设角度和预设距离,预设角度和预设距离可基于实际情况进行设置,本实施例对此不做具体限定。In one embodiment, before controlling the drone to follow the target object and controlling the shooting device to shoot towards the target object, the position of the drone is adjusted so that the drone is in a preset relative orientation relative to the target object; When the man-machine is at a preset relative position relative to the target object, the drone is controlled to follow the target object, and the shooting device is controlled to shoot toward the target object. Wherein, the UAV maintains a preset relative orientation when following the target object, and the preset relative orientation includes: the UAV is in front of the target object, and the UAV and the target object have a preset angle and a preset distance, and the preset angle and the preset distance can be set based on actual conditions, which is not specifically limited in this embodiment.
示例性的,调整无人机的位置的方式可以为:获取无人机与目标对象之间的相对位置关系;根据无人机与目标对象之间的相对位置关系,调整无人机的位置,以使得无人机相对于目标对象处于预设相对方位。Exemplarily, the manner of adjusting the position of the UAV may be: acquiring the relative positional relationship between the UAV and the target object; adjusting the position of the UAV according to the relative positional relationship between the UAV and the target object, So that the UAV is in a preset relative position relative to the target object.
步骤S202、增大所述拍摄装置的焦距并调整所述拍摄装置的姿态,以使得所述拍摄装置由朝向所述目标对象进行拍摄转换到朝向目标对象的目标区域进行拍摄。Step S202 , increasing the focal length of the photographing device and adjusting the posture of the photographing device, so that the photographing device switches from photographing towards the target object to photographing towards a target area of the target object.
其中,目标对象为人,目标区域包括人的头肩区域,通过对人的头肩区域进行拍摄,使得拍摄装置能够更好地捕捉人的面部表情,进而突显出拍摄到的视频中的人的面部表情与局部细节;或者,目标对象为车,目标区域包括车中的驾驶员区域,通过对车中的驾驶员区域进行拍摄,使得拍摄装置能够更好地捕捉驾驶员的面部表情,进而突显出拍摄到的视频中的驾驶员的面部表情与局部细节。Wherein, the target object is a person, and the target area includes the head and shoulder area of the person. By shooting the head and shoulder area of the person, the shooting device can better capture the facial expression of the person, and then highlight the face of the person in the captured video. expressions and local details; or, the target object is a car, and the target area includes the driver’s area in the car. By shooting the driver’s area in the car, the camera can better capture the driver’s facial expressions, thereby highlighting the The facial expressions and local details of the driver in the captured video.
在一实施例中,在跟随与拍摄目标对象的过程中,获取无人机跟随目标对象的飞行距离、飞行时长、该目标对象的手势动作,在该飞行距离大于或等于预设距离阈值、该飞行时长大于或等于预设时长阈值或者该手势动作为预设手势动作时,增大所述拍摄装置的焦距并调整所述拍摄装置的姿态,以使得所述拍摄装置由朝向所述目标对象进行拍摄转换到朝向目标对象的目标区域进行拍摄。In one embodiment, during the process of following and photographing the target object, the flight distance, flight duration, and gestures of the target object that the UAV follows are acquired. When the flight distance is greater than or equal to the preset distance threshold, the When the flight duration is greater than or equal to the preset duration threshold or the gesture action is a preset gesture action, increase the focal length of the shooting device and adjust the posture of the shooting device so that the shooting device moves towards the target object The shot transitions to shooting towards the target area of the target object.
在一实施例中,拍摄装置包括第一镜头和第二镜头,获取目标对象在第一镜头采集到的图像中的位置信息;根据目标对象在第一镜头采集到的图像中的位置信息,控制无人机跟随目标对象,并控制第二镜头朝向目标对象进行拍摄。其中,第一镜头可以包括广角镜头或变焦镜头,第二镜头可以包括变焦镜头。In one embodiment, the shooting device includes a first lens and a second lens, and acquires position information of the target object in the image captured by the first lens; according to the position information of the target object in the image captured by the first lens, control The drone follows the target object and controls the second camera to shoot towards the target object. Wherein, the first lens may include a wide-angle lens or a zoom lens, and the second lens may include a zoom lens.
如图10所示,未增大拍摄装置的焦距前,拍摄装置采集到的图像61可以包括目标对象的全身,当增大拍摄装置的焦距后,拍摄装置采集到的图像62仅包括目标对象的头肩区域。As shown in Figure 10, before the focal length of the photographing device is increased, the image 61 collected by the photographing device may include the whole body of the target object; when the focal length of the photographing device is increased, the image 62 collected by the photographing device only includes the body of the target object. head and shoulders area.
上述实施例提供的无人机的控制方法,通过控制无人机跟随目标对象,并控制拍摄装置朝向目标对象进行拍摄,然后增大拍摄装置的焦距并调整所述拍摄装置的姿态,以使得所述拍摄装置由朝向所述目标对象进行拍摄转换到朝向目标对象的目标区域进行拍摄,使得拍摄的视频能够体现目标对象的脸部表情与局部细节。The control method of the drone provided by the above-mentioned embodiments controls the drone to follow the target object, and controls the shooting device to shoot toward the target object, and then increases the focal length of the shooting device and adjusts the posture of the shooting device, so that the The shooting device switches from shooting towards the target object to shooting towards the target area of the target object, so that the captured video can reflect the facial expressions and local details of the target object.
请参阅图11,图11是本申请实施例提供的又一种无人机的控制方法的步骤示意流程图。Please refer to FIG. 11 . FIG. 11 is a schematic flowchart of the steps of another method for controlling a drone provided in an embodiment of the present application.
如图11所示,该无人机的控制方法包括步骤S301至步骤S302。As shown in FIG. 11 , the method for controlling the drone includes steps S301 to S302.
步骤S301、控制拍摄装置对目标对象进行延时拍摄。Step S301 , controlling the shooting device to take time-lapse shooting of the target object.
示例性的,遥控设备显示无人机的拍摄装置采集到的实时图像,并将用户在该实时图像中选择的对象确定为目标对象;获取目标对象在该实时图像中的位置信息,并将该位置信息发送给无人机;无人机根据目标对象在该实时图像中的位置信息,控制无人机跟随目标对象,并控制拍摄装置对目标对象进行延 时拍摄。Exemplarily, the remote control device displays the real-time image collected by the shooting device of the drone, and determines the object selected by the user in the real-time image as the target object; obtains the position information of the target object in the real-time image, and The location information is sent to the drone; the drone controls the drone to follow the target object according to the location information of the target object in the real-time image, and controls the shooting device to take time-lapse shots of the target object.
示例性的,该延时拍摄的时长与无人机的剩余电量和/或无人机所处地区的日落时间有关。通过无人机的剩余电量可以确定延时拍摄的时长,在保证无人机安全的前提下,可以拍摄具有延时效果的视频,通过无人机所处地区的日落时间来确定延时拍摄的时长,使得拍摄到的视频能够呈现日落的变化。Exemplarily, the duration of the time-lapse shooting is related to the remaining power of the drone and/or the sunset time of the area where the drone is located. The duration of the time-lapse shooting can be determined by the remaining power of the drone. On the premise of ensuring the safety of the drone, a video with a time-lapse effect can be shot, and the time of the time-lapse shooting can be determined by the sunset time of the area where the drone is located. The duration allows the captured video to show the changes of the sunset.
步骤S302、在延时拍摄的末尾时间段内,调整拍摄装置的朝向,以使得目标对象在延时拍摄的图像中的图像区域由画面中心移动到画面边缘。Step S302. During the end time period of the time-lapse shooting, adjust the orientation of the shooting device so that the image area of the target object in the time-lapse shooting image moves from the center of the frame to the edge of the frame.
示例性的,获取延时拍摄的持续时长和预估延时拍摄时长,在持续时长与预估延时拍摄时长之间的差值小于或等于预设差值时,确定延时拍摄进入末尾时间段。其中,预估延时拍摄时长与无人机的剩余电量和/或无人机所处地区的日落时间有关。Exemplarily, the duration of the time-lapse shooting and the estimated time-lapse shooting time are obtained, and when the difference between the duration and the estimated time-lapse shooting time is less than or equal to the preset difference, it is determined that the time-lapse shooting enters the end time part. Wherein, the estimated time-lapse shooting time is related to the remaining power of the drone and/or the sunset time of the area where the drone is located.
示例性的,调整拍摄装置的朝向的方式可以为:根据第一目标对象在延时拍摄的图像中的图像区域与图像的画面边缘之间的距离,确定拍摄装置的姿态变化量;根据姿态变化量,调整拍摄装置的朝向,以使得第一目标对象在延时拍摄的图像中的图像区域由画面中心移动到画面边缘。Exemplarily, the manner of adjusting the orientation of the shooting device may be: according to the distance between the image area of the first target object in the time-lapse captured image and the edge of the image, determining the amount of change in the posture of the shooting device; Adjust the orientation of the shooting device so that the image area of the first target object in the time-lapse captured image moves from the center of the frame to the edge of the frame.
如图12所示,无人机以位置点71为起点开始对目标对象73进行跟随,并控制拍摄装置对目标对象73进行延时拍摄,在无人机处于位置点72时停止延时拍摄,从而记录了夕阳到傍晚这一段时间的景物,且目标对象73在延时拍摄的末尾时间段目标对象73在延时拍摄的图像中的图像区域由画面中心移动到画面边缘,呈现拍摄结束的效果。As shown in FIG. 12 , the UAV begins to follow the target object 73 starting from the position point 71, and controls the shooting device to perform delayed shooting of the target object 73, and stops the time-lapse shooting when the UAV is at the position point 72, Thus, the scene from the setting sun to the evening is recorded, and the image area of the target object 73 in the time-lapse shooting image moves from the center of the screen to the edge of the screen at the end of the time-lapse shooting period, presenting the effect of the shooting end .
上述实施例提供的无人机的控制方法,控制拍摄装置对目标对象进行延时拍摄,然后在延时拍摄的末尾时间段内,调整拍摄装置的朝向,以使得目标对象在延时拍摄的图像中的图像区域由画面中心移动到画面边缘,从而能够拍摄得到基于延时效果和呈现拍摄结束的效果的视频。In the control method of the drone provided in the above embodiment, the shooting device is controlled to take time-lapse shooting of the target object, and then during the end time period of the time-lapse shooting, the orientation of the shooting device is adjusted so that the image of the target object in the time-lapse shooting The image area in the image moves from the center of the screen to the edge of the screen, so that a video based on the time-lapse effect and the effect of showing the end of shooting can be shot.
请参阅图13,图13是本申请实施例提供的又一种无人机的控制方法的步骤示意流程图。Please refer to FIG. 13 . FIG. 13 is a schematic flowchart of the steps of another method for controlling a drone provided by an embodiment of the present application.
如图13所示,该无人机的控制方法包括步骤S401至步骤S406。As shown in FIG. 13 , the method for controlling the drone includes steps S401 to S406.
步骤S401、获取第一目标对象与第二目标对象之间的相对位置信息。Step S401, acquiring relative position information between a first target object and a second target object.
示例性的,遥控设备显示无人机的拍摄装置采集到的实时图像,并获取用户在该实时图像中选择的第一目标对象和第二目标对象;获取第一目标对象在该实时图像中的第一位置信息和第二目标对象在该实时图像中的第二位置信息,并将第一位置信息和第二位置信息发送给无人机;无人机根据第一位置信息和 第二位置信息,确定第一目标对象与第二目标对象之间的相对位置信息。其中,第一目标对象不同于第二目标对象。Exemplarily, the remote control device displays the real-time image collected by the shooting device of the drone, and obtains the first target object and the second target object selected by the user in the real-time image; obtains the first target object in the real-time image The first position information and the second position information of the second target object in the real-time image, and send the first position information and the second position information to the drone; the drone according to the first position information and the second position information , to determine relative position information between the first target object and the second target object. Wherein, the first target object is different from the second target object.
示例性的,获取拍摄装置采集到的图像,并对该图像进行目标识别;当在拍摄装置采集到的图像中识别到第一预设类别的第一目标对象和第二预设类别的第二目标对象时,获取第一目标对象与第二目标对象之间的相对位置信息。其中,第一预设类别包括车辆和人,第二预设类别包括山、湖泊、大海、树木、标志性建筑等。Exemplarily, the image captured by the shooting device is acquired, and target recognition is performed on the image; when the first target object of the first preset category and the second target object of the second preset category are recognized in the image captured by the shooting device When the target object is used, the relative position information between the first target object and the second target object is obtained. Wherein, the first preset category includes vehicles and people, and the second preset category includes mountains, lakes, seas, trees, landmark buildings, and the like.
步骤S402、根据相对位置信息,确定无人机的目标环绕角度和/或目标环绕方向。Step S402, according to the relative position information, determine the target circle angle and/or target circle direction of the UAV.
其中,第一目标对象与第二目标对象之间的相对位置信息包括第一目标对象与第二目标对象之间的相对距离和/或第一目标对象与第二目标对象之间的相对角度,目标环绕方向包括顺时针方向或逆时针方向。Wherein, the relative position information between the first target object and the second target object includes the relative distance between the first target object and the second target object and/or the relative angle between the first target object and the second target object, Target wrapping directions include clockwise or counterclockwise.
示例性的,获取预存的相对位置信息与环绕角度之间的第一映射关系,并根据第一目标对象与第二目标对象之间的相对位置信息和第一映射关系,确定确定无人机的目标环绕角度。和/或,获取预存的相对位置信息与环绕方向之间的第二映射关系,并根据第一目标对象与第二目标对象之间的相对位置信息和第二映射关系,确定无人机的目标环绕方向。Exemplarily, the first mapping relationship between the pre-stored relative position information and the circling angle is acquired, and according to the relative position information and the first mapping relationship between the first target object and the second target object, determine the UAV's The angle around the target. And/or, obtain the second mapping relationship between the pre-stored relative position information and the surrounding direction, and determine the target of the drone according to the relative position information and the second mapping relationship between the first target object and the second target object Orientation around.
步骤S403、控制无人机按照目标环绕角度和/或目标环绕方向环绕第一目标对象飞行,并控制拍摄装置对第一目标对象和第二目标对象进行拍摄。Step S403, controlling the UAV to fly around the first target object according to the target circling angle and/or target circling direction, and controlling the photographing device to photograph the first target object and the second target object.
其中,第一目标对象不同于第二目标对象,第一目标对象与第二目标对象在拍摄装置采集到的图像中的相对方位随着无人机的环绕第一目标对象飞行而发生变化。例如,如图14所示,无人机以位置点83为起点沿着顺时针方向对第一目标对象81进行环绕40°,在无人机环绕第一目标对象81的同时,控制拍摄装置对第一目标对象81和第二目标对象82进行拍摄。Wherein, the first target object is different from the second target object, and the relative orientations of the first target object and the second target object in the images collected by the photographing device change as the drone flies around the first target object. For example, as shown in FIG. 14 , the drone takes the position point 83 as a starting point to circle the first target object 81 for 40° clockwise, and when the drone circles the first target object 81, the camera is controlled to The first target object 81 and the second target object 82 are photographed.
上述实施例提供的无人机的控制方法,基于第一目标对象与第二目标对象之间的相对位置信息,确定无人机的目标环绕角度和/或目标环绕方向,控制所述无人机按照目标环绕角度和/或目标环绕方向环绕第一目标对象飞行,并控制拍摄装置对第一目标对象和第二目标对象进行拍摄,使得第一目标对象与第二目标对象在拍摄装置采集到的图像中的相对方位随着无人机的环绕第一目标对象飞行而发生变化,以使得图像中的第一目标对象与第二目标对象之间具有位置转换的效果,也可以得到第一目标对象在不同视角的第二目标对象中的视频。In the control method of the UAV provided in the above-mentioned embodiments, based on the relative position information between the first target object and the second target object, the target circling angle and/or target circling direction of the UAV are determined, and the UAV is controlled. Fly around the first target object according to the target circling angle and/or target circling direction, and control the shooting device to shoot the first target object and the second target object, so that the first target object and the second target object are captured by the shooting device The relative orientation in the image changes as the UAV flies around the first target object, so that there is a position conversion effect between the first target object and the second target object in the image, and the first target object can also be obtained Video of the second target object at a different viewpoint.
请参阅图15,图15是本申请实施例提供的一种无人机的控制装置的结构 示意性框图。Please refer to Fig. 15, Fig. 15 is a structural schematic block diagram of a control device for a drone provided by an embodiment of the present application.
如图15所示,无人机的控制装置600包括处理器610和存储器620,处理器610和存储器620通过总线630连接,该总线630比如为I2C(Inter-integrated Circuit)总线。As shown in Figure 15, the control device 600 of the drone includes a processor 610 and a memory 620, and the processor 610 and the memory 620 are connected by a bus 630, such as an I2C (Inter-integrated Circuit) bus.
具体地,处理器610可以是微控制单元(Micro-controller Unit,MCU)、中央处理单元(Central Processing Unit,CPU)或数字信号处理器(Digital Signal Processor,DSP)等。Specifically, the processor 610 may be a micro-controller unit (Micro-controller Unit, MCU), a central processing unit (Central Processing Unit, CPU), or a digital signal processor (Digital Signal Processor, DSP), etc.
具体地,存储器620可以是Flash芯片、只读存储器(ROM,Read-Only Memory)磁盘、光盘、U盘或移动硬盘等。Specifically, the memory 620 may be a Flash chip, a read-only memory (ROM, Read-Only Memory) disk, an optical disk, a U disk, or a mobile hard disk.
其中,所述处理器610用于运行存储在存储器620中的计算机程序,并在执行所述计算机程序时实现以下步骤:Wherein, the processor 610 is configured to run a computer program stored in the memory 620, and implement the following steps when executing the computer program:
控制所述无人机跟随第一目标对象,并控制所述拍摄装置朝向所述第一目标对象进行拍摄;controlling the UAV to follow the first target object, and controlling the shooting device to shoot towards the first target object;
若在所述拍摄装置朝向所述第一目标对象进行拍摄的图像中识别出预设类别的第二目标对象,或者检测到预设类别的第二目标对象相对于所述无人机或所述第一目标对象的位置满足预设条件,则控制所述拍摄装置由朝向所述第一目标对象进行拍摄转换到朝向所述第二目标对象进行拍摄,所述第二目标对象不同于所述第一目标对象。If a second target object of a preset category is identified in the image captured by the shooting device towards the first target object, or a second target object of a preset category is detected relative to the UAV or the The position of the first target object satisfies the preset condition, and the shooting device is controlled to switch from shooting toward the first target object to shooting toward the second target object, and the second target object is different from the first target object. a target object.
可选的,所述处理器在实现控制所述无人机跟随所述第一目标对象之前,还用于实现:Optionally, before realizing controlling the UAV to follow the first target object, the processor is further configured to:
调整所述无人机的位置,以使得所述无人机相对于所述第一目标对象处于预设相对方位;adjusting the position of the UAV so that the UAV is in a preset relative orientation relative to the first target object;
其中,所述跟随所述第一目标对象无人机跟随所述第一目标对象时保持所述预设相对方位。Wherein, the UAV following the first target object maintains the preset relative orientation when following the first target object.
可选的,所述预设相对方位包括:所述无人机处于所述第一目标对象的侧前方,并且所述无人机与所述第一目标对象具有预设角度和预设距离。Optionally, the preset relative orientation includes: the UAV is in front of the first target object, and the UAV has a preset angle and a preset distance from the first target object.
可选的,所述处理器在实现控制所述拍摄装置朝向所述第一目标对象进行拍摄时,用于实现:Optionally, when the processor realizes controlling the shooting device to shoot toward the first target object, it is used to realize:
增大所述拍摄装置的焦距并调整所述拍摄装置的姿态,以使得所述拍摄装置由朝向所述第一目标对象进行拍摄转换到朝向所述第一目标对象的目标区域进行拍摄。Increase the focal length of the photographing device and adjust the posture of the photographing device, so that the photographing device switches from photographing towards the first target object to photographing towards a target area of the first target object.
可选的,所述第一目标对象为人,所述目标区域包括人的头肩区域;或者, 所述第一目标对象为车,所述目标区域包括车中的驾驶员区域。Optionally, the first target object is a person, and the target area includes a head and shoulder area of the person; or, the first target object is a car, and the target area includes a driver area in the car.
可选的,所述拍摄装置包括变焦镜头,所述处理器在实现增大所述拍摄装置的焦距时,用于实现:Optionally, the photographing device includes a zoom lens, and the processor is configured to implement: when increasing the focal length of the photographing device:
增大所述变焦镜头的焦距并调整所述变焦镜头的姿态,以使得所述变焦镜头由朝向所述第一目标对象进行拍摄转换到朝向所述第一目标对象的目标区域进行拍摄。Increase the focal length of the zoom lens and adjust the posture of the zoom lens, so that the zoom lens switches from shooting toward the first target object to shooting toward a target area of the first target object.
可选的,所述拍摄装置包括广角镜头,所述在所述拍摄装置朝向所述第一目标对象进行拍摄的图像中识别出预设类别的第二目标对象,包括:Optionally, the photographing device includes a wide-angle lens, and identifying a second target object of a preset category in an image captured by the photographing device towards the first target object includes:
在所述广角镜头朝向所述第一目标对象进行拍摄的图像中识别出预设类别的第二目标对象。A second target object of a preset category is identified in an image captured by the wide-angle lens towards the first target object.
可选的,所述处理器在实现控制所述拍摄装置由朝向所述第一目标对象进行拍摄转换到朝向所述第二目标对象进行拍摄之前,还用于实现:Optionally, before realizing controlling the photographing device to switch from photographing towards the first target object to photographing towards the second target object, the processor is further configured to implement:
获取所述无人机跟随所述第一目标对象的飞行距离、飞行时长或所述拍摄装置采集到的图像中的所述第一目标对象的手势动作;Acquiring the flight distance and flight duration of the UAV following the first target object, or the gesture action of the first target object in the image collected by the shooting device;
在所述飞行距离达到预设距离、所述飞行时长达到预设时长或所述手势动作为预设手势动作时,控制所述拍摄装置由朝向所述第一目标对象进行拍摄转换到朝向所述第二目标对象进行拍摄。When the flight distance reaches a preset distance, the flight duration reaches a preset duration, or the gesture action is a preset gesture action, the shooting device is controlled to switch from shooting toward the first target object to toward the first target object. The second target object is photographed.
可选的,所述处理器在实现控制所述拍摄装置由朝向所述第一目标对象进行拍摄转换到朝向所述第二目标对象进行拍摄时,用于实现:Optionally, when the processor realizes controlling the shooting device to switch from shooting toward the first target object to shooting toward the second target object, it is used to realize:
控制所述无人机远离所述第一目标对象或者减小所述拍摄装置的焦距;controlling the UAV to stay away from the first target object or reducing the focal length of the photographing device;
在所述无人机远离所述第一目标对象或者所述拍摄装置的焦距减小的过程中,控制所述拍摄装置由朝向所述第一目标对象进行拍摄转换到朝向所述第二目标对象进行拍摄。When the UAV moves away from the first target object or the focal length of the shooting device decreases, control the shooting device to switch from shooting towards the first target object to towards the second target object to shoot.
可选的,所述处理器还用于实现以下步骤:Optionally, the processor is also used to implement the following steps:
在所述无人机远离所述第一目标对象或者所述拍摄装置的焦距减小的过程中,若检测到所述第二目标对象完整呈现在所述拍摄装置拍摄的图像中,则控制所述拍摄装置由朝向所述第一目标对象进行拍摄转换到朝向所述第二目标对象进行拍摄。In the process that the UAV is far away from the first target object or the focal length of the shooting device is reduced, if it is detected that the second target object is completely present in the image captured by the shooting device, control the The photographing device switches from photographing towards the first target object to photographing towards the second target object.
可选的,所述处理器还用于实现以下步骤:Optionally, the processor is also used to implement the following steps:
根据所述第二目标对象在所述拍摄装置拍摄的图像中的画幅占比,确定所述无人机远离所述第一目标对象飞行时的飞行距离。According to the frame ratio of the second target object in the image captured by the photographing device, the flight distance of the UAV when flying away from the first target object is determined.
可选的,所述处理器在实现控制所述拍摄装置由朝向所述第一目标对象进 行拍摄转换到朝向所述第二目标对象进行拍摄之后,还用于实现:Optionally, after the processor controls the shooting device to switch from shooting toward the first target object to shooting toward the second target object, it is further configured to:
控制所述无人机环绕所述第一目标对象,并控制所述拍摄装置对所述第一目标对象和所述第二目标对象进行拍摄。Controlling the UAV to surround the first target object, and controlling the photographing device to photograph the first target object and the second target object.
可选的,所述控制所述无人机环绕所述第一目标对象,包括:Optionally, the controlling the UAV to surround the first target object includes:
根据所述第一目标对象和所述第二目标对象的相对方位确定目标环绕角度和目标环绕方向;determining a target circling angle and a target circling direction according to the relative orientations of the first target object and the second target object;
控制所述无人机按照所述目标环绕角度和所述目标环绕方向环绕所述第一目标对象;controlling the UAV to circle the first target object according to the target circle angle and the target circle direction;
其中,所述第一目标对象与所述第二目标对象在所述拍摄装置采集到的图像中的相对方位随着所述无人机环绕所述第一目标对象飞行而发生变化。Wherein, the relative orientation of the first target object and the second target object in the image captured by the photographing device changes as the drone flies around the first target object.
可选的,所述处理器还用于实现以下步骤:Optionally, the processor is also used to implement the following steps:
控制所述无人机按照预设环绕角度环绕所述第一目标对象之后,控制所述拍摄装置对所述第一目标对象进行延时拍摄。After the UAV is controlled to surround the first target object according to a preset angle of rotation, the photographing device is controlled to take time-lapse photographs of the first target object.
可选的,所述处理器还用于实现以下步骤:Optionally, the processor is also used to implement the following steps:
控制所述无人机保持环绕结束时与所述第一目标对象的相对方位跟随所述第一目标对象;controlling the UAV to follow the first target object relative to the first target object at the end of the circle;
在所述无人机跟随所述第一目标对象的过程中,控制所述拍摄装置对所述第一目标对象进行延时拍摄。During the process of the UAV following the first target object, the photographing device is controlled to take time-lapse photographs of the first target object.
可选的,所述处理器还用于实现以下步骤:Optionally, the processor is also used to implement the following steps:
在所述延时拍摄的末尾时间段内,调整所述拍摄装置的朝向,以使得所述第一目标对象在所述延时拍摄的图像中的图像区域由画面中心移动到画面边缘。During the end time period of the time-lapse shooting, the orientation of the shooting device is adjusted so that the image area of the first target object in the time-lapse shooting image moves from the center of the frame to the edge of the frame.
可选的,所述延时拍摄的时长与所述无人机的剩余电量和/或所述无人机所处地区的日落时间有关。Optionally, the duration of the time-lapse shooting is related to the remaining power of the drone and/or the sunset time of the area where the drone is located.
可选的,所述处理器在实现调整所述拍摄装置的朝向时,用于实现:Optionally, when the processor adjusts the orientation of the shooting device, it is configured to:
根据所述第一目标对象在所述延时拍摄的图像中的图像区域与所述图像的画面边缘之间的距离,确定所述拍摄装置的姿态变化量;determining the amount of posture change of the shooting device according to the distance between the image area of the first target object in the time-lapse captured image and the frame edge of the image;
根据所述姿态变化量,调整所述拍摄装置的朝向,以使得所述第一目标对象在所述延时拍摄的图像中的图像区域由画面中心移动到画面边缘。According to the amount of posture change, the orientation of the photographing device is adjusted so that the image area of the first target object in the time-lapse photographed image moves from the center of the frame to the edge of the frame.
在一实施例中,所述处理器610用于运行存储在存储器620中的计算机程序,并在执行所述计算机程序时实现以下步骤:In one embodiment, the processor 610 is configured to run a computer program stored in the memory 620, and implement the following steps when executing the computer program:
控制所述无人机跟随目标对象,并控制所述拍摄装置朝向所述目标对象进行拍摄;Controlling the UAV to follow the target object, and controlling the shooting device to shoot towards the target object;
增大所述拍摄装置的焦距并调整所述拍摄装置的姿态,以使得所述拍摄装置由朝向所述目标对象进行拍摄转换到朝向所述目标对象的目标区域进行拍摄。Increase the focal length of the photographing device and adjust the posture of the photographing device, so that the photographing device switches from photographing towards the target object to photographing towards a target area of the target object.
在一实施例中,所述处理器610用于运行存储在存储器620中的计算机程序,并在执行所述计算机程序时实现以下步骤:In one embodiment, the processor 610 is configured to run a computer program stored in the memory 620, and implement the following steps when executing the computer program:
控制所述拍摄装置对目标对象进行延时拍摄;controlling the shooting device to take time-lapse shooting of the target object;
在所述延时拍摄的末尾时间段内,调整所述拍摄装置的朝向,以使得所述目标对象在所述延时拍摄的图像中的图像区域由画面中心移动到画面边缘。During the end time period of the time-lapse shooting, the orientation of the shooting device is adjusted so that the image area of the target object in the time-lapse shooting image moves from the center of the frame to the edge of the frame.
在一实施例中,所述处理器610用于运行存储在存储器620中的计算机程序,并在执行所述计算机程序时实现以下步骤:In one embodiment, the processor 610 is configured to run a computer program stored in the memory 620, and implement the following steps when executing the computer program:
获取第一目标对象与第二目标对象之间的相对位置信息;Acquiring relative position information between the first target object and the second target object;
根据所述相对位置信息,确定无人机的目标环绕角度和/或目标环绕方向;According to the relative position information, determine the target circle angle and/or target circle direction of the UAV;
控制所述无人机按照所述目标环绕角度和/或所述目标环绕方向环绕所述第一目标对象飞行,并控制所述拍摄装置对所述第一目标对象和所述第二目标对象进行拍摄;Controlling the UAV to fly around the first target object according to the target circling angle and/or the target circling direction, and controlling the photographing device to take pictures of the first target object and the second target object shoot;
其中,所述第一目标对象与所述第二目标对象在所述拍摄装置采集到的图像中的相对方位随着所述无人机的环绕所述第一目标对象飞行而发生变化。Wherein, the relative orientation of the first target object and the second target object in the image captured by the photographing device changes as the UAV flies around the first target object.
需要说明的是,所属领域的技术人员可以清楚地了解到,为了描述的方便和简洁,上述描述的无人机的控制装置的具体工作过程,可以参考前述无人机的控制方法实施例中的对应过程,在此不再赘述。It should be noted that those skilled in the art can clearly understand that for the convenience and brevity of description, the specific working process of the control device of the drone described above can be referred to in the above-mentioned embodiment of the control method of the drone The corresponding process will not be repeated here.
请参阅图16,图16是本申请实施例提供的一种无人机的结构示意性框图。Please refer to FIG. 16 . FIG. 16 is a schematic structural block diagram of an unmanned aerial vehicle provided by an embodiment of the present application.
如图16所示,无人机700包括机体710、动力系统720、拍摄装置730和无人机的控制装置740,动力系统720设于机体710上,用于为无人机700提供飞行动力,拍摄装置730与机体710固定连接或可拆卸连接,用于采集图像,无人机的控制装置740,设于机体710内,用于控制无人机700。其中,无人机的控制装置740可以为如图15所示的无人机的控制装置600。As shown in Figure 16, the UAV 700 includes a body 710, a power system 720, a camera 730 and a control device 740 of the UAV, and the power system 720 is arranged on the body 710 to provide flight power for the UAV 700, The photographing device 730 is fixedly connected or detachably connected with the body 710 for capturing images, and the control device 740 of the UAV is installed in the body 710 for controlling the UAV 700 . Wherein, the control device 740 of the drone may be the control device 600 of the drone as shown in FIG. 15 .
需要说明的是,所属领域的技术人员可以清楚地了解到,为了描述的方便和简洁,上述描述的无人机的具体工作过程,可以参考前述无人机的控制方法实施例中的对应过程,在此不再赘述。It should be noted that those skilled in the art can clearly understand that for the convenience and brevity of the description, the specific working process of the drone described above can refer to the corresponding process in the aforementioned embodiment of the control method of the drone. I won't repeat them here.
本申请实施例还提供一种存储介质,所述存储介质存储有计算机程序,所述计算机程序中包括程序指令,所述处理器执行所述程序指令,实现上述实施例提供的无人机的控制方法的步骤。The embodiment of the present application also provides a storage medium, the storage medium stores a computer program, the computer program includes program instructions, and the processor executes the program instructions to realize the control of the drone provided by the above-mentioned embodiments method steps.
其中,所述存储介质可以是前述任一实施例所述的无人机的控制装置的内 部存储单元,例如所述无人机的控制装置的硬盘或内存。所述存储介质也可以是所述无人机的控制装置的外部存储设备,例如所述无人机的控制装置上配备的插接式硬盘,智能存储卡(Smart Media Card,SMC),安全数字(Secure Digital,SD)卡,闪存卡(Flash Card)等。Wherein, the storage medium may be an internal storage unit of the control device of the drone described in any of the foregoing embodiments, such as a hard disk or a memory of the control device of the drone. The storage medium can also be an external storage device of the control device of the drone, such as a plug-in hard disk equipped on the control device of the drone, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card, flash memory card (Flash Card), etc.
应当理解,在此本申请说明书中所使用的术语仅仅是出于描述特定实施例的目的而并不意在限制本申请。如在本申请说明书和所附权利要求书中所使用的那样,除非上下文清楚地指明其它情况,否则单数形式的“一”、“一个”及“该”意在包括复数形式。It should be understood that the terms used in the specification of this application are for the purpose of describing specific embodiments only and are not intended to limit the application. As used in this specification and the appended claims, the singular forms "a", "an" and "the" are intended to include plural referents unless the context clearly dictates otherwise.
还应当理解,在本申请说明书和所附权利要求书中使用的术语“和/或”是指相关联列出的项中的一个或多个的任何组合以及所有可能组合,并且包括这些组合。It should also be understood that the term "and/or" used in the description of the present application and the appended claims refers to any combination and all possible combinations of one or more of the associated listed items, and includes these combinations.
以上所述,仅为本申请的具体实施方式,但本申请的保护范围并不局限于此,任何熟悉本技术领域的技术人员在本申请揭露的技术范围内,可轻易想到各种等效的修改或替换,这些修改或替换都应涵盖在本申请的保护范围之内。因此,本申请的保护范围应以权利要求的保护范围为准。The above is only a specific embodiment of the application, but the scope of protection of the application is not limited thereto. Any person familiar with the technical field can easily think of various equivalents within the scope of the technology disclosed in the application. Modifications or replacements, these modifications or replacements shall be covered within the scope of protection of this application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims (44)

  1. 一种无人机的控制方法,其特征在于,所述无人机搭载有拍摄装置,所述方法包括:A method for controlling an unmanned aerial vehicle, characterized in that the unmanned aerial vehicle is equipped with a shooting device, and the method comprises:
    控制所述无人机跟随第一目标对象,并控制所述拍摄装置朝向所述第一目标对象进行拍摄;controlling the UAV to follow the first target object, and controlling the shooting device to shoot towards the first target object;
    若在所述拍摄装置朝向所述第一目标对象进行拍摄的图像中识别出预设类别的第二目标对象,或者检测到预设类别的第二目标对象相对于所述无人机或所述第一目标对象的位置满足预设条件,则控制所述拍摄装置由朝向所述第一目标对象进行拍摄转换到朝向所述第二目标对象进行拍摄,所述第二目标对象不同于所述第一目标对象。If a second target object of a preset category is identified in the image captured by the shooting device towards the first target object, or a second target object of a preset category is detected relative to the UAV or the The position of the first target object satisfies the preset condition, and the shooting device is controlled to switch from shooting toward the first target object to shooting toward the second target object, and the second target object is different from the first target object. a target object.
  2. 根据权利要求1所述的无人机的控制方法,其特征在于,所述控制所述无人机跟随所述第一目标对象之前,所述方法还包括:The method for controlling an unmanned aerial vehicle according to claim 1, wherein before controlling the unmanned aerial vehicle to follow the first target object, the method further comprises:
    调整所述无人机的位置,以使得所述无人机相对于所述第一目标对象处于预设相对方位;adjusting the position of the UAV so that the UAV is in a preset relative orientation relative to the first target object;
    其中,所述无人机跟随所述第一目标对象时保持所述预设相对方位。Wherein, the drone maintains the preset relative orientation when following the first target object.
  3. 根据权利要求2所述的无人机的控制方法,其特征在于,所述预设相对方位包括:所述无人机处于所述第一目标对象的侧前方,并且所述无人机与所述第一目标对象具有预设角度和预设距离。The method for controlling an unmanned aerial vehicle according to claim 2, wherein the preset relative orientation comprises: the unmanned aerial vehicle is in front of the first target object, and the unmanned aerial vehicle is in front of the first target object, and the unmanned aerial vehicle and the The first target object has a preset angle and a preset distance.
  4. 根据权利要求1-3任一项所述的无人机的控制方法,其特征在于,所述控制所述拍摄装置朝向所述第一目标对象进行拍摄,包括:The control method of the unmanned aerial vehicle according to any one of claims 1-3, wherein the controlling the shooting device to shoot toward the first target object includes:
    增大所述拍摄装置的焦距并调整所述拍摄装置的姿态,以使得所述拍摄装置由朝向所述第一目标对象进行拍摄转换到朝向所述第一目标对象的目标区域进行拍摄。Increase the focal length of the photographing device and adjust the posture of the photographing device, so that the photographing device switches from photographing towards the first target object to photographing towards a target area of the first target object.
  5. 根据权利要求4所述的无人机的控制方法,其特征在于,所述第一目标对象为人,所述目标区域包括人的头肩区域;或者,所述第一目标对象为车,所述目标区域包括车中的驾驶员区域。The method for controlling an unmanned aerial vehicle according to claim 4, wherein the first target object is a person, and the target area includes a head and shoulder area of a person; or, the first target object is a car, and the The target area includes the driver's area in the car.
  6. 根据权利要求4所述的无人机的控制方法,其特征在于,所述拍摄装置包括变焦镜头,所述增大所述拍摄装置的焦距,包括:The control method of the unmanned aerial vehicle according to claim 4, wherein the shooting device includes a zoom lens, and the increasing the focal length of the shooting device includes:
    增大所述变焦镜头的焦距并调整所述变焦镜头的姿态,以使得所述变焦镜头由朝向所述第一目标对象进行拍摄转换到朝向所述第一目标对象的目标区域进行拍摄。Increase the focal length of the zoom lens and adjust the posture of the zoom lens, so that the zoom lens switches from shooting toward the first target object to shooting toward a target area of the first target object.
  7. 根据权利要求1所述的无人机的控制方法,其特征在于,所述拍摄装置包括广角镜头,所述在所述拍摄装置朝向所述第一目标对象进行拍摄的图像中识别出预设类别的第二目标对象,包括:The control method of the unmanned aerial vehicle according to claim 1, wherein the shooting device includes a wide-angle lens, and the preset category is identified in the image taken by the shooting device towards the first target object. Secondary target audience, including:
    在所述广角镜头朝向所述第一目标对象进行拍摄的图像中识别出预设类别的第二目标对象。A second target object of a preset category is identified in an image captured by the wide-angle lens toward the first target object.
  8. 根据权利要求1所述的无人机的控制方法,其特征在于,所述控制所述拍摄装置由朝向所述第一目标对象进行拍摄转换到朝向所述第二目标对象进行拍摄之前,还包括:The control method of the unmanned aerial vehicle according to claim 1, characterized in that, before the control of the shooting device is switched from shooting toward the first target object to shooting toward the second target object, it also includes :
    获取所述无人机跟随所述第一目标对象的飞行距离、飞行时长或所述拍摄装置采集到的图像中的所述第一目标对象的手势动作;Acquiring the flight distance and flight duration of the UAV following the first target object, or the gesture action of the first target object in the image collected by the shooting device;
    在所述飞行距离达到预设距离、所述飞行时长达到预设时长或所述手势动作为预设手势动作时,控制所述拍摄装置由朝向所述第一目标对象进行拍摄转换到朝向所述第二目标对象进行拍摄。When the flight distance reaches a preset distance, the flight duration reaches a preset duration, or the gesture action is a preset gesture action, the shooting device is controlled to switch from shooting toward the first target object to toward the first target object. The second target object is photographed.
  9. 根据权利要求1-8中任一项所述的无人机的控制方法,其特征在于,所述控制所述拍摄装置由朝向所述第一目标对象进行拍摄转换到朝向所述第二目标对象进行拍摄,包括:According to the control method of the drone according to any one of claims 1-8, it is characterized in that the control of the shooting device is switched from shooting toward the first target object to toward the second target object Take photos, including:
    控制所述无人机远离所述第一目标对象或者减小所述拍摄装置的焦距;controlling the UAV to stay away from the first target object or reducing the focal length of the photographing device;
    在所述无人机远离所述第一目标对象或者所述拍摄装置的焦距减小的过程中,控制所述拍摄装置由朝向所述第一目标对象进行拍摄转换到朝向所述第二目标对象进行拍摄。In the process that the UAV moves away from the first target object or the focal length of the shooting device decreases, control the shooting device to switch from shooting towards the first target object to facing the second target object to shoot.
  10. 根据权利要求9所述的无人机的控制方法,其特征在于,所述方法还包括:The control method of unmanned aerial vehicle according to claim 9, is characterized in that, described method also comprises:
    在所述无人机远离所述第一目标对象或者所述拍摄装置的焦距减小的过程中,若检测到所述第二目标对象完整呈现在所述拍摄装置拍摄的图像中,则控制所述拍摄装置由朝向所述第一目标对象进行拍摄转换到朝向所述第二目标对象进行拍摄。When the UAV is far away from the first target object or the focal length of the photographing device is reduced, if it is detected that the second target object is completely present in the image captured by the photographing device, control the The photographing device switches from photographing towards the first target object to photographing towards the second target object.
  11. 根据权利要求9或10所述的无人机的控制方法,其特征在于,所述方法还包括:The method for controlling an unmanned aerial vehicle according to claim 9 or 10, wherein the method further comprises:
    根据所述第二目标对象在所述拍摄装置拍摄的图像中的画幅占比,确定所述无人机远离所述第一目标对象飞行时的飞行距离。According to the frame ratio of the second target object in the image captured by the photographing device, the flight distance of the UAV when flying away from the first target object is determined.
  12. 根据权利要求1-11中任一项所述的无人机的控制方法,其特征在于,所述控制所述拍摄装置由朝向所述第一目标对象进行拍摄转换到朝向所述第二 目标对象进行拍摄之后,所述方法还包括:The control method of the drone according to any one of claims 1-11, characterized in that, the control of the shooting device is switched from shooting toward the first target object to toward the second target object After shooting, the method also includes:
    控制所述无人机环绕所述第一目标对象,并控制所述拍摄装置对所述第一目标对象和所述第二目标对象进行拍摄。Controlling the UAV to surround the first target object, and controlling the photographing device to photograph the first target object and the second target object.
  13. 根据权利要求12所述的无人机的控制方法,其特征在于,所述控制所述无人机环绕所述第一目标对象,包括:The method for controlling an unmanned aerial vehicle according to claim 12, wherein the controlling the unmanned aerial vehicle to surround the first target object comprises:
    根据所述第一目标对象和所述第二目标对象的相对方位确定目标环绕角度和目标环绕方向;determining a target circling angle and a target circling direction according to the relative orientations of the first target object and the second target object;
    控制所述无人机按照所述目标环绕角度和所述目标环绕方向环绕所述第一目标对象;controlling the UAV to circle the first target object according to the target circle angle and the target circle direction;
    其中,所述第一目标对象与所述第二目标对象在所述拍摄装置采集到的图像中的相对方位随着所述无人机环绕所述第一目标对象飞行而发生变化。Wherein, the relative orientation of the first target object and the second target object in the image captured by the photographing device changes as the drone flies around the first target object.
  14. 根据权利要求12所述的无人机的控制方法,其特征在于,所述控制所述无人机按照预设环绕角度环绕所述第一目标对象之后,所述方法还包括:The method for controlling an unmanned aerial vehicle according to claim 12, wherein after controlling the unmanned aerial vehicle to surround the first target object according to a preset angle of rotation, the method further comprises:
    控制所述拍摄装置对所述第一目标对象进行延时拍摄。and controlling the photographing device to perform time-lapse photographing of the first target object.
  15. 根据权利要求14所述的无人机的控制方法,其特征在于,所述控制所述无人机按照预设环绕角度环绕所述第一目标对象之后,所述方法还包括:The method for controlling an unmanned aerial vehicle according to claim 14, wherein after controlling the unmanned aerial vehicle to surround the first target object according to a preset angle of rotation, the method further comprises:
    控制所述无人机保持环绕结束时与所述第一目标对象的相对方位跟随所述第一目标对象;controlling the UAV to follow the first target object relative to the first target object at the end of the circle;
    在所述无人机跟随所述第一目标对象的过程中,控制所述拍摄装置对所述第一目标对象进行延时拍摄。During the process of the UAV following the first target object, the photographing device is controlled to take time-lapse photographs of the first target object.
  16. 根据权利要求14所述的无人机的控制方法,其特征在于,所述方法还包括:The control method of unmanned aerial vehicle according to claim 14, is characterized in that, described method also comprises:
    在所述延时拍摄的末尾时间段内,调整所述拍摄装置的朝向,以使得所述第一目标对象在所述延时拍摄的图像中的图像区域由画面中心移动到画面边缘。During the end time period of the time-lapse shooting, the orientation of the shooting device is adjusted so that the image area of the first target object in the time-lapse shooting image moves from the center of the frame to the edge of the frame.
  17. 根据权利要求14所述的无人机的控制方法,其特征在于,所述延时拍摄的时长与所述无人机的剩余电量和/或所述无人机所处地区的日落时间有关。The method for controlling a UAV according to claim 14, wherein the duration of the time-lapse shooting is related to the remaining power of the UAV and/or the sunset time of the area where the UAV is located.
  18. 根据权利要求16所述的无人机的控制方法,其特征在于,所述调整所述拍摄装置的朝向,包括:The control method of the unmanned aerial vehicle according to claim 16, wherein said adjusting the orientation of said photographing device comprises:
    根据所述第一目标对象在所述延时拍摄的图像中的图像区域与所述图像的画面边缘之间的距离,确定所述拍摄装置的姿态变化量;determining the amount of posture change of the shooting device according to the distance between the image area of the first target object in the time-lapse captured image and the frame edge of the image;
    根据所述姿态变化量,调整所述拍摄装置的朝向,以使得所述第一目标对象在所述延时拍摄的图像中的图像区域由画面中心移动到画面边缘。According to the amount of posture change, the orientation of the photographing device is adjusted so that the image area of the first target object in the time-lapse photographed image moves from the center of the frame to the edge of the frame.
  19. 一种无人机的控制方法,其特征在于,所述无人机搭载有拍摄装置,所述方法包括:A method for controlling an unmanned aerial vehicle, characterized in that the unmanned aerial vehicle is equipped with a shooting device, and the method comprises:
    控制所述无人机跟随目标对象,并控制所述拍摄装置朝向所述目标对象进行拍摄;Controlling the UAV to follow the target object, and controlling the shooting device to shoot towards the target object;
    增大所述拍摄装置的焦距并调整所述拍摄装置的姿态,以使得所述拍摄装置由朝向所述目标对象进行拍摄转换到朝向所述目标对象的目标区域进行拍摄。Increase the focal length of the photographing device and adjust the posture of the photographing device, so that the photographing device switches from photographing towards the target object to photographing towards a target area of the target object.
  20. 一种无人机的控制方法,其特征在于,所述无人机搭载有拍摄装置,所述方法包括:A method for controlling an unmanned aerial vehicle, characterized in that the unmanned aerial vehicle is equipped with a shooting device, and the method comprises:
    控制所述拍摄装置对目标对象进行延时拍摄;controlling the shooting device to take time-lapse shooting of the target object;
    在所述延时拍摄的末尾时间段内,调整所述拍摄装置的朝向,以使得所述目标对象在所述延时拍摄的图像中的图像区域由画面中心移动到画面边缘。During the end time period of the time-lapse shooting, the orientation of the shooting device is adjusted so that the image area of the target object in the time-lapse shooting image moves from the center of the frame to the edge of the frame.
  21. 一种无人机的控制方法,其特征在于,所述无人机搭载有拍摄装置,所述方法包括:A method for controlling an unmanned aerial vehicle, characterized in that the unmanned aerial vehicle is equipped with a shooting device, and the method comprises:
    获取第一目标对象与第二目标对象之间的相对位置信息;Acquiring relative position information between the first target object and the second target object;
    根据所述相对位置信息,确定无人机的目标环绕角度和/或目标环绕方向;According to the relative position information, determine the target circle angle and/or target circle direction of the UAV;
    控制所述无人机按照所述目标环绕角度和/或所述目标环绕方向环绕所述第一目标对象飞行,并控制所述拍摄装置对所述第一目标对象和所述第二目标对象进行拍摄;Controlling the UAV to fly around the first target object according to the target circling angle and/or the target circling direction, and controlling the photographing device to take pictures of the first target object and the second target object shoot;
    其中,所述第一目标对象与所述第二目标对象在所述拍摄装置采集到的图像中的相对方位随着所述无人机的环绕所述第一目标对象飞行而发生变化。Wherein, the relative orientation of the first target object and the second target object in the image captured by the photographing device changes as the UAV flies around the first target object.
  22. 一种无人机的控制装置,其特征在于,所述无人机搭载有拍摄装置,所述控制装置包括存储器和处理器;A control device for an unmanned aerial vehicle, characterized in that the unmanned aerial vehicle is equipped with a shooting device, and the control device includes a memory and a processor;
    所述存储器用于存储计算机程序;The memory is used to store computer programs;
    所述处理器,用于执行所述计算机程序并在执行所述计算机程序时,实现以下步骤:The processor is configured to execute the computer program and implement the following steps when executing the computer program:
    控制所述无人机跟随第一目标对象,并控制所述拍摄装置朝向所述第一目标对象进行拍摄;controlling the UAV to follow the first target object, and controlling the shooting device to shoot towards the first target object;
    若在所述拍摄装置朝向所述第一目标对象进行拍摄的图像中识别出预设类别的第二目标对象,或者检测到预设类别的第二目标对象相对于所述无人机或所述第一目标对象的位置满足预设条件,则控制所述拍摄装置由朝向所述第一目标对象进行拍摄转换到朝向所述第二目标对象进行拍摄,所述第二目标对象不同于所述第一目标对象。If a second target object of a preset category is identified in the image captured by the shooting device towards the first target object, or a second target object of a preset category is detected relative to the UAV or the The position of the first target object satisfies the preset condition, and the shooting device is controlled to switch from shooting toward the first target object to shooting toward the second target object, and the second target object is different from the first target object. a target object.
  23. 根据权利要求22所述的无人机的控制装置,其特征在于,所述处理器在实现控制所述无人机跟随所述第一目标对象之前,还用于实现:The control device of the unmanned aerial vehicle according to claim 22, wherein the processor is further configured to realize: before controlling the unmanned aerial vehicle to follow the first target object:
    调整所述无人机的位置,以使得所述无人机相对于所述第一目标对象处于预设相对方位;adjusting the position of the UAV so that the UAV is in a preset relative orientation relative to the first target object;
    其中,所述无人机跟随所述第一目标对象时保持所述预设相对方位。Wherein, the drone maintains the preset relative orientation when following the first target object.
  24. 根据权利要求23所述的无人机的控制装置,其特征在于,所述预设相对方位包括:所述无人机处于所述第一目标对象的侧前方,并且所述无人机与所述第一目标对象具有预设角度和预设距离。The control device of the drone according to claim 23, wherein the preset relative orientation comprises: the drone is in front of the first target object, and the drone is in front of the first target object, and the drone and the The first target object has a preset angle and a preset distance.
  25. 根据权利要求22-24中任一项所述的无人机的控制装置,其特征在于,所述处理器在实现控制所述拍摄装置朝向所述第一目标对象进行拍摄时,用于实现:The control device of the unmanned aerial vehicle according to any one of claims 22-24, wherein the processor is configured to realize:
    增大所述拍摄装置的焦距并调整所述拍摄装置的姿态,以使得所述拍摄装置由朝向所述第一目标对象进行拍摄转换到朝向所述第一目标对象的目标区域进行拍摄。Increase the focal length of the photographing device and adjust the posture of the photographing device, so that the photographing device switches from photographing towards the first target object to photographing towards a target area of the first target object.
  26. 根据权利要求25所述的无人机的控制装置,其特征在于,所述第一目标对象为人,所述目标区域包括人的头肩区域;或者,所述第一目标对象为车,所述目标区域包括车中的驾驶员区域。The control device of unmanned aerial vehicle according to claim 25, it is characterized in that, the first target object is a person, and the target area includes the head and shoulder area of the person; or, the first target object is a car, and the The target area includes the driver's area in the car.
  27. 根据权利要求25所述的无人机的控制装置,其特征在于,所述拍摄装置包括变焦镜头,所述处理器在实现增大所述拍摄装置的焦距时,用于实现:The control device of the unmanned aerial vehicle according to claim 25, wherein the shooting device includes a zoom lens, and when the processor increases the focal length of the shooting device, it is used to realize:
    增大所述变焦镜头的焦距并调整所述变焦镜头的姿态,以使得所述变焦镜头由朝向所述第一目标对象进行拍摄转换到朝向所述第一目标对象的目标区域进行拍摄。Increase the focal length of the zoom lens and adjust the posture of the zoom lens, so that the zoom lens switches from shooting toward the first target object to shooting toward a target area of the first target object.
  28. 根据权利要求22所述的无人机的控制装置,其特征在于,所述拍摄装置包括广角镜头,所述在所述拍摄装置朝向所述第一目标对象进行拍摄的图像中识别出预设类别的第二目标对象,包括:The control device of the unmanned aerial vehicle according to claim 22, wherein the shooting device includes a wide-angle lens, and the preset category is identified in the image taken by the shooting device towards the first target object. Secondary target audience, including:
    在所述广角镜头朝向所述第一目标对象进行拍摄的图像中识别出预设类别的第二目标对象。A second target object of a preset category is identified in an image captured by the wide-angle lens towards the first target object.
  29. 根据权利要求22所述的无人机的控制装置,其特征在于,所述处理器在实现控制所述拍摄装置由朝向所述第一目标对象进行拍摄转换到朝向所述第二目标对象进行拍摄之前,还用于实现:The control device of the unmanned aerial vehicle according to claim 22, characterized in that, the processor controls the shooting device to switch from shooting toward the first target object to shooting toward the second target object Previously, it was also used to implement:
    获取所述无人机跟随所述第一目标对象的飞行距离、飞行时长或所述拍摄装置采集到的图像中的所述第一目标对象的手势动作;Acquiring the flight distance and flight duration of the UAV following the first target object, or the gesture action of the first target object in the image collected by the shooting device;
    在所述飞行距离达到预设距离、所述飞行时长达到预设时长或所述手势动作为预设手势动作时,控制所述拍摄装置由朝向所述第一目标对象进行拍摄转换到朝向所述第二目标对象进行拍摄。When the flight distance reaches a preset distance, the flight duration reaches a preset duration, or the gesture action is a preset gesture action, the shooting device is controlled to switch from shooting toward the first target object to toward the first target object. The second target object is photographed.
  30. 根据权利要求22-29中任一项所述的无人机的控制装置,其特征在于,所述处理器在实现控制所述拍摄装置由朝向所述第一目标对象进行拍摄转换到朝向所述第二目标对象进行拍摄时,用于实现:According to the control device of any one of claims 22-29, it is characterized in that, the processor controls the shooting device to switch from shooting toward the first target object to toward the first target object. When shooting with the second target object, it is used to achieve:
    控制所述无人机远离所述第一目标对象或者减小所述拍摄装置的焦距;controlling the UAV to stay away from the first target object or reducing the focal length of the photographing device;
    在所述无人机远离所述第一目标对象或者所述拍摄装置的焦距减小的过程中,控制所述拍摄装置由朝向所述第一目标对象进行拍摄转换到朝向所述第二目标对象进行拍摄。When the UAV moves away from the first target object or the focal length of the shooting device decreases, control the shooting device to switch from shooting towards the first target object to towards the second target object to shoot.
  31. 根据权利要求30所述的无人机的控制装置,其特征在于,所述处理器还用于实现以下步骤:The control device of the unmanned aerial vehicle according to claim 30, wherein the processor is also used to implement the following steps:
    在所述无人机远离所述第一目标对象或者所述拍摄装置的焦距减小的过程中,若检测到所述第二目标对象完整呈现在所述拍摄装置拍摄的图像中,则控制所述拍摄装置由朝向所述第一目标对象进行拍摄转换到朝向所述第二目标对象进行拍摄。In the process that the UAV is far away from the first target object or the focal length of the shooting device is reduced, if it is detected that the second target object is completely present in the image captured by the shooting device, control the The photographing device switches from photographing towards the first target object to photographing towards the second target object.
  32. 根据权利要求30或31所述的无人机的控制装置,其特征在于,所述处理器还用于实现以下步骤:The control device of the unmanned aerial vehicle according to claim 30 or 31, wherein the processor is also used to implement the following steps:
    根据所述第二目标对象在所述拍摄装置拍摄的图像中的画幅占比,确定所述无人机远离所述第一目标对象飞行时的飞行距离。According to the frame ratio of the second target object in the image captured by the photographing device, the flight distance of the UAV when flying away from the first target object is determined.
  33. 根据权利要求22-32中任一项所述的无人机的控制装置,其特征在于,所述处理器在实现控制所述拍摄装置由朝向所述第一目标对象进行拍摄转换到朝向所述第二目标对象进行拍摄之后,还用于实现:According to the control device of any one of claims 22-32, it is characterized in that, the processor realizes controlling the shooting device to switch from shooting toward the first target object to toward the first target object. After the second target object is photographed, it is also used to achieve:
    控制所述无人机环绕所述第一目标对象,并控制所述拍摄装置对所述第一目标对象和所述第二目标对象进行拍摄。Controlling the UAV to surround the first target object, and controlling the photographing device to photograph the first target object and the second target object.
  34. 根据权利要求33所述的无人机的控制装置,其特征在于,所述控制所述无人机环绕所述第一目标对象,包括:The control device of the drone according to claim 33, wherein the controlling the drone to surround the first target object comprises:
    根据所述第一目标对象和所述第二目标对象的相对方位确定目标环绕角度和目标环绕方向;determining a target circling angle and a target circling direction according to the relative orientations of the first target object and the second target object;
    控制所述无人机按照所述目标环绕角度和所述目标环绕方向环绕所述第一目标对象;controlling the UAV to circle the first target object according to the target circle angle and the target circle direction;
    其中,所述第一目标对象与所述第二目标对象在所述拍摄装置采集到的图 像中的相对方位随着所述无人机环绕所述第一目标对象飞行而发生变化。Wherein, the relative orientation of the first target object and the second target object in the image collected by the photographing device changes as the UAV flies around the first target object.
  35. 根据权利要求33所述的无人机的控制装置,其特征在于,所述处理器还用于实现以下步骤:The control device of the unmanned aerial vehicle according to claim 33, wherein the processor is also used to implement the following steps:
    控制所述无人机按照预设环绕角度环绕所述第一目标对象之后,控制所述拍摄装置对所述第一目标对象进行延时拍摄。After the UAV is controlled to surround the first target object according to a preset angle of rotation, the photographing device is controlled to take time-lapse photographs of the first target object.
  36. 根据权利要求35所述的无人机的控制装置,其特征在于,所述处理器还用于实现以下步骤:The control device of the unmanned aerial vehicle according to claim 35, wherein the processor is also used to implement the following steps:
    控制所述无人机保持环绕结束时与所述第一目标对象的相对方位跟随所述第一目标对象;controlling the UAV to follow the first target object relative to the first target object at the end of the circle;
    在所述无人机跟随所述第一目标对象的过程中,控制所述拍摄装置对所述第一目标对象进行延时拍摄。During the process of the UAV following the first target object, the photographing device is controlled to take time-lapse photographs of the first target object.
  37. 根据权利要求35所述的无人机的控制装置,其特征在于,所述处理器还用于实现以下步骤:The control device of the unmanned aerial vehicle according to claim 35, wherein the processor is also used to implement the following steps:
    在所述延时拍摄的末尾时间段内,调整所述拍摄装置的朝向,以使得所述第一目标对象在所述延时拍摄的图像中的图像区域由画面中心移动到画面边缘。During the end time period of the time-lapse shooting, the orientation of the shooting device is adjusted so that the image area of the first target object in the time-lapse shooting image moves from the center of the frame to the edge of the frame.
  38. 根据权利要求35所述的无人机的控制装置,其特征在于,所述延时拍摄的时长与所述无人机的剩余电量和/或所述无人机所处地区的日落时间有关。The control device for the drone according to claim 35, wherein the duration of the time-lapse shooting is related to the remaining power of the drone and/or the sunset time of the area where the drone is located.
  39. 根据权利要求37所述的无人机的控制装置,其特征在于,所述处理器在实现调整所述拍摄装置的朝向时,用于实现:The control device of the unmanned aerial vehicle according to claim 37, wherein, when the processor adjusts the orientation of the shooting device, it is used to realize:
    根据所述第一目标对象在所述延时拍摄的图像中的图像区域与所述图像的画面边缘之间的距离,确定所述拍摄装置的姿态变化量;determining the amount of posture change of the shooting device according to the distance between the image area of the first target object in the time-lapse captured image and the frame edge of the image;
    根据所述姿态变化量,调整所述拍摄装置的朝向,以使得所述第一目标对象在所述延时拍摄的图像中的图像区域由画面中心移动到画面边缘。According to the amount of posture change, the orientation of the photographing device is adjusted so that the image area of the first target object in the time-lapse photographed image moves from the center of the frame to the edge of the frame.
  40. 一种无人机的控制装置,其特征在于,所述无人机搭载有拍摄装置,所述控制装置包括存储器和处理器;A control device for an unmanned aerial vehicle, characterized in that the unmanned aerial vehicle is equipped with a shooting device, and the control device includes a memory and a processor;
    所述存储器用于存储计算机程序;The memory is used to store computer programs;
    所述处理器,用于执行所述计算机程序并在执行所述计算机程序时,实现以下步骤:The processor is configured to execute the computer program and implement the following steps when executing the computer program:
    控制所述无人机跟随目标对象,并控制所述拍摄装置朝向所述目标对象进行拍摄;Controlling the UAV to follow the target object, and controlling the shooting device to shoot towards the target object;
    增大所述拍摄装置的焦距并调整所述拍摄装置的姿态,以使得所述拍摄装置由朝向所述目标对象进行拍摄转换到朝向所述目标对象的目标区域进行拍摄。Increase the focal length of the photographing device and adjust the posture of the photographing device, so that the photographing device switches from photographing towards the target object to photographing towards a target area of the target object.
  41. 一种无人机的控制装置,其特征在于,所述无人机搭载有拍摄装置,所述控制装置包括存储器和处理器;A control device for an unmanned aerial vehicle, characterized in that the unmanned aerial vehicle is equipped with a shooting device, and the control device includes a memory and a processor;
    所述存储器用于存储计算机程序;The memory is used to store computer programs;
    所述处理器,用于执行所述计算机程序并在执行所述计算机程序时,实现以下步骤:The processor is configured to execute the computer program and implement the following steps when executing the computer program:
    控制所述拍摄装置对目标对象进行延时拍摄;controlling the shooting device to take time-lapse shooting of the target object;
    在所述延时拍摄的末尾时间段内,调整所述拍摄装置的朝向,以使得所述目标对象在所述延时拍摄的图像中的图像区域由画面中心移动到画面边缘。During the end time period of the time-lapse shooting, the orientation of the shooting device is adjusted so that the image area of the target object in the time-lapse shooting image moves from the center of the frame to the edge of the frame.
  42. 一种无人机的控制装置,其特征在于,所述无人机搭载有拍摄装置,所述控制装置包括存储器和处理器;A control device for an unmanned aerial vehicle, characterized in that the unmanned aerial vehicle is equipped with a shooting device, and the control device includes a memory and a processor;
    所述存储器用于存储计算机程序;The memory is used to store computer programs;
    所述处理器,用于执行所述计算机程序并在执行所述计算机程序时,实现以下步骤:The processor is configured to execute the computer program and implement the following steps when executing the computer program:
    获取第一目标对象与第二目标对象之间的相对位置信息;Acquiring relative position information between the first target object and the second target object;
    根据所述相对位置信息,确定无人机的目标环绕角度和/或目标环绕方向;According to the relative position information, determine the target circle angle and/or target circle direction of the UAV;
    控制所述无人机按照所述目标环绕角度和/或所述目标环绕方向环绕所述第一目标对象飞行,并控制所述拍摄装置对所述第一目标对象和所述第二目标对象进行拍摄;Controlling the UAV to fly around the first target object according to the target circling angle and/or the target circling direction, and controlling the photographing device to take pictures of the first target object and the second target object shoot;
    其中,所述第一目标对象与所述第二目标对象在所述拍摄装置采集到的图像中的相对方位随着所述无人机的环绕所述第一目标对象飞行而发生变化。Wherein, the relative orientation of the first target object and the second target object in the image captured by the photographing device changes as the UAV flies around the first target object.
  43. 一种无人机,其特征在于,包括:A kind of unmanned aerial vehicle, is characterized in that, comprises:
    机体;body;
    动力系统,设于所述机体上,用于为所述无人机提供飞行动力;The power system is arranged on the body and is used to provide flight power for the unmanned aerial vehicle;
    拍摄装置,所述拍摄装置与所述机体固定连接或可拆卸连接;A photographing device, the photographing device is fixedly or detachably connected to the body;
    权利要求22-42中任一项所述的无人机的控制装置。The control device of the drone according to any one of claims 22-42.
  44. 一种计算机可读存储介质,其特征在于,所述计算机可读存储介质存储有计算机程序,所述计算机程序被处理器执行时使所述处理器实现如权利要求1-21中任一项所述的无人机的控制方法的步骤。A computer-readable storage medium, characterized in that, the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the processor implements the process described in any one of claims 1-21. The steps of the control method of the unmanned aerial vehicle described above.
PCT/CN2021/143273 2021-12-30 2021-12-30 Control method and device for unmanned aerial vehicle, unmanned aerial vehicle, and storage medium WO2023123254A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN202180100395.0A CN117751580A (en) 2021-12-30 2021-12-30 Unmanned aerial vehicle control method and device, unmanned aerial vehicle and storage medium
PCT/CN2021/143273 WO2023123254A1 (en) 2021-12-30 2021-12-30 Control method and device for unmanned aerial vehicle, unmanned aerial vehicle, and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2021/143273 WO2023123254A1 (en) 2021-12-30 2021-12-30 Control method and device for unmanned aerial vehicle, unmanned aerial vehicle, and storage medium

Publications (1)

Publication Number Publication Date
WO2023123254A1 true WO2023123254A1 (en) 2023-07-06

Family

ID=86997042

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/143273 WO2023123254A1 (en) 2021-12-30 2021-12-30 Control method and device for unmanned aerial vehicle, unmanned aerial vehicle, and storage medium

Country Status (2)

Country Link
CN (1) CN117751580A (en)
WO (1) WO2023123254A1 (en)

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010124398A (en) * 2008-11-21 2010-06-03 Mitsubishi Electric Corp Automatic tracking photographing apparatus from aerial mobile vehicle
US20110298923A1 (en) * 2009-02-26 2011-12-08 Hisayuki Mukae Moving object image capture system, moving object, ground station apparatus, and moving object image capture method
CN109190478A (en) * 2018-08-03 2019-01-11 北京猎户星空科技有限公司 The switching method of target object, device and electronic equipment during focus follows
CN109240344A (en) * 2018-09-20 2019-01-18 重庆市亿飞智联科技有限公司 Method for tracking target, device, pod equipment and aircraft
CN109889727A (en) * 2019-03-14 2019-06-14 睿魔智能科技(深圳)有限公司 Unmanned photographic subjects switching method and system, unmanned cameras and storage medium
WO2019183746A1 (en) * 2018-03-26 2019-10-03 深圳市大疆创新科技有限公司 Tracking processing method for unmanned aerial vehicle and control terminal
CN110945452A (en) * 2018-07-23 2020-03-31 深圳市大疆创新科技有限公司 Cloud deck, unmanned aerial vehicle control method, cloud deck and unmanned aerial vehicle
CN111935389A (en) * 2019-12-30 2020-11-13 苏州臻迪智能科技有限公司 Shot object switching method and device, shooting equipment and readable storage medium
WO2021134311A1 (en) * 2019-12-30 2021-07-08 苏州臻迪智能科技有限公司 Method and apparatus for switching object to be photographed, and image processing method and apparatus
CN113841380A (en) * 2020-10-20 2021-12-24 深圳市大疆创新科技有限公司 Method, device, system, equipment and storage medium for determining target following strategy

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010124398A (en) * 2008-11-21 2010-06-03 Mitsubishi Electric Corp Automatic tracking photographing apparatus from aerial mobile vehicle
US20110298923A1 (en) * 2009-02-26 2011-12-08 Hisayuki Mukae Moving object image capture system, moving object, ground station apparatus, and moving object image capture method
WO2019183746A1 (en) * 2018-03-26 2019-10-03 深圳市大疆创新科技有限公司 Tracking processing method for unmanned aerial vehicle and control terminal
CN110945452A (en) * 2018-07-23 2020-03-31 深圳市大疆创新科技有限公司 Cloud deck, unmanned aerial vehicle control method, cloud deck and unmanned aerial vehicle
CN109190478A (en) * 2018-08-03 2019-01-11 北京猎户星空科技有限公司 The switching method of target object, device and electronic equipment during focus follows
CN109240344A (en) * 2018-09-20 2019-01-18 重庆市亿飞智联科技有限公司 Method for tracking target, device, pod equipment and aircraft
CN109889727A (en) * 2019-03-14 2019-06-14 睿魔智能科技(深圳)有限公司 Unmanned photographic subjects switching method and system, unmanned cameras and storage medium
CN111935389A (en) * 2019-12-30 2020-11-13 苏州臻迪智能科技有限公司 Shot object switching method and device, shooting equipment and readable storage medium
WO2021134311A1 (en) * 2019-12-30 2021-07-08 苏州臻迪智能科技有限公司 Method and apparatus for switching object to be photographed, and image processing method and apparatus
CN113841380A (en) * 2020-10-20 2021-12-24 深圳市大疆创新科技有限公司 Method, device, system, equipment and storage medium for determining target following strategy

Also Published As

Publication number Publication date
CN117751580A (en) 2024-03-22

Similar Documents

Publication Publication Date Title
US10979615B2 (en) System and method for providing autonomous photography and videography
US20200346753A1 (en) Uav control method, device and uav
US20190246042A1 (en) Photographing composition method and apparatus, movable object and computer-readable storage medium
CN110692027A (en) System and method for providing easy-to-use release and automatic positioning of drone applications
WO2022032538A1 (en) Panorama photographing method, apparatus and system, and computer-readable storage medium
WO2019227441A1 (en) Video control method and device of movable platform
KR20160147713A (en) Information processing device, information processing method, program, and imaging system
WO2018035764A1 (en) Method for taking wide-angle pictures, device, cradle heads, unmanned aerial vehicle and robot
WO2019061063A1 (en) Image collection method for unmanned aerial vehicle, and unmanned aerial vehicle
WO2019227333A1 (en) Group photograph photographing method and apparatus
CN112154649A (en) Aerial survey method, shooting control method, aircraft, terminal, system and storage medium
WO2020215215A1 (en) Gimbal control method and device, gimbal, system and storage medium
WO2019104569A1 (en) Focusing method and device, and readable storage medium
WO2022141956A1 (en) Flight control method, video editing method, device, unmanned aerial vehicle, and storage medium
WO2020019106A1 (en) Gimbal and unmanned aerial vehicle control method, gimbal, and unmanned aerial vehicle
US20210004005A1 (en) Image capture method and device, and machine-readable storage medium
WO2019195991A1 (en) Trajectory determination and time-lapse photography methods, device, and machine readable storage medium
WO2021031159A1 (en) Match photographing method, electronic device, unmanned aerial vehicle and storage medium
WO2020133410A1 (en) Image capture method and device
US20230359204A1 (en) Flight control method, video editing method, device, uav and storage medium
WO2023123254A1 (en) Control method and device for unmanned aerial vehicle, unmanned aerial vehicle, and storage medium
WO2018191840A1 (en) Interactive photographing system and method for unmanned aerial vehicle
WO2021056411A1 (en) Air route adjustment method, ground end device, unmanned aerial vehicle, system, and storage medium
WO2023041013A1 (en) Video capturing method and apparatus using unmanned aerial vehicle, and unmanned aerial vehicle and storage medium
WO2022056683A1 (en) Field of view determination method, field of view determination device, field of view determination system, and medium

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 202180100395.0

Country of ref document: CN