WO2022188151A1 - Image photographing method, control apparatus, movable platform, and computer storage medium - Google Patents

Image photographing method, control apparatus, movable platform, and computer storage medium Download PDF

Info

Publication number
WO2022188151A1
WO2022188151A1 PCT/CN2021/080462 CN2021080462W WO2022188151A1 WO 2022188151 A1 WO2022188151 A1 WO 2022188151A1 CN 2021080462 W CN2021080462 W CN 2021080462W WO 2022188151 A1 WO2022188151 A1 WO 2022188151A1
Authority
WO
WIPO (PCT)
Prior art keywords
shooting
information
movable platform
target
height
Prior art date
Application number
PCT/CN2021/080462
Other languages
French (fr)
Chinese (zh)
Inventor
翁松伟
付洁
王泽森
Original Assignee
深圳市大疆创新科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市大疆创新科技有限公司 filed Critical 深圳市大疆创新科技有限公司
Priority to CN202180082558.7A priority Critical patent/CN116762354A/en
Priority to PCT/CN2021/080462 priority patent/WO2022188151A1/en
Publication of WO2022188151A1 publication Critical patent/WO2022188151A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules

Definitions

  • the present invention generally relates to the technical field of data processing, and more particularly, to an image capturing method, a control device, a movable platform and a computer storage medium.
  • the one-button shooting function usually needs to be selected by the user. For some new users, it is difficult to clearly select the appropriate shooting method or shooting angle at the beginning stage. to quickly capture great photos or videos.
  • one aspect of the present application provides an image shooting method, the image shooting method includes: identifying a shooting target within a shooting range of a movable platform that meets preset shooting conditions; acquiring composition planning information matching the shooting target ; Based on the composition planning information, determine the target shooting position that the movable platform should be in when shooting the shooting target; After controlling the movable platform to be in the target shooting position, based on the composition planning information The photographing device mounted on the movable platform is controlled to photograph the photographing target.
  • movable platform includes:
  • a photographing device arranged on the movable platform body, for photographing images
  • a communication interface for communicating with the control device
  • one or more processors configured to execute the program instructions stored in the memory, so that the processors perform the following steps: identifying the shooting targets that meet preset shooting conditions within the shooting range of the movable platform; obtaining composition planning information matched with the shooting target; based on the composition planning information, determine the target shooting position that the movable platform should be in when shooting the shooting target; when the movable platform is controlled to be in the After the target shooting position is determined, the shooting device is controlled to shoot the shooting target based on the composition planning information.
  • control device comprising:
  • a communication interface at least used to communicate with a movable platform, wherein a photographing device is provided on the movable platform;
  • processors for executing the program instructions stored in the memory, causing the processors to perform the following steps:
  • composition planning information that matches the shooting target
  • a display for displaying visual information for displaying visual information.
  • Another aspect of the present application further provides a computer storage medium on which a computer program is stored, and when the computer program is executed by a processor, the aforementioned image capturing method is implemented.
  • the shooting device after identifying the shooting target within the shooting range of the movable platform that meets the preset shooting conditions, the shooting device is controlled based on the composition planning information to shoot the shooting target.
  • Target shooting so that users can quickly use the preset composition planning information to assist users to complete the shooting of the shooting device on the movable platform without spending too much time on composition, etc., and can shoot with high quality and good effect. , which reduces the user's learning cost and improves the user's experience.
  • FIG. 1 shows a schematic diagram of an aircraft in an embodiment of the present application
  • FIG. 2 shows a flowchart of an image capturing method in an embodiment of the present application
  • Fig. 3 shows the schematic diagram of the scenic spots of a plurality of loops in an embodiment of the present application
  • FIG. 4 shows a schematic diagram of a satellite map in an embodiment of the present application
  • FIG. 5 shows a schematic block diagram of a movable platform in an embodiment of the present application
  • FIG. 6 shows a schematic block diagram of a control device in an embodiment of the present application.
  • the image capturing method for a movable platform provided in the embodiments of the present application can be applied to a movable platform and any other application scenarios involving image capturing.
  • the movable platform may include an aircraft (such as an unmanned aerial vehicle). , robot, unmanned vehicle, and unmanned ship, the embodiments of the present application do not limit specific application scenarios.
  • the case where the movable platform is an aircraft is mainly used as an example to describe the solution of the present application, but it can be understood that this is not intended to limit the application scenarios of the present application.
  • FIG. 1 shows a schematic diagram of an aircraft 100 in one embodiment of the present application.
  • the aircraft 100 includes a carrier (ie, a frame) 102 and a load 104 .
  • a carrier ie, a frame
  • a load 104 may be located directly on the aircraft 100 without the need for the carrier 102 .
  • Aircraft 100 may include processor 101 , memory 102 , powertrain 106 , sensing system 108 , and communication system 110 . These components are interconnected by a bus system and/or other form of connection mechanism (not shown).
  • the payload 104 may include a camera or the like.
  • the powertrain 106 may include one or more rotating bodies, propellers, blades, engines, motors, wheels, bearings, magnets, nozzles.
  • the rotating body of the power mechanism may be a self-tightening rotating body, a rotating body assembly, or other rotating body power unit.
  • An aircraft may have one or more power mechanisms. All powertrains can be of the same type. Alternatively, one or more of the power mechanisms may be of a different type.
  • Powertrain 106 may be mounted on the aircraft by suitable means, such as by support elements (eg, drive shafts). The powertrain 106 may be installed in any suitable location on the aircraft 100, such as the top end, the lower end, the front end, the rear end, the side, or any combination thereof.
  • the powertrain 106 enables the aircraft to take off vertically from a surface, or land vertically on a surface, without requiring any horizontal movement of the aircraft 100 (eg, without taxiing on a runway).
  • powertrain 106 may allow aircraft 100 to preset positions and/or steering wheel in the air.
  • One or more of the power mechanisms 106 may be controlled independently of the other power mechanisms.
  • one or more power mechanisms 106 may be controlled simultaneously.
  • the aircraft 100 may have multiple horizontal rotations to track the lift and/or push of the target.
  • the horizontally oriented rotator can be actuated to provide the ability of the aircraft 100 to take off vertically, land vertically, and hover.
  • one or more of the horizontal rotating bodies may rotate clockwise, while the other one or more of the horizontal rotating bodies may rotate counterclockwise.
  • the rate of rotation of each horizontal rotator can be varied independently to effect lift and/or push operations caused by each rotator to adjust the spatial orientation, velocity, and/or acceleration of the aircraft 100 (eg, relative to up to three rotation and translation of degrees of freedom).
  • Sensing system 108 may include one or more sensors to sense spatial orientation, velocity, and/or acceleration (eg, rotation and translation with respect to up to three degrees of freedom) of aircraft 100 .
  • the one or more sensors include any of the sensors described above, including GPS sensors, motion sensors, inertial sensors, proximity sensors, or image sensors.
  • Sensing data provided by the sensing system 108 may be used to track the spatial orientation, velocity, and/or acceleration of the target 100 (as described below, using a suitable processing unit and/or control unit).
  • the sensing system 108 may be used to collect data on the environment of the aircraft, such as climatic conditions, potential obstacles to be approached, locations of geographic features, locations of man-made structures, image information, and the like.
  • the communication system 110 enables communication with the control device 112 having the communication system 114 via a wireless signal 116 .
  • Communication systems 110, 114 may include any number of transmitters, receivers, and/or transceivers for wireless communication.
  • the communication may be one-way communication, so that data can be sent from one direction.
  • one-way communication may include that only the aircraft 100 transmits data to the control device 112, or vice versa.
  • One or more transmitters of communication system 110 may transmit data to one or more receivers of communication system 114, and vice versa.
  • the communication may be two-way communication, so that data may be transmitted between the aircraft 100 and the control device 112 in both directions. Two-way communication includes that one or more transmitters of communication system 110 can transmit data to one or more receivers of communication system 114, and vice versa.
  • control device 112 may provide control data to, and receive from, one or more of aircraft 100 , carrier 102 , and payload 104 .
  • Information eg position and/or motion information of the aircraft, carrier or payload, payload sensing data, eg image data captured by a camera such as a camera).
  • the control data for the control device may include instructions regarding position, movement, actuation, or control of the aircraft, carrier and/or load.
  • the control data may cause changes in the position and/or orientation of the aircraft (eg, by controlling the power mechanism 106 ), or cause movement of the carrier relative to the aircraft (eg, by controlling the carrier 102 ).
  • Control data from a control device can result in load control, such as controlling the operation of a camera or other image capture device (capturing still or moving images, zooming, turning on or off, switching shooting modes, changing image resolution, changing focus, changing depth of field, changing exposure time, changing the viewing angle or field of view).
  • the communication of the aircraft, carrier and/or payload may include information from one or more sensors (eg, sensing system 108 or payload 104).
  • the communication may include sensory information transmitted from one or more different types of sensors, such as GPS sensors, motion sensors, inertial sensors, proximity sensors, or image sensors.
  • the sensed information is about the position (eg, orientation, position), motion, or acceleration of the aircraft, carrier, and/or load.
  • the sensed information transmitted from the load includes the data captured by the load or the status of the load.
  • the control data transmitted by the control device 112 may be used to track the status of one or more of the aircraft 100, the carrier 102, or the payload 104.
  • carrier 102 and payload 104 may each include a communication module for communicating with control device 112 so that the control device may communicate or track aircraft 100 , carrier 102 and payload 104 individually.
  • aircraft 100 may communicate with other remote devices in addition to controls 112 , which may also communicate with other remote devices in addition to aircraft 100 .
  • the aircraft and/or controls 112 may be in communication with another aircraft or a carrier or payload of another aircraft.
  • the additional remote device may be a second control device or other computing device (eg, a computer, desktop, tablet, smartphone, or other mobile device).
  • the remote device may transmit data to the aircraft 100 , receive data from the aircraft 100 , transmit data to the control device 112 , and/or receive data from the control device 112 .
  • the remote device may be connected to the Internet or other telecommunications network to allow data received from aircraft 100 and/or controls 112 to be uploaded to a website or server.
  • the movement of the aircraft, the movement of the carrier, and the movement of the load relative to a fixed reference (eg, the external environment), and/or relative to each other, may be controlled by the control device.
  • the control device may be a remote control terminal, located remotely from the aircraft, carrier and/or load.
  • the control device may be located on or affixed to the support platform.
  • the control device may be hand-held or wearable.
  • the control device may include a smartphone, tablet, desktop, computer, glasses, gloves, helmet, microphone, or any combination thereof.
  • the control means may comprise a user interface such as a keyboard, mouse, joystick, touch screen or display. Any suitable user input may interact with the control device, such as manual input of commands, voice control, gesture control, or positional control (eg, by movement, position, or tilt of the control device).
  • the aircraft 100 may include one or more memories 102, and the memory 102 stores a computer program executed by the processor, for example, for storing corresponding steps and program instructions for implementing the image capturing method according to the embodiment of the present application.
  • One or more computer program products may be included, which may include various forms of computer-readable storage media, such as volatile memory and/or non-volatile memory.
  • the volatile memory may include, for example, random access memory (RAM) and/or cache memory, or the like.
  • the non-volatile memory may include, for example, read only memory (ROM), hard disk, flash memory, and the like.
  • Aircraft 100 may include one or more processors 101, which may be central processing units (CPUs), graphics processing units (GPUs), application specific integrated circuits (ASICs), field programmable gate arrays (FPGAs), or have data processing capabilities and/or other forms of processing units for instruction execution capabilities, and may control other components in aircraft 100 to perform desired functions.
  • the processor can execute the program instructions stored in the memory, so as to execute the relevant steps in the image capturing method of the embodiments of the present application described below.
  • a processor can include one or more embedded processors, processor cores, microprocessors, logic circuits, hardware finite state machines (FSMs), digital signal processors (DSPs), or combinations thereof.
  • the processor includes a Field Programmable Gate Array (FPGA), or one or more ARM processors.
  • the one-button shooting function usually needs to be selected by the user. For some new users, it is difficult to clearly select the appropriate shooting method or shooting angle at the beginning stage. to quickly capture great photos or videos.
  • an embodiment of the present application provides an image shooting method, the image shooting method includes: identifying a shooting target within a shooting range of a movable platform that meets preset shooting conditions; acquiring composition planning information matching the shooting target ; Based on the composition planning information, determine the target shooting position where the movable platform should be when shooting the shooting target; after controlling the movable platform to be at the target shooting position, control the shooting device to shoot the shooting target based on the composition planning information.
  • the shooting device after identifying a shooting target that meets the preset shooting conditions within the shooting range of the movable platform, the shooting device is controlled to shoot the shooting target based on the composition planning information, so that the user does not need to compose the image and so on. If you spend too much time, you can quickly use the preset composition planning information to assist the user to complete the shooting of the shooting device on the movable platform, and can shoot high-quality and effective images, reducing the user's learning cost and improving user experience.
  • the execution subject may be a movable platform (such as an aircraft), the capturing device is set on the movable platform, the movable platform and the control device are communicatively connected, and the execution subject may also be Part or all of the computer equipment that can realize the control of the movable platform and the control of the photographing device carried on the movable platform by software, hardware or a combination of software and hardware, or can also be a movable platform and a control device, which can be The mobile platform can perform some steps in the image capturing method, and the control device executes some steps in the image capturing method, for example, the control device performs display-related steps and acquires user instructions based on user operations, and outputs the user instructions to the movable platform, Steps such as making the movable platform move to the target shooting position according to the user's instruction, and shooting the shooting target.
  • the mobile platform can perform some steps in the image capturing method
  • the control device executes some steps in the image capturing method, for example, the control device performs display-
  • the image capturing method 200 includes the following steps S201 to S204:
  • step S201 a shooting target within the shooting range of the movable platform that meets the preset shooting conditions is identified.
  • the user can quickly understand the photographable sights or buildings near the movable platform.
  • the shooting target can be de-identified in real time during the flight of the movable platform, or, the control command input by the user through the control device to start automatic shooting can also be obtained.
  • the movable platform or the control device starts to identify the movable platform.
  • the control device may display an operation button corresponding to shooting, and may acquire a control instruction to start automatic shooting entered by the user through the operation button (eg, clicking the operation button).
  • Any suitable method may be used to identify the shooting targets within the shooting range of the movable platform that meet the preset shooting conditions, and there may be one or more shooting targets within the shooting range.
  • identifying a shooting target that meets a preset shooting condition within the shooting range of the movable platform includes: acquiring calibration information of the shootable object, wherein the calibration information includes at least one of the following information: the shooting object has been calibrated The shape feature information and the position marker information of the calibrated photographable objects; obtain the feature information of the photographable objects within the shooting range of the movable platform, and the feature information includes shape feature information and/or position information.
  • the calibration information includes at least one of the following information: shape feature information of the calibrated photographable object, position marker information of the calibrated photographable object, for example, the calibration information includes shape feature information of the calibrated photographable object,
  • the shape feature information of the calibrated photographable object includes at least one of the following feature information: the top-view shape feature of the photographable object, the side-view shape feature of the photographable object, or may also include other information that can identify the photographable object.
  • the shape feature of the photographed object, and the top-view shape feature of the photographable object may be, for example, the shape feature of the roof of a building.
  • the position marking information of the photographable object that has been calibrated may include the latitude and longitude coordinates of the photographable object, or any other coordinate information that can mark the position of the photographable object, and the like.
  • the calibration information can be obtained by pre-calibrating the shape features of photographable objects such as scenic spots or buildings.
  • a scenic spot composed of multiple rings in the top view can be set as a crop circle, as shown in Figure 3.
  • the strip-shaped building built on the mountain is set as the Great Wall
  • the spiral-rising high-rise building is set as the Canton Tower
  • the bamboo-shaped building is set as the Chunsun Building
  • the calibration information can be pre-stored in the memory of the mobile platform, or the calibration information can be stored in a server such as a cloud device, and can be directly retrieved and used when needed.
  • the feature information of the photographable objects within the shooting range of the movable platform can be obtained by any suitable method.
  • the feature information of the object includes: acquiring image information within the shooting range of the movable platform; and identifying the shape feature information of the shootable object within the shooting range of the movable platform based on the image information.
  • the image information may include image data captured by a camera lens (such as an infrared lens or a visible light lens) on the movable platform body, or may include image data collected by a binocular lens, or a Time of Flight (TOF) camera.
  • the collected image data, or the image data can also be a satellite map, such as a satellite map within the shooting range of the movable platform provided by the control device, etc.
  • the movable platform stored by the control device can be obtained by obtaining the information.
  • the shape feature information of the photographable objects in the image information can be recognized based on an intelligent recognition method such as machine learning, or the recognition can also be performed based on any other suitable method.
  • identifying the shooting targets within the shooting range of the movable platform that meet the preset shooting conditions further includes: after acquiring the feature information of the shootable objects within the shooting range of the movable platform, classifying the features of the shootable objects
  • the information and calibration information are matched to identify the shooting targets within the shooting range of the movable platform.
  • the shape features of the shooting targets that meet the preset shooting conditions are matched with the shape feature information of at least one calibrated photographable object, and the preset shooting conditions are satisfied.
  • the shape feature of the conditional photographing target matches the shape feature information of at least one calibrated photographable object, that is, the photographing target may be a calibrated photographable object, or may also be other photographable objects with substantially the same shape as the calibrated photographable object.
  • a photographic object, that is, the same calibrated photographable object corresponds to one or more photographic objects having substantially the same shape feature.
  • the position information of the shooting target that satisfies the preset shooting conditions matches the position mark information of a calibrated photographable object.
  • the corresponding shape of the target matches and the position information of the shooting target matches the position marker information in the calibration information, or, it can also be that only the position information matches the position marker information in the calibration information.
  • the location marker information of the calibration information includes geographic location information of one or more calibrated photographable objects, such as latitude and longitude coordinate information, and the feature information of the photographable objects and the calibration information are matched to identify the photographing of the movable platform.
  • the shooting targets within the range include: acquiring first position information, and identifying one or more shooting targets around the first position information that match the position marker information in the calibration information, wherein the first position information includes the following information. At least one: starting coordinate information when the movable platform starts to move, coordinate position information where the control device is located, current location information of the movable platform, or other information that can roughly characterize the location where the movable platform is located.
  • the mobile platform can be based on the GPS sensor carried by the mobile platform to obtain geographic location information (the starting coordinate information when the mobile platform starts to move or the current location information of the mobile platform), or the geographic location information obtained from the control device of the mobile platform.
  • Position information for example, coordinate position information where the control device is located, etc., based on one or more of these data to identify and acquire feature information of the photographable objects within the photographing range of the movable platform.
  • the method when the photographing method is performed by a control device communicatively connected to the movable platform, the method further includes: after recognizing one or more photographing targets within the photographing range of the movable platform that meet the preset photographing conditions , each shooting target is marked in the image information by the logo; the image information and each logo are displayed on the display interface of the control device, and the user can quickly know the information of the shooting target by identifying the shooting target, so that the user can decide whether to The target is photographed, and when multiple photographing targets are displayed, it is convenient for the user to intuitively select the target to be photographed.
  • the identification of the shooting target includes at least one of the following identification information: a pattern identification or a text identification, or may also include any other identification information that can identify the shooting target, and the pattern identification includes an arrow pattern identification or other identification information that can identify the shooting target.
  • Pattern identification for example, when a shooting target such as the Recocoon Stadium as shown in Figure 4 is identified within the shooting range of the movable platform (for example, within the flight range of the drone), a satellite map is displayed on the display interface of the control device, And mark the Chongcocoon Stadium on the satellite map with the arrow pointing.
  • the text identification may include the name or other text description of the shooting target.
  • the shooting target can also be identified by, for example, a digital identification. For example, when one shooting target is identified, a number "1" is used for identification, and when multiple shooting targets are identified, each The shooting targets are identified. For example, when three shooting targets are identified, "1, 2, and 3" are used to identify each shooting target.
  • image information is displayed on the display interface of the control device, and multiple shooting targets are displayed in the image information
  • the image information includes a satellite map or image data collected by sensors of the movable platform (for example, the control device communicates with the movable platform). connection, the control device can obtain the image data collected by the sensor of the movable platform in real time), when multiple shooting targets are identified, the image shooting method of the present application further includes: based on the user's selection instruction, determining the multiple shooting targets.
  • the control device selects one of the multiple shooting targets in the image information based on the selection instruction input by the user to shoot, for example, obtains the selection input by the user by, for example, clicking on one of the multiple shooting targets in the image information instruction, so as to select one of the multiple shooting targets in the image information for shooting.
  • step S202 the composition planning information matching the shooting target is acquired.
  • the composition planning information includes at least one of the following: a composition method, a preset height of the movable platform (that is, a preset height of the movable platform when the composition is preset), shooting parameters, and shooting orientation, wherein the composition method includes: the shooting target is in The proportion of the shooting picture, and/or the position of the shooting target in the shooting picture, or other composition methods that can make the shooting image better.
  • the shooting parameters include, but are not limited to, a preset field of view, exposure parameters, etc. corresponding to the preset composition. Based on the preset height of the movable platform and the preset field of view of the photographing device, an image corresponding to the composition mode can be photographed and acquired.
  • the composition planning information can be pre-stored in the memory of the movable platform, or stored in the memory of other computing devices that can communicate with the movable platform or the control device, and can be directly obtained when needed, so as to avoid users using the movable platform.
  • the above-mentioned shooting device spends too much time on composition and other aspects when shooting images, which improves the user experience and shooting efficiency.
  • acquiring the composition planning information matching the shooting target includes: acquiring composition planning information of at least one historically shot image of the shooting target; and determining the composition planning information of the shooting target based on the composition planning information of the at least one historically shot image
  • composition planning information such as the latitude, longitude and height when the mobile platform was photographed can be obtained according to the exif information of historically photographed images, such as the picture, and the preset composition can be performed through these information.
  • the composition planning information is used to photograph the photographic target.
  • the historical shooting images can be the shooting images collected by various photography applications (Application, APP for short), such as photos, videos, etc., which can be the most liked or viewed images for the user, or the user can select his/herself from the historical shooting images Any image you want to shoot.
  • photography applications Application, APP for short
  • photos, videos, etc. which can be the most liked or viewed images for the user, or the user can select his/herself from the historical shooting images Any image you want to shoot.
  • acquiring composition planning information that matches the shooting target includes: acquiring a data set of composition planning information of calibrated photographable objects, wherein the composition planning information of each calibrated photographable object is for each calibrated photographable object.
  • the satellite map around the photographable object is obtained by performing a preset composition, for example, by performing a preset composition on the satellite map, and adjusting the proportion of the shooting target such as a building in the picture, etc.; wherein, the data set of the composition planning information can be a preset composition.
  • step S203 based on the composition planning information, a target shooting position where the movable platform should be when shooting the shooting target is determined.
  • the target shooting position may include the target shooting height of the movable platform, that is, the height the movable platform should be at when shooting, and the target shooting position may also include geographic location information such as latitude and longitude coordinate information, which may be based on the selected shooting target.
  • geographic location information such as latitude and longitude coordinate information, which may be based on the selected shooting target.
  • the control device may obtain geographic location information of a selected photographing target based on a satellite map, and output the geographic location information to the movable platform.
  • the target shooting position includes a target shooting height
  • determining the target shooting position that the movable platform should be in when shooting the shooting target includes: based on the composition planning information and the current field of view of the shooting device, determining The estimated shooting height of the movable platform; obtain the restricted height around the position of the movable platform; compare the estimated shooting height with the limited height (when the movable platform is an aircraft, the limited height is also the limited flying height), Determine the target shooting height, so as to avoid the estimated shooting height being higher than the limit height, which will cause the movable platform to stray into the restricted flight area and cause potential safety risks.
  • the estimated shooting height that the movable platform should be at when shooting according to the composition planning information can be calculated based on any suitable method. For example, based on the composition planning information and the current field of view of the shooting device, determine the estimated shooting height of the movable platform.
  • the height includes: obtaining the current field of view of the shooting device of the movable platform; obtaining the preset field of view of the shooting device and the preset height of the movable platform in the preset composition based on the composition planning information; Field and current field of view to determine the estimated shooting height of the movable platform.
  • the estimated shooting height H can be calculated by the following formula (1):
  • V is the radius of the current field of view during actual shooting
  • is the current field of view (fov) of the shooting device during actual shooting.
  • the current field of view of the shooting device can be directly read from the shooting device. Since the actual shooting needs to be taken according to the composition planning information in the preset composition, the radius of the preset field of view in the preset composition and the current field of view in the actual shooting The radius is the same, which is represented by V in this paper.
  • the radius of the preset field of view can be calculated by the following formula (2):
  • is the preset field of view when the preset composition is used
  • h is the preset height of the movable platform when the preset composition is used.
  • comparing the estimated shooting height and the restricted height data to determine the target shooting height including: when the estimated shooting height is higher than the limited height, the target shooting height is set as the limited height; when the estimated shooting height is lower than the limit height; When it is equal to or equal to the limit height, the target shooting height is set to the estimated shooting height.
  • the restricted height can be obtained from local laws and regulations around the location where the movable platform is located.
  • the local laws and regulations stipulate the relevant provisions of the restricted flying area, and the restricted flying area can include at least one of the following: (1) Civil aviation Large airports; (2) General aviation fixed-wing airports; (3) Helicopter airports; (4) Special area restricted areas (such as restricted flight areas), such as Washington, Beijing, commercial areas, military areas, office areas, etc.; (5) other Restricted areas (eg, restricted areas), such as temporary restricted areas (eg, restricted areas).
  • the shooting method of the present application further includes: when the estimated shooting height is higher than the limit height, outputting first prompt information, which may be a movable platform such as a drone.
  • first prompt information may be a movable platform such as a drone.
  • the first prompt information is output, and the first prompt information may be, for example, a sound output by the movable platform or control an alarm device such as an LED light to flash for prompting.
  • the shooting effect of the preset composition may not be fully realized. Therefore, the user is prompted through the first prompt information so that the user can decide whether to continue shooting, and the automatic shooting can be ended based on the obtained user instruction.
  • the control device acquires and displays first prompt information
  • the first prompt information may be sent by a movable platform such as a drone when it is determined that the estimated shooting height is higher than the limit height, or it may be sent by the control device when the estimated shooting height is higher than the limit height.
  • the first prompt information can be text information or other information that can prompt the user.
  • the text information such as "the preset shooting height is higher than the limit height"
  • the manner of displaying the first prompt information includes, but is not limited to, flashing display, highlight display, differentiated font color, etc., so that the user can obtain the prompt information conspicuously and make a decision.
  • the shooting method of the present application further includes: acquiring the current power of the movable platform, and when it is determined that the power required for the movable platform to move from the current position to the target shooting position and return home is greater than the current power, the shooting is not triggered.
  • Shooting of the target that is, without triggering the movable platform such as the aircraft to fly to the target shooting position; when it is determined that the power required for the movable platform to move from the current position to the target shooting position and return home is less than the current power, the shooting of the shooting target is triggered.
  • such as controlling the movable platform to fly to the target shooting position so as to avoid the problem of unable to shoot due to insufficient power.
  • the method of the present application further includes: when it is determined that the power required for the movable platform to move from the current position to the target shooting position and return home is greater than the current power, output second prompt information, so that the user can know the reason why the automatic shooting cannot be triggered, so that the user can timely to replenish the battery or perform other operations.
  • the movable platform is controlled to move to the target shooting position.
  • step S204 after the movable platform is controlled to be at the target shooting position, the shooting device mounted on the movable platform is controlled to shoot the shooting target based on the composition planning information. Based on the composition planning information, the shooting device is controlled to shoot the shooting target, so that the user can quickly use the preset composition planning information to assist the user to complete the shooting of the shooting device on the movable platform without spending too much time on composition, etc., and It can shoot high-quality and effective images, reduce the user's learning cost, and improve the user's experience.
  • the image capturing method is executed by a control device that is communicatively connected to the movable platform, and after controlling the movable platform to be at the target shooting position, controlling the shooting device to shoot the shooting target based on the composition planning information, including: After the control device acquires the feedback information sent by the movable platform, it displays the feedback information, which is sent after the movable platform is in the target shooting position. “Location” and other text descriptions, so that users can know the information in time and proceed to the next step.
  • the image capturing method is performed by a movable platform, and the movable platform is communicatively connected to a control device.
  • the shooting device is controlled to shoot the shooting target based on the composition planning information, including: : After controlling the movable platform to be at the target shooting position, output feedback information, so that the control device displays the feedback information after acquiring the feedback information sent by the movable platform.
  • the control device displays options corresponding to each shooting mode of the shooting device based on user instructions, wherein the shooting modes include at least one of the following modes : single shot, stacking, panorama, 360° panorama, or any other shooting mode; then, obtain the mode selection instruction input by the user, for example, obtain the mode input by the user by clicking the shooting mode option displayed on the shooting mode setting interface Select the instruction, and determine the shooting mode for shooting according to the mode selection instruction, and the shooting device of the movable platform shoots the shooting target based on the shooting mode indicated by the mode selection instruction, so as to obtain a shooting image with a specific effect, and can make the user Familiarize yourself with the shooting effects of different shooting functions of the mobile platform shooting device faster, and increase your interest in shooting.
  • controlling the shooting device to shoot the shooting target based on the composition planning information includes: displaying a shooting effect diagram corresponding to the selected shooting mode on the display interface of the control device, and shooting
  • the renderings include a preset composition generated from one or more satellite maps that satisfies the composition planning information of the shooting target, or the renderings can also be obtained from the sensor of the movable platform after the movable platform is in the target shooting position. Live image data.
  • controlling the shooting device to shoot the shooting target based on the composition planning information including: controlling the device to acquire and display the estimated shooting time of the selected shooting mode, and the estimated shooting time That is, it refers to the time required for shooting according to the composition planning information, so that the user can decide whether to continue shooting.
  • controlling the shooting device to shoot the shooting target based on the composition planning information further comprising: acquiring the position of the light source, for example, acquiring current time information and weather information; Time information and weather information to determine the position of the light source; then, based on the position of the light source and the composition planning information, control the shooting device to shoot the target at one or more shooting angles, for example, according to the position of the light source, adjust the position of the shooting device so that the target is in the During the sunny day and sunset time, shooting is performed at one or more shooting angles such as the front light position, the side light position, and the backlight position.
  • the user does not need to manually adjust the shooting angle and learn the shooting skills of various shooting angles.
  • Shooting from multiple shooting angles so that you can quickly understand the shooting effects of different shooting angles, obtain images with multiple effects, save the time and energy spent by users on shooting, improve the user experience, and make non- Ordinary users of professional aerial photography can obtain more shooting images from shooting angles that cannot be noticed, increasing users' interest in aerial photography.
  • the position of the light source and the position of the photographing device for example, the position of the movable platform can be controlled and adjusted, or when the photographing device is set on the pan-tilt, the orientation of the pan-tilt can be controlled and adjusted to adjust the orientation of the photographing device.
  • the control device can obtain time information and weather information from, for example, satellite maps, applications with weather information, etc., and can output the time information and weather information to the movable platform, or the control device can directly output the position information of the light source, and the movable platform can obtain the light source. location information.
  • the image capturing method of the present application further includes: acquiring an image captured by the capturing device, and displaying the image on a display interface of the control device.
  • the shooting device after identifying the shooting target that meets the preset shooting conditions within the shooting range of the movable platform, the shooting device is controlled to shoot the shooting target based on the composition planning information, so that the user is not required to shoot. If you spend too much time on composition and other aspects, you can quickly use the preset composition planning information to assist the user to complete the shooting of the shooting device on the movable platform, and can shoot high-quality and effective images, reducing the user's The learning cost improves the user experience.
  • An embodiment of the present application also provides a movable platform, and the movable platform may include an aircraft (eg, an unmanned aerial vehicle), a robot, an unmanned vehicle, a ship, a gimbal, and the like.
  • the embodiments of the present application mainly take the case where the movable platform is an aircraft as an example.
  • the movable platform may include: a movable platform body 500, a photographing device 504, a communication interface (also referred to as a communication system herein, when the movable platform is an aircraft, the communication interface may correspond to the foregoing communication system 110),
  • the memory 502 one or more processors 501, the photographing device 504 is arranged on the movable platform body 500 for photographing images, the communication interface 504 is at least used for communicating with the control device, and the memory 502 is used for storing executable program instructions;
  • the movable platform may also have a power mechanism, and the power mechanism is used to move the movable platform; one or more processors 501 are configured to execute program instructions stored in the memory, so that the processor executes the relevant steps of the image capturing method in the foregoing embodiments,
  • the foregoing description of the image capturing method which will not be repeated here.
  • the one or more processors 501 are configured to execute program instructions stored in the memory 502, so that the processors perform the following steps: identifying a shooting target within the shooting range of the movable platform that meets preset shooting conditions; Matching composition planning information; based on the composition planning information, determine the target shooting position that the movable platform should be in when shooting the shooting target; after controlling the movable platform to be at the target shooting position, control the shooting device to shoot the shooting target based on the composition planning information. shoot.
  • the processor 501 identifies a shooting target within the shooting range of the movable platform that meets a preset shooting condition, including: acquiring calibration information of the shootable object, where the calibration information includes at least one of the following information: calibrated The shape feature information of the photographable objects and the position mark information of the calibrated photographable objects; obtain the feature information of the photographable objects within the shooting range of the movable platform, and the feature information includes shape feature information and/or position information; The feature information and the calibration information are matched to identify the shooting target within the shooting range of the movable platform, wherein the shape feature of the shooting target that satisfies the preset shooting conditions matches the shape feature information of at least one calibrated photographable object, and /or, the location information of the photographing target is matched with the location marker information of a calibrated photographable object.
  • the calibration information includes at least one of the following information: calibrated The shape feature information of the photographable objects and the position mark information of the calibrated photographable objects; obtain the feature information of the photographable objects within the shooting
  • the shape feature information of the calibrated photographable object includes at least one of the following feature information: a top-view shape feature of the photographable object, and a side-view shape feature of the photographable object.
  • the composition planning information includes at least one of the following: composition mode, height of the movable platform during shooting, shooting parameters, and shooting orientation, wherein the composition mode includes: the proportion of the shooting target in the shooting picture, and/or , the position of the shooting target in the shooting screen.
  • the processor 501 acquires the feature information of the photographable object within the photographing range of the movable platform, including: acquiring the photographic object within the photographing range of the movable platform. Image information; based on the image information, identify the shape feature information of the photographable objects within the photographing range of the movable platform.
  • the image information includes at least one of the following information: satellite maps, image data collected by sensors of the movable platform, etc., satellite maps such as satellite maps within the shooting range of the movable platform provided by the control device, etc.
  • the satellite map within the shooting range of the movable platform stored by the control device can be obtained, or when the satellite map is not stored, the current position information of the movable platform or the current position information of the control device can also be obtained. Download the location information to obtain a satellite map within the shooting range of the mobile platform.
  • the processor 501 is further configured to: after identifying one or more shooting targets within the shooting range of the movable platform that meet the preset shooting conditions, mark each shooting target with an identifier in the image information; output the image information and logos, so that the control device displays image information and each logo on the display interface.
  • the identification includes at least one of the following identification information: a pattern identification or a character identification, and the pattern identification includes an arrow pattern identification.
  • the location marker information includes geographic location information of the calibrated photographable object, such as latitude and longitude coordinate information
  • the processor 501 matches the feature information of the photographable object with the calibration information to identify the photographing target within the photographing range of the movable platform , including: acquiring first position information, where the first position information includes at least one of the following information: the starting coordinate information when the movable platform starts to move, the coordinate position information where the control device is located;
  • the location tag information matches one or more shooting targets.
  • Image information is displayed on the display interface of the control device, and multiple shooting targets are displayed in the image information.
  • the image information includes a satellite map or image data collected by sensors of a movable platform.
  • the processor 501 is further configured to: determine one of the multiple shooting targets to shoot based on the user's selection instruction, for example, the processor obtains the selection instruction output by the control device, and determines one of the multiple shooting targets to shoot, that is, to determine Select the subject indicated by the command to shoot.
  • the processor 501 obtains composition planning information matching the shooting target, including: obtaining composition planning information of at least one historically captured image of the shooting target;
  • composition planning information for example, the control device acquires composition planning information of at least one historically captured image, and outputs the compositional planning information, and the processor 501 acquires the compositional planning information of at least one historically captured image from the control device.
  • the processor 501 obtains composition planning information matching the shooting target, including: obtaining a data set of composition planning information of the calibrated photographable objects, wherein the composition planning information of each calibrated photographable object is for each The satellite map around the object that can be photographed has been calibrated and obtained by preset composition; the composition planning information matching the shooting target is obtained from the data set.
  • the same calibrated photographable object corresponds to one or more photographic targets having substantially the same shape feature.
  • the target shooting position includes the target shooting height
  • the processor 501 determines, based on the composition planning information, the target shooting position that the movable platform should be in when shooting the shooting target, including: based on the composition planning information and the current view of the shooting device field, determine the estimated shooting height of the movable platform; obtain the restricted height around the location of the movable platform; compare the estimated shooting height with the limited height to determine the target shooting height.
  • the processor 501 compares the estimated shooting height with the restricted height data, and determines the target shooting height, including: when the estimated shooting height is higher than the limited height, the target shooting height is set as the limited height; when the estimated shooting height is higher than the limited height; When the shooting height is lower than or equal to the limit height, the target shooting height is set as the estimated shooting height.
  • the processor 501 determines the estimated shooting height of the movable platform based on the composition planning information and the current field of view of the shooting device, including: acquiring the current field of view of the shooting device of the movable platform; based on the composition planning information, acquiring When the composition is preset, the preset field of view of the shooting device and the preset height of the movable platform are determined; the estimated shooting height of the movable platform is determined based on the preset height, the preset field of view, and the current field of view.
  • the processor 501 is further configured to: output the first prompt information when the estimated shooting height is higher than the limit height. It can be a movable platform such as a drone that outputs first prompt information when it is determined that the estimated shooting height is higher than the limit height.
  • the first prompt information can be, for example, a sound output by the movable platform or control an alarm device such as an LED light to flash to prompt.
  • the processor 501 is further configured to: when the estimated shooting height is higher than the limit height, output the first prompt information, so that the control device acquires and displays the first prompt information.
  • the processor 501 is further configured to: acquire the current power of the movable platform, and when it is determined that the power required for the movable platform to move from the current position to the target shooting position and return home is greater than the current power, then do not trigger the shooting of the target shooting; when it is determined that the power required for the movable platform to move from the current position to the target shooting position and return home is less than the current power, the shooting of the shooting target is triggered.
  • the processor 501 is further configured to: when it is determined that the power required for the movable platform to move from the current position to the target shooting position and return home is greater than the current power, output the second prompt information, so that the control device obtains and displays the first Two prompt information.
  • the processor 501 controls the shooting device to shoot the shooting target based on the composition planning information, including: after controlling the movable platform to be at the target shooting position, outputting feedback information to After the control device obtains the feedback information, the feedback information is displayed, and the control device is caused to display options corresponding to each shooting mode of the shooting device based on the user's instruction, wherein the shooting mode includes at least one of the following modes: single shooting, stacking, Panorama and 360° panorama; obtain the mode selection instruction output by the control device, and determine the shooting mode for shooting according to the mode selection instruction.
  • the processor 501 controls the shooting device to shoot the shooting target based on the composition planning information, including: when the mode selection instruction output by the control device is acquired, outputting the selected The shooting effect map corresponding to the shooting mode, so that the control device displays the shooting effect map corresponding to the selected shooting mode, and the shooting effect map includes a preset composition generated from one or more satellite maps that meets the composition planning information of the shooting target.
  • the processor 501 controls the shooting device to shoot the shooting target based on the composition planning information, including: when the mode selection instruction output by the control device is acquired, outputting the selected The estimated shooting time corresponding to the shooting mode, so that the control device acquires and displays the estimated shooting time of the selected shooting mode.
  • the processor 501 controls the shooting device to shoot the shooting target based on the composition planning information, including: acquiring current time information and weather information; based on the time information and weather information, Determine the position of the light source; based on the position of the light source and the composition planning information, control the photographing device to photograph the photographing target at one or more photographing angles.
  • the shooting device is controlled to shoot the shooting target based on the composition planning information, so that the user does not need to compose the picture, etc. If you spend too much time in the aspect, you can quickly use the preset composition planning information to assist the user to complete the shooting of the shooting device on the movable platform, and can shoot high-quality and effective images, reducing the user's learning cost, Improve the user experience.
  • an embodiment of the present application further provides a control device for a movable platform, and the control device may be an external device independent of the movable platform, such as a control device for the movable platform.
  • the control device may include, for example, a control device for a movable platform.
  • Mobile phone, remote control, tablet computer, notebook, etc. the control device can also be a part or all of the control system of the mobile platform, or can realize the control method of the mobile platform through software, hardware or a combination of software and hardware. part or all of computer equipment.
  • the control device 600 of the movable platform includes one or more memories 601, one or more processors 602, a communication interface 603 (which may correspond to the communication system 114 in FIG. 1), a display 604, etc., These components are interconnected by a bus system and/or other form of connection mechanism (not shown). It should be noted that the components and structures of the device 600 shown in FIG. 6 are only exemplary and not restrictive, and the control device 600 may also have other components and structures as required.
  • the processor 602 is configured to execute the program instructions stored in the memory 601, so that the processor executes some steps and all steps of the image capturing method in the foregoing, wherein, in order to avoid repetition, for the detailed description of some steps, reference may be made to the foregoing, which will not be repeated here. Repeat.
  • the memory 601 is used to store various data and executable program instructions generated during the movement of the relevant movable platform, for example, used to store various application programs or algorithms for implementing various specific functions.
  • One or more computer program products may be included, and the computer program products may include various forms of computer-readable storage media, such as volatile memory and/or non-volatile memory.
  • Volatile memory may include, for example, random access memory (RAM) and/or cache memory, among others.
  • Non-volatile memory may include, for example, read only memory (ROM), hard disk, flash memory, and the like.
  • Processor 602 may be a central processing unit (CPU), graphics processing unit (GPU), application specific integrated circuit (ASIC), field programmable gate array (FPGA), or other form of processing with data processing capabilities and/or instruction execution capabilities unit, and may control other components in device 600 to perform desired functions.
  • a processor can include one or more embedded processors, processor cores, microprocessors, logic circuits, hardware finite state machines (FSMs), digital signal processors (DSPs), graphics processing units (GPUs), or the like The combination.
  • FSMs hardware finite state machines
  • DSPs digital signal processors
  • GPUs graphics processing units
  • the display 604 is used to display various visual information, for example, the visual information includes, but is not limited to, image data returned by the movable platform, various operation pages, images captured by the photographing device, and the like.
  • the control device 600 of the movable platform may include one or more memories 601 for storing executable program instructions, and a processor 602 for executing the program instructions stored in the memory 601, so that the processor executes the following Steps: Identify the shooting target that meets the preset shooting conditions within the shooting range of the movable platform; obtain composition planning information that matches the shooting target; based on the composition planning information, determine the target shooting where the movable platform should be when shooting the shooting target position; output control instructions, so that after the movable platform obtains the control instructions, it moves to the target shooting position based on the control instructions, and enables the movable platform to control the shooting device to shoot the shooting target based on the composition planning information.
  • the processor 602 identifies a shooting target that meets a preset shooting condition within the shooting range of the movable platform, including: acquiring calibration information of the shootable object, wherein the calibration information includes at least one of the following information: calibrated The shape feature information of the photographable object, the position marker information of the calibrated photographable object; the calibration information can be stored in the memory of the movable platform, or in other servers, and the control device can obtain the calibration information from the movable platform or the server, Obtain the feature information of the photographable objects within the shooting range of the movable platform, and the feature information includes shape feature information and/or position information; Shooting targets, wherein the shape features of the shooting targets that meet the preset shooting conditions are matched with the feature information of at least one calibrated photographable object, and/or the position information of the shooting target and the position mark information of a calibrated photographable object match.
  • the calibration information includes at least one of the following information: calibrated The shape feature information of the photographable object, the position marker information of the calibrated photographable object
  • the shape feature information of the calibrated photographable object includes at least one of the following feature information: a top-view shape feature of the photographable object, and a side-view shape feature of the photographable object.
  • the same calibrated photographable object corresponds to one or more photographic targets having substantially the same shape feature.
  • control device obtains feature information output by the movable platform, or the control device obtains image information output from the movable platform, such as image data collected by a sensor, etc., and the processor 602 automatically identifies the shape features of the photographable objects in the image information. information, or, the processor 602 obtains the shape feature information of the photographable objects in the satellite map to automatically identify the satellite map, or the processor 602 obtains the position information of the photographing target output by the position sensor of the movable platform, and the like.
  • the processor 602 acquires the feature information of the photographable object within the photographing range of the movable platform, including: acquiring the photographic object within the photographing range of the movable platform. Image information; based on the image information, identify the shape feature information of the photographable objects within the photographing range of the movable platform.
  • the image information includes at least one of the following information: a satellite map, and image data collected by sensors of the movable platform.
  • the processor 602 is configured to mark each shooting target with an identifier in the image information, and the image information includes the following information At least one of: satellite map, image data collected by sensors of the movable platform; the display 604 is used to display image information and various signs.
  • the identification includes at least one of the following identification information: a pattern identification or a character identification, and the pattern identification includes an arrow pattern identification.
  • the location marker information includes geographic location information of one or more calibrated photographable objects
  • the processor 602 matches the feature information of the photographable objects with the calibration information to identify the photographing target within the photographing range of the movable platform , including: acquiring first position information, where the first position information includes at least one of the following information: the starting coordinate information when the movable platform starts to move, the coordinate position information where the control device is located;
  • the location tag information matches one or more shooting targets.
  • the processor 602 is further configured to: select one of the multiple shooting targets in the image information for shooting based on a selection instruction input by the user.
  • the processor is configured to acquire composition planning information matching the shooting target, including: acquiring composition planning information of at least one historically shot image of the shooting target; and determining the composition planning information of the shooting target based on the composition planning information of at least one historically shot image Composition planning information, and outputting the composition planning information, so that the movable platform obtains the composition planning information and shoots the shooting target based on the composition planning information.
  • the processor is configured to acquire composition planning information that matches the shooting target, including: acquiring a dataset of composition planning information of calibrated photographable objects, wherein the composition planning information of each calibrated photographable object is for each Obtained by pre-setting the composition on the satellite map around the target that has been calibrated; obtaining the composition planning information matching the shooting target from the data set, and outputting the composition planning information, so that the mobile platform can obtain the composition planning information and based on the composition planning information
  • the composition planning information is used to photograph the photographic target.
  • the composition planning information includes at least one of the following: composition mode, preset height of the movable platform, shooting parameters, and shooting orientation, wherein the composition mode includes: the proportion of the shooting target in the shooting picture, and/or , the position of the shooting target in the shooting screen.
  • the target shooting position includes the target shooting height
  • the processor 602 determines, based on the composition planning information, the target shooting position that the movable platform should be in when shooting the shooting target, including: based on the composition planning information and the current first position of the shooting device In a field of view, determine the estimated shooting height of the movable platform; obtain the restricted height around the position of the movable platform; compare the estimated shooting height with the limited height to determine the target shooting height.
  • the processor 602 determines the estimated shooting height of the movable platform based on the composition planning information and the current field of view of the shooting device, including: acquiring the current field of view of the shooting device of the movable platform; When the composition is preset, the preset field of view of the shooting device and the preset height of the movable platform are determined; the estimated shooting height of the movable platform is determined based on the preset height, the preset field of view, and the current field of view.
  • the processor 602 compares the estimated shooting height with the limited height data, and determines the target shooting height, including: when the estimated shooting height is higher than the limited height, the target shooting height is set as the limited height; when the estimated shooting height is higher than the limited height; When the shooting height is lower than or equal to the limit height, the target shooting height is set as the estimated shooting height.
  • the display 604 is further configured to: acquire and display first prompt information, where the first prompt information is used to prompt that the estimated shooting height of the movable platform is higher than the limit height.
  • the first prompt information is output when the processor 602 determines that the estimated shooting height is higher than the limit height, or the first prompt information is output when the movable platform determines that the estimated shooting height is higher than the limit height. of.
  • the display 604 is further configured to acquire and display second prompt information, where the second prompt information is used to prompt the movable platform to move from the current position to the target shooting position and return to the home, and the required power is greater than the current power, and the target shooting position includes Target shooting height, target shooting height includes estimated shooting height or restricted height.
  • the display 604 is further configured to: acquire and display feedback information output after the movable platform is in the target shooting position; and display options corresponding to each shooting mode of the shooting device based on user instructions, wherein the shooting modes include the following modes At least one of: Single Shot, Felling, Panorama, 360° Panorama.
  • the processor 602 is further configured to: obtain a mode selection instruction input by the user, determine a shooting mode for shooting according to the mode selection instruction, and output the mode selection instruction, so as to control the shooting device of the movable platform based on the corresponding the shooting mode to shoot.
  • the display 604 is further configured to: display a shooting effect map corresponding to the selected shooting mode, where the shooting effect map includes a preset composition generated from one or more satellite maps and satisfying the composition planning information of the shooting target.
  • the display 604 is further configured to: display the estimated shooting time corresponding to the selected shooting mode.
  • the display 604 is further configured to display at least one of the following information: weather information, time information, location information, and light source location information.
  • control device 600 further includes an output device that can output various information (eg, images or sounds) to the outside (eg, a user), and may include one or more of a display, a speaker, and the like.
  • an output device that can output various information (eg, images or sounds) to the outside (eg, a user), and may include one or more of a display, a speaker, and the like.
  • control device 600 further includes a display, which can be used to obtain a grid map of the restricted area, and display the grid map on the display interface.
  • control device 600 further includes a communication interface 603 for communicating between various components in the control device 600 and between the various components of the control device 600 and other devices outside the system, for example, when the device is an external device When the device is installed, it can communicate with the movable platform through the communication interface, so that information can be exchanged between the two.
  • the communication interface 603 is an interface that can be any currently known communication protocol, such as a wired interface or a wireless interface, wherein the communication interface can include one or more serial ports, a USB interface, an Ethernet port, WiFi, a wired network, and a DVI interface,
  • the device integrates interconnect modules or other suitable various ports, interfaces, or connections.
  • Device 600 may also access wireless networks based on communication standards, such as WiFi, 2G, 3G, 4G, 6G, or a combination thereof.
  • the communication interface receives broadcast signals or broadcast related information from an external broadcast management system via a broadcast channel.
  • the communication interface further includes a near field communication (NFC) module to facilitate short-range communication.
  • the NFC module may be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.
  • RFID radio frequency identification
  • IrDA infrared data association
  • UWB ultra-wideband
  • device 600 also includes an input device (not shown) that may be a device used by a user to input instructions, and may include one or more of a keyboard, trackball, mouse, microphone, touch screen, etc., or other controls An input device consisting of buttons.
  • an input device may be a device used by a user to input instructions, and may include one or more of a keyboard, trackball, mouse, microphone, touch screen, etc., or other controls An input device consisting of buttons.
  • control device in the embodiment of the present application is used to implement the aforementioned image capturing method, and thus also has the advantages of the aforementioned image capturing method.
  • the embodiments of the present application further provide a computer storage medium, such as a computer-readable storage medium, on which a computer program is stored.
  • a computer storage medium such as a computer-readable storage medium
  • One or more computer program instructions may be stored on the computer storage medium, and the processor may execute the program instructions stored in the memory to implement the functions (implemented by the processor) in the embodiments of the present application described herein and/or or other desired functions, for example, to execute the corresponding steps of the image capturing method 200 according to the embodiment of the present application
  • various application programs and various data may also be stored in the computer-readable storage medium, for example, the application program uses and/or various data generated, etc.
  • the computer-readable storage medium may include, for example, a memory card of a smartphone, a storage component of a tablet computer, a hard disk of a personal computer, a read only memory (ROM), an erasable programmable read only memory (EPROM), a portable compact disk read only memory (CD-ROM), USB memory, or any combination of the above storage media.
  • the computer-readable storage medium can be any combination of one or more computer-readable storage media.
  • the disclosed apparatus and method may be implemented in other manners.
  • the device embodiments described above are only illustrative.
  • the division of the units is only a logical function division. In actual implementation, there may be other division methods.
  • multiple units or components may be combined or May be integrated into another device, or some features may be omitted, or not implemented.
  • Various component embodiments of the present application may be implemented in hardware, or in software modules running on one or more processors, or in a combination thereof.
  • a microprocessor or a digital signal processor (DSP) may be used in practice to implement some or all functions of some modules according to the embodiments of the present application.
  • DSP digital signal processor
  • the present application can also be implemented as a program of apparatus (eg, computer programs and computer program products) for performing part or all of the methods described herein.
  • Such a program implementing the present application may be stored on a computer-readable medium, or may be in the form of one or more signals. Such signals may be downloaded from Internet sites, or provided on carrier signals, or in any other form.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Studio Devices (AREA)

Abstract

An image photographing method, a control apparatus, a movable platform, and a computer storage medium. The image photographing method (200) comprises: identifying a photographic target, that meets a preset photographic condition, within the photographic range of a movable platform (S201); acquiring image composition planning information matching the photographic target (S202); on the basis of the image composition planning information, determining a target photographic position where the movable platform should be located when photographing the photographic target (S203); and after controlling the movable platform to be at the target photographic position, controlling, on the basis of the image composition planning information, a photographic apparatus mounted on the movable platform to photograph the photographic target (S204). According to the method, a user can be quickly assisted to complete photographing by a photographic apparatus on a movable platform using preset image composition planning information without spending too much time on image composition, etc., thereby reducing learning costs of the user.

Description

影像拍摄方法、控制装置、可移动平台和计算机存储介质Image shooting method, control device, movable platform and computer storage medium
说明书manual
技术领域technical field
本发明总地涉及数据处理技术领域,更具体地涉及一种影像拍摄方法、控制装置、可移动平台和计算机存储介质。The present invention generally relates to the technical field of data processing, and more particularly, to an image capturing method, a control device, a movable platform and a computer storage medium.
背景技术Background technique
对于互联网时代下的用户,快速高质的完成无人机航拍是一件极其重要的事情。尤其对于刚尝试无人机航拍的新用户来说,练习无人机的飞行已经耗费一定精力,如果还要在构图方面花费心思,可能会造成一部分用户对航拍丧失兴趣。For users in the Internet era, it is extremely important to complete drone aerial photography quickly and with high quality. Especially for new users who have just tried drone aerial photography, it takes a certain amount of energy to practice the flight of drones. If they still need to pay attention to composition, it may cause some users to lose interest in aerial photography.
目前虽然有些无人机配置一键拍摄的功能,但该一键拍摄的功能通常需要用户自行选择,对于一些新用户来说,很难在初学阶段能够清楚明白的选用适合的拍摄方式或者拍摄角度来快速拍摄精彩照片或视频。At present, although some drones are equipped with the one-button shooting function, the one-button shooting function usually needs to be selected by the user. For some new users, it is difficult to clearly select the appropriate shooting method or shooting angle at the beginning stage. to quickly capture great photos or videos.
发明内容SUMMARY OF THE INVENTION
为了解决上述问题中的至少一个而提出了本申请。具体地,本申请一方面提供一种影像拍摄方法,所述影像拍摄方法包括:识别可移动平台的拍摄范围内满足预设拍摄条件的拍摄目标;获取和所述拍摄目标相匹配的构图规划信息;基于所述构图规划信息,确定对所述拍摄目标进行拍摄时所述可移动平台应处于的目标拍摄位置;当控制所述可移动平台处于所述目标拍摄位置后,基于所述构图规划信息控制所述可移动平台搭载的拍摄装置对所述拍摄目标进行拍摄。The present application has been made to solve at least one of the above-mentioned problems. Specifically, one aspect of the present application provides an image shooting method, the image shooting method includes: identifying a shooting target within a shooting range of a movable platform that meets preset shooting conditions; acquiring composition planning information matching the shooting target ; Based on the composition planning information, determine the target shooting position that the movable platform should be in when shooting the shooting target; After controlling the movable platform to be in the target shooting position, based on the composition planning information The photographing device mounted on the movable platform is controlled to photograph the photographing target.
本申请又一方面提供一种可移动平台,所述可移动平台包括:Another aspect of the present application provides a movable platform, the movable platform includes:
可移动平台本体;Movable platform body;
拍摄装置,设置于所述可移动平台本体,用于拍摄影像;a photographing device, arranged on the movable platform body, for photographing images;
通信接口,用于和控制装置通信连接;A communication interface for communicating with the control device;
存储器,用于存储可执行的程序指令;memory for storing executable program instructions;
一个或多个处理器,用于执行所述存储器中存储的所述程序指令,使得所述处理器执行以下步骤:识别所述可移动平台的拍摄范围内满足预设拍摄条件的拍摄目标;获取和所述拍摄目标相匹配的构图规划信息;基于所述构图规划信息,确定对所述拍摄目标进行拍摄时所述可移动平台应处于的目标拍摄位置;当控制所述可移动平台处于所述目标拍摄位置后,基于所述构图规划信息控制所述拍摄 装置对所述拍摄目标进行拍摄。one or more processors, configured to execute the program instructions stored in the memory, so that the processors perform the following steps: identifying the shooting targets that meet preset shooting conditions within the shooting range of the movable platform; obtaining composition planning information matched with the shooting target; based on the composition planning information, determine the target shooting position that the movable platform should be in when shooting the shooting target; when the movable platform is controlled to be in the After the target shooting position is determined, the shooting device is controlled to shoot the shooting target based on the composition planning information.
本申请再一方面提供一种控制装置,所述控制装置包括:Yet another aspect of the present application provides a control device, the control device comprising:
通信接口,至少用于和可移动平台进行通信,其中,所述可移动平台上设置有拍摄装置;a communication interface, at least used to communicate with a movable platform, wherein a photographing device is provided on the movable platform;
存储器,用于存储可执行的程序指令;memory for storing executable program instructions;
一个或多个处理器,用于执行所述存储器中存储的所述程序指令,使得所述处理器执行以下步骤:one or more processors for executing the program instructions stored in the memory, causing the processors to perform the following steps:
识别所述可移动平台的拍摄范围内满足预设拍摄条件的拍摄目标;Identify the shooting targets that meet the preset shooting conditions within the shooting range of the movable platform;
获取和所述拍摄目标相匹配的构图规划信息;acquiring composition planning information that matches the shooting target;
基于所述构图规划信息,确定对所述拍摄目标进行拍摄时所述可移动平台应处于的目标拍摄位置;determining, based on the composition planning information, a target shooting position that the movable platform should be in when shooting the shooting target;
输出控制指令,以使所述可移动平台获取到所述控制指令后,基于所述控制指令移动到所述目标拍摄位置,并使所述可移动平台基于所述构图规划信息控制所述拍摄装置对所述拍摄目标进行拍摄;outputting a control instruction, so that the movable platform moves to the target shooting position based on the control instruction after acquiring the control instruction, and enables the movable platform to control the shooting device based on the composition planning information photographing the photographing target;
显示器,用于显示可视化信息。A display for displaying visual information.
本申请另一方面还提供一种计算机存储介质,其上存储有计算机程序,所述计算机程序被处理器执行时实现前述的影像拍摄方法。Another aspect of the present application further provides a computer storage medium on which a computer program is stored, and when the computer program is executed by a processor, the aforementioned image capturing method is implemented.
本申请实施例中的影像拍摄方法、可移动平台、控制装置和计算机存储介质,当识别到可移动平台的拍摄范围内满足预设拍摄条件的拍摄目标后,基于构图规划信息控制拍摄装置对拍摄目标进行拍摄,从而无需用户在构图等方面花费过多的时间,即可快速的利用预设的构图规划信息协助用户完成可移动平台上拍摄装置的拍摄,且能够拍摄出高质量和效果很好的影像,降低了用户的学习成本,提升了用户的使用体验。In the image shooting method, movable platform, control device and computer storage medium in the embodiments of the present application, after identifying the shooting target within the shooting range of the movable platform that meets the preset shooting conditions, the shooting device is controlled based on the composition planning information to shoot the shooting target. Target shooting, so that users can quickly use the preset composition planning information to assist users to complete the shooting of the shooting device on the movable platform without spending too much time on composition, etc., and can shoot with high quality and good effect. , which reduces the user's learning cost and improves the user's experience.
附图说明Description of drawings
为了更清楚地说明本申请实施例中的技术方案,下面将对实施例描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本申请的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动性的前提下,还可以根据这些附图获得其他的附图。In order to illustrate the technical solutions in the embodiments of the present application more clearly, the following briefly introduces the drawings that are used in the description of the embodiments. Obviously, the drawings in the following description are only some embodiments of the present application. For those of ordinary skill in the art, other drawings can also be obtained from these drawings without creative labor.
图1示出了本申请一个实施例中的飞行器的示意图;FIG. 1 shows a schematic diagram of an aircraft in an embodiment of the present application;
图2示出了本申请一个实施例中的影像拍摄方法的流程图;FIG. 2 shows a flowchart of an image capturing method in an embodiment of the present application;
图3示出了本申请一个实施例中的多个环状物的景点的示意图;Fig. 3 shows the schematic diagram of the scenic spots of a plurality of loops in an embodiment of the present application;
图4示出了本申请一个实施例中的卫星地图的示意图;FIG. 4 shows a schematic diagram of a satellite map in an embodiment of the present application;
图5示出了本申请一个实施例中的可移动平台的示意性框图;FIG. 5 shows a schematic block diagram of a movable platform in an embodiment of the present application;
图6示出了本申请一个实施例中的控制装置的示意性框图。FIG. 6 shows a schematic block diagram of a control device in an embodiment of the present application.
具体实施方式Detailed ways
为了使得本申请的目的、技术方案和优点更为明显,下面将参照附图详细描述根据本申请的示例实施例。显然,所描述的实施例仅仅是本申请的一部分实施例,而不是本申请的全部实施例,应理解,本申请不受这里描述的示例实施例的限制。In order to make the objectives, technical solutions and advantages of the present application more apparent, the exemplary embodiments according to the present application will be described in detail below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments of the present application, and it should be understood that the present application is not limited by the example embodiments described herein.
在下文的描述中,给出了大量具体的细节以便提供对本申请更为彻底的理解。然而,对于本领域技术人员而言显而易见的是,本申请可以无需一个或多个这些细节而得以实施。在其他的例子中,为了避免与本申请发生混淆,对于本领域公知的一些技术特征未进行描述。In the following description, numerous specific details are set forth in order to provide a more thorough understanding of the present application. It will be apparent, however, to one skilled in the art that the present application may be practiced without one or more of these details. In other instances, some technical features known in the art have not been described in order to avoid confusion with the present application.
应当理解的是,本申请能够以不同形式实施,而不应当解释为局限于这里提出的实施例。相反地,提供这些实施例将使公开彻底和完全,并且将本申请的范围完全地传递给本领域技术人员。It should be understood that the application may be embodied in different forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of this application to those skilled in the art.
在此使用的术语的目的仅在于描述具体实施例并且不作为本申请的限制。在此使用时,单数形式的“一”、“一个”和“所述/该”也意图包括复数形式,除非上下文清楚指出另外的方式。还应明白术语“组成”和/或“包括”,当在该说明书中使用时,确定所述特征、整数、步骤、操作、元件和/或部件的存在,但不排除一个或更多其它的特征、整数、步骤、操作、元件、部件和/或组的存在或添加。在此使用时,术语“和/或”包括相关所列项目的任何及所有组合。The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. As used herein, the singular forms "a," "an," and "the/the" are intended to include the plural forms as well, unless the context clearly dictates otherwise. It should also be understood that the terms "compose" and/or "include", when used in this specification, identify the presence of stated features, integers, steps, operations, elements and/or components, but do not exclude one or more other The presence or addition of features, integers, steps, operations, elements, parts and/or groups. As used herein, the term "and/or" includes any and all combinations of the associated listed items.
为了彻底理解本申请,将在下列的描述中提出详细的结构和方法,以便阐释本申请提出的技术方案。本申请的可选实施例详细描述如下,然而除了这些详细描述外,本申请还可以具有其他实施方式。For a thorough understanding of the present application, detailed structures and methods will be presented in the following description in order to explain the technical solutions proposed by the present application. Alternative embodiments of the present application are described in detail below, however, the present application may have other embodiments in addition to these detailed descriptions.
下面结合附图,对本申请的影像拍摄方法、控制装置、可移动平台和计算机存储介质进行详细说明。在不冲突的情况下,下述的实施例及实施方式中的特征可以相互组合。The image capturing method, control device, movable platform and computer storage medium of the present application will be described in detail below with reference to the accompanying drawings. The features of the embodiments and implementations described below may be combined with each other without conflict.
需要说明的是,本申请实施例提供的可移动平台的影像拍摄方法,可以应用于可移动平台以及其他任意涉及影像拍摄的应用场景中,例如,可移动平台可以 包括飞行器(例如无人机)、机器人、无人车、无人船,本申请实施例对具体的应用场景不做限制。It should be noted that the image capturing method for a movable platform provided in the embodiments of the present application can be applied to a movable platform and any other application scenarios involving image capturing. For example, the movable platform may include an aircraft (such as an unmanned aerial vehicle). , robot, unmanned vehicle, and unmanned ship, the embodiments of the present application do not limit specific application scenarios.
本申请实施例中主要以可移动平台为飞行器的情况为例,对本申请的方案进行描述,但可以理解的是,这并不意欲对本申请的应用场景构成限制。In the embodiments of the present application, the case where the movable platform is an aircraft is mainly used as an example to describe the solution of the present application, but it can be understood that this is not intended to limit the application scenarios of the present application.
在一个示例中,图1示出了本申请一个实施例中的飞行器100的示意图。该飞行器100包括承载体(也即机架)102及负载104。本领域技术人员应该了解,本文所描述的关于飞行器的任何实施例适用于任何飞行器(如无人飞行器,也称无人机)。在某些实施例中,负载104可以直接位于飞行器100上,而不需要承载体102。飞行器100可以包括处理器101、存储器102、动力机构106,传感系统108、以及通讯系统110。这些组件通过总线系统和/或其它形式的连接机构(未示出)互连。负载104可以包括拍摄装置等。In one example, FIG. 1 shows a schematic diagram of an aircraft 100 in one embodiment of the present application. The aircraft 100 includes a carrier (ie, a frame) 102 and a load 104 . Those skilled in the art will appreciate that any of the embodiments described herein with respect to aircraft are applicable to any aircraft (eg, unmanned aerial vehicles, also known as drones). In some embodiments, the load 104 may be located directly on the aircraft 100 without the need for the carrier 102 . Aircraft 100 may include processor 101 , memory 102 , powertrain 106 , sensing system 108 , and communication system 110 . These components are interconnected by a bus system and/or other form of connection mechanism (not shown). The payload 104 may include a camera or the like.
动力机构106可以包括一个或者多个旋转体、螺旋桨、桨叶、引擎、电机、轮子、轴承、磁铁、喷嘴。例如,所述动力机构的旋转体可以是自紧固(self-tightening)旋转体、旋转体组件、或者其它的旋转体动力单元。飞行器可以有一个或多个动力机构。所有的动力机构可以是相同的类型。可选的,一个或者多个动力机构可以是不同的类型。动力机构106可以通过合适的手段安装在飞行器上,如通过支撑元件(如驱动轴)。动力机构106可以安装在飞行器100任何合适的位置,如顶端、下端、前端、后端、侧面或者其中的任意结合。The powertrain 106 may include one or more rotating bodies, propellers, blades, engines, motors, wheels, bearings, magnets, nozzles. For example, the rotating body of the power mechanism may be a self-tightening rotating body, a rotating body assembly, or other rotating body power unit. An aircraft may have one or more power mechanisms. All powertrains can be of the same type. Alternatively, one or more of the power mechanisms may be of a different type. Powertrain 106 may be mounted on the aircraft by suitable means, such as by support elements (eg, drive shafts). The powertrain 106 may be installed in any suitable location on the aircraft 100, such as the top end, the lower end, the front end, the rear end, the side, or any combination thereof.
在某些实施例中,动力机构106能够使飞行器垂直地从表面起飞,或者垂直地降落在表面上,而不需要飞行器100任何水平运动(如不需要在跑道上滑行)。可选的,动力机构106可以允许飞行器100在空中预设位置和/或方向盘旋。一个或者多个动力机构106在受到控制时可以独立于其它的动力机构。可选的,一个或者多个动力机构106可以同时受到控制。例如,飞行器100可以有多个水平方向的旋转体,以追踪目标的提升及/或推动。水平方向的旋转体可以被致动以提供飞行器100垂直起飞、垂直降落、盘旋的能力。在某些实施例中,水平方向的旋转体中的一个或者多个可以顺时针方向旋转,而水平方向的旋转体中的其它一个或者多个可以逆时针方向旋转。例如,顺时针旋转的旋转体与逆时针旋转的旋转体的数量一样。每一个水平方向的旋转体的旋转速率可以独立变化,以实现每个旋转体导致的提升及/或推动操作,从而调整飞行器100的空间方位、速度及/或加速度(如相对于多达三个自由度的旋转及平移)。In some embodiments, the powertrain 106 enables the aircraft to take off vertically from a surface, or land vertically on a surface, without requiring any horizontal movement of the aircraft 100 (eg, without taxiing on a runway). Optionally, powertrain 106 may allow aircraft 100 to preset positions and/or steering wheel in the air. One or more of the power mechanisms 106 may be controlled independently of the other power mechanisms. Alternatively, one or more power mechanisms 106 may be controlled simultaneously. For example, the aircraft 100 may have multiple horizontal rotations to track the lift and/or push of the target. The horizontally oriented rotator can be actuated to provide the ability of the aircraft 100 to take off vertically, land vertically, and hover. In some embodiments, one or more of the horizontal rotating bodies may rotate clockwise, while the other one or more of the horizontal rotating bodies may rotate counterclockwise. For example, there are the same number of rotating bodies that rotate clockwise as there are counter-clockwise rotating bodies. The rate of rotation of each horizontal rotator can be varied independently to effect lift and/or push operations caused by each rotator to adjust the spatial orientation, velocity, and/or acceleration of the aircraft 100 (eg, relative to up to three rotation and translation of degrees of freedom).
传感系统108可以包括一个或者多个传感器,以感测飞行器100的空间方位、 速度及/或加速度(如相对于多达三个自由度的旋转及平移)。所述一个或者多个传感器包括前述描述的任何传感器,包括GPS传感器、运动传感器、惯性传感器、近程传感器或者影像传感器。传感系统108提供的感测数据可以用于追踪目标100的空间方位、速度及/或加速度(如下所述,利用适合的处理单元及/或控制单元)。可选的,传感系统108可以用于采集飞行器的环境的数据,如气候条件、要接近的潜在的障碍、地理特征的位置、人造结构的位置、图像信息等。 Sensing system 108 may include one or more sensors to sense spatial orientation, velocity, and/or acceleration (eg, rotation and translation with respect to up to three degrees of freedom) of aircraft 100 . The one or more sensors include any of the sensors described above, including GPS sensors, motion sensors, inertial sensors, proximity sensors, or image sensors. Sensing data provided by the sensing system 108 may be used to track the spatial orientation, velocity, and/or acceleration of the target 100 (as described below, using a suitable processing unit and/or control unit). Optionally, the sensing system 108 may be used to collect data on the environment of the aircraft, such as climatic conditions, potential obstacles to be approached, locations of geographic features, locations of man-made structures, image information, and the like.
通讯系统110能够实现与具有通讯系统114的控制装置112通过无线信号116进行通讯。通讯系统110、114可以包括任何数量的用于无线通讯的发送器、接收器、及/或收发器。所述通讯可以是单向通讯,这样数据可以从一个方向发送。例如,单向通讯可以包括,只有飞行器100传送数据给控制装置112,或者反之亦然。通讯系统110的一个或者多个发送器可以发送数据给通讯系统114的一个或者多个接收器,反之亦然。可选的,所述通讯可以是双向通讯,这样,数据可以在飞行器100与控制装置112之间在两个方向传输。双向通讯包括通讯系统110的一个或者多个发送器可以发送数据给通讯系统114的一个或者多个接收器,及反之亦然。The communication system 110 enables communication with the control device 112 having the communication system 114 via a wireless signal 116 . Communication systems 110, 114 may include any number of transmitters, receivers, and/or transceivers for wireless communication. The communication may be one-way communication, so that data can be sent from one direction. For example, one-way communication may include that only the aircraft 100 transmits data to the control device 112, or vice versa. One or more transmitters of communication system 110 may transmit data to one or more receivers of communication system 114, and vice versa. Optionally, the communication may be two-way communication, so that data may be transmitted between the aircraft 100 and the control device 112 in both directions. Two-way communication includes that one or more transmitters of communication system 110 can transmit data to one or more receivers of communication system 114, and vice versa.
在某些实施例中,控制装置112可以向飞行器100、承载体102及负载104中的一个或者多个提供控制数据,并且从飞行器100、承载体102及负载104中的一个或者多个中接收信息(如飞行器、承载体或者负载的位置及/或运动信息,负载感测的数据,如拍摄装置例如相机捕获的影像数据)。在某些实施例中,控制装置的控制数据可以包括关于位置、运动、致动的指令,或者对飞行器、承载体及/或负载的控制。例如,控制数据可以导致飞行器位置及/或方向的改变(如通过控制动力机构106),或者导致承载体相对于飞行器的运动(如通过对承载体102的控制)。控制装置的控制数据可以导致负载控制,如控制相机或者其它影像捕获设备的操作(捕获静止或者运动的影像、变焦、开启或关闭、切换拍摄模式、改变影像分辨率、改变焦距、改变景深、改变曝光时间、改变可视角度或者视场)。在某些实施例中,飞行器、承载体及/或负载的通讯可以包括一个或者多个传感器(如传感系统108或者负载104)发出的信息。所述通讯可以包括从一个或者多个不同类型的传感器(如GPS传感器、运动传感器、惯性传感器、近程传感器或者影像传感器)传送的感应信息。所述感应信息是关于飞行器、承载体及/或负载的位置(如方向、位置)、运动、或者加速度。从负载传送的感应信息包括负载捕获的数据或者负载的状态。控制装置112传送提供的控制数据可以用于追踪飞行 器100、承载体102或者负载104中一个或者多个的状态。可选的或者同时地,承载体102及负载104每一个都可以包括通讯模块,用于与控制装置112通讯,以便控制装置可以单独地通讯或者追踪飞行器100、承载体102及负载104。In certain embodiments, control device 112 may provide control data to, and receive from, one or more of aircraft 100 , carrier 102 , and payload 104 . Information (eg position and/or motion information of the aircraft, carrier or payload, payload sensing data, eg image data captured by a camera such as a camera). In some embodiments, the control data for the control device may include instructions regarding position, movement, actuation, or control of the aircraft, carrier and/or load. For example, the control data may cause changes in the position and/or orientation of the aircraft (eg, by controlling the power mechanism 106 ), or cause movement of the carrier relative to the aircraft (eg, by controlling the carrier 102 ). Control data from a control device can result in load control, such as controlling the operation of a camera or other image capture device (capturing still or moving images, zooming, turning on or off, switching shooting modes, changing image resolution, changing focus, changing depth of field, changing exposure time, changing the viewing angle or field of view). In some embodiments, the communication of the aircraft, carrier and/or payload may include information from one or more sensors (eg, sensing system 108 or payload 104). The communication may include sensory information transmitted from one or more different types of sensors, such as GPS sensors, motion sensors, inertial sensors, proximity sensors, or image sensors. The sensed information is about the position (eg, orientation, position), motion, or acceleration of the aircraft, carrier, and/or load. The sensed information transmitted from the load includes the data captured by the load or the status of the load. The control data transmitted by the control device 112 may be used to track the status of one or more of the aircraft 100, the carrier 102, or the payload 104. Alternatively or concurrently, carrier 102 and payload 104 may each include a communication module for communicating with control device 112 so that the control device may communicate or track aircraft 100 , carrier 102 and payload 104 individually.
在某些实施例中,飞行器100可以与除了控制装置112之外的其它远程设备通讯,控制装置112也可以与除飞行器100之外的其它远程设备进行通讯。例如,飞行器及/或控制装置112可以与另一个飞行器或者另一个飞行器的承载体或负载通讯。当有需要的时候,所述另外的远程设备可以是第二控制装置或者其它计算设备(如计算机、桌上型电脑、平板电脑、智能手机、或者其它移动设备)。该远程设备可以向飞行器100传送数据,从飞行器100接收数据,传送数据给控制装置112,及/或从控制装置112接收数据。可选的,该远程设备可以连接到因特网或者其它电信网络,以使从飞行器100及/或控制装置112接收的数据上传到网站或者服务器上。In some embodiments, aircraft 100 may communicate with other remote devices in addition to controls 112 , which may also communicate with other remote devices in addition to aircraft 100 . For example, the aircraft and/or controls 112 may be in communication with another aircraft or a carrier or payload of another aircraft. When desired, the additional remote device may be a second control device or other computing device (eg, a computer, desktop, tablet, smartphone, or other mobile device). The remote device may transmit data to the aircraft 100 , receive data from the aircraft 100 , transmit data to the control device 112 , and/or receive data from the control device 112 . Optionally, the remote device may be connected to the Internet or other telecommunications network to allow data received from aircraft 100 and/or controls 112 to be uploaded to a website or server.
在某些实施例中,飞行器的运动、承载体的运动及负载相对固定参照物(如外部环境)的运动,及/或者彼此间的运动,都可以由控制装置所控制。所述控制装置可以是远程控制终端,位于远离飞行器、承载体及/或负载的地方。控制装置可以位于或者粘贴于支撑平台上。可选的,所述控制装置可以是手持的或者穿戴式的。例如,所述控制装置可以包括智能手机、平板电脑、桌上型电脑、计算机、眼镜、手套、头盔、麦克风或者其中任意的结合。所述控制装置可以包括用户界面,如键盘、鼠标、操纵杆、触摸屏或者显示器。任何适合的用户输入可以与控制装置交互,如手动输入指令、声音控制、手势控制或者位置控制(如通过控制装置的运动、位置或者倾斜)。In some embodiments, the movement of the aircraft, the movement of the carrier, and the movement of the load relative to a fixed reference (eg, the external environment), and/or relative to each other, may be controlled by the control device. The control device may be a remote control terminal, located remotely from the aircraft, carrier and/or load. The control device may be located on or affixed to the support platform. Optionally, the control device may be hand-held or wearable. For example, the control device may include a smartphone, tablet, desktop, computer, glasses, gloves, helmet, microphone, or any combination thereof. The control means may comprise a user interface such as a keyboard, mouse, joystick, touch screen or display. Any suitable user input may interact with the control device, such as manual input of commands, voice control, gesture control, or positional control (eg, by movement, position, or tilt of the control device).
飞行器100可以包括一个或者多个存储器102,存储器102上存储有由所述处理器运行的计算机程序,例如用于存储用于实现根据本申请实施例的影像拍摄方法中的相应步骤和程序指令。可以包括一个或多个计算机程序产品,所述计算机程序产品可以包括各种形式的计算机可读存储介质,例如易失性存储器和/或非易失性存储器。所述易失性存储器例如可以包括随机存取存储器(RAM)和/或高速缓冲存储器(cache)等。所述非易失性存储器例如可以包括只读存储器(ROM)、硬盘、闪存等。The aircraft 100 may include one or more memories 102, and the memory 102 stores a computer program executed by the processor, for example, for storing corresponding steps and program instructions for implementing the image capturing method according to the embodiment of the present application. One or more computer program products may be included, which may include various forms of computer-readable storage media, such as volatile memory and/or non-volatile memory. The volatile memory may include, for example, random access memory (RAM) and/or cache memory, or the like. The non-volatile memory may include, for example, read only memory (ROM), hard disk, flash memory, and the like.
飞行器100可以包括一个或者多个处理器101,处理器101可以是中央处理单元(CPU)、图像处理单元(GPU)、专用集成电路(ASIC)、现场可编程门阵列(FPGA)或者具有数据处理能力和/或指令执行能力的其它形式的处理单元, 并且可以控制飞行器100中的其它组件以执行期望的功能。所述处理器能够执行存储器中存储的程序指令,以执行下文描述的本申请实施例的影像拍摄方法中的相关步骤。例如,处理器能够包括一个或多个嵌入式处理器、处理器核心、微型处理器、逻辑电路、硬件有限状态机(FSM)、数字信号处理器(DSP)或它们的组合。在本实施例中,所述处理器包括现场可编程门阵列(FPGA),或者一个或者多个ARM处理器。 Aircraft 100 may include one or more processors 101, which may be central processing units (CPUs), graphics processing units (GPUs), application specific integrated circuits (ASICs), field programmable gate arrays (FPGAs), or have data processing capabilities and/or other forms of processing units for instruction execution capabilities, and may control other components in aircraft 100 to perform desired functions. The processor can execute the program instructions stored in the memory, so as to execute the relevant steps in the image capturing method of the embodiments of the present application described below. For example, a processor can include one or more embedded processors, processor cores, microprocessors, logic circuits, hardware finite state machines (FSMs), digital signal processors (DSPs), or combinations thereof. In this embodiment, the processor includes a Field Programmable Gate Array (FPGA), or one or more ARM processors.
对于互联网时代下的用户,快速高质的完成无人机航拍是一件极其重要的事情。尤其对于刚尝试无人机航拍的新用户来说,练习无人机的飞行已经耗费一定精力,如果还要在构图方面花费心思,可能会造成一部分用户对航拍丧失兴趣。For users in the Internet era, it is extremely important to complete drone aerial photography quickly and with high quality. Especially for new users who have just tried drone aerial photography, it takes a certain amount of energy to practice the flight of drones. If they still need to pay attention to composition, it may cause some users to lose interest in aerial photography.
目前虽然有些无人机配置一键拍摄的功能,但该一键拍摄的功能通常需要用户自行选择,对于一些新用户来说,很难在初学阶段能够清楚明白的选用适合的拍摄方式或者拍摄角度来快速拍摄精彩照片或视频。At present, although some drones are equipped with the one-button shooting function, the one-button shooting function usually needs to be selected by the user. For some new users, it is difficult to clearly select the appropriate shooting method or shooting angle at the beginning stage. to quickly capture great photos or videos.
鉴于上述问题的存在,本申请实施例中提供一种影像拍摄方法,影像拍摄方法包括:识别可移动平台的拍摄范围内满足预设拍摄条件的拍摄目标;获取和拍摄目标相匹配的构图规划信息;基于构图规划信息,确定对拍摄目标进行拍摄时可移动平台应处于的目标拍摄位置;当控制可移动平台处于目标拍摄位置后,基于构图规划信息控制拍摄装置对拍摄目标进行拍摄。本申请实施例中的影像拍摄方法,当识别到可移动平台的拍摄范围内满足预设拍摄条件的拍摄目标后,基于构图规划信息控制拍摄装置对拍摄目标进行拍摄,从而无需用户在构图等方面花费过多的时间,即可快速的利用预设的构图规划信息协助用户完成可移动平台上拍摄装置的拍摄,且能够拍摄出高质量和效果很好的影像,降低了用户的学习成本,提升了用户的使用体验。In view of the existence of the above problems, an embodiment of the present application provides an image shooting method, the image shooting method includes: identifying a shooting target within a shooting range of a movable platform that meets preset shooting conditions; acquiring composition planning information matching the shooting target ; Based on the composition planning information, determine the target shooting position where the movable platform should be when shooting the shooting target; after controlling the movable platform to be at the target shooting position, control the shooting device to shoot the shooting target based on the composition planning information. In the image shooting method in the embodiment of the present application, after identifying a shooting target that meets the preset shooting conditions within the shooting range of the movable platform, the shooting device is controlled to shoot the shooting target based on the composition planning information, so that the user does not need to compose the image and so on. If you spend too much time, you can quickly use the preset composition planning information to assist the user to complete the shooting of the shooting device on the movable platform, and can shoot high-quality and effective images, reducing the user's learning cost and improving user experience.
需要说明的是,本申请实施例提供的影像拍摄方法,其执行主体可以是可移动平台(例如飞行器),拍摄装置设置于可移动平台,可移动平台和控制装置通信连接,执行主体还可以是可以通过软件、硬件或者软硬件结合的方式实现对可移动平台的控制及对可移动平台搭载的拍摄装置的控制的计算机设备的部分或者全部,或者,还可以是可移动平台和控制装置,可移动平台可以执行影像拍摄方法中的部分步骤,而控制装置执行影像拍摄方法中的部分步骤,例如控制装置执行显示相关的步骤以及基于用户操作获取用户指令,并将用户指令输出给可移动平台,以使可移动平台根据用户指令移动到目标拍摄位置,对拍摄目标进行拍摄等的步骤。It should be noted that, in the image capturing method provided by the embodiments of the present application, the execution subject may be a movable platform (such as an aircraft), the capturing device is set on the movable platform, the movable platform and the control device are communicatively connected, and the execution subject may also be Part or all of the computer equipment that can realize the control of the movable platform and the control of the photographing device carried on the movable platform by software, hardware or a combination of software and hardware, or can also be a movable platform and a control device, which can be The mobile platform can perform some steps in the image capturing method, and the control device executes some steps in the image capturing method, for example, the control device performs display-related steps and acquires user instructions based on user operations, and outputs the user instructions to the movable platform, Steps such as making the movable platform move to the target shooting position according to the user's instruction, and shooting the shooting target.
下面,参考附图对本申请实施例提供的影像拍摄方法进行描述。Hereinafter, the image capturing method provided by the embodiments of the present application will be described with reference to the accompanying drawings.
作为示例,如图2所示,本申请实施例提供的影像拍摄方法200包括以下步骤S201至步骤S204:As an example, as shown in FIG. 2 , the image capturing method 200 provided by this embodiment of the present application includes the following steps S201 to S204:
首先,在步骤S201中,识别可移动平台的拍摄范围内满足预设拍摄条件的拍摄目标。通过自动识别可移动平台的拍摄范围内满足预设拍摄条件的拍摄目标,可以使用户更快的了解可移动平台附近的可拍摄景点或建筑物。First, in step S201, a shooting target within the shooting range of the movable platform that meets the preset shooting conditions is identified. By automatically identifying the shooting target within the shooting range of the movable platform that meets the preset shooting conditions, the user can quickly understand the photographable sights or buildings near the movable platform.
可以在可移动平台的飞行过程中实时的去识别拍摄目标,或者,还可以获取用户通过控制装置输入的开始自动拍摄的控制指令,响应于该控制指令,可移动平台或控制装置开始识别可移动平台的拍摄范围内满足预设拍摄条件的拍摄目标。示例性地,控制装置可以显示拍摄对应的操作按键,可以获取用户通过该操作按键(例如点击该操作按键)输入的开始自动拍摄的控制指令。The shooting target can be de-identified in real time during the flight of the movable platform, or, the control command input by the user through the control device to start automatic shooting can also be obtained. In response to the control command, the movable platform or the control device starts to identify the movable platform. Shooting targets that meet the preset shooting conditions within the shooting range of the platform. Exemplarily, the control device may display an operation button corresponding to shooting, and may acquire a control instruction to start automatic shooting entered by the user through the operation button (eg, clicking the operation button).
可以通过任意适合的方法识别可移动平台的拍摄范围内满足预设拍摄条件的拍摄目标,在拍摄范围内可以具有一个或多个拍摄目标。Any suitable method may be used to identify the shooting targets within the shooting range of the movable platform that meet the preset shooting conditions, and there may be one or more shooting targets within the shooting range.
在一个示例中,识别可移动平台的拍摄范围内满足预设拍摄条件的拍摄目标,包括:获取可拍摄物的标定信息,其中,标定信息包括以下信息中的至少一种:已标定可拍摄物的形状特征信息、已标定可拍摄物的位置标记信息;获取可移动平台的拍摄范围内的可拍摄物的特征信息,特征信息包括形状特征信息和/或位置信息。In one example, identifying a shooting target that meets a preset shooting condition within the shooting range of the movable platform includes: acquiring calibration information of the shootable object, wherein the calibration information includes at least one of the following information: the shooting object has been calibrated The shape feature information and the position marker information of the calibrated photographable objects; obtain the feature information of the photographable objects within the shooting range of the movable platform, and the feature information includes shape feature information and/or position information.
可选地,标定信息包括以下信息中的至少一种:已标定可拍摄物的形状特征信息、已标定可拍摄物的位置标记信息,例如,标定信息包括已标定可拍摄物的形状特征信息,可选地,已标定可拍摄物的形状特征信息包括以下特征信息中的至少一种:可拍摄物的俯视形状特征、可拍摄物的侧视形状特征,或者,还可以包括其他的能够标识可拍摄物的形状特征,可拍摄物的俯视形状特征例如可以为建筑物的屋顶形状特征。已标定可拍摄物的位置标记信息可以包括可拍摄物的经纬坐标,或者,其他任意能够标志可拍摄物的位置的坐标信息等。Optionally, the calibration information includes at least one of the following information: shape feature information of the calibrated photographable object, position marker information of the calibrated photographable object, for example, the calibration information includes shape feature information of the calibrated photographable object, Optionally, the shape feature information of the calibrated photographable object includes at least one of the following feature information: the top-view shape feature of the photographable object, the side-view shape feature of the photographable object, or may also include other information that can identify the photographable object. The shape feature of the photographed object, and the top-view shape feature of the photographable object may be, for example, the shape feature of the roof of a building. The position marking information of the photographable object that has been calibrated may include the latitude and longitude coordinates of the photographable object, or any other coordinate information that can mark the position of the photographable object, and the like.
可以通过预先对可拍摄物例如景点或建筑物的形状特征进行标定,以获得标定信息,例如俯视形状由多个环状物组成的景点可以设定为麦田怪圈,如图3所示,再例如,依山而建的条状建筑物标定为长城,螺旋上升的高层建筑设定为广州塔,笋状建筑为春笋大厦,或者其他对应的可拍摄物的标定信息。该些标定信息可以预存于可移动平台的存储器中,或者,该标定信息可以存储于服务器例如云端设备中,当需要时,直接调取使用。The calibration information can be obtained by pre-calibrating the shape features of photographable objects such as scenic spots or buildings. For example, a scenic spot composed of multiple rings in the top view can be set as a crop circle, as shown in Figure 3. For example, , the strip-shaped building built on the mountain is set as the Great Wall, the spiral-rising high-rise building is set as the Canton Tower, the bamboo-shaped building is set as the Chunsun Building, or the calibration information of other corresponding photographable objects. The calibration information can be pre-stored in the memory of the mobile platform, or the calibration information can be stored in a server such as a cloud device, and can be directly retrieved and used when needed.
可以通过任意适合的方法获取可移动平台的拍摄范围内的可拍摄物的特征信息,例如,当标定信息包括已标定可拍摄物的形状特征信息时,获取可移动平台的拍摄范围内的可拍摄物的特征信息,包括:获取可移动平台的拍摄范围内的图像信息;基于图像信息,识别可移动平台的拍摄范围内的可拍摄物的形状特征信息。其中,图像信息可以包括可移动平台本体上的相机的镜头(例如红外镜头或可见光镜头)拍摄的图像数据,也可以包括双目镜头采集的图像数据、或者深度(Time of flight,简称TOF)摄像头采集的图像数据,或者图像数据还可以是卫星地图例如控制装置提供的可移动平台的拍摄范围内的卫星地图等,当使用卫星地图提供的图像信息时,可以通过获取控制装置存储的可移动平台的拍摄范围内的卫星地图,或者当未存储卫星地图时,也可以获取可移动平台当前的位置信息或者当前控制装置的位置信息,基于该位置信息下载获取可移动平台的拍摄范围内的卫星地图。可选地,可以基于例如机器学习的智能识别方法,识别图像信息中可拍摄物的形状特征信息,或者还可以基于其他任意适合的方法进行识别。The feature information of the photographable objects within the shooting range of the movable platform can be obtained by any suitable method. The feature information of the object includes: acquiring image information within the shooting range of the movable platform; and identifying the shape feature information of the shootable object within the shooting range of the movable platform based on the image information. The image information may include image data captured by a camera lens (such as an infrared lens or a visible light lens) on the movable platform body, or may include image data collected by a binocular lens, or a Time of Flight (TOF) camera. The collected image data, or the image data can also be a satellite map, such as a satellite map within the shooting range of the movable platform provided by the control device, etc. When using the image information provided by the satellite map, the movable platform stored by the control device can be obtained by obtaining the information. The satellite map within the shooting range of the mobile platform, or when the satellite map is not stored, the current position information of the mobile platform or the position information of the current control device can also be obtained, and the satellite map within the shooting range of the mobile platform can be downloaded and obtained based on the position information. . Optionally, the shape feature information of the photographable objects in the image information can be recognized based on an intelligent recognition method such as machine learning, or the recognition can also be performed based on any other suitable method.
在一个示例中,识别可移动平台的拍摄范围内满足预设拍摄条件的拍摄目标,还包括:当获取到可移动平台的拍摄范围内的可拍摄物的特征信息后,将可拍摄物的特征信息和标定信息进行匹配,识别可移动平台的拍摄范围内的拍摄目标,例如满足预设拍摄条件的拍摄目标的形状特征与至少一个已标定可拍摄物的形状特征信息相匹配,满足预设拍摄条件的拍摄目标的形状特征与至少一个已标定可拍摄物的形状特征信息相匹配,也即拍摄目标可以是已标定可拍摄物,或者还可以是和已标定可拍摄具有大体相同形状的其他可拍摄物,也即,同一已标定可拍摄物对应一个或多个具有大体相同的形状特征的拍摄目标。In one example, identifying the shooting targets within the shooting range of the movable platform that meet the preset shooting conditions further includes: after acquiring the feature information of the shootable objects within the shooting range of the movable platform, classifying the features of the shootable objects The information and calibration information are matched to identify the shooting targets within the shooting range of the movable platform. For example, the shape features of the shooting targets that meet the preset shooting conditions are matched with the shape feature information of at least one calibrated photographable object, and the preset shooting conditions are satisfied. The shape feature of the conditional photographing target matches the shape feature information of at least one calibrated photographable object, that is, the photographing target may be a calibrated photographable object, or may also be other photographable objects with substantially the same shape as the calibrated photographable object. A photographic object, that is, the same calibrated photographable object corresponds to one or more photographic objects having substantially the same shape feature.
再例如,满足预设拍摄条件的拍摄目标的位置信息和一个已标定可拍摄物的位置标记信息相匹配,拍摄目标可以是仅形状和标定信息中的形状匹配,也可以是形状和标定信息中的对应形状匹配且拍摄目标的位置信息和标定信息中的位置标记信息匹配,或者,还可以是仅位置信息和标定信息中的位置标记信息匹配。For another example, the position information of the shooting target that satisfies the preset shooting conditions matches the position mark information of a calibrated photographable object. The corresponding shape of the target matches and the position information of the shooting target matches the position marker information in the calibration information, or, it can also be that only the position information matches the position marker information in the calibration information.
在一个示例中,标定信息的位置标记信息包括一个或多个已标定可拍摄物的地理位置信息,例如经纬坐标信息,将可拍摄物的特征信息和标定信息进行匹配,识别可移动平台的拍摄范围内的拍摄目标,包括:获取第一位置信息,识别第一位置信息周围的与标定信息中的位置标记信息相匹配的一个或多个拍摄目标,其中,第一位置信息包括以下信息中的至少一个:可移动平台开始移动时的起始坐标信息、控制装置所处的坐标位置信息、可移动平台当前的位置信息,或者其他 能够大体表征可移动平台所处的位置的信息。例如可以是基于可移动平台携带的GPS传感器获取地理位置信息(可移动平台开始移动时的起始坐标信息或可移动平台当前的位置信息)、还可以是自可移动平台的控制装置获取的地理位置信息(例如控制装置所处的坐标位置信息)等,基于该些数据中的一种或几种来识别获取可移动平台的拍摄范围内的可拍摄物的特征信息。In one example, the location marker information of the calibration information includes geographic location information of one or more calibrated photographable objects, such as latitude and longitude coordinate information, and the feature information of the photographable objects and the calibration information are matched to identify the photographing of the movable platform. The shooting targets within the range include: acquiring first position information, and identifying one or more shooting targets around the first position information that match the position marker information in the calibration information, wherein the first position information includes the following information. At least one: starting coordinate information when the movable platform starts to move, coordinate position information where the control device is located, current location information of the movable platform, or other information that can roughly characterize the location where the movable platform is located. For example, it can be based on the GPS sensor carried by the mobile platform to obtain geographic location information (the starting coordinate information when the mobile platform starts to move or the current location information of the mobile platform), or the geographic location information obtained from the control device of the mobile platform. Position information (for example, coordinate position information where the control device is located), etc., based on one or more of these data to identify and acquire feature information of the photographable objects within the photographing range of the movable platform.
在一个示例中,当拍摄方法由与所述可移动平台通信连接的控制装置执行,该方法还包括:当识别到可移动平台的拍摄范围内满足预设拍摄条件的一个或多个拍摄目标后,在图像信息中通过标识标注各个拍摄目标;在控制装置的显示界面上显示图像信息和各个标识,通过对拍摄目标进行标识可以使用户快速的获知拍摄目标的信息,从而便于用户决定是否对拍摄目标进行拍摄,以及当显示多个拍摄目标时,可以便于用户直观的选择想拍摄的目标。In one example, when the photographing method is performed by a control device communicatively connected to the movable platform, the method further includes: after recognizing one or more photographing targets within the photographing range of the movable platform that meet the preset photographing conditions , each shooting target is marked in the image information by the logo; the image information and each logo are displayed on the display interface of the control device, and the user can quickly know the information of the shooting target by identifying the shooting target, so that the user can decide whether to The target is photographed, and when multiple photographing targets are displayed, it is convenient for the user to intuitively select the target to be photographed.
拍摄目标的标识包括以下标识信息中的至少一种:图案标识或文字标识,或者还可以包括其他任意的能够对拍摄目标进行标识的标识信息,图案标识包括箭头图案标识或者其他能够标识拍摄目标的图案标识,例如在可移动平台的可拍摄范围内(例如无人机的飞行范围内)识别到拍摄目标例如如图4所示的重茧体育场时,在控制装置的显示界面上显示卫星地图,并在卫星地图上通过箭头指向对重茧体育场进行标识。文字标识可以包括拍摄目标的名称或者其他文字描述。可选地,还可以通过例如数字标识对拍摄目标进行标识,例如当识别到一个拍摄目标时,用数字“1”进行标识,当识别到多个拍摄目标时,用排序的数字随机的对各个拍摄目标进行标识,例如当识别到3个拍摄目标时,分别用“1、2、3”对各个拍摄目标进行标识。The identification of the shooting target includes at least one of the following identification information: a pattern identification or a text identification, or may also include any other identification information that can identify the shooting target, and the pattern identification includes an arrow pattern identification or other identification information that can identify the shooting target. Pattern identification, for example, when a shooting target such as the Recocoon Stadium as shown in Figure 4 is identified within the shooting range of the movable platform (for example, within the flight range of the drone), a satellite map is displayed on the display interface of the control device, And mark the Chongcocoon Stadium on the satellite map with the arrow pointing. The text identification may include the name or other text description of the shooting target. Optionally, the shooting target can also be identified by, for example, a digital identification. For example, when one shooting target is identified, a number "1" is used for identification, and when multiple shooting targets are identified, each The shooting targets are identified. For example, when three shooting targets are identified, "1, 2, and 3" are used to identify each shooting target.
在一个示例中,控制装置的显示界面上显示有图像信息,图像信息中显示有多个拍摄目标,图像信息包括卫星地图或可移动平台的传感器采集的图像数据(例如控制装置和可移动平台通信连接,控制装置可以实时获取到可移动平台的传感器采集的图像数据),当识别到多个拍摄目标时,本申请的影像拍摄方法还包括:基于用户的选择指令,确定多个拍摄目标中的一个进行拍摄,例如,控制装置基于用户输入的选择指令,在图像信息中选中多个拍摄目标中的一个进行拍摄,例如获取用户通过例如点击图像信息中的多个拍摄目标中的一个输入的选择指令,从而在图像信息中选中多个拍摄目标中的一个进行拍摄。In one example, image information is displayed on the display interface of the control device, and multiple shooting targets are displayed in the image information, and the image information includes a satellite map or image data collected by sensors of the movable platform (for example, the control device communicates with the movable platform). connection, the control device can obtain the image data collected by the sensor of the movable platform in real time), when multiple shooting targets are identified, the image shooting method of the present application further includes: based on the user's selection instruction, determining the multiple shooting targets. One for shooting, for example, the control device selects one of the multiple shooting targets in the image information based on the selection instruction input by the user to shoot, for example, obtains the selection input by the user by, for example, clicking on one of the multiple shooting targets in the image information instruction, so as to select one of the multiple shooting targets in the image information for shooting.
接着,继续参考图2,在步骤S202中,获取和拍摄目标相匹配的构图规划信息。Next, with continued reference to FIG. 2 , in step S202 , the composition planning information matching the shooting target is acquired.
构图规划信息包括以下至少一项:构图方式、可移动平台的预设高度(也即预设构图时可移动平台的预设高度)、拍摄参数、拍摄方位,其中,构图方式包括:拍摄目标在拍摄画面中所占的比例,和/或,拍摄目标在拍摄画面中的位置,或者其他能够使拍摄影像效果更好的构图方式。拍摄参数包括但不限于预设构图时对应的预设视场、曝光参数等等。基于可移动平台的预设高度和拍摄装置的预设视场可以拍摄获取对应构图方式的影像。The composition planning information includes at least one of the following: a composition method, a preset height of the movable platform (that is, a preset height of the movable platform when the composition is preset), shooting parameters, and shooting orientation, wherein the composition method includes: the shooting target is in The proportion of the shooting picture, and/or the position of the shooting target in the shooting picture, or other composition methods that can make the shooting image better. The shooting parameters include, but are not limited to, a preset field of view, exposure parameters, etc. corresponding to the preset composition. Based on the preset height of the movable platform and the preset field of view of the photographing device, an image corresponding to the composition mode can be photographed and acquired.
该构图规划信息可以预先存储在可移动平台的存储器中,或者存储于其他能能够和可移动平台通信或控制装置通信的计算设备的存储器中,需要时直接获取,从而避免用户在利用可移动平台上的拍摄装置进行影像拍摄时在构图等方面花费过多的时间,提升用户的使用体验和拍摄效率。The composition planning information can be pre-stored in the memory of the movable platform, or stored in the memory of other computing devices that can communicate with the movable platform or the control device, and can be directly obtained when needed, so as to avoid users using the movable platform. The above-mentioned shooting device spends too much time on composition and other aspects when shooting images, which improves the user experience and shooting efficiency.
在一个示例中,获取和拍摄目标相匹配的构图规划信息,包括:获取拍摄目标的至少一个历史拍摄影像的构图规划信息;基于至少一个历史拍摄影像的构图规划信息,确定拍摄目标的构图规划信息,例如可以根据历史拍摄影像例如图片的exif信息获取到可移动平台拍摄该图片时的经纬度和高度等构图规划信息,通过该些信息进行预设构图,当获取到用户的拍摄指令后,直接基于该构图规划信息对拍摄目标进行拍摄。In an example, acquiring the composition planning information matching the shooting target includes: acquiring composition planning information of at least one historically shot image of the shooting target; and determining the composition planning information of the shooting target based on the composition planning information of the at least one historically shot image For example, composition planning information such as the latitude, longitude and height when the mobile platform was photographed can be obtained according to the exif information of historically photographed images, such as the picture, and the preset composition can be performed through these information. The composition planning information is used to photograph the photographic target.
历史拍摄影像可以是各种摄影应用程序(Application,简称APP)收集的拍摄影像例如照片、视频等,可以为用户点赞量或者浏览量最高的影像,或者,用户可以在历史拍摄影像中选择自己想拍摄的任意影像。The historical shooting images can be the shooting images collected by various photography applications (Application, APP for short), such as photos, videos, etc., which can be the most liked or viewed images for the user, or the user can select his/herself from the historical shooting images Any image you want to shoot.
在另一个示例中,获取和拍摄目标相匹配的构图规划信息,包括:获取已标定可拍摄物的构图规划信息的数据集,其中,各个已标定可拍摄物的构图规划信息为对各个已标定可拍摄物周围的卫星地图进行预设构图而获得的,例如通过卫星地图进行预设构图,调整拍摄目标例如建筑物在画面中的占比等;其中,该构图规划信息的数据集可以是预存在可移动平台或者其他的计算装置中的数据信息,自数据集中获取和拍摄目标相匹配的构图规划信息。In another example, acquiring composition planning information that matches the shooting target includes: acquiring a data set of composition planning information of calibrated photographable objects, wherein the composition planning information of each calibrated photographable object is for each calibrated photographable object. The satellite map around the photographable object is obtained by performing a preset composition, for example, by performing a preset composition on the satellite map, and adjusting the proportion of the shooting target such as a building in the picture, etc.; wherein, the data set of the composition planning information can be a preset composition. There is data information in the movable platform or other computing devices, and composition planning information matching the shooting target is obtained from the data set.
接着,在步骤S203中,基于构图规划信息,确定对拍摄目标进行拍摄时可移动平台应处于的目标拍摄位置。Next, in step S203, based on the composition planning information, a target shooting position where the movable platform should be when shooting the shooting target is determined.
目标拍摄位置可以包括可移动平台的目标拍摄高度,也即拍摄时可移动平台应处于的高度,目标拍摄位置还包括地理位置信息例如经纬度坐标信息,该经纬度坐标信息可以基于选定的拍摄目标的地理位置信息获得,例如,控制装置可以 基于卫星地图获取选定的拍摄目标的地理位置信息,并将该地理位置信息输出给可移动平台。The target shooting position may include the target shooting height of the movable platform, that is, the height the movable platform should be at when shooting, and the target shooting position may also include geographic location information such as latitude and longitude coordinate information, which may be based on the selected shooting target. Obtaining geographic location information, for example, the control device may obtain geographic location information of a selected photographing target based on a satellite map, and output the geographic location information to the movable platform.
在一个示例中,目标拍摄位置包括目标拍摄高度,基于构图规划信息,确定对拍摄目标进行拍摄时可移动平台应处于的目标拍摄位置,包括:基于构图规划信息和拍摄装置的当前视场,确定可移动平台的预估拍摄高度;获取可移动平台所在位置周围的限制高度;将预估拍摄高度和限制高度(当可移动平台为飞行器时,该限制高度也即为限制飞行高度)进行比较,确定目标拍摄高度,从而避免预估拍摄高度高于限制高度而导致可移动平台误入限飞区,引起安全风险隐患。In one example, the target shooting position includes a target shooting height, and based on the composition planning information, determining the target shooting position that the movable platform should be in when shooting the shooting target includes: based on the composition planning information and the current field of view of the shooting device, determining The estimated shooting height of the movable platform; obtain the restricted height around the position of the movable platform; compare the estimated shooting height with the limited height (when the movable platform is an aircraft, the limited height is also the limited flying height), Determine the target shooting height, so as to avoid the estimated shooting height being higher than the limit height, which will cause the movable platform to stray into the restricted flight area and cause potential safety risks.
可以基于任意适合的方法计算获得当按照构图规划信息进行拍摄时,可移动平台应处于的预估拍摄高度,例如,基于构图规划信息和拍摄装置的当前视场,确定可移动平台的预估拍摄高度,包括:获取可移动平台的拍摄装置的当前视场;基于构图规划信息,获取预设构图时拍摄装置的预设视场和可移动平台的预设高度;基于预设高度、预设视场和当前视场,确定可移动平台的预估拍摄高度。The estimated shooting height that the movable platform should be at when shooting according to the composition planning information can be calculated based on any suitable method. For example, based on the composition planning information and the current field of view of the shooting device, determine the estimated shooting height of the movable platform. The height includes: obtaining the current field of view of the shooting device of the movable platform; obtaining the preset field of view of the shooting device and the preset height of the movable platform in the preset composition based on the composition planning information; Field and current field of view to determine the estimated shooting height of the movable platform.
可以通过以下公式(1)计算获得预估拍摄高度H:The estimated shooting height H can be calculated by the following formula (1):
Figure PCTCN2021080462-appb-000001
Figure PCTCN2021080462-appb-000001
其中,V为实际拍摄时当前视场的半径,β为实际拍摄时拍摄装置的当前视场(fov)。Wherein, V is the radius of the current field of view during actual shooting, and β is the current field of view (fov) of the shooting device during actual shooting.
拍摄装置的当前视场可以从拍摄装置直接读取获得,由于实际拍摄时要按照预设构图时的构图规划信息进行拍摄,因此预设构图时预设视场的半径和实际拍摄时当前视场的半径相同,本文中均用V表示,可以通过以下公式(2)计算预设视场的半径:The current field of view of the shooting device can be directly read from the shooting device. Since the actual shooting needs to be taken according to the composition planning information in the preset composition, the radius of the preset field of view in the preset composition and the current field of view in the actual shooting The radius is the same, which is represented by V in this paper. The radius of the preset field of view can be calculated by the following formula (2):
Figure PCTCN2021080462-appb-000002
Figure PCTCN2021080462-appb-000002
其中,θ预设构图时预设视场,h为预设构图时可移动平台的预设高度。Among them, θ is the preset field of view when the preset composition is used, and h is the preset height of the movable platform when the preset composition is used.
将公式(2)代入公式(1),最终获得公式(3),通过公式(3)可以计算获得预估拍摄高度H,公式(3)如下:Substitute formula (2) into formula (1), and finally obtain formula (3). The estimated shooting height H can be calculated and obtained by formula (3). Formula (3) is as follows:
Figure PCTCN2021080462-appb-000003
Figure PCTCN2021080462-appb-000003
可选地,将预估拍摄高度和限制高度数据进行比较,确定目标拍摄高度,包括:当预估拍摄高度高于限制高度时,目标拍摄高度设定为限制高度;当预估拍摄高度低于或等于限制高度时,目标拍摄高度设定为预估拍摄高度。Optionally, comparing the estimated shooting height and the restricted height data to determine the target shooting height, including: when the estimated shooting height is higher than the limited height, the target shooting height is set as the limited height; when the estimated shooting height is lower than the limit height; When it is equal to or equal to the limit height, the target shooting height is set to the estimated shooting height.
可选地,限制高度可以是从可移动平台所在位置周围的当地法律法规中查找获得的,当地法律法规中规定有限飞区的相关规定,限飞区可以包括以下至少一种:(1)民航大型机场;(2)通航固定翼机场;(3)直升机机场;(4)特殊区域限制区域(例如限飞区),比如华盛顿、北京、商业区、军事区、办公区等;(5)其他限制区域(例如限飞区),例如临时限制区域(例如限飞区)。Optionally, the restricted height can be obtained from local laws and regulations around the location where the movable platform is located. The local laws and regulations stipulate the relevant provisions of the restricted flying area, and the restricted flying area can include at least one of the following: (1) Civil aviation Large airports; (2) General aviation fixed-wing airports; (3) Helicopter airports; (4) Special area restricted areas (such as restricted flight areas), such as Washington, Beijing, commercial areas, military areas, office areas, etc.; (5) other Restricted areas (eg, restricted areas), such as temporary restricted areas (eg, restricted areas).
在一个示例中,本申请的拍摄方法还包括:当预估拍摄高度高于限制高度时,输出第一提示信息,可以是可移动平台例如无人机当确定预估拍摄高度高于限制高度时输出第一提示信息,第一提示信息可以是例如可移动平台输出的声音或者控制报警装置例如LED灯闪烁进行提示。In an example, the shooting method of the present application further includes: when the estimated shooting height is higher than the limit height, outputting first prompt information, which may be a movable platform such as a drone. When it is determined that the estimated shooting height is higher than the limit height The first prompt information is output, and the first prompt information may be, for example, a sound output by the movable platform or control an alarm device such as an LED light to flash for prompting.
如果基于限制高度进行拍摄则可能无法完全实现预设构图的拍摄效果,因此通过第一提示信息对用户进行提示,以便用户决定是否继续进行拍摄,可以基于获取的用户指令,结束自动拍摄。If shooting based on the restricted height, the shooting effect of the preset composition may not be fully realized. Therefore, the user is prompted through the first prompt information so that the user can decide whether to continue shooting, and the automatic shooting can be ended based on the obtained user instruction.
在一个示例中,控制装置获取并显示第一提示信息,该第一提示信息可以是可移动平台例如无人机当确定预估拍摄高度高于限制高度时发送的,或者,可以是控制装置当确定预估拍摄高度高于限制高度时输出显示的,第一提示信息可以是文字信息或者其他能够提示用户的信息,文字信息例如“预设拍摄高度高于限制高度”等,还可以通过区别化显示第一提示信息的方式,区别化显示的方式包括但不限于闪烁显示、高亮显示、区别化的字体颜色等,以便使用户能够醒目的获取到提示信息,并做出决定。In one example, the control device acquires and displays first prompt information, and the first prompt information may be sent by a movable platform such as a drone when it is determined that the estimated shooting height is higher than the limit height, or it may be sent by the control device when the estimated shooting height is higher than the limit height. When it is determined that the estimated shooting height is higher than the limit height, the first prompt information can be text information or other information that can prompt the user. The text information, such as "the preset shooting height is higher than the limit height", can also be distinguished by The manner of displaying the first prompt information includes, but is not limited to, flashing display, highlight display, differentiated font color, etc., so that the user can obtain the prompt information conspicuously and make a decision.
在其他示例中,还可以是控制可移动平台飞行到限制高度之后,输出第一提示信息,例如提示用户已飞到限制高度,并且还可以通过实时回传可移动平台的传感器所采集的图像数据,从而便于用户判断当可移动平台处于限制高度而非预估拍摄高度时所拍摄的影像数据是否满足用户需求,进而由用户决定是否进行拍摄。In other examples, it is also possible to output the first prompt information after controlling the movable platform to fly to the limit height, for example, prompting the user to have flown to the limit height, and also to send back the image data collected by the sensor of the movable platform in real time. , so that it is convenient for the user to judge whether the image data captured when the movable platform is at the restricted height rather than the estimated shooting height meets the user's needs, and then the user decides whether to shoot.
在一个示例中,本申请的拍摄方法还包括:获取可移动平台的当前电量,当确定可移动平台自当前位置移动到目标拍摄位置并返航所需的电量大于当前电量时,则不触发对拍摄目标的拍摄,也即不触发可移动平台例如飞行器飞行到目标拍摄位置;当确定可移动平台自当前位置移动到目标拍摄位置并返航所需的电量小于当前电量时,则触发对拍摄目标的拍摄,例如控制可移动平台飞行到目标拍摄位置,从而避免由于电量不足而导致的无法进行拍摄的问题。In an example, the shooting method of the present application further includes: acquiring the current power of the movable platform, and when it is determined that the power required for the movable platform to move from the current position to the target shooting position and return home is greater than the current power, the shooting is not triggered. Shooting of the target, that is, without triggering the movable platform such as the aircraft to fly to the target shooting position; when it is determined that the power required for the movable platform to move from the current position to the target shooting position and return home is less than the current power, the shooting of the shooting target is triggered. , such as controlling the movable platform to fly to the target shooting position, so as to avoid the problem of unable to shoot due to insufficient power.
本申请的方法还包括:当确定可移动平台自当前位置移动到目标拍摄位置并 返航所需的电量大于当前电量时,输出第二提示信息,以便用户获知不能触发自动拍摄的原因,便于用户及时的补充电量或者进行其他操作。The method of the present application further includes: when it is determined that the power required for the movable platform to move from the current position to the target shooting position and return home is greater than the current power, output second prompt information, so that the user can know the reason why the automatic shooting cannot be triggered, so that the user can timely to replenish the battery or perform other operations.
当确定目标拍摄位置后,控制可移动平台移动到目标拍摄位置。After the target shooting position is determined, the movable platform is controlled to move to the target shooting position.
继续如图2所示,在步骤S204中,当控制可移动平台处于目标拍摄位置后,基于构图规划信息控制可移动平台搭载的拍摄装置对拍摄目标进行拍摄。基于构图规划信息控制拍摄装置对拍摄目标进行拍摄,从而无需用户在构图等方面花费过多的时间,即可快速的利用预设的构图规划信息协助用户完成可移动平台上拍摄装置的拍摄,且能够拍摄出高质量和效果很好的影像,降低了用户的学习成本,提升了用户的使用体验。Continuing as shown in FIG. 2 , in step S204 , after the movable platform is controlled to be at the target shooting position, the shooting device mounted on the movable platform is controlled to shoot the shooting target based on the composition planning information. Based on the composition planning information, the shooting device is controlled to shoot the shooting target, so that the user can quickly use the preset composition planning information to assist the user to complete the shooting of the shooting device on the movable platform without spending too much time on composition, etc., and It can shoot high-quality and effective images, reduce the user's learning cost, and improve the user's experience.
在一个示例中,所述影像拍摄方法由与所述可移动平台通信连接的控制装置执行,当控制可移动平台处于目标拍摄位置后,基于构图规划信息控制拍摄装置对拍摄目标进行拍摄,包括:当控制装置获取到可移动平台发送的反馈信息后,显示反馈信息,反馈信息是可移动平台处于所述目标拍摄位置后发送的,反馈信息可以包括但不限于文字信息等,例如“到达目标拍摄位置”一类的文字描述,以便用户及时获知该信息从而进行下一步操作。In one example, the image capturing method is executed by a control device that is communicatively connected to the movable platform, and after controlling the movable platform to be at the target shooting position, controlling the shooting device to shoot the shooting target based on the composition planning information, including: After the control device acquires the feedback information sent by the movable platform, it displays the feedback information, which is sent after the movable platform is in the target shooting position. “Location” and other text descriptions, so that users can know the information in time and proceed to the next step.
在一个示例中,所述影像拍摄方法由可移动平台执行,可移动平台和控制装置通信连接,当控制可移动平台处于目标拍摄位置后,基于构图规划信息控制拍摄装置对拍摄目标进行拍摄,包括:当控制可移动平台处于目标拍摄位置后,输出反馈信息,以使控制装置获取到可移动平台发送的反馈信息后显示反馈信息。In one example, the image capturing method is performed by a movable platform, and the movable platform is communicatively connected to a control device. After the movable platform is controlled to be at the target shooting position, the shooting device is controlled to shoot the shooting target based on the composition planning information, including: : After controlling the movable platform to be at the target shooting position, output feedback information, so that the control device displays the feedback information after acquiring the feedback information sent by the movable platform.
当控制可移动平台处于目标拍摄位置后,向用户开放拍摄模式的选择,例如,控制装置基于用户指令,显示拍摄装置的各个拍摄模式对应的选项,其中,拍摄模式包括以下模式中的至少一种:单张拍摄、堆伐、全景、360°全景、或者其他任意的拍摄模式;之后,获取用户输入的模式选择指令,例如获取用户通过点击拍摄模式设置界面显示的拍摄模式的选项而输入的模式选择指令,并根据模式选择指令,确定用于拍摄的拍摄模式,可移动平台的拍摄装置基于模式选择指令指示的拍摄模式对拍摄目标进行拍摄,以获得具有特定效果的拍摄影像,且可以使用户更快的熟悉可移动平台的拍摄装置不同拍摄功能的拍摄效果,提升对拍摄的兴趣。After the movable platform is controlled to be at the target shooting position, the selection of shooting modes is opened to the user. For example, the control device displays options corresponding to each shooting mode of the shooting device based on user instructions, wherein the shooting modes include at least one of the following modes : single shot, stacking, panorama, 360° panorama, or any other shooting mode; then, obtain the mode selection instruction input by the user, for example, obtain the mode input by the user by clicking the shooting mode option displayed on the shooting mode setting interface Select the instruction, and determine the shooting mode for shooting according to the mode selection instruction, and the shooting device of the movable platform shoots the shooting target based on the shooting mode indicated by the mode selection instruction, so as to obtain a shooting image with a specific effect, and can make the user Familiarize yourself with the shooting effects of different shooting functions of the mobile platform shooting device faster, and increase your interest in shooting.
在一个示例中,当控制可移动平台处于目标拍摄位置后,基于构图规划信息控制拍摄装置对拍摄目标进行拍摄,包括:在控制装置的显示界面上显示选中的 拍摄模式对应的拍摄效果图,拍摄效果图包括由一张或多张卫星地图而生成的满足拍摄目标的构图规划信息的预设构图,或者拍摄效果图还可以是可移动平台在处于目标拍摄位置之后,从可移动平台的传感器获取的实时图像数据。In one example, after controlling the movable platform to be at the target shooting position, controlling the shooting device to shoot the shooting target based on the composition planning information includes: displaying a shooting effect diagram corresponding to the selected shooting mode on the display interface of the control device, and shooting The renderings include a preset composition generated from one or more satellite maps that satisfies the composition planning information of the shooting target, or the renderings can also be obtained from the sensor of the movable platform after the movable platform is in the target shooting position. Live image data.
在一个示例中,当控制可移动平台处于目标拍摄位置后,基于构图规划信息控制拍摄装置对拍摄目标进行拍摄,包括:控制装置获取并显示选中的拍摄模式的预估拍摄时间,预估拍摄时间也即是指按照构图规划信息进行拍摄所需要的时间,以便用户决定是否继续进行拍摄。In an example, after controlling the movable platform to be at the target shooting position, controlling the shooting device to shoot the shooting target based on the composition planning information, including: controlling the device to acquire and display the estimated shooting time of the selected shooting mode, and the estimated shooting time That is, it refers to the time required for shooting according to the composition planning information, so that the user can decide whether to continue shooting.
当确定了拍摄模式之后,当控制可移动平台处于目标拍摄位置后,基于构图规划信息控制拍摄装置对拍摄目标进行拍摄,还包括:获取光源位置,例如,获取当前的时间信息和天气信息;基于时间信息和天气信息,确定光源位置;之后,基于光源位置和构图规划信息,控制拍摄装置对拍摄目标进行一个或多个拍摄角度的拍摄,例如根据光源位置,调整拍摄装置的位置使拍摄目标在晴天夕阳时间段在顺光光位、侧光光位、逆光光位等一个或多个拍摄角度进行拍摄,因此,无需用户手动调整拍摄角度以及学习各种拍摄角度的拍摄技巧等,即可快速的进行多个拍摄角度的拍摄,从而更快的了解到不同拍摄角度的拍摄效果,获得具有多种效果的影像,节省用户在拍摄上所花费的时间和精力,提升用户的使用体验,且可以使非专业航拍的普通用户能够获得更多无法注意的拍摄角度的拍摄影像,提升用户对航拍的兴趣。After the shooting mode is determined, after controlling the movable platform to be at the target shooting position, controlling the shooting device to shoot the shooting target based on the composition planning information, further comprising: acquiring the position of the light source, for example, acquiring current time information and weather information; Time information and weather information to determine the position of the light source; then, based on the position of the light source and the composition planning information, control the shooting device to shoot the target at one or more shooting angles, for example, according to the position of the light source, adjust the position of the shooting device so that the target is in the During the sunny day and sunset time, shooting is performed at one or more shooting angles such as the front light position, the side light position, and the backlight position. Therefore, the user does not need to manually adjust the shooting angle and learn the shooting skills of various shooting angles. Shooting from multiple shooting angles, so that you can quickly understand the shooting effects of different shooting angles, obtain images with multiple effects, save the time and energy spent by users on shooting, improve the user experience, and make non- Ordinary users of professional aerial photography can obtain more shooting images from shooting angles that cannot be noticed, increasing users' interest in aerial photography.
根据光源位置、调整拍摄装置的位置,例如可以是控制调整可移动平台的位置,或者当拍摄装置设置于云台上时,则可以控制调整云台的朝向等从而调整拍摄装置的朝向。According to the position of the light source and the position of the photographing device, for example, the position of the movable platform can be controlled and adjusted, or when the photographing device is set on the pan-tilt, the orientation of the pan-tilt can be controlled and adjusted to adjust the orientation of the photographing device.
控制装置可以从例如卫星地图、具有天气信息的应用程序等获取时间信息和天气信息,可以将时间信息和天气信息输出给可移动平台,或者控制装置直接输出光源位置信息,可移动平台获取该光源位置信息。The control device can obtain time information and weather information from, for example, satellite maps, applications with weather information, etc., and can output the time information and weather information to the movable platform, or the control device can directly output the position information of the light source, and the movable platform can obtain the light source. location information.
本申请的影像拍摄方法还包括:获取拍摄装置拍摄的影像,并在控制装置的显示界面上显示所述影像。The image capturing method of the present application further includes: acquiring an image captured by the capturing device, and displaying the image on a display interface of the control device.
综上,根据本申请实施例中的影像拍摄方法,当识别到可移动平台的拍摄范围内满足预设拍摄条件的拍摄目标后,基于构图规划信息控制拍摄装置对拍摄目标进行拍摄,从而无需用户在构图等方面花费过多的时间,即可快速的利用预设的构图规划信息协助用户完成可移动平台上拍摄装置的拍摄,且能够拍摄出高质量和效果很好的影像,降低了用户的学习成本,提升了用户的使用体验。To sum up, according to the image shooting method in the embodiment of the present application, after identifying the shooting target that meets the preset shooting conditions within the shooting range of the movable platform, the shooting device is controlled to shoot the shooting target based on the composition planning information, so that the user is not required to shoot. If you spend too much time on composition and other aspects, you can quickly use the preset composition planning information to assist the user to complete the shooting of the shooting device on the movable platform, and can shoot high-quality and effective images, reducing the user's The learning cost improves the user experience.
本申请实施例还提供的一种可移动平台,可移动平台可以包括飞行器(例如无人机)、机器人、无人车、船、云台等。本申请实施例主要以可移动平台为飞行器的情况为例。An embodiment of the present application also provides a movable platform, and the movable platform may include an aircraft (eg, an unmanned aerial vehicle), a robot, an unmanned vehicle, a ship, a gimbal, and the like. The embodiments of the present application mainly take the case where the movable platform is an aircraft as an example.
如图5所示,可移动平台可以包括:可移动平台本体500、拍摄装置504、通信接口(本文也称通讯系统,当可移动平台为飞行器时,通信接口可以对应前文的通讯系统110)、存储器502、一个或多个处理器501,拍摄装置504设置于可移动平台本体500,用于拍摄影像,通信接口504至少用于和控制装置通信连接,存储器502用于存储可执行的程序指令;可移动平台可以还动力机构,动力机构用于使可移动平台移动;一个或多个处理器501用于执行存储器中存储的程序指令,使得处理器执行前述实施例中影像拍摄方法的相关步骤,相应步骤的细节描述可以参考前文的影像拍摄方法的描述,在此不再重复。As shown in FIG. 5 , the movable platform may include: a movable platform body 500, a photographing device 504, a communication interface (also referred to as a communication system herein, when the movable platform is an aircraft, the communication interface may correspond to the foregoing communication system 110), The memory 502, one or more processors 501, the photographing device 504 is arranged on the movable platform body 500 for photographing images, the communication interface 504 is at least used for communicating with the control device, and the memory 502 is used for storing executable program instructions; The movable platform may also have a power mechanism, and the power mechanism is used to move the movable platform; one or more processors 501 are configured to execute program instructions stored in the memory, so that the processor executes the relevant steps of the image capturing method in the foregoing embodiments, For the detailed description of the corresponding steps, reference may be made to the foregoing description of the image capturing method, which will not be repeated here.
作为示例,一个或多个处理器501用于执行存储器502中存储的程序指令,使得处理器执行以下步骤:识别可移动平台的拍摄范围内满足预设拍摄条件的拍摄目标;获取和拍摄目标相匹配的构图规划信息;基于构图规划信息,确定对拍摄目标进行拍摄时可移动平台应处于的目标拍摄位置;当控制可移动平台处于目标拍摄位置后,基于构图规划信息控制拍摄装置对拍摄目标进行拍摄。在一个示例中,处理器501识别可移动平台的拍摄范围内满足预设拍摄条件的拍摄目标,包括:获取可拍摄物的标定信息,其中,标定信息包括以下信息中的至少一种:已标定可拍摄物的形状特征信息、已标定可拍摄物的位置标记信息;获取可移动平台的拍摄范围内的可拍摄物的特征信息,特征信息包括形状特征信息和/或位置信息;将可拍摄物的特征信息和标定信息进行匹配,识别可移动平台的拍摄范围内的拍摄目标,其中,满足预设拍摄条件的拍摄目标的形状特征与至少一个已标定可拍摄物的形状特征信息相匹配,和/或,拍摄目标的位置信息和一个已标定可拍摄物的位置标记信息相匹配。As an example, the one or more processors 501 are configured to execute program instructions stored in the memory 502, so that the processors perform the following steps: identifying a shooting target within the shooting range of the movable platform that meets preset shooting conditions; Matching composition planning information; based on the composition planning information, determine the target shooting position that the movable platform should be in when shooting the shooting target; after controlling the movable platform to be at the target shooting position, control the shooting device to shoot the shooting target based on the composition planning information. shoot. In one example, the processor 501 identifies a shooting target within the shooting range of the movable platform that meets a preset shooting condition, including: acquiring calibration information of the shootable object, where the calibration information includes at least one of the following information: calibrated The shape feature information of the photographable objects and the position mark information of the calibrated photographable objects; obtain the feature information of the photographable objects within the shooting range of the movable platform, and the feature information includes shape feature information and/or position information; The feature information and the calibration information are matched to identify the shooting target within the shooting range of the movable platform, wherein the shape feature of the shooting target that satisfies the preset shooting conditions matches the shape feature information of at least one calibrated photographable object, and /or, the location information of the photographing target is matched with the location marker information of a calibrated photographable object.
可选地,已标定可拍摄物的形状特征信息包括以下特征信息中的至少一种:可拍摄物的俯视形状特征、可拍摄物的侧视形状特征。Optionally, the shape feature information of the calibrated photographable object includes at least one of the following feature information: a top-view shape feature of the photographable object, and a side-view shape feature of the photographable object.
可选地,构图规划信息包括以下至少一项:构图方式、拍摄时可移动平台的高度、拍摄参数、拍摄方位,其中,构图方式包括:拍摄目标在拍摄画面中所占的比例,和/或,拍摄目标在拍摄画面中的位置。Optionally, the composition planning information includes at least one of the following: composition mode, height of the movable platform during shooting, shooting parameters, and shooting orientation, wherein the composition mode includes: the proportion of the shooting target in the shooting picture, and/or , the position of the shooting target in the shooting screen.
在一个示例中,当标定信息包括已标定可拍摄物的形状特征信息时,处理器 501获取可移动平台的拍摄范围内的可拍摄物的特征信息,包括:获取可移动平台的拍摄范围内的图像信息;基于图像信息,识别可移动平台的拍摄范围内的可拍摄物的形状特征信息。图像信息包括以下信息中的至少一种:卫星地图、可移动平台的传感器采集的图像数据等,卫星地图例如控制装置提供的可移动平台的拍摄范围内的卫星地图等,当使用卫星地图提供的图像信息时,可以通过获取控制装置存储的可移动平台的拍摄范围内的卫星地图,或者当未存储卫星地图时,也可以获取可移动平台当前的位置信息或者当前控制装置的位置信息,基于该位置信息下载获取可移动平台的拍摄范围内的卫星地图。In an example, when the calibration information includes the shape feature information of the calibrated photographable object, the processor 501 acquires the feature information of the photographable object within the photographing range of the movable platform, including: acquiring the photographic object within the photographing range of the movable platform. Image information; based on the image information, identify the shape feature information of the photographable objects within the photographing range of the movable platform. The image information includes at least one of the following information: satellite maps, image data collected by sensors of the movable platform, etc., satellite maps such as satellite maps within the shooting range of the movable platform provided by the control device, etc. When the image information is used, the satellite map within the shooting range of the movable platform stored by the control device can be obtained, or when the satellite map is not stored, the current position information of the movable platform or the current position information of the control device can also be obtained. Download the location information to obtain a satellite map within the shooting range of the mobile platform.
在一个示例中,处理器501还用于:当识别到可移动平台的拍摄范围内满足预设拍摄条件的一个或多个拍摄目标后,在图像信息中通过标识标注各个拍摄目标;输出图像信息和标识,以使控制装置在显示界面上显示图像信息和各个标识。可选地,标识包括以下标识信息中的至少一种:图案标识或文字标识,图案标识包括箭头图案标识。In an example, the processor 501 is further configured to: after identifying one or more shooting targets within the shooting range of the movable platform that meet the preset shooting conditions, mark each shooting target with an identifier in the image information; output the image information and logos, so that the control device displays image information and each logo on the display interface. Optionally, the identification includes at least one of the following identification information: a pattern identification or a character identification, and the pattern identification includes an arrow pattern identification.
在一个示例中,位置标记信息包括已标定可拍摄物的地理位置信息例如经纬度坐标信息,处理器501将可拍摄物的特征信息和标定信息进行匹配,识别可移动平台的拍摄范围内的拍摄目标,包括:获取第一位置信息,第一位置信息包括以下信息中的至少一个:可移动平台开始移动时的起始坐标信息、控制装置所处的坐标位置信息;识别第一位置信息周围的与位置标记信息相匹配的一个或多个拍摄目标。In one example, the location marker information includes geographic location information of the calibrated photographable object, such as latitude and longitude coordinate information, and the processor 501 matches the feature information of the photographable object with the calibration information to identify the photographing target within the photographing range of the movable platform , including: acquiring first position information, where the first position information includes at least one of the following information: the starting coordinate information when the movable platform starts to move, the coordinate position information where the control device is located; The location tag information matches one or more shooting targets.
控制装置的显示界面上显示有图像信息,图像信息中显示有多个拍摄目标,图像信息包括卫星地图或可移动平台的传感器采集的图像数据,在一个示例中,当识别到多个拍摄目标时,处理器501还用于:基于用户的选择指令,确定多个拍摄目标中的一个进行拍摄,例如处理器获取控制装置输出的选择指令,确定多个拍摄目标中的一个进行拍摄,也即确定选择指令指示的拍摄目标进行拍摄。Image information is displayed on the display interface of the control device, and multiple shooting targets are displayed in the image information. The image information includes a satellite map or image data collected by sensors of a movable platform. In one example, when multiple shooting targets are identified , the processor 501 is further configured to: determine one of the multiple shooting targets to shoot based on the user's selection instruction, for example, the processor obtains the selection instruction output by the control device, and determines one of the multiple shooting targets to shoot, that is, to determine Select the subject indicated by the command to shoot.
在一个示例中,处理器501获取和拍摄目标相匹配的构图规划信息,包括:获取拍摄目标的至少一个历史拍摄影像的构图规划信息;基于至少一个历史拍摄影像的构图规划信息,确定拍摄目标的构图规划信息,例如,控制装置获取至少一个历史拍摄影像的构图规划信息,并输出该构图规划信息,处理器501从控制装置获取至少一个历史拍摄影像的构图规划信息。In an example, the processor 501 obtains composition planning information matching the shooting target, including: obtaining composition planning information of at least one historically captured image of the shooting target; For composition planning information, for example, the control device acquires composition planning information of at least one historically captured image, and outputs the compositional planning information, and the processor 501 acquires the compositional planning information of at least one historically captured image from the control device.
在一个示例中,处理器501获取和拍摄目标相匹配的构图规划信息,包括:获取已标定可拍摄物的构图规划信息的数据集,其中,各个已标定可拍摄物的构 图规划信息为对各个已标定可拍摄物周围的卫星地图进行预设构图而获得的;自数据集中获取和拍摄目标相匹配的构图规划信息。In an example, the processor 501 obtains composition planning information matching the shooting target, including: obtaining a data set of composition planning information of the calibrated photographable objects, wherein the composition planning information of each calibrated photographable object is for each The satellite map around the object that can be photographed has been calibrated and obtained by preset composition; the composition planning information matching the shooting target is obtained from the data set.
可选地,同一已标定可拍摄物对应一个或多个具有大体相同的形状特征的拍摄目标。Optionally, the same calibrated photographable object corresponds to one or more photographic targets having substantially the same shape feature.
在一个示例中,目标拍摄位置包括目标拍摄高度,处理器501基于构图规划信息,确定对拍摄目标进行拍摄时可移动平台应处于的目标拍摄位置,包括:基于构图规划信息和拍摄装置的当前视场,确定可移动平台的预估拍摄高度;获取可移动平台所在位置周围的限制高度;将预估拍摄高度和限制高度进行比较,确定目标拍摄高度。In one example, the target shooting position includes the target shooting height, and the processor 501 determines, based on the composition planning information, the target shooting position that the movable platform should be in when shooting the shooting target, including: based on the composition planning information and the current view of the shooting device field, determine the estimated shooting height of the movable platform; obtain the restricted height around the location of the movable platform; compare the estimated shooting height with the limited height to determine the target shooting height.
在一个示例中,处理器501将预估拍摄高度和限制高度数据进行比较,确定目标拍摄高度,包括:当预估拍摄高度高于限制高度时,目标拍摄高度设定为限制高度;当预估拍摄高度低于或等于限制高度时,目标拍摄高度设定为预估拍摄高度。In one example, the processor 501 compares the estimated shooting height with the restricted height data, and determines the target shooting height, including: when the estimated shooting height is higher than the limited height, the target shooting height is set as the limited height; when the estimated shooting height is higher than the limited height; When the shooting height is lower than or equal to the limit height, the target shooting height is set as the estimated shooting height.
在一个示例中,处理器501基于构图规划信息和拍摄装置的当前视场,确定可移动平台的预估拍摄高度,包括:获取可移动平台的拍摄装置的当前视场;基于构图规划信息,获取预设构图时拍摄装置的预设视场和可移动平台的预设高度;基于预设高度、预设视场和当前视场,确定可移动平台的预估拍摄高度。In one example, the processor 501 determines the estimated shooting height of the movable platform based on the composition planning information and the current field of view of the shooting device, including: acquiring the current field of view of the shooting device of the movable platform; based on the composition planning information, acquiring When the composition is preset, the preset field of view of the shooting device and the preset height of the movable platform are determined; the estimated shooting height of the movable platform is determined based on the preset height, the preset field of view, and the current field of view.
在一个示例中,处理器501还用于:当预估拍摄高度高于限制高度时,输出第一提示信息。可以是可移动平台例如无人机当确定预估拍摄高度高于限制高度时输出第一提示信息,第一提示信息可以是例如可移动平台输出的声音或者控制报警装置例如LED灯闪烁进行提示。或者,处理器501还用于:当预估拍摄高度高于限制高度时,输出第一提示信息,以使控制装置获取并显示该第一提示信息。In an example, the processor 501 is further configured to: output the first prompt information when the estimated shooting height is higher than the limit height. It can be a movable platform such as a drone that outputs first prompt information when it is determined that the estimated shooting height is higher than the limit height. The first prompt information can be, for example, a sound output by the movable platform or control an alarm device such as an LED light to flash to prompt. Alternatively, the processor 501 is further configured to: when the estimated shooting height is higher than the limit height, output the first prompt information, so that the control device acquires and displays the first prompt information.
在一个示例中,处理器501还用于:获取可移动平台的当前电量,当确定可移动平台自当前位置移动到目标拍摄位置并返航所需的电量大于当前电量时,则不触发对拍摄目标的拍摄;当确定可移动平台自当前位置移动到目标拍摄位置并返航所需的电量小于当前电量时,则触发对拍摄目标的拍摄。In an example, the processor 501 is further configured to: acquire the current power of the movable platform, and when it is determined that the power required for the movable platform to move from the current position to the target shooting position and return home is greater than the current power, then do not trigger the shooting of the target shooting; when it is determined that the power required for the movable platform to move from the current position to the target shooting position and return home is less than the current power, the shooting of the shooting target is triggered.
在一个示例中,处理器501还用于:当确定可移动平台自当前位置移动到目标拍摄位置并返航所需的电量大于当前电量时,输出第二提示信息,以使控制装置获取并显示第二提示信息。In an example, the processor 501 is further configured to: when it is determined that the power required for the movable platform to move from the current position to the target shooting position and return home is greater than the current power, output the second prompt information, so that the control device obtains and displays the first Two prompt information.
在一个示例中,当控制可移动平台处于目标拍摄位置后,处理器501基于构 图规划信息控制拍摄装置对拍摄目标进行拍摄,包括:当控制可移动平台处于目标拍摄位置后,输出反馈信息,以使控制装置获取到反馈信息后显示反馈信息,以及使控制装置基于用户指令显示拍摄装置的各个拍摄模式对应的选项,其中,拍摄模式包括以下模式中的至少一种:单张拍摄、堆伐、全景、360°全景;获取控制装置输出的模式选择指令,并根据模式选择指令,确定用于拍摄的拍摄模式。In one example, after controlling the movable platform to be at the target shooting position, the processor 501 controls the shooting device to shoot the shooting target based on the composition planning information, including: after controlling the movable platform to be at the target shooting position, outputting feedback information to After the control device obtains the feedback information, the feedback information is displayed, and the control device is caused to display options corresponding to each shooting mode of the shooting device based on the user's instruction, wherein the shooting mode includes at least one of the following modes: single shooting, stacking, Panorama and 360° panorama; obtain the mode selection instruction output by the control device, and determine the shooting mode for shooting according to the mode selection instruction.
在一个示例中,当控制可移动平台处于目标拍摄位置后,处理器501基于构图规划信息控制拍摄装置对拍摄目标进行拍摄,包括:当获取到控制装置输出的模式选择指令时,输出与选中的拍摄模式对应的拍摄效果图,以使控制装置显示选中的拍摄模式对应的拍摄效果图,拍摄效果图包括由一张或多张卫星地图而生成的满足拍摄目标的构图规划信息的预设构图。In one example, after controlling the movable platform to be at the target shooting position, the processor 501 controls the shooting device to shoot the shooting target based on the composition planning information, including: when the mode selection instruction output by the control device is acquired, outputting the selected The shooting effect map corresponding to the shooting mode, so that the control device displays the shooting effect map corresponding to the selected shooting mode, and the shooting effect map includes a preset composition generated from one or more satellite maps that meets the composition planning information of the shooting target.
在一个示例中,当控制可移动平台处于目标拍摄位置后,处理器501基于构图规划信息控制拍摄装置对拍摄目标进行拍摄,包括:当获取到控制装置输出的模式选择指令时,输出与选中的拍摄模式对应的预估拍摄时间,以使控制装置获取并显示选中的拍摄模式的预估拍摄时间。In one example, after controlling the movable platform to be at the target shooting position, the processor 501 controls the shooting device to shoot the shooting target based on the composition planning information, including: when the mode selection instruction output by the control device is acquired, outputting the selected The estimated shooting time corresponding to the shooting mode, so that the control device acquires and displays the estimated shooting time of the selected shooting mode.
在一个示例中,当控制可移动平台处于目标拍摄位置后,处理器501基于构图规划信息控制拍摄装置对拍摄目标进行拍摄,包括:获取当前的时间信息和天气信息;基于时间信息和天气信息,确定光源位置;基于光源位置和构图规划信息,控制拍摄装置对拍摄目标进行一个或多个拍摄角度的拍摄。In one example, after controlling the movable platform to be at the target shooting position, the processor 501 controls the shooting device to shoot the shooting target based on the composition planning information, including: acquiring current time information and weather information; based on the time information and weather information, Determine the position of the light source; based on the position of the light source and the composition planning information, control the photographing device to photograph the photographing target at one or more photographing angles.
根据本申请实施例中的可移动平台,当识别到可移动平台的拍摄范围内满足预设拍摄条件的拍摄目标后,基于构图规划信息控制拍摄装置对拍摄目标进行拍摄,从而无需用户在构图等方面花费过多的时间,即可快速的利用预设的构图规划信息协助用户完成可移动平台上拍摄装置的拍摄,且能够拍摄出高质量和效果很好的影像,降低了用户的学习成本,提升了用户的使用体验。According to the movable platform in the embodiment of the present application, after identifying a shooting target that meets the preset shooting conditions within the shooting range of the movable platform, the shooting device is controlled to shoot the shooting target based on the composition planning information, so that the user does not need to compose the picture, etc. If you spend too much time in the aspect, you can quickly use the preset composition planning information to assist the user to complete the shooting of the shooting device on the movable platform, and can shoot high-quality and effective images, reducing the user's learning cost, Improve the user experience.
如图6所示,本申请实施例还提供一种可移动平台的控制装置,该控制装置可以是独立于可移动平台的外部设备,例如可移动平台的控制控制装置,控制控制装置可以包括例如手机、遥控器、平板电脑、笔记本等,该控制装置还可以是可移动平台的控制系统的一部分或者全部,还可以是可以通过软件、硬件或者软硬件结合的方式实现可移动平台的控制方法的计算机设备的部分或者全部。As shown in FIG. 6 , an embodiment of the present application further provides a control device for a movable platform, and the control device may be an external device independent of the movable platform, such as a control device for the movable platform. The control device may include, for example, a control device for a movable platform. Mobile phone, remote control, tablet computer, notebook, etc., the control device can also be a part or all of the control system of the mobile platform, or can realize the control method of the mobile platform through software, hardware or a combination of software and hardware. part or all of computer equipment.
如图6所示,可移动平台的控制装置600,包括一个或多个存储器601、一个或多个处理器602、通信接口603(可以和图1中的通信系统114对应)、显示 器604等,这些组件通过总线系统和/或其它形式的连接机构(未示出)互连。应当注意,图6所示的装置600的组件和结构只是示例性的,而非限制性的,根据需要,控制装置600也可以具有其他组件和结构。处理器602用于执行存储器601中存储的程序指令,使得处理器执行前文中影像拍摄方法的部分步骤和全部步骤,其中,为了避免重复,对于一些步骤的细节描述可以参考前文,在此不再赘述。As shown in FIG. 6, the control device 600 of the movable platform includes one or more memories 601, one or more processors 602, a communication interface 603 (which may correspond to the communication system 114 in FIG. 1), a display 604, etc., These components are interconnected by a bus system and/or other form of connection mechanism (not shown). It should be noted that the components and structures of the device 600 shown in FIG. 6 are only exemplary and not restrictive, and the control device 600 may also have other components and structures as required. The processor 602 is configured to execute the program instructions stored in the memory 601, so that the processor executes some steps and all steps of the image capturing method in the foregoing, wherein, in order to avoid repetition, for the detailed description of some steps, reference may be made to the foregoing, which will not be repeated here. Repeat.
存储器601用于存储相关可移动平台移动过程中产生的各种数据和可执行程序指令,例如用于存储各种应用程序或实现各种具体功能的算法。可以包括一个或多个计算机程序产品,计算机程序产品可以包括各种形式的计算机可读存储介质,例如易失性存储器和/或非易失性存储器。易失性存储器例如可以包括随机存取存储器(RAM)和/或高速缓冲存储器(cache)等。非易失性存储器例如可以包括只读存储器(ROM)、硬盘、闪存等。The memory 601 is used to store various data and executable program instructions generated during the movement of the relevant movable platform, for example, used to store various application programs or algorithms for implementing various specific functions. One or more computer program products may be included, and the computer program products may include various forms of computer-readable storage media, such as volatile memory and/or non-volatile memory. Volatile memory may include, for example, random access memory (RAM) and/or cache memory, among others. Non-volatile memory may include, for example, read only memory (ROM), hard disk, flash memory, and the like.
处理器602可以是中央处理单元(CPU)、图像处理单元(GPU)、专用集成电路(ASIC)、现场可编程门阵列(FPGA)或者具有数据处理能力和/或指令执行能力的其它形式的处理单元,并且可以控制装置600中的其它组件以执行期望的功能。例如,处理器能够包括一个或多个嵌入式处理器、处理器核心、微型处理器、逻辑电路、硬件有限状态机(FSM)、数字信号处理器(DSP)、图像处理单元(GPU)或它们的组合。 Processor 602 may be a central processing unit (CPU), graphics processing unit (GPU), application specific integrated circuit (ASIC), field programmable gate array (FPGA), or other form of processing with data processing capabilities and/or instruction execution capabilities unit, and may control other components in device 600 to perform desired functions. For example, a processor can include one or more embedded processors, processor cores, microprocessors, logic circuits, hardware finite state machines (FSMs), digital signal processors (DSPs), graphics processing units (GPUs), or the like The combination.
显示器604用于显示各种可视化信息,例如可视化信息包括但不限于可移动平台传回的图像数据、各种操作页面、拍摄装置拍摄的影像等。The display 604 is used to display various visual information, for example, the visual information includes, but is not limited to, image data returned by the movable platform, various operation pages, images captured by the photographing device, and the like.
如图6所示,可移动平台的控制装置600可以包括一个或多个存储器601,用于存储可执行的程序指令,处理器602用于执行存储器601中存储的程序指令,使得处理器执行以下步骤:识别可移动平台的拍摄范围内满足预设拍摄条件的拍摄目标;获取和拍摄目标相匹配的构图规划信息;基于构图规划信息,确定对拍摄目标进行拍摄时可移动平台应处于的目标拍摄位置;输出控制指令,以使可移动平台获取到控制指令后,基于控制指令移动到目标拍摄位置,并使可移动平台基于构图规划信息控制拍摄装置对拍摄目标进行拍摄。As shown in FIG. 6 , the control device 600 of the movable platform may include one or more memories 601 for storing executable program instructions, and a processor 602 for executing the program instructions stored in the memory 601, so that the processor executes the following Steps: Identify the shooting target that meets the preset shooting conditions within the shooting range of the movable platform; obtain composition planning information that matches the shooting target; based on the composition planning information, determine the target shooting where the movable platform should be when shooting the shooting target position; output control instructions, so that after the movable platform obtains the control instructions, it moves to the target shooting position based on the control instructions, and enables the movable platform to control the shooting device to shoot the shooting target based on the composition planning information.
在一个示例中,处理器602识别可移动平台的拍摄范围内满足预设拍摄条件的拍摄目标,包括:获取可拍摄物的标定信息,其中,标定信息包括以下信息中的至少一种:已标定可拍摄物的形状特征信息、已标定可拍摄物的位置标记信息;标定信息可以存储在可移动平台的存储器中,或者其他的服务器中,控制装置可 以从可移动平台或服务器获取该标定信息,获取可移动平台的拍摄范围内的可拍摄物的特征信息,特征信息包括形状特征信息和/或位置信息;将可拍摄物的特征信息和标定信息进行匹配,识别可移动平台的拍摄范围内的拍摄目标,其中,满足预设拍摄条件的拍摄目标的形状特征与至少一个已标定可拍摄物的特征信息相匹配,和/或,拍摄目标的位置信息和一个已标定可拍摄物的位置标记信息相匹配。In one example, the processor 602 identifies a shooting target that meets a preset shooting condition within the shooting range of the movable platform, including: acquiring calibration information of the shootable object, wherein the calibration information includes at least one of the following information: calibrated The shape feature information of the photographable object, the position marker information of the calibrated photographable object; the calibration information can be stored in the memory of the movable platform, or in other servers, and the control device can obtain the calibration information from the movable platform or the server, Obtain the feature information of the photographable objects within the shooting range of the movable platform, and the feature information includes shape feature information and/or position information; Shooting targets, wherein the shape features of the shooting targets that meet the preset shooting conditions are matched with the feature information of at least one calibrated photographable object, and/or the position information of the shooting target and the position mark information of a calibrated photographable object match.
可选地,已标定可拍摄物的形状特征信息包括以下特征信息中的至少一种:可拍摄物的俯视形状特征、可拍摄物的侧视形状特征。可选地,同一已标定可拍摄物对应一个或多个具有大体相同的形状特征的拍摄目标。Optionally, the shape feature information of the calibrated photographable object includes at least one of the following feature information: a top-view shape feature of the photographable object, and a side-view shape feature of the photographable object. Optionally, the same calibrated photographable object corresponds to one or more photographic targets having substantially the same shape feature.
可选地,控制装置获取可移动平台输出的特征信息,或者,控制装置获取可移动平台输出的图像信息例如传感器采集的图像数据等,处理器602自动识别图像信息中的可拍摄物的形状特征信息,或者,处理器602获取卫星地图自动识别卫星地图中的可拍摄物的形状特征信息,或者,处理器602获取可移动平台的位置传感器输出的拍摄目标的位置信息等。Optionally, the control device obtains feature information output by the movable platform, or the control device obtains image information output from the movable platform, such as image data collected by a sensor, etc., and the processor 602 automatically identifies the shape features of the photographable objects in the image information. information, or, the processor 602 obtains the shape feature information of the photographable objects in the satellite map to automatically identify the satellite map, or the processor 602 obtains the position information of the photographing target output by the position sensor of the movable platform, and the like.
在一个示例中,当标定信息包括已标定可拍摄物的形状特征信息时,处理器602获取可移动平台的拍摄范围内的可拍摄物的特征信息,包括:获取可移动平台的拍摄范围内的图像信息;基于图像信息,识别可移动平台的拍摄范围内的可拍摄物的形状特征信息。可选地,图像信息包括以下信息中的至少一种:卫星地图、可移动平台的传感器采集的图像数据。In one example, when the calibration information includes the shape feature information of the calibrated photographable object, the processor 602 acquires the feature information of the photographable object within the photographing range of the movable platform, including: acquiring the photographic object within the photographing range of the movable platform. Image information; based on the image information, identify the shape feature information of the photographable objects within the photographing range of the movable platform. Optionally, the image information includes at least one of the following information: a satellite map, and image data collected by sensors of the movable platform.
在一个示例中,当识别到可移动平台的拍摄范围内满足预设拍摄条件的一个或多个拍摄目标后,处理器602用于在图像信息中通过标识标注各个拍摄目标,图像信息包括以下信息中的至少一种:卫星地图、可移动平台的传感器采集的图像数据;显示器604用于显示图像信息和各个标识。可选地,标识包括以下标识信息中的至少一种:图案标识或文字标识,图案标识包括箭头图案标识。In one example, after recognizing one or more shooting targets within the shooting range of the movable platform that meet the preset shooting conditions, the processor 602 is configured to mark each shooting target with an identifier in the image information, and the image information includes the following information At least one of: satellite map, image data collected by sensors of the movable platform; the display 604 is used to display image information and various signs. Optionally, the identification includes at least one of the following identification information: a pattern identification or a character identification, and the pattern identification includes an arrow pattern identification.
在一个示例中,位置标记信息包括一个或多个已标定可拍摄物的地理位置信息,处理器602将可拍摄物的特征信息和标定信息进行匹配,识别可移动平台的拍摄范围内的拍摄目标,包括:获取第一位置信息,第一位置信息包括以下信息中的至少一个:可移动平台开始移动时的起始坐标信息、控制装置所处的坐标位置信息;识别第一位置信息周围的与位置标记信息相匹配的一个或多个拍摄目标。In one example, the location marker information includes geographic location information of one or more calibrated photographable objects, and the processor 602 matches the feature information of the photographable objects with the calibration information to identify the photographing target within the photographing range of the movable platform , including: acquiring first position information, where the first position information includes at least one of the following information: the starting coordinate information when the movable platform starts to move, the coordinate position information where the control device is located; The location tag information matches one or more shooting targets.
在一个示例中,当识别到多个拍摄目标时,处理器602还用于:基于用户输入的选择指令,在图像信息中选中多个拍摄目标中的一个进行拍摄。In an example, when multiple shooting targets are identified, the processor 602 is further configured to: select one of the multiple shooting targets in the image information for shooting based on a selection instruction input by the user.
在一个示例中,处理器用于获取和拍摄目标相匹配的构图规划信息,包括:获取拍摄目标的至少一个历史拍摄影像的构图规划信息;基于至少一个历史拍摄影像的构图规划信息,确定拍摄目标的构图规划信息,并输出该构图规划信息,以使可移动平台获取该构图规划信息并基于该构图规划信息对拍摄目标进行拍摄。In one example, the processor is configured to acquire composition planning information matching the shooting target, including: acquiring composition planning information of at least one historically shot image of the shooting target; and determining the composition planning information of the shooting target based on the composition planning information of at least one historically shot image Composition planning information, and outputting the composition planning information, so that the movable platform obtains the composition planning information and shoots the shooting target based on the composition planning information.
在一个示例中,处理器用于获取和拍摄目标相匹配的构图规划信息,包括:获取已标定可拍摄物的构图规划信息的数据集,其中,各个已标定可拍摄物的构图规划信息为对各个已标定可拍摄物周围的卫星地图进行预设构图而获得的;自数据集中获取和拍摄目标相匹配的构图规划信息,并输出该构图规划信息,以使可移动平台获取该构图规划信息并基于该构图规划信息对拍摄目标进行拍摄。In one example, the processor is configured to acquire composition planning information that matches the shooting target, including: acquiring a dataset of composition planning information of calibrated photographable objects, wherein the composition planning information of each calibrated photographable object is for each Obtained by pre-setting the composition on the satellite map around the target that has been calibrated; obtaining the composition planning information matching the shooting target from the data set, and outputting the composition planning information, so that the mobile platform can obtain the composition planning information and based on the composition planning information The composition planning information is used to photograph the photographic target.
可选地,构图规划信息包括以下至少一项:构图方式、可移动平台的预设高度、拍摄参数、拍摄方位,其中,构图方式包括:拍摄目标在拍摄画面中所占的比例,和/或,拍摄目标在拍摄画面中的位置。Optionally, the composition planning information includes at least one of the following: composition mode, preset height of the movable platform, shooting parameters, and shooting orientation, wherein the composition mode includes: the proportion of the shooting target in the shooting picture, and/or , the position of the shooting target in the shooting screen.
在一个示例中,目标拍摄位置包括目标拍摄高度,处理器602基于构图规划信息,确定对拍摄目标进行拍摄时可移动平台应处于的目标拍摄位置,包括:基于构图规划信息和拍摄装置当前的第一视场,确定可移动平台的预估拍摄高度;获取可移动平台所在位置周围的限制高度;将预估拍摄高度和限制高度进行比较,确定目标拍摄高度。In one example, the target shooting position includes the target shooting height, and the processor 602 determines, based on the composition planning information, the target shooting position that the movable platform should be in when shooting the shooting target, including: based on the composition planning information and the current first position of the shooting device In a field of view, determine the estimated shooting height of the movable platform; obtain the restricted height around the position of the movable platform; compare the estimated shooting height with the limited height to determine the target shooting height.
在一个示例中,处理器602基于构图规划信息和拍摄装置的当前视场,确定可移动平台的预估拍摄高度,包括:获取可移动平台的拍摄装置的当前视场;基于构图规划信息,获取预设构图时拍摄装置的预设视场和可移动平台的预设高度;基于预设高度、预设视场和当前视场,确定可移动平台的预估拍摄高度。In one example, the processor 602 determines the estimated shooting height of the movable platform based on the composition planning information and the current field of view of the shooting device, including: acquiring the current field of view of the shooting device of the movable platform; When the composition is preset, the preset field of view of the shooting device and the preset height of the movable platform are determined; the estimated shooting height of the movable platform is determined based on the preset height, the preset field of view, and the current field of view.
在一个示例中,处理器602将预估拍摄高度和限制高度数据进行比较,确定目标拍摄高度,包括:当预估拍摄高度高于限制高度时,目标拍摄高度设定为限制高度;当预估拍摄高度低于或等于限制高度时,目标拍摄高度设定为预估拍摄高度。In one example, the processor 602 compares the estimated shooting height with the limited height data, and determines the target shooting height, including: when the estimated shooting height is higher than the limited height, the target shooting height is set as the limited height; when the estimated shooting height is higher than the limited height; When the shooting height is lower than or equal to the limit height, the target shooting height is set as the estimated shooting height.
在一个示例中,显示器604还用于:获取并显示第一提示信息,第一提示信息用于提示可移动平台的预估拍摄高度高于限制高度。第一提示信息为当处理器602确定所述预估拍摄高度高于所述限制高度时输出的,或者,第一提示信息为当可移动平台确定预估拍摄高度高于所述限制高度时输出的。In an example, the display 604 is further configured to: acquire and display first prompt information, where the first prompt information is used to prompt that the estimated shooting height of the movable platform is higher than the limit height. The first prompt information is output when the processor 602 determines that the estimated shooting height is higher than the limit height, or the first prompt information is output when the movable platform determines that the estimated shooting height is higher than the limit height. of.
在一个示例中,显示器604还用于获取并显示第二提示信息,第二提示信息 用于提示可移动平台自当前位置移动到目标拍摄位置并返航所需的电量大于当前电量,目标拍摄位置包括目标拍摄高度,目标拍摄高度包括预估拍摄高度或限制高度。In an example, the display 604 is further configured to acquire and display second prompt information, where the second prompt information is used to prompt the movable platform to move from the current position to the target shooting position and return to the home, and the required power is greater than the current power, and the target shooting position includes Target shooting height, target shooting height includes estimated shooting height or restricted height.
在一个示例中,显示器604还用于:获取并显示可移动平台处于目标拍摄位置后输出的反馈信息;以及基于用户指令显示拍摄装置的各个拍摄模式对应的选项,其中,拍摄模式包括以下模式中的至少一种:单张拍摄、堆伐、全景、360°全景。In one example, the display 604 is further configured to: acquire and display feedback information output after the movable platform is in the target shooting position; and display options corresponding to each shooting mode of the shooting device based on user instructions, wherein the shooting modes include the following modes At least one of: Single Shot, Felling, Panorama, 360° Panorama.
在一个示例中,处理器602还用于:获取用户输入的模式选择指令,并根据模式选择指令,确定用于拍摄的拍摄模式,并输出模式选择指令,以控制可移动平台的拍摄装置基于对应的拍摄模式进行拍摄。In one example, the processor 602 is further configured to: obtain a mode selection instruction input by the user, determine a shooting mode for shooting according to the mode selection instruction, and output the mode selection instruction, so as to control the shooting device of the movable platform based on the corresponding the shooting mode to shoot.
在一个示例中,显示器604还用于:显示与选中的拍摄模式对应的拍摄效果图,拍摄效果图包括由一张或多张卫星地图而生成的满足拍摄目标的构图规划信息的预设构图。In one example, the display 604 is further configured to: display a shooting effect map corresponding to the selected shooting mode, where the shooting effect map includes a preset composition generated from one or more satellite maps and satisfying the composition planning information of the shooting target.
在一个示例中,显示器604还用于:显示与选中的拍摄模式对应的预估拍摄时间。In one example, the display 604 is further configured to: display the estimated shooting time corresponding to the selected shooting mode.
可选地,显示器604还用于显示以下信息中的至少一种信息:天气信息、时间信息、位置信息、光源位置信息。Optionally, the display 604 is further configured to display at least one of the following information: weather information, time information, location information, and light source location information.
在一个示例中,控制装置600还包括输出装置可以向外部(例如用户)输出各种信息(例如图像或声音),并且可以包括显示器、扬声器等中的一个或多个。In one example, the control device 600 further includes an output device that can output various information (eg, images or sounds) to the outside (eg, a user), and may include one or more of a display, a speaker, and the like.
在一个示例中,控制装置600还包括显示器,可以用于获取限制区域的栅格地图,并在显示界面上显示栅格地图。In one example, the control device 600 further includes a display, which can be used to obtain a grid map of the restricted area, and display the grid map on the display interface.
在一个示例中,控制装置600还包括通信接口603,用于控制装置600中各个组件之间以及控制装置600的各个组件和该系统之外的其他装置之间进行通信,例如,当装置为外部设备时,可以通过通信接口和可移动平台进行通信,从而使两者之间能进行信息交互。In one example, the control device 600 further includes a communication interface 603 for communicating between various components in the control device 600 and between the various components of the control device 600 and other devices outside the system, for example, when the device is an external device When the device is installed, it can communicate with the movable platform through the communication interface, so that information can be exchanged between the two.
通信接口603是可以是目前已知的任意通信协议的接口,例如有线接口或无线接口,其中,通信接口可以包括一个或者多个串口、USB接口、以太网端口、WiFi、有线网络、DVI接口,设备集成互联模块或其他适合的各种端口、接口,或者连接。装置600还可以接入基于通信标准的无线网络,如WiFi、2G、3G、4G、6G或它们的组合。在一个示例性实施例中,通信接口经由广播信道接收来自外部广播管理系统的广播信号或广播相关信息。在一个示例性实施例中,通信 接口还包括近场通信(NFC)模块,以促进短程通信。例如,在NFC模块可基于射频识别(RFID)技术,红外数据协会(IrDA)技术,超宽带(UWB)技术,蓝牙(BT)技术和其他技术来实现。The communication interface 603 is an interface that can be any currently known communication protocol, such as a wired interface or a wireless interface, wherein the communication interface can include one or more serial ports, a USB interface, an Ethernet port, WiFi, a wired network, and a DVI interface, The device integrates interconnect modules or other suitable various ports, interfaces, or connections. Device 600 may also access wireless networks based on communication standards, such as WiFi, 2G, 3G, 4G, 6G, or a combination thereof. In one exemplary embodiment, the communication interface receives broadcast signals or broadcast related information from an external broadcast management system via a broadcast channel. In one exemplary embodiment, the communication interface further includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module may be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.
在一个示例中,装置600还包括输入装置(未示出)可以是用户用来输入指令的装置,并且可以包括键盘、轨迹球、鼠标、麦克风和触摸屏等中的一个或多个,或其它控制按钮构成的输入装置。In one example, device 600 also includes an input device (not shown) that may be a device used by a user to input instructions, and may include one or more of a keyboard, trackball, mouse, microphone, touch screen, etc., or other controls An input device consisting of buttons.
本申请实施例中的控制装置用于实现前述的影像拍摄方法,因此也具有前述影像拍摄方法的优点。The control device in the embodiment of the present application is used to implement the aforementioned image capturing method, and thus also has the advantages of the aforementioned image capturing method.
另外,本申请实施例还提供了一种计算机存储介质,例如计算机可读存储介质,其上存储有计算机程序。在所述计算机存储介质上可以存储一个或多个计算机程序指令,处理器可以运行存储器存储的所述程序指令,以实现本文所述的本申请实施例中(由处理器实现)的功能以及/或者其它期望的功能,例如以执行根据本申请实施例的影像拍摄方法200的相应步骤,在所述计算机可读存储介质中还可以存储各种应用程序和各种数据,例如所述应用程序使用和/或产生的各种数据等。In addition, the embodiments of the present application further provide a computer storage medium, such as a computer-readable storage medium, on which a computer program is stored. One or more computer program instructions may be stored on the computer storage medium, and the processor may execute the program instructions stored in the memory to implement the functions (implemented by the processor) in the embodiments of the present application described herein and/or or other desired functions, for example, to execute the corresponding steps of the image capturing method 200 according to the embodiment of the present application, various application programs and various data may also be stored in the computer-readable storage medium, for example, the application program uses and/or various data generated, etc.
例如,所述计算机可读存储介质例如可以包括智能电话的存储卡、平板电脑的存储部件、个人计算机的硬盘、只读存储器(ROM)、可擦除可编程只读存储器(EPROM)、便携式紧致盘只读存储器(CD-ROM)、USB存储器、或者上述存储介质的任意组合。所述计算机可读存储介质可以是一个或多个计算机可读存储介质的任意组合。For example, the computer-readable storage medium may include, for example, a memory card of a smartphone, a storage component of a tablet computer, a hard disk of a personal computer, a read only memory (ROM), an erasable programmable read only memory (EPROM), a portable compact disk read only memory (CD-ROM), USB memory, or any combination of the above storage media. The computer-readable storage medium can be any combination of one or more computer-readable storage media.
应当理解,本申请的各部分可以用硬件、软件、固件或它们的组合来实现。在上述实施方式中,多个步骤或方法可以用存储在存储器中且由合适的指令执行系统执行的软件或固件来实现。如,如果用硬件来实现和在另一实施方式中一样,可用本领域公知的下列技术中的任一项或他们的组合来实现:具有用于对数据信号实现逻辑功能的逻辑门电路的离散逻辑电路,具有合适的组合逻辑门电路的专用集成电路,可编程门阵列(Programmable Gate Array;以下简称:PGA),现场可编程门阵列(Field Programmable Gate Array;简称:FPGA)等。It should be understood that various parts of this application may be implemented in hardware, software, firmware, or a combination thereof. In the above-described embodiments, various steps or methods may be implemented in software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware as in another embodiment, it can be implemented by any one of the following techniques known in the art, or a combination thereof: discrete with logic gates for implementing logic functions on data signals Logic circuits, application-specific integrated circuits with suitable combinational logic gate circuits, Programmable Gate Array (hereinafter referred to as: PGA), Field Programmable Gate Array (Field Programmable Gate Array; referred to as: FPGA), etc.
尽管这里已经参考附图描述了示例实施例,应理解上述示例实施例仅仅是示例性的,并且不意图将本申请的范围限制于此。本领域普通技术人员可以在其中进行各种改变和修改,而不偏离本申请的范围和精神。所有这些改变和修改意在被包括在所附权利要求所要求的本申请的范围之内。Although example embodiments have been described herein with reference to the accompanying drawings, it should be understood that the above-described example embodiments are exemplary only, and are not intended to limit the scope of the application thereto. Various changes and modifications may be made therein by those of ordinary skill in the art without departing from the scope and spirit of the present application. All such changes and modifications are intended to be included within the scope of this application as claimed in the appended claims.
本领域普通技术人员可以意识到,结合本文中所公开的实施例描述的各示例的单元及算法步骤,能够以电子硬件、或者计算机软件和电子硬件的结合来实现。这些功能究竟以硬件还是软件方式来执行,取决于技术方案的特定应用和设计约束条件。专业技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能,但是这种实现不应认为超出本申请的范围。Those of ordinary skill in the art can realize that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Skilled artisans may implement the described functionality using different methods for each particular application, but such implementations should not be considered beyond the scope of this application.
在本申请所提供的几个实施例中,应该理解到,所揭露的设备和方法,可以通过其它的方式实现。例如,以上所描述的设备实施例仅仅是示意性的,例如,所述单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个单元或组件可以结合或者可以集成到另一个设备,或一些特征可以忽略,或不执行。In the several embodiments provided in this application, it should be understood that the disclosed apparatus and method may be implemented in other manners. For example, the device embodiments described above are only illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components may be combined or May be integrated into another device, or some features may be omitted, or not implemented.
在此处所提供的说明书中,说明了大量具体细节。然而,能够理解,本申请的实施例可以在没有这些具体细节的情况下实践。在一些实例中,并未详细示出公知的方法、结构和技术,以便不模糊对本说明书的理解。In the description provided herein, numerous specific details are set forth. It will be understood, however, that the embodiments of the present application may be practiced without these specific details. In some instances, well-known methods, structures and techniques have not been shown in detail in order not to obscure an understanding of this description.
类似地,应当理解,为了精简本申请并帮助理解各个发明方面中的一个或多个,在对本申请的示例性实施例的描述中,本申请的各个特征有时被一起分组到单个实施例、图、或者对其的描述中。然而,并不应将该本申请的方法解释成反映如下意图:即所要求保护的本申请要求比在每个权利要求中所明确记载的特征更多的特征。更确切地说,如相应的权利要求书所反映的那样,其发明点在于可以用少于某个公开的单个实施例的所有特征的特征来解决相应的技术问题。因此,遵循具体实施方式的权利要求书由此明确地并入该具体实施方式,其中每个权利要求本身都作为本申请的单独实施例。Similarly, it is to be understood that in the description of the exemplary embodiments of the present application, various features of the present application are sometimes grouped together into a single embodiment, FIG. , or in its description. However, this method of application should not be construed as reflecting an intention that the claimed application requires more features than are expressly recited in each claim. Rather, as the corresponding claims reflect, the invention lies in the fact that the corresponding technical problem may be solved with less than all features of a single disclosed embodiment. Thus, the claims following the Detailed Description are hereby expressly incorporated into this Detailed Description, with each claim standing on its own as a separate embodiment of this application.
本领域的技术人员可以理解,除了特征之间相互排斥之外,可以采用任何组合对本说明书(包括伴随的权利要求、摘要和附图)中公开的所有特征以及如此公开的任何方法或者设备的所有过程或单元进行组合。除非另外明确陈述,本说明书(包括伴随的权利要求、摘要和附图)中公开的每个特征可以由提供相同、等同或相似目的替代特征来代替。It will be understood by those skilled in the art that all features disclosed in this specification (including the accompanying claims, abstract and drawings) and any method or apparatus so disclosed may be used in any combination, except that the features are mutually exclusive. Processes or units are combined. Each feature disclosed in this specification (including accompanying claims, abstract and drawings) may be replaced by alternative features serving the same, equivalent or similar purpose, unless expressly stated otherwise.
此外,本领域的技术人员能够理解,尽管在此所述的一些实施例包括其它实施例中所包括的某些特征而不是其它特征,但是不同实施例的特征的组合意味着处于本申请的范围之内并且形成不同的实施例。例如,在权利要求书中,所要求保护的实施例的任意之一都可以以任意的组合方式来使用。Furthermore, those skilled in the art will appreciate that although some of the embodiments described herein include certain features, but not others, included in other embodiments, that combinations of features of different embodiments are intended to be within the scope of the present application within and form different embodiments. For example, in the claims, any of the claimed embodiments may be used in any combination.
本申请的各个部件实施例可以以硬件实现,或者以在一个或者多个处理器上 运行的软件模块实现,或者以它们的组合实现。本领域的技术人员应当理解,可以在实践中使用微处理器或者数字信号处理器(DSP)来实现根据本申请实施例的一些模块的一些或者全部功能。本申请还可以实现为用于执行这里所描述的方法的一部分或者全部的装置程序(例如,计算机程序和计算机程序产品)。这样的实现本申请的程序可以存储在计算机可读介质上,或者可以具有一个或者多个信号的形式。这样的信号可以从因特网网站上下载得到,或者在载体信号上提供,或者以任何其他形式提供。Various component embodiments of the present application may be implemented in hardware, or in software modules running on one or more processors, or in a combination thereof. Those skilled in the art should understand that a microprocessor or a digital signal processor (DSP) may be used in practice to implement some or all functions of some modules according to the embodiments of the present application. The present application can also be implemented as a program of apparatus (eg, computer programs and computer program products) for performing part or all of the methods described herein. Such a program implementing the present application may be stored on a computer-readable medium, or may be in the form of one or more signals. Such signals may be downloaded from Internet sites, or provided on carrier signals, or in any other form.
应该注意的是上述实施例对本申请进行说明而不是对本申请进行限制,并且本领域技术人员在不脱离所附权利要求的范围的情况下可设计出替换实施例。在权利要求中,不应将位于括号之间的任何参考符号构造成对权利要求的限制。本申请可以借助于包括有若干不同元件的硬件以及借助于适当编程的计算机来实现。在列举了若干装置的单元权利要求中,这些装置中的若干个可以是通过同一个硬件项来具体体现。单词第一、第二、以及第三等的使用不表示任何顺序。可将这些单词解释为名称。It should be noted that the above-described embodiments illustrate rather than limit the application, and alternative embodiments may be devised by those skilled in the art without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The application can be implemented by means of hardware comprising several different elements and by means of a suitably programmed computer. In a unit claim enumerating several means, several of these means may be embodied by one and the same item of hardware. The use of the words first, second, and third, etc. do not denote any order. These words can be interpreted as names.

Claims (73)

  1. 一种影像拍摄方法,其特征在于,所述方法包括:An image capturing method, characterized in that the method comprises:
    识别可移动平台的拍摄范围内满足预设拍摄条件的拍摄目标;Identify the shooting targets that meet the preset shooting conditions within the shooting range of the movable platform;
    获取和所述拍摄目标相匹配的构图规划信息;acquiring composition planning information that matches the shooting target;
    基于所述构图规划信息,确定对所述拍摄目标进行拍摄时所述可移动平台应处于的目标拍摄位置;determining, based on the composition planning information, a target shooting position that the movable platform should be in when shooting the shooting target;
    当控制所述可移动平台处于所述目标拍摄位置后,基于所述构图规划信息控制所述可移动平台搭载的拍摄装置对所述拍摄目标进行拍摄。After the movable platform is controlled to be at the target shooting position, the shooting device mounted on the movable platform is controlled to shoot the shooting target based on the composition planning information.
  2. 如权利要求1所述的影像拍摄方法,其特征在于,所述识别所述可移动平台的拍摄范围内满足预设拍摄条件的拍摄目标,包括:The image shooting method according to claim 1, wherein the identifying the shooting target within the shooting range of the movable platform that meets the preset shooting conditions comprises:
    获取可拍摄物的标定信息,其中,所述标定信息包括以下信息中的至少一种:已标定可拍摄物的形状特征信息、已标定可拍摄物的位置标记信息;Obtaining calibration information of the photographable object, wherein the calibration information includes at least one of the following information: shape feature information of the calibrated photographable object, and position marker information of the calibrated photographable object;
    获取所述可移动平台的拍摄范围内的可拍摄物的特征信息,所述特征信息包括形状特征信息和/或位置信息;acquiring feature information of the photographable objects within the shooting range of the movable platform, where the feature information includes shape feature information and/or position information;
    将所述可拍摄物的特征信息和所述标定信息进行匹配,识别所述可移动平台的拍摄范围内的拍摄目标,其中,所述满足预设拍摄条件的拍摄目标的形状特征与至少一个已标定可拍摄物的特征信息相匹配,和/或,所述拍摄目标的位置信息和一个已标定可拍摄物的位置标记信息相匹配。Match the feature information of the photographable object with the calibration information, and identify the photographing target within the photographing range of the movable platform, wherein the shape feature of the photographing target that meets the preset photographing conditions and at least one The feature information of the calibrated photographable object is matched, and/or the position information of the photographed object is matched with the position marker information of a calibrated photographable object.
  3. 如权利要求1所述的影像拍摄方法,其特征在于,所述构图规划信息包括以下至少一项:构图方式、可移动平台的预设高度、拍摄参数、拍摄方位,其中,所述构图方式包括:所述拍摄目标在拍摄画面中所占的比例,和/或,所述拍摄目标在拍摄画面中的位置。The image shooting method according to claim 1, wherein the composition planning information includes at least one of the following: composition mode, preset height of the movable platform, shooting parameters, and shooting orientation, wherein the composition mode includes: : the proportion of the shooting target in the shooting picture, and/or the position of the shooting target in the shooting picture.
  4. 如权利要求2所述的影像拍摄方法,其特征在于,当所述标定信息包括已标定可拍摄物的形状特征信息时,所述获取所述可移动平台的拍摄范围内的可拍摄物的特征信息,包括:The image capturing method according to claim 2, wherein when the calibration information includes shape feature information of the calibrated photographable object, the acquiring the characteristics of the photographable object within the photographing range of the movable platform information, including:
    获取所述可移动平台的拍摄范围内的图像信息;acquiring image information within the shooting range of the movable platform;
    基于所述图像信息,识别所述可移动平台的拍摄范围内的可拍摄物的形状特征信息。Based on the image information, the shape feature information of the photographable objects within the photographing range of the movable platform is identified.
  5. 如权利要求4所述的影像拍摄方法,其特征在于,所述图像信息包括以下信息中的至少一种:卫星地图、所述可移动平台的传感器采集的图像数据。The image capturing method according to claim 4, wherein the image information includes at least one of the following information: a satellite map, and image data collected by a sensor of the movable platform.
  6. 如权利要求4所述的影像拍摄方法,其特征在于,所述影像拍摄方法由 与所述可移动平台通信连接的控制装置执行,所述方法还包括:The image capturing method according to claim 4, wherein the image capturing method is performed by a control device communicatively connected to the movable platform, and the method further comprises:
    当识别到所述可移动平台的拍摄范围内满足预设拍摄条件的一个或多个拍摄目标后,在所述图像信息中通过标识标注各个拍摄目标;After recognizing one or more shooting targets within the shooting range of the movable platform that meet the preset shooting conditions, marking each shooting target with an identifier in the image information;
    在所述控制装置的显示界面上显示所述图像信息和各个所述标识。The image information and each of the signs are displayed on the display interface of the control device.
  7. 如权利要求6所述的影像拍摄方法,其特征在于,所述标识包括以下标识信息中的至少一种:图案标识或文字标识,所述图案标识包括箭头图案标识。The image capturing method according to claim 6, wherein the identification includes at least one of the following identification information: a pattern identification or a text identification, and the pattern identification includes an arrow pattern identification.
  8. 如权利要求2所述的影像拍摄方法,其特征在于,所述位置标记信息包括一个或多个已标定可拍摄物的地理位置信息,所述将所述可拍摄物的特征信息和所述标定信息进行匹配,识别所述可移动平台的拍摄范围内的拍摄目标,包括:The image capturing method according to claim 2, wherein the location marker information includes geographic location information of one or more calibrated photographable objects, and the feature information of the photographable objects and the calibration The information is matched to identify the shooting target within the shooting range of the movable platform, including:
    获取第一位置信息,所述第一位置信息包括以下信息中的至少一个:所述可移动平台开始移动时的起始坐标信息、控制装置所处的坐标位置信息;Acquiring first position information, where the first position information includes at least one of the following information: starting coordinate information when the movable platform starts to move, and coordinate position information where the control device is located;
    识别所述第一位置信息周围的与所述位置标记信息相匹配的一个或多个拍摄目标。Identifying one or more shooting targets around the first position information that match the position marker information.
  9. 如权利要求4或8所述的影像拍摄方法,其特征在于,The image capturing method according to claim 4 or 8, wherein,
    当识别到多个拍摄目标时,所述影像拍摄方法还包括:基于用户的选择指令,确定所述多个拍摄目标中的一个进行拍摄。When multiple shooting targets are identified, the image shooting method further includes: determining one of the multiple shooting targets to shoot based on a user's selection instruction.
  10. 如权利要求9所述的影像拍摄方法,其特征在于,控制装置的显示界面上显示有图像信息,所述图像信息中显示有多个拍摄目标,所述图像信息包括卫星地图或所述可移动平台的传感器采集的图像数据,所述基于用户的选择指令,确定所述多个拍摄目标中的一个进行拍摄,包括:The image shooting method according to claim 9, wherein image information is displayed on the display interface of the control device, a plurality of shooting targets are displayed in the image information, and the image information includes a satellite map or the movable The image data collected by the sensor of the platform, and determining one of the multiple shooting targets for shooting based on the user's selection instruction, including:
    所述控制装置基于用户输入的选择指令,在所述图像信息中选中所述多个拍摄目标中的一个进行拍摄。The control device selects one of the plurality of photographing targets in the image information for photographing based on a selection instruction input by the user.
  11. 如权利要求1所述的影像拍摄方法,其特征在于,所述获取和所述拍摄目标相匹配的构图规划信息,包括:The image shooting method according to claim 1, wherein the acquiring composition planning information matching the shooting target comprises:
    获取所述拍摄目标的至少一个历史拍摄影像的构图规划信息;acquiring composition planning information of at least one historically shot image of the shooting target;
    基于所述至少一个历史拍摄影像的构图规划信息,确定所述拍摄目标的构图规划信息。Based on the composition planning information of the at least one historically shot image, the composition planning information of the shooting target is determined.
  12. 如权利要求1所述的影像拍摄方法,其特征在于,所述获取和所述拍摄目标相匹配的构图规划信息,包括:The image shooting method according to claim 1, wherein the acquiring composition planning information matching the shooting target comprises:
    获取已标定可拍摄物的构图规划信息的数据集,其中,各个所述已标定可拍摄物的构图规划信息为对各个已标定可拍摄物周围的卫星地图进行预设构图而 获得的;Obtain the data set of the composition planning information of the calibrated photographable objects, wherein the composition planning information of each of the calibrated photographable objects is obtained by performing preset composition on the satellite maps around each of the calibrated photographable objects;
    自所述数据集中获取和所述拍摄目标相匹配的构图规划信息。The composition planning information matching the shooting target is acquired from the data set.
  13. 如权利要求1所述的影像拍摄方法,其特征在于,同一已标定可拍摄物对应一个或多个具有大体相同的形状特征的拍摄目标。1. The image capturing method of claim 1, wherein the same calibrated photographable object corresponds to one or more photographing objects having substantially the same shape feature.
  14. 如权利要求2所述的影像拍摄方法,其特征在于,所述已标定可拍摄物的形状特征信息包括以下特征信息中的至少一种:可拍摄物的俯视形状特征、可拍摄物的侧视形状特征。The image capturing method according to claim 2, wherein the shape feature information of the calibrated photographable object includes at least one of the following feature information: a top-view shape feature of the photographable object, a side view of the photographable object shape features.
  15. 如权利要求1所述的影像拍摄方法,其特征在于,所述目标拍摄位置包括目标拍摄高度,所述基于所述构图规划信息,确定对所述拍摄目标进行拍摄时所述可移动平台应处于的目标拍摄位置,包括:The image shooting method according to claim 1, wherein the target shooting position includes a target shooting height, and it is determined based on the composition planning information that the movable platform should be in a position when shooting the shooting target. target shooting locations, including:
    基于所述构图规划信息和所述拍摄装置的当前视场,确定所述可移动平台的预估拍摄高度;determining an estimated shooting height of the movable platform based on the composition planning information and the current field of view of the shooting device;
    获取所述可移动平台所在位置周围的限制高度;Obtain the restricted height around the position of the movable platform;
    将所述预估拍摄高度和所述限制高度进行比较,确定所述目标拍摄高度。The estimated shooting height is compared with the limit height, and the target shooting height is determined.
  16. 如权利要求15所述的影像拍摄方法,其特征在于,所述基于所述构图规划信息和所述拍摄装置的当前视场,确定所述可移动平台的预估拍摄高度,包括:The image shooting method according to claim 15, wherein the determining the estimated shooting height of the movable platform based on the composition planning information and the current field of view of the shooting device comprises:
    获取可移动平台的所述拍摄装置的当前视场;obtaining the current field of view of the photographing device of the movable platform;
    基于所述构图规划信息,获取预设构图时所述拍摄装置的预设视场和可移动平台的预设高度;obtaining, based on the composition planning information, a preset field of view of the photographing device and a preset height of the movable platform when a preset composition is used;
    基于所述预设高度、所述预设视场和所述当前视场,确定所述可移动平台的预估拍摄高度。Based on the preset height, the preset field of view, and the current field of view, an estimated shooting height of the movable platform is determined.
  17. 如权利要求15所述的影像拍摄方法,其特征在于,所述将所述预估拍摄高度和所述限制高度数据进行比较,确定所述目标拍摄高度,包括:The image shooting method according to claim 15, wherein the comparing the estimated shooting height with the restricted height data to determine the target shooting height comprises:
    当所述预估拍摄高度高于所述限制高度时,所述目标拍摄高度设定为所述限制高度;或,When the estimated shooting height is higher than the limit height, the target shooting height is set as the limit height; or,
    当所述预估拍摄高度低于或等于所述限制高度时,所述目标拍摄高度设定为所述预估拍摄高度。When the estimated shooting height is lower than or equal to the limit height, the target shooting height is set as the estimated shooting height.
  18. 如权利要求17所述的影像拍摄方法,其特征在于,所述影像拍摄方法还包括:The image capturing method of claim 17, wherein the image capturing method further comprises:
    当所述预估拍摄高度高于所述限制高度时,输出第一提示信息。When the estimated shooting height is higher than the limit height, first prompt information is output.
  19. 如权利要求1所述的影像拍摄方法,其特征在于,所述影像拍摄方法还包括:The image capturing method of claim 1, wherein the image capturing method further comprises:
    获取所述可移动平台的当前电量,当确定所述可移动平台自当前位置移动到所述目标拍摄位置并返航所需的电量大于所述当前电量时,则不触发对所述拍摄目标的拍摄;Obtain the current power of the movable platform, and when it is determined that the power required for the movable platform to move from the current position to the target shooting position and return home is greater than the current power, the shooting of the shooting target is not triggered ;
    当确定所述可移动平台自当前位置移动到所述目标拍摄位置并返航所需的电量小于当前电量时,则触发对所述拍摄目标的拍摄。When it is determined that the power required for the movable platform to move from the current position to the target shooting position and return home is less than the current power, the shooting of the shooting target is triggered.
  20. 如权利要求19所述的影像拍摄方法,其特征在于,所述影像拍摄方法还包括:当确定所述可移动平台自当前位置移动到所述目标拍摄位置并返航所需的电量大于所述当前电量时,输出第二提示信息。19. The image capturing method according to claim 19, wherein the image capturing method further comprises: when it is determined that the movable platform moves from the current position to the target shooting position and returns to home, the required power is greater than the current When the battery is charged, the second prompt message is output.
  21. 如权利要求1所述的影像拍摄方法,其特征在于,所述影像拍摄方法由与所述可移动平台通信连接的控制装置执行,当控制所述可移动平台处于所述目标拍摄位置后,基于所述构图规划信息控制所述拍摄装置对所述拍摄目标进行拍摄,包括:The image capturing method according to claim 1, wherein the image capturing method is executed by a control device communicatively connected to the movable platform, and after controlling the movable platform to be at the target capturing position, based on The composition planning information controls the photographing device to photograph the photographing target, including:
    当所述控制装置获取到所述可移动平台发送的反馈信息后,显示所述反馈信息,所述反馈信息是所述可移动平台处于所述目标拍摄位置后发送的;After the control device acquires the feedback information sent by the movable platform, the feedback information is displayed, and the feedback information is sent after the movable platform is in the target shooting position;
    控制装置基于用户指令,显示所述拍摄装置的各个拍摄模式对应的选项,其中,所述拍摄模式包括以下模式中的至少一种:单张拍摄、堆伐、全景、360°全景;The control device displays, based on user instructions, options corresponding to each shooting mode of the shooting device, wherein the shooting mode includes at least one of the following modes: single shot, stacking, panorama, and 360° panorama;
    控制装置获取用户输入的模式选择指令,并根据所述模式选择指令,确定用于拍摄的拍摄模式。The control device acquires a mode selection instruction input by the user, and determines a shooting mode for shooting according to the mode selection instruction.
  22. 如权利要求21所述的影像拍摄方法,其特征在于,当控制所述可移动平台处于所述目标拍摄位置后,基于所述构图规划信息控制所述拍摄装置对所述拍摄目标进行拍摄,包括:The image shooting method according to claim 21, wherein after controlling the movable platform to be at the target shooting position, controlling the shooting device to shoot the shooting target based on the composition planning information, comprising: :
    在控制装置的显示界面上显示选中的各个拍摄模式对应的拍摄效果图,所述拍摄效果图包括由一张或多张卫星地图而生成的满足所述拍摄目标的构图规划信息的预设构图。The shooting effect map corresponding to each selected shooting mode is displayed on the display interface of the control device, and the shooting effect map includes a preset composition generated from one or more satellite maps and satisfying the composition planning information of the shooting target.
  23. 如权利要求21所述的影像拍摄方法,其特征在于,当控制所述可移动平台处于所述目标拍摄位置后,基于所述构图规划信息控制所述拍摄装置对所述拍摄目标进行拍摄,包括:The image shooting method according to claim 21, wherein after controlling the movable platform to be at the target shooting position, controlling the shooting device to shoot the shooting target based on the composition planning information, comprising: :
    控制装置获取并显示选中的拍摄模式的预估拍摄时间。The control device acquires and displays the estimated shooting time of the selected shooting mode.
  24. 如权利要求1所述的影像拍摄方法,其特征在于,当控制所述可移动平台处于所述目标拍摄位置后,基于所述构图规划信息控制所述拍摄装置对所述拍摄目标进行拍摄,包括:The image shooting method according to claim 1, wherein after controlling the movable platform to be at the target shooting position, controlling the shooting device to shoot the shooting target based on the composition planning information, comprising: :
    获取当前的时间信息和天气信息;Get current time information and weather information;
    基于所述时间信息和天气信息,确定光源位置;determining the location of the light source based on the time information and weather information;
    基于所述光源位置和所述构图规划信息,控制所述拍摄装置对所述拍摄目标进行一个或多个拍摄角度的拍摄。Based on the position of the light source and the composition planning information, the photographing device is controlled to photograph the photographing target at one or more photographing angles.
  25. 一种可移动平台,其特征在于,所述可移动平台包括:A movable platform, characterized in that the movable platform comprises:
    可移动平台本体;Movable platform body;
    拍摄装置,设置于所述可移动平台本体,用于拍摄影像;a photographing device, arranged on the movable platform body, for photographing images;
    通信接口,用于和控制装置通信连接;A communication interface for communicating with the control device;
    存储器,用于存储可执行的程序指令;memory for storing executable program instructions;
    一个或多个处理器,用于执行所述存储器中存储的所述程序指令,使得所述处理器执行以下步骤:one or more processors for executing the program instructions stored in the memory, causing the processors to perform the following steps:
    识别所述可移动平台的拍摄范围内满足预设拍摄条件的拍摄目标;Identify the shooting targets that meet the preset shooting conditions within the shooting range of the movable platform;
    获取和所述拍摄目标相匹配的构图规划信息;acquiring composition planning information that matches the shooting target;
    基于所述构图规划信息,确定对所述拍摄目标进行拍摄时所述可移动平台应处于的目标拍摄位置;determining, based on the composition planning information, a target shooting position that the movable platform should be in when shooting the shooting target;
    当控制所述可移动平台处于所述目标拍摄位置后,基于所述构图规划信息控制所述拍摄装置对所述拍摄目标进行拍摄。After the movable platform is controlled to be at the target shooting position, the shooting device is controlled to shoot the shooting target based on the composition planning information.
  26. 如权利要求25所述的可移动平台,其特征在于,所述处理器识别所述可移动平台的拍摄范围内满足预设拍摄条件的拍摄目标,包括:The movable platform of claim 25, wherein the processor identifies a shooting target within a shooting range of the movable platform that meets preset shooting conditions, comprising:
    获取可拍摄物的标定信息,其中,所述标定信息包括以下信息中的至少一种:已标定可拍摄物的形状特征信息、已标定可拍摄物的位置标记信息;Obtaining calibration information of the photographable object, wherein the calibration information includes at least one of the following information: shape feature information of the calibrated photographable object, and position marker information of the calibrated photographable object;
    获取所述可移动平台的拍摄范围内的可拍摄物的特征信息,所述特征信息包括形状特征信息和/或位置信息;acquiring feature information of the photographable objects within the shooting range of the movable platform, where the feature information includes shape feature information and/or position information;
    将所述可拍摄物的特征信息和所述标定信息进行匹配,识别所述可移动平台的拍摄范围内的拍摄目标,其中,所述满足预设拍摄条件的拍摄目标的形状特征与至少一个已标定可拍摄物的特征信息相匹配,和/或,所述拍摄目标的位置信息和一个已标定可拍摄物的位置标记信息相匹配。Match the feature information of the photographable object with the calibration information, and identify the photographing target within the photographing range of the movable platform, wherein the shape feature of the photographing target that meets the preset photographing conditions and at least one The feature information of the calibrated photographable object is matched, and/or the position information of the photographed object is matched with the position marker information of a calibrated photographable object.
  27. 如权利要求25所述的可移动平台,其特征在于,所述构图规划信息包 括以下至少一项:构图方式、可移动平台的预设高度、拍摄参数、拍摄方位,其中,所述构图方式包括:所述拍摄目标在拍摄画面中所占的比例,和/或,所述拍摄目标在拍摄画面中的位置。The movable platform according to claim 25, wherein the composition planning information includes at least one of the following: composition mode, preset height of the movable platform, shooting parameters, and shooting orientation, wherein the composition mode includes: : the proportion of the shooting target in the shooting picture, and/or the position of the shooting target in the shooting picture.
  28. 如权利要求25所述的可移动平台,其特征在于,当所述标定信息包括已标定可拍摄物的形状特征信息时,所述处理器获取所述可移动平台的拍摄范围内的可拍摄物的特征信息,包括:The movable platform according to claim 25, wherein when the calibration information includes shape feature information of the calibrated photographable objects, the processor acquires the photographable objects within the photographing range of the movable platform characteristic information, including:
    获取所述可移动平台的拍摄范围内的图像信息;acquiring image information within the shooting range of the movable platform;
    基于所述图像信息,识别所述可移动平台的拍摄范围内的可拍摄物的形状特征信息。Based on the image information, the shape feature information of the photographable objects within the photographing range of the movable platform is identified.
  29. 如权利要求28所述的可移动平台,其特征在于,所述图像信息包括以下信息中的至少一种:卫星地图、所述可移动平台的传感器采集的图像数据。The movable platform of claim 28, wherein the image information includes at least one of the following information: a satellite map, and image data collected by sensors of the movable platform.
  30. 如权利要求25所述的可移动平台,其特征在于,所述处理器还用于:The movable platform of claim 25, wherein the processor is further configured to:
    当识别到所述可移动平台的拍摄范围内满足预设拍摄条件的一个或多个拍摄目标后,在所述图像信息中通过标识标注各个拍摄目标;After recognizing one or more shooting targets within the shooting range of the movable platform that meet the preset shooting conditions, marking each shooting target with an identifier in the image information;
    输出所述图像信息和所述标识,以使所述控制装置在显示界面上显示所述图像信息和各个所述标识。The image information and the logo are output, so that the control device displays the image information and each of the logos on the display interface.
  31. 如权利要求30所述的可移动平台,其特征在于,所述标识包括以下标识信息中的至少一种:图案标识或文字标识,所述图案标识包括箭头图案标识。The movable platform according to claim 30, wherein the identification includes at least one of the following identification information: a pattern identification or a character identification, and the pattern identification includes an arrow pattern identification.
  32. 如权利要求24所述的可移动平台,其特征在于,所述位置标记信息包括已标定可拍摄物的地理位置信息,所述处理器将所述可拍摄物的特征信息和所述标定信息进行匹配,识别所述可移动平台的拍摄范围内的拍摄目标,包括:The movable platform according to claim 24, wherein the location marker information includes geographic location information of the calibrated photographable object, and the processor performs a comparison between the feature information of the photographable object and the calibration information. Match, identify the shooting target within the shooting range of the movable platform, including:
    获取第一位置信息,所述第一位置信息包括以下信息中的至少一个:所述可移动平台开始移动时的起始坐标信息、控制装置所处的坐标位置信息;Acquiring first position information, where the first position information includes at least one of the following information: starting coordinate information when the movable platform starts to move, and coordinate position information where the control device is located;
    识别所述第一位置信息周围的与所述位置标记信息相匹配的一个或多个拍摄目标。Identifying one or more shooting targets around the first position information that match the position marker information.
  33. 如权利要求28或32所述的可移动平台,其特征在于,当识别到多个拍摄目标时,所述处理器还用于:基于用户的选择指令,确定所述多个拍摄目标中的一个进行拍摄。The movable platform according to claim 28 or 32, wherein when multiple shooting targets are identified, the processor is further configured to: determine one of the multiple shooting targets based on a user's selection instruction to shoot.
  34. 如权利要求33所述的可移动平台,其特征在于,所述控制装置的显示界面上显示有图像信息,所述图像信息中显示有所述可拍摄物,所述图像信息包括卫星地图或所述可移动平台的传感器采集的图像数据,所述处理器基于用户的 选择指令,确定所述多个可拍摄物中的一个作为所述拍摄目标,包括:The movable platform according to claim 33, wherein image information is displayed on the display interface of the control device, the photographable object is displayed in the image information, and the image information includes a satellite map or all The image data collected by the sensor of the movable platform, the processor determines one of the plurality of photographable objects as the photographing target based on the user's selection instruction, including:
    获取所述控制装置输出的选择指令;obtaining the selection instruction output by the control device;
    基于所述选择指令,确定所述多个拍摄目标中的一个进行拍摄。Based on the selection instruction, one of the plurality of photographing targets is determined to be photographed.
  35. 如权利要求25所述的可移动平台,其特征在于,所述处理器获取和所述拍摄目标相匹配的构图规划信息,包括:The movable platform of claim 25, wherein the processor obtains composition planning information matching the shooting target, comprising:
    获取所述拍摄目标的至少一个历史拍摄影像的构图规划信息;acquiring composition planning information of at least one historically shot image of the shooting target;
    基于所述至少一个历史拍摄影像的构图规划信息,确定所述拍摄目标的构图规划信息。Based on the composition planning information of the at least one historically shot image, the composition planning information of the shooting target is determined.
  36. 如权利要求25所述的可移动平台,其特征在于,所述处理器获取和所述拍摄目标相匹配的构图规划信息,包括:The movable platform of claim 25, wherein the processor obtains composition planning information matching the shooting target, comprising:
    获取已标定可拍摄物的构图规划信息的数据集,其中,各个所述已标定可拍摄物的构图规划信息为对各个已标定可拍摄物周围的卫星地图进行预设构图而获得的;obtaining a dataset of composition planning information of the calibrated photographable objects, wherein the composition planning information of each of the calibrated photographable objects is obtained by performing preset composition on satellite maps around each calibrated photographable object;
    自所述数据集中获取和所述拍摄目标相匹配的构图规划信息。The composition planning information matching the shooting target is acquired from the data set.
  37. 如权利要求25所述的可移动平台,其特征在于,同一已标定可拍摄物对应一个或多个具有大体相同的形状特征的拍摄目标。26. The movable platform of claim 25, wherein the same calibrated photographable object corresponds to one or more photographing targets having substantially the same shape feature.
  38. 如权利要求26所述的可移动平台,其特征在于,所述已标定可拍摄物的形状特征信息包括以下特征信息中的至少一种:可拍摄物的俯视形状特征、可拍摄物的侧视形状特征。The movable platform according to claim 26, wherein the shape feature information of the calibrated photographable object includes at least one of the following feature information: a top-view shape feature of the photographable object, a side view of the photographable object shape features.
  39. 如权利要求25所述的可移动平台,其特征在于,所述目标拍摄位置包括目标拍摄高度,所述处理器基于所述构图规划信息,确定对所述拍摄目标进行拍摄时所述可移动平台应处于的目标拍摄位置,包括:The movable platform according to claim 25, wherein the target shooting position includes a target shooting height, and the processor determines the movable platform when shooting the shooting target based on the composition planning information The target shooting position to be in, including:
    基于所述构图规划信息和所述拍摄装置的当前视场,确定所述可移动平台的预估拍摄高度;determining an estimated shooting height of the movable platform based on the composition planning information and the current field of view of the shooting device;
    获取所述可移动平台所在位置周围的限制高度;Obtain the restricted height around the position of the movable platform;
    将所述预估拍摄高度和所述限制高度进行比较,确定所述目标拍摄高度。The estimated shooting height is compared with the limit height, and the target shooting height is determined.
  40. 如权利要求39所述的可移动平台,其特征在于,所述处理器基于所述构图规划信息和所述拍摄装置的当前视场,确定所述可移动平台的预估拍摄高度,包括:The movable platform of claim 39, wherein the processor determines the estimated shooting height of the movable platform based on the composition planning information and the current field of view of the shooting device, comprising:
    获取可移动平台的所述拍摄装置的当前视场;obtaining the current field of view of the photographing device of the movable platform;
    基于所述构图规划信息,获取预设构图时所述拍摄装置的预设视场和可移动 平台的预设高度;Based on the composition planning information, the preset field of view of the shooting device and the preset height of the movable platform are obtained when the preset composition is obtained;
    基于所述预设高度、所述预设视场和所述当前视场,确定所述可移动平台的预估拍摄高度。Based on the preset height, the preset field of view, and the current field of view, an estimated shooting height of the movable platform is determined.
  41. 如权利要求39所述的可移动平台,其特征在于,所述处理器将所述预估拍摄高度和所述限制高度数据进行比较,确定所述目标拍摄高度,包括:The movable platform of claim 39, wherein the processor compares the estimated shooting height with the restricted height data, and determines the target shooting height, comprising:
    当所述预估拍摄高度高于所述限制高度时,所述目标拍摄高度设定为所述限制高度;或When the estimated shooting height is higher than the limit height, the target shooting height is set as the limit height; or
    当所述预估拍摄高度低于或等于所述限制高度时,所述目标拍摄高度设定为所述预估拍摄高度。When the estimated shooting height is lower than or equal to the limit height, the target shooting height is set as the estimated shooting height.
  42. 如权利要求41所述的可移动平台,其特征在于,所述处理器还用于:The movable platform of claim 41, wherein the processor is further configured to:
    当所述预估拍摄高度高于所述限制高度时,输出第一提示信息。When the estimated shooting height is higher than the limit height, first prompt information is output.
  43. 如权利要求25所述的可移动平台,其特征在于,所述处理器还用于:The movable platform of claim 25, wherein the processor is further configured to:
    获取所述可移动平台的当前电量,当确定所述可移动平台自当前位置移动到所述目标拍摄位置并返航所需的电量大于所述当前电量时,则不触发对所述拍摄目标的拍摄;Obtain the current power of the movable platform, and when it is determined that the power required for the movable platform to move from the current position to the target shooting position and return home is greater than the current power, the shooting of the shooting target is not triggered ;
    当确定所述可移动平台自当前位置移动到所述目标拍摄位置并返航所需的电量小于当前电量时,则触发对所述拍摄目标的拍摄。When it is determined that the power required for the movable platform to move from the current position to the target shooting position and return home is less than the current power, the shooting of the shooting target is triggered.
  44. 如权利要求43所述的可移动平台,其特征在于,所述处理器还用于:当确定所述可移动平台自当前位置移动到所述目标拍摄位置并返航所需的电量大于所述当前电量时,输出第二提示信息,以使所述控制装置获取并显示所述第二提示信息。The mobile platform according to claim 43, wherein the processor is further configured to: when it is determined that the mobile platform needs to move from the current position to the target shooting position and return home, the power required for it is greater than the current When the power is low, output the second prompt information, so that the control device acquires and displays the second prompt information.
  45. 如权利要求25所述的可移动平台,其特征在于,当控制所述可移动平台处于所述目标拍摄位置后,所述处理器基于所述构图规划信息控制所述拍摄装置对所述拍摄目标进行拍摄,包括:The movable platform according to claim 25, wherein after controlling the movable platform to be at the target shooting position, the processor controls the shooting device to shoot the shooting target based on the composition planning information Filming, including:
    当控制所述可移动平台处于所述目标拍摄位置后,输出反馈信息,以使控制装置获取到所述反馈信息后显示所述反馈信息,以及使所述控制装置基于用户指令显示所述拍摄装置的各个拍摄模式对应的选项,其中,所述拍摄模式包括以下模式中的至少一种:单张拍摄、堆伐、全景、360°全景;After controlling the movable platform to be at the target shooting position, output feedback information, so that the control device displays the feedback information after acquiring the feedback information, and causes the control device to display the shooting device based on user instructions options corresponding to each shooting mode of , wherein the shooting mode includes at least one of the following modes: single shot, stacking, panorama, and 360° panorama;
    获取所述控制装置输出的模式选择指令,并根据所述模式选择指令,确定用于拍摄的拍摄模式。A mode selection instruction output by the control device is acquired, and a shooting mode for shooting is determined according to the mode selection instruction.
  46. 如权利要求45所述的可移动平台,其特征在于,当控制所述可移动平 台处于所述目标拍摄位置后,所述处理器基于所述构图规划信息控制所述拍摄装置对所述拍摄目标进行拍摄,包括:The movable platform according to claim 45, wherein after controlling the movable platform to be at the target shooting position, the processor controls the shooting device to shoot the shooting target based on the composition planning information Filming, including:
    当获取到控制装置输出的模式选择指令时,输出与选中的拍摄模式对应的拍摄效果图,以使控制装置显示选中的拍摄模式对应的拍摄效果图,所述拍摄效果图包括由一张或多张卫星地图而生成的满足所述拍摄目标的构图规划信息的预设构图。When the mode selection instruction output by the control device is obtained, a shooting effect map corresponding to the selected shooting mode is output, so that the control device displays the shooting effect map corresponding to the selected shooting mode, and the shooting effect map includes one or more shooting effects. A preset composition that satisfies the composition planning information of the shooting target and is generated from a satellite map.
  47. 如权利要求45所述的可移动平台,其特征在于,当控制所述可移动平台处于所述目标拍摄位置后,所述处理器基于所述构图规划信息控制所述拍摄装置对所述拍摄目标进行拍摄,包括:The movable platform according to claim 45, wherein after controlling the movable platform to be at the target shooting position, the processor controls the shooting device to shoot the shooting target based on the composition planning information Filming, including:
    当获取到控制装置输出的模式选择指令时,输出与选中的拍摄模式对应的预估拍摄时间,以使控制装置获取并显示选中的拍摄模式的预估拍摄时间。When the mode selection instruction output by the control device is acquired, the estimated shooting time corresponding to the selected shooting mode is output, so that the control device acquires and displays the estimated shooting time of the selected shooting mode.
  48. 如权利要求25所述的可移动平台,其特征在于,当控制所述可移动平台处于所述目标拍摄位置后,所述处理器基于所述构图规划信息控制所述拍摄装置对所述拍摄目标进行拍摄,包括:The movable platform according to claim 25, wherein after controlling the movable platform to be at the target shooting position, the processor controls the shooting device to shoot the shooting target based on the composition planning information Filming, including:
    获取当前的时间信息和天气信息;Get current time information and weather information;
    基于所述时间信息和天气信息,确定光源位置;determining the location of the light source based on the time information and weather information;
    基于所述光源位置和所述构图规划信息,控制所述拍摄装置对所述拍摄目标进行一个或多个拍摄角度的拍摄。Based on the position of the light source and the composition planning information, the photographing device is controlled to photograph the photographing target at one or more photographing angles.
  49. 如权利要求25至48任一项所述的可移动平台,其特征在于,所述可移动平台包括飞行器、机器人、车辆、云台或船。The movable platform according to any one of claims 25 to 48, wherein the movable platform comprises an aircraft, a robot, a vehicle, a pan/tilt or a ship.
  50. 一种控制装置,其特征在于,所述控制装置包括:A control device, characterized in that the control device comprises:
    通信接口,至少用于和可移动平台进行通信,其中,所述可移动平台上设置有拍摄装置;a communication interface, at least used to communicate with a movable platform, wherein a photographing device is provided on the movable platform;
    存储器,用于存储可执行的程序指令;memory for storing executable program instructions;
    一个或多个处理器,用于执行所述存储器中存储的所述程序指令,使得所述处理器执行以下步骤:one or more processors for executing the program instructions stored in the memory, causing the processors to perform the following steps:
    识别所述可移动平台的拍摄范围内满足预设拍摄条件的拍摄目标;Identify the shooting targets that meet the preset shooting conditions within the shooting range of the movable platform;
    获取和所述拍摄目标相匹配的构图规划信息;acquiring composition planning information that matches the shooting target;
    基于所述构图规划信息,确定对所述拍摄目标进行拍摄时所述可移动平台应处于的目标拍摄位置;determining, based on the composition planning information, a target shooting position that the movable platform should be in when shooting the shooting target;
    输出控制指令,以使所述可移动平台获取到所述控制指令后,基于所述控制 指令移动到所述目标拍摄位置,并使所述可移动平台基于所述构图规划信息控制所述拍摄装置对所述拍摄目标进行拍摄;outputting a control instruction, so that the movable platform moves to the target shooting position based on the control instruction after acquiring the control instruction, and enables the movable platform to control the shooting device based on the composition planning information photographing the photographing target;
    显示器,用于显示可视化信息。A display for displaying visual information.
  51. 如权利要求50所述的控制装置,其特征在于,所述处理器识别所述可移动平台的拍摄范围内满足预设拍摄条件的拍摄目标,包括:The control device according to claim 50, wherein the processor identifies a shooting target within a shooting range of the movable platform that meets a preset shooting condition, comprising:
    获取可拍摄物的标定信息,其中,所述标定信息包括以下信息中的至少一种:已标定可拍摄物的形状特征信息、已标定可拍摄物的位置标记信息;Obtaining calibration information of the photographable object, wherein the calibration information includes at least one of the following information: shape feature information of the calibrated photographable object, and position marker information of the calibrated photographable object;
    获取所述可移动平台的拍摄范围内的可拍摄物的特征信息,所述特征信息包括形状特征信息和/或位置信息;acquiring feature information of the photographable objects within the shooting range of the movable platform, where the feature information includes shape feature information and/or position information;
    将所述可拍摄物的特征信息和所述标定信息进行匹配,识别所述可移动平台的拍摄范围内的拍摄目标,其中,所述满足预设拍摄条件的拍摄目标的形状特征与至少一个已标定可拍摄物的特征信息相匹配,和/或,所述拍摄目标的位置信息和一个已标定可拍摄物的位置标记信息相匹配。Match the feature information of the photographable object with the calibration information, and identify the photographing target within the photographing range of the movable platform, wherein the shape feature of the photographing target that meets the preset photographing conditions and at least one The feature information of the calibrated photographable object is matched, and/or the position information of the photographed object is matched with the position marker information of a calibrated photographable object.
  52. 如权利要求51所述的控制装置,其特征在于,所述构图规划信息包括以下至少一项:构图方式、可移动平台的预设高度、拍摄参数、拍摄方位,其中,所述构图方式包括:所述拍摄目标在拍摄画面中所占的比例,和/或,所述拍摄目标在拍摄画面中的位置。The control device according to claim 51, wherein the composition planning information includes at least one of the following: composition mode, preset height of the movable platform, shooting parameters, and shooting orientation, wherein the composition mode includes: The proportion of the shooting object in the shooting picture, and/or the position of the shooting object in the shooting picture.
  53. 如权利要求51所述的控制装置,其特征在于,当所述标定信息包括已标定可拍摄物的形状特征信息时,所述处理器获取所述可移动平台的拍摄范围内的可拍摄物的特征信息,包括:The control device according to claim 51, wherein when the calibration information includes shape feature information of the calibrated photographable object, the processor acquires the photographable object within the photographing range of the movable platform. Characteristic information, including:
    获取所述可移动平台的拍摄范围内的图像信息;acquiring image information within the shooting range of the movable platform;
    基于所述图像信息,识别所述可移动平台的拍摄范围内的可拍摄物的形状特征信息。Based on the image information, the shape feature information of the photographable objects within the photographing range of the movable platform is identified.
  54. 如权利要求53所述的控制装置,其特征在于,所述图像信息包括以下信息中的至少一种:卫星地图、所述可移动平台的传感器采集的图像数据。The control device according to claim 53, wherein the image information includes at least one of the following information: a satellite map, and image data collected by sensors of the movable platform.
  55. 如权利要求50所述的控制装置,其特征在于,当识别到所述可移动平台的拍摄范围内满足预设拍摄条件的一个或多个拍摄目标后,所述处理器用于在图像信息中通过标识标注各个拍摄目标,所述图像信息包括以下信息中的至少一种:卫星地图、所述可移动平台的传感器采集的图像数据;The control device according to claim 50, wherein after recognizing one or more shooting targets within the shooting range of the movable platform that meet the preset shooting conditions, the processor is configured to pass the image information through the image information. Each shooting target is marked and marked, and the image information includes at least one of the following information: a satellite map, and image data collected by a sensor of the movable platform;
    所述显示器用于显示所述图像信息和各个所述标识。The display is used to display the image information and each of the logos.
  56. 如权利要求55所述的控制装置,其特征在于,所述标识包括以下标识 信息中的至少一种:图案标识或文字标识,所述图案标识包括箭头图案标识。The control device according to claim 55, wherein the identification includes at least one of the following identification information: a pattern identification or a character identification, and the pattern identification includes an arrow pattern identification.
  57. 如权利要求51所述的控制装置,其特征在于,所述位置标记信息包括一个或多个已标定可拍摄物的地理位置信息,所述处理器将所述可拍摄物的特征信息和所述标定信息进行匹配,识别所述可移动平台的拍摄范围内的拍摄目标,包括:The control device of claim 51, wherein the location marker information includes geographic location information of one or more calibrated photographable objects, and the processor compares the feature information of the photographable objects with the The calibration information is matched to identify the shooting target within the shooting range of the movable platform, including:
    获取第一位置信息,所述第一位置信息包括以下信息中的至少一个:所述可移动平台开始移动时的起始坐标信息、控制装置所处的坐标位置信息;Acquiring first position information, where the first position information includes at least one of the following information: starting coordinate information when the movable platform starts to move, and coordinate position information where the control device is located;
    识别所述第一位置信息周围的与所述位置标记信息相匹配的一个或多个拍摄目标。Identifying one or more shooting targets around the first position information that match the position marker information.
  58. 如权利要求53或55所述的控制装置,其特征在于,当识别到多个拍摄目标时,所述处理器还用于:The control device according to claim 53 or 55, wherein when multiple shooting targets are identified, the processor is further configured to:
    基于用户输入的选择指令,在所述图像信息中选中所述多个拍摄目标中的一个进行拍摄。Based on the selection instruction input by the user, one of the plurality of shooting targets is selected in the image information for shooting.
  59. 如权利要求50所述的控制装置,其特征在于,所述处理器用于获取和所述拍摄目标相匹配的构图规划信息,包括:The control device according to claim 50, wherein the processor is configured to acquire composition planning information matching the shooting target, comprising:
    获取所述拍摄目标的至少一个历史拍摄影像的构图规划信息;acquiring composition planning information of at least one historically shot image of the shooting target;
    基于所述至少一个历史拍摄影像的构图规划信息,确定所述拍摄目标的构图规划信息。Based on the composition planning information of the at least one historically shot image, the composition planning information of the shooting target is determined.
  60. 如权利要求50所述的控制装置,其特征在于,所述处理器用于获取和所述拍摄目标相匹配的构图规划信息,包括:The control device according to claim 50, wherein the processor is configured to acquire composition planning information matching the shooting target, comprising:
    获取已标定可拍摄物的构图规划信息的数据集,其中,各个所述已标定可拍摄物的构图规划信息为对各个已标定可拍摄物周围的卫星地图进行预设构图而获得的;obtaining a dataset of composition planning information of the calibrated photographable objects, wherein the composition planning information of each of the calibrated photographable objects is obtained by performing preset composition on satellite maps around each calibrated photographable object;
    自所述数据集中获取和所述拍摄目标相匹配的构图规划信息。The composition planning information matching the shooting target is acquired from the data set.
  61. 如权利要求50所述的控制装置,其特征在于,同一已标定可拍摄物对应一个或多个具有大体相同的形状特征的拍摄目标。51. The control device of claim 50, wherein the same calibrated photographable object corresponds to one or more photographing targets having substantially the same shape feature.
  62. 如权利要求51所述的控制装置,其特征在于,所述已标定可拍摄物的形状特征信息包括以下特征信息中的至少一种:可拍摄物的俯视形状特征、可拍摄物的侧视形状特征。The control device according to claim 51, wherein the shape feature information of the calibrated photographable object includes at least one of the following feature information: the top-view shape feature of the photographable object, the side-view shape of the photographable object feature.
  63. 如权利要求51所述的控制装置,其特征在于,所述目标拍摄位置包括目标拍摄高度,所述处理器基于所述构图规划信息,确定对所述拍摄目标进行拍 摄时所述可移动平台应处于的目标拍摄位置,包括:The control device according to claim 51, wherein the target shooting position includes a target shooting height, and the processor determines, based on the composition planning information, that the movable platform should be used when shooting the shooting target. The target shooting position in which it is located, including:
    基于所述构图规划信息和所述拍摄装置的当前视场,确定所述可移动平台的预估拍摄高度;determining an estimated shooting height of the movable platform based on the composition planning information and the current field of view of the shooting device;
    获取所述可移动平台所在位置周围的限制高度;Obtain the restricted height around the position of the movable platform;
    将所述预估拍摄高度和所述限制高度进行比较,确定所述目标拍摄高度。The estimated shooting height is compared with the limit height, and the target shooting height is determined.
  64. 如权利要求63所述的控制装置,其特征在于,所述处理器基于所述构图规划信息和所述拍摄装置的当前视场,确定所述可移动平台的预估拍摄高度,包括:The control device according to claim 63, wherein the processor determines the estimated shooting height of the movable platform based on the composition planning information and the current field of view of the shooting device, comprising:
    获取可移动平台的所述拍摄装置的当前视场;obtaining the current field of view of the photographing device of the movable platform;
    基于所述构图规划信息,获取预设构图时所述拍摄装置的预设视场和可移动平台的预设高度;obtaining, based on the composition planning information, a preset field of view of the photographing device and a preset height of the movable platform when a preset composition is used;
    基于所述预设高度、所述预设视场和所述当前视场,确定所述可移动平台的预估拍摄高度。Based on the preset height, the preset field of view, and the current field of view, an estimated shooting height of the movable platform is determined.
  65. 如权利要求63所述的控制装置,其特征在于,所述处理器将所述预估拍摄高度和所述限制高度数据进行比较,确定所述目标拍摄高度,包括:The control device of claim 63, wherein the processor compares the estimated shooting height with the restricted height data, and determines the target shooting height, comprising:
    当所述预估拍摄高度高于所述限制高度时,所述目标拍摄高度设定为所述限制高度;或When the estimated shooting height is higher than the limit height, the target shooting height is set as the limit height; or
    当所述预估拍摄高度低于或等于所述限制高度时,所述目标拍摄高度设定为所述预估拍摄高度。When the estimated shooting height is lower than or equal to the limit height, the target shooting height is set as the estimated shooting height.
  66. 如权利要求63所述的控制装置,其特征在于,The control device of claim 63, wherein:
    所述显示器还用于:获取并显示第一提示信息,所述第一提示信息用于提示可移动平台的预估拍摄高度高于限制高度,所述第一提示信息为当所述处理器确定所述预估拍摄高度高于所述限制高度时输出的,或者,所述第一提示信息为当可移动平台确定所述预估拍摄高度高于所述限制高度时输出的。The display is further configured to: acquire and display first prompt information, the first prompt information is used to prompt that the estimated shooting height of the movable platform is higher than the limit height, and the first prompt information is when the processor determines The estimated shooting height is output when the height is higher than the limit height, or the first prompt information is output when the movable platform determines that the estimated shooting height is higher than the limit height.
  67. 如权利要求63所述的控制装置,其特征在于,所述显示器还用于获取并显示第二提示信息,所述第二提示信息用于提示所述可移动平台自当前位置移动到目标拍摄位置并返航所需的电量大于当前电量,所述目标拍摄位置包括目标拍摄高度,所述目标拍摄高度包括所述预估拍摄高度或所述限制高度。The control device according to claim 63, wherein the display is further configured to acquire and display second prompt information, wherein the second prompt information is used to prompt the movable platform to move from the current position to the target shooting position And the power required for returning home is greater than the current power, the target shooting position includes the target shooting height, and the target shooting height includes the estimated shooting altitude or the limit altitude.
  68. 如权利要求50所述的控制装置,其特征在于,所述显示器还用于:The control device of claim 50, wherein the display is further configured to:
    获取并显示可移动平台处于目标拍摄位置后输出的反馈信息;以及Obtain and display the feedback information output after the movable platform is in the target shooting position; and
    基于用户指令显示所述拍摄装置的各个拍摄模式对应的选项,其中,所述拍 摄模式包括以下模式中的至少一种:单张拍摄、堆伐、全景、360°全景。Options corresponding to each shooting mode of the shooting device are displayed based on a user instruction, wherein the shooting mode includes at least one of the following modes: single shooting, stacking, panorama, and 360° panorama.
  69. 如权利要求68所述的控制装置,其特征在于,所述处理器还用于:The control device of claim 68, wherein the processor is further configured to:
    获取用户输入的模式选择指令,并根据所述模式选择指令,确定用于拍摄的拍摄模式,并输出模式选择指令,以控制所述可移动平台的拍摄装置基于对应的拍摄模式进行拍摄。The mode selection instruction input by the user is acquired, and according to the mode selection instruction, a shooting mode for shooting is determined, and the mode selection instruction is output to control the shooting device of the movable platform to shoot based on the corresponding shooting mode.
  70. 如权利要求69所述的控制装置,其特征在于,所述显示器还用于:显示与选中的拍摄模式对应的拍摄效果图,所述拍摄效果图包括由一张或多张卫星地图而生成的满足所述拍摄目标的构图规划信息的预设构图。The control device according to claim 69, wherein the display is further configured to: display a shooting effect map corresponding to the selected shooting mode, and the shooting effect map includes a satisfactory image generated from one or more satellite maps. The preset composition of the composition planning information of the shooting target.
  71. 如权利要求69所述的控制装置,其特征在于,所述显示器还用于:显示与选中的拍摄模式对应的预估拍摄时间。The control device according to claim 69, wherein the display is further configured to: display the estimated shooting time corresponding to the selected shooting mode.
  72. 如权利要求50所述的控制装置,其特征在于,所述显示器还用于显示以下信息中的至少一种信息:天气信息、时间信息、位置信息、光源位置信息。The control device according to claim 50, wherein the display is further configured to display at least one of the following information: weather information, time information, location information, and light source location information.
  73. 一种计算机存储介质,其上存储有计算机程序,其特征在于,所述计算机程序被处理器执行时实现1至24任一项所述的影像拍摄方法。A computer storage medium on which a computer program is stored, characterized in that, when the computer program is executed by a processor, the image capturing method described in any one of 1 to 24 is implemented.
PCT/CN2021/080462 2021-03-12 2021-03-12 Image photographing method, control apparatus, movable platform, and computer storage medium WO2022188151A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN202180082558.7A CN116762354A (en) 2021-03-12 2021-03-12 Image shooting method, control device, movable platform and computer storage medium
PCT/CN2021/080462 WO2022188151A1 (en) 2021-03-12 2021-03-12 Image photographing method, control apparatus, movable platform, and computer storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2021/080462 WO2022188151A1 (en) 2021-03-12 2021-03-12 Image photographing method, control apparatus, movable platform, and computer storage medium

Publications (1)

Publication Number Publication Date
WO2022188151A1 true WO2022188151A1 (en) 2022-09-15

Family

ID=83226203

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/080462 WO2022188151A1 (en) 2021-03-12 2021-03-12 Image photographing method, control apparatus, movable platform, and computer storage medium

Country Status (2)

Country Link
CN (1) CN116762354A (en)
WO (1) WO2022188151A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115292529A (en) * 2022-09-20 2022-11-04 中咨数据有限公司 Method, system, equipment and medium for automatic image processing and automatic result warehousing

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106131411A (en) * 2016-07-14 2016-11-16 纳恩博(北京)科技有限公司 A kind of method and apparatus shooting image
CN106412230A (en) * 2015-07-29 2017-02-15 Lg电子株式会社 Mobile terminal and method for controlling the same
WO2018214401A1 (en) * 2017-05-26 2018-11-29 深圳市大疆创新科技有限公司 Mobile platform, flying object, support apparatus, portable terminal, method for assisting in photography, program and recording medium
CN109241820A (en) * 2018-07-10 2019-01-18 北京二郎神科技有限公司 The autonomous image pickup method of unmanned plane based on space exploration

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106412230A (en) * 2015-07-29 2017-02-15 Lg电子株式会社 Mobile terminal and method for controlling the same
CN106131411A (en) * 2016-07-14 2016-11-16 纳恩博(北京)科技有限公司 A kind of method and apparatus shooting image
WO2018214401A1 (en) * 2017-05-26 2018-11-29 深圳市大疆创新科技有限公司 Mobile platform, flying object, support apparatus, portable terminal, method for assisting in photography, program and recording medium
CN109241820A (en) * 2018-07-10 2019-01-18 北京二郎神科技有限公司 The autonomous image pickup method of unmanned plane based on space exploration

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115292529A (en) * 2022-09-20 2022-11-04 中咨数据有限公司 Method, system, equipment and medium for automatic image processing and automatic result warehousing

Also Published As

Publication number Publication date
CN116762354A (en) 2023-09-15

Similar Documents

Publication Publication Date Title
US11797009B2 (en) Unmanned aerial image capture platform
US11644832B2 (en) User interaction paradigms for a flying digital assistant
US11649052B2 (en) System and method for providing autonomous photography and videography
US10587790B2 (en) Control method for photographing using unmanned aerial vehicle, photographing method using unmanned aerial vehicle, mobile terminal, and unmanned aerial vehicle
CN108351649B (en) Method and apparatus for controlling a movable object
JP6811336B2 (en) Multi gimbal assembly
WO2017075964A1 (en) Unmanned aerial vehicle photographing control method, unmanned aerial vehicle photographing method, mobile terminal and unmanned aerial vehicle
CN108351653B (en) System and method for UAV flight control
WO2018209702A1 (en) Method for controlling unmanned aerial vehicle, unmanned aerial vehicle and machine-readable storage medium
CN108351574A (en) System, method and apparatus for camera parameter to be arranged
JPWO2018198313A1 (en) Unmanned aerial vehicle action plan creation system, method and program
US11049406B2 (en) Thermal image based precision drone landing systems and methods
JP6225147B2 (en) Controller terminal and wireless aircraft control method
WO2022188151A1 (en) Image photographing method, control apparatus, movable platform, and computer storage medium
WO2022109860A1 (en) Target object tracking method and gimbal
WO2020225979A1 (en) Information processing device, information processing method, program, and information processing system
WO2022056683A1 (en) Field of view determination method, field of view determination device, field of view determination system, and medium
JP7081198B2 (en) Shooting system and shooting control device
WO2022061615A1 (en) Method and apparatus for determining target to be followed, system, device, and storage medium
JP2023083072A (en) Method, system and program
KR20240087359A (en) Drone system for recognizing and taceing the object based on real-time flying image

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21929626

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 202180082558.7

Country of ref document: CN

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21929626

Country of ref document: EP

Kind code of ref document: A1