WO2022226930A1

WO2022226930A1 - Data processing method, terminal device, unmanned aerial vehicle, system, and storage medium

Info

Publication number: WO2022226930A1
Application number: PCT/CN2021/091153
Authority: WO
Inventors: 周萌飞
Original assignee: 深圳市大疆创新科技有限公司
Priority date: 2021-04-29
Filing date: 2021-04-29
Publication date: 2022-11-03
Also published as: CN116724282A

Abstract

A data processing method, a terminal device, an unmanned aerial vehicle, a system, and a storage medium. The method comprises: displaying images photographed by a photography apparatus of an unmanned aerial vehicle on a display interface of a terminal device (S101); obtaining an operation of a user on the display interface, and determining a target image from among the images photographed by the unmanned aerial vehicle according to the operation (S102); obtaining target state data of the photography apparatus when photographing the target image, the target state data comprising flight state data and photography state data (S103); generating an identification code according to the target state data, and displaying the identification code on the display interface, wherein the target state data can be obtained on the basis of the identification code (S104).

Description

Data processing method, terminal equipment, unmanned aerial vehicle, system and storage medium

technical field

The present application relates to the technical field of unmanned aerial vehicles, and in particular, to a data processing method, terminal equipment, unmanned aerial vehicle, system and storage medium.

Background technique

When shooting, the camera on the drone usually records relevant information (such as exposure, aperture, focal length, shutter, GPS information when the drone takes photos, route information when the drone shoots video, and the rotation angle of the gimbal. , etc.) are stored in a markup language (KML, Keyhole Markup Language) file, but the operation of transferring files between devices is cumbersome, which is not conducive to users' convenient access to these relevant information and re-shooting operations.

SUMMARY OF THE INVENTION

Based on this, the present application provides a data processing method, a terminal device, an unmanned aerial vehicle, an unmanned aerial vehicle system and a storage medium.

In a first aspect, the present application provides a data processing method, the method comprising:

Display the image captured by the camera of the UAV on the display interface of the terminal device;

acquiring the user's operation on the display interface, and determining the target image from the image captured by the drone according to the operation;

acquiring target state data when the shooting device shoots the target image, the target state data including flight state data and shooting state data;

An identification code is generated according to the target state data, and the identification code is displayed on the display interface, wherein the target state data can be obtained based on the identification code.

In a second aspect, the present application provides a data processing method applied to a UAV, the method comprising:

Receive the request instruction sent by the terminal device, the request instruction is used to instruct the drone to send the target state data when the shooting device of the drone shoots the target image, and the target state data includes the flight state data and the shooting state data;

The target state data is sent to the terminal device, so that the terminal device generates an identification code according to the target state data, and the target state data can be obtained based on the identification code.

In a third aspect, the present application provides a terminal device, the terminal device includes: a memory and a processor; the memory is used to store a computer program;

The processor is configured to execute the computer program and implement the following steps when executing the computer program:

In a fourth aspect, the present application provides an unmanned aerial vehicle, the unmanned aerial vehicle is equipped with a photographing device, and the unmanned aerial vehicle comprises: a communication module, a memory and a processor;

the memory is used to store computer programs;

The control communication module receives the request instruction sent by the terminal device, and the request instruction is used to instruct the drone to send the target state data when the shooting device of the drone shoots the target image, and the target state data includes the flight state data and the shooting status data;

The control communication module sends the target state data to the terminal device, so that the terminal device generates an identification code according to the target state data, and the target state data can be obtained based on the identification code.

In a fifth aspect, the present application provides an unmanned aerial vehicle system, the unmanned aerial vehicle system includes the above-mentioned terminal device and the above-mentioned unmanned aerial vehicle.

In a sixth aspect, the present application provides a computer-readable storage medium, where the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the processor implements the data described in the first aspect above Approach.

In a seventh aspect, the present application provides a computer-readable storage medium, where the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the processor implements the data described in the second aspect above Approach.

Embodiments of the present application provide a data processing method, a terminal device, an unmanned aerial vehicle, an unmanned aerial vehicle system, and a storage medium. The method at the terminal device side includes: displaying an image captured by a camera of the unmanned aerial vehicle on a display interface of the terminal device Obtain the user's operation on the display interface, and determine the target image from the image captured by the drone according to the operation; obtain the target state data when the shooting device shoots the target image, the target state data It includes flight state data and shooting state data; an identification code is generated according to the target state data, and the identification code is displayed on the display interface, wherein the target state data can be obtained based on the identification code. Since the target image is determined from the image captured by the drone according to the user's operation on the display interface displaying the image captured by the camera device of the drone, the target image that the user may be interested in can be easily captured; When the shooting device captures the target image, the target state data generates an identification code and displays it on the display interface, and the target state data can be obtained based on the identification code, which can provide technical support for quick and convenient sharing of the identification code, and quickly and easily obtain the target based on the identification code. The target state data of the image, including the flight state data and the shooting state data, provides technical support, which in turn can provide technical support for subsequent re-shooting. The method at the UAV side includes: receiving a request instruction sent by a terminal device, where the request instruction is used to instruct the UAV to send target state data when a photographing device of the UAV shoots a target image; sending the target state data to the terminal device, so that the terminal The device generates an identification code according to the target state data, and the target state data can be obtained based on the identification code. In this way, technical support can be provided for the terminal device to generate the identification code according to the target state data.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not limiting of the present application.

Description of drawings

In order to explain the technical solutions of the embodiments of the present application more clearly, the following briefly introduces the accompanying drawings used in the description of the embodiments. For those of ordinary skill, other drawings can also be obtained from these drawings without any creative effort.

1 is a schematic flowchart of an embodiment of a data processing method of the present application;

2 is a schematic flowchart of another embodiment of the data processing method of the present application;

3 is a schematic flowchart of another embodiment of the data processing method of the present application;

4 is a schematic diagram of an image identification code according to an embodiment of the data processing method of the present application;

5 is a schematic flowchart of another embodiment of the data processing method of the present application;

6 is a schematic flowchart of another embodiment of the data processing method of the present application;

7 is a schematic flowchart of another embodiment of the data processing method of the present application;

8 is a schematic structural diagram of an embodiment of a terminal device of the present application;

9 is a schematic structural diagram of an embodiment of an unmanned aerial vehicle of the present application;

FIG. 10 is a schematic structural diagram of an embodiment of an unmanned aerial vehicle system of the present application.

Detailed ways

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present application.

The flowcharts shown in the figures are for illustration only, and do not necessarily include all contents and operations/steps, nor do they have to be performed in the order described. For example, some operations/steps can also be decomposed, combined or partially combined, so the actual execution order may be changed according to the actual situation.

Some embodiments of the present application will be described in detail below with reference to the accompanying drawings. The embodiments described below and features in the embodiments may be combined with each other without conflict.

The data processing methods in the embodiments of the present application include a data processing method applied to a terminal device (referred to as a terminal device-side method) and a data processing method applied to an unmanned aerial vehicle (referred to as a UAV-side method). For the convenience of description and to facilitate a better understanding of the data processing method in the embodiment of the present application, the terminal device-side method and the UAV-side method are combined for detailed description below.

It should be noted that although the terminal device-side method and the UAV-side method are described together, the terminal-device-side method and the UAV-side method are independent of each other, and the terminal-device-side method can share the identification code quickly and conveniently. Provide technical support to quickly and easily obtain target state data including flight state data and shooting state data based on the identification code to obtain the target image, and then provide technical support for subsequent re-shooting; the UAV-side method is the terminal device. Provide technical support for generating identification codes based on target status data.

Referring to FIGS. 1 to 3, FIG. 1 is a schematic flowchart of an embodiment of the data processing method of the present application, FIG. 2 is a schematic flowchart of another embodiment of the data processing method of the present application, and FIG. 3 is another embodiment of the data processing method of the present application. Schematic diagram of the process. It should be noted that the method in Fig. 1 is the method on the terminal equipment side, the method in Fig. 2 is the method on the UAV side, and the UAV is equipped with a photographing device, and the method in Fig. 3 is the combination of the method on the terminal equipment side and the UAV side method. way together.

The terminal device end method includes: step S101, step S102, step S103 and step S104; the drone end method includes: step S201 and step S202.

Terminal device side method:

Step S101: Display the image captured by the camera of the drone on the display interface of the terminal device.

Step S102: Acquire a user's operation on the display interface, and determine a target image from an image captured by the drone according to the operation.

UAV side method:

Step S201: Receive a request instruction sent by the terminal device, where the request instruction is used to instruct the drone to send the target state data when the camera of the drone shoots the target image, and the target state data includes the flight state data and the shooting status data.

Step S202: Send the target state data to a terminal device, so that the terminal device generates an identification code according to the target state data, and the target state data can be obtained based on the identification code.

Terminal device side method:

Step S103: Acquire target state data when the photographing device shoots the target image, where the target state data includes flight state data and shooting state data.

Step S104: Generate an identification code according to the target state data, and display the identification code on the display interface, wherein the target state data can be obtained based on the identification code.

In this embodiment of the present application, the terminal device may refer to a device capable of sending an instruction that the drone can respond to to the drone. The terminal device may be a single device with a display screen, or a combination of two or more devices (one of which is a device with a display screen, which is used to display the image captured by the camera of the drone). Terminal devices include but are not limited to: a remote control with a display screen, a combination of a remote control and a mobile phone, a combination of a remote control and a tablet computer (eg iPad), a combination of a mobile phone and a tablet computer (eg iPad), and so on.

The image captured by the camera on the drone is transmitted to the terminal device through image transmission, and displayed on the display interface of the terminal device. The user can operate on these images on the display interface (for example, click, select, box-select, favorite, etc.) to express interest. The terminal device determines the target image from the images captured by the drone according to these operations, for example, the image clicked by the user is determined as the target image, the image saved by the user is determined as the target image, and the image selected by the user is determined as the target image, and many more. In this way, the target image that the user is interested in can be determined through this way of interacting with the user. That is, in step S102, the operation of the user on the display interface is obtained, and the target image is determined from the image captured by the drone according to the operation, and may also include: obtaining the user's click on the image on the display interface, selecting the image or saving the image Image operation, according to the operation, the clicked image, the selected image or the favorited image is determined as the target image from the images captured by the drone.

When the terminal device determines the target image, it is also sending a request instruction to the UAV to request the UAV to send the target state data when the shooting device of the UAV shoots the target image, and the target state data includes the flight state data and the shooting state. data.

The flight state data may refer to the flight state data related to the UAV when the photographing device of the UAV captures the target image. Wherein, when the flight state data is used for subsequent re-shooting requirements, the flight state data may refer to the flight state data of the UAV related to re-shooting when the photographing device of the UAV captures the target image. The flight status data of the UAV related to the re-shooting can usually include the UAV waypoint information or the UAV route information, and can also include the UAV altitude information. If the target image is a photo, the flight status data may include the UAV waypoint information when the photo was taken. If the target image is a video image, the flight status data may include the UAV route information when the video image was taken.

The shooting status data may refer to shooting status data related to the target image when the shooting device of the drone shoots the target image. The shooting state data includes at least one of image information obtained by the sensory camera, pan/tilt angle information, and shooting parameter information of the shooting device.

The perception camera can identify the content in the monitoring screen based on the intelligent analysis of the video, and perform semantic description and best picture capture. A series of information such as direction, speed, etc., and text description and best picture capture for these information. Therefore, the image information obtained by the perception camera can provide more accurate position information, correct the position of the UAV, and perform high-precision re-shooting based on the image information obtained by the perception camera.

Wherein, the shooting parameter information of the shooting device includes at least one of aperture, exposure time, sensitivity, white balance, resolution and image scale.

After the drone receives the request instruction, it sends the target state data to the terminal device, and the terminal device obtains the target state data sent by the drone when the shooting device shoots the target image, and generates an identification code according to the target state data. , and display the identification code on the display interface, and the target state data can be obtained based on the identification code. In this way, the user can see the identification code on the display interface, and subsequently the user can perform simple and convenient operations on the identification code on the display interface, and can interact with the terminal device or interact with other terminal devices in an interactive manner. Moreover, the user does not need to know the shooting information of the image by looking at the exchangeable image file (EXIF, Exchangeable Image File) information of the image, and controls the drone to go to the waypoint by copying the coordinate point through the third-party software, and can pass the identification code. Take quick retakes.

For example, when interacting with a terminal device, if the target state data has been deleted locally, the operation identification code can obtain the target state data obtained based on the identification code, and re-shoot locally; or, interact with other terminal devices, operate the identification code, and The identification code is shared with other terminal devices, and other terminal devices obtain target state data based on the identification code, and can also perform re-shooting. Application scenarios of interacting with other terminal devices, for example, if the user changes the terminal device or replaces the drone, the target status data can be obtained based on the identification code on another terminal device by sharing, and can also be re-shot; Alternatively, the user shares the identification code to other terminal devices in a sharing manner, and other terminal devices obtain target state data based on the identification code, and can also perform re-shooting; and so on.

There are many ways to obtain the target state data based on the identification code. For example, the target state data can be recorded on the image, and an identification code can be generated from the image recorded with the target state data. Through the identification code, the image recorded with the target state data can be obtained, and the target state data recorded by the image can be directly read. For another example, the target state data is stored in a server, an identification code is generated according to the storage address of the target state data in the server, and the storage address of the target state data can be obtained through the identification code, and then obtained from the storage address of the target state data in the server. target state data.

The method on the terminal device side according to the embodiment of the present application includes: displaying an image captured by a camera of an unmanned aerial vehicle on a display interface of the terminal device; Determine a target image in the image; acquire target state data when the shooting device shoots the target image, the target state data includes flight state data and shooting state data; generate an identification code according to the target state data, and use the An identification code is displayed on the display interface, wherein the target state data can be obtained based on the identification code. Since the target image is determined from the image captured by the drone according to the user's operation on the display interface displaying the image captured by the camera device of the drone, the target image that the user may be interested in can be easily captured; When the shooting device captures the target image, the target state data generates an identification code and displays it on the display interface, and the target state data can be obtained based on the identification code, which can provide technical support for quick and convenient sharing of the identification code, and quickly and easily obtain the target based on the identification code. The target state data of the image, including the flight state data and the shooting state data, provides technical support, which in turn can provide technical support for subsequent re-shooting. The method at the UAV side includes: receiving a request instruction sent by a terminal device, where the request instruction is used to instruct the UAV to send target state data when a photographing device of the UAV shoots a target image; sending the target state data to the terminal device, so that the terminal The device generates an identification code according to the target state data, and the target state data can be obtained based on the identification code. In this way, technical support can be provided for the terminal device to generate the identification code according to the target state data.

The details of the identification code are described below.

In one embodiment, the identification code is a commonly used text identification code or an image identification code. In this way, a brand-new user communication method can be provided, using identification codes or image identification codes, which can be spread by almost all social media, to help users communicate with each other.

For example, the implementation of the text identification code may be as follows: a meaningless code may be generated from the storage address of the target state data, and some prefix and suffix information may be added before and after the code to facilitate identification. For example, the image identification code can be implemented as follows: a meaningless code can be generated from the storage address of the target state data, the code can be converted into a two-dimensional code, and the locally compressed photo or video material can be obtained. If it is a video, it can be compressed into GIF Motion picture, if it is a photo, it can be combined into one photo. Through this image, the user can quickly learn the location, author, preview effect and other related information of the image identification code, as shown in FIG. 4 .

In one embodiment, the identification code is an encrypted identification code, which can ensure the security of the target state data. For example, in the implementation process of the text identification code or the image identification code, the storage address of the target state data can be encrypted first, and then a piece of meaningless code can be generated.

In one embodiment, the identification code carries a validity period, and within the validity period of the identification code, the target state data can be obtained based on the identification code, and beyond the validity period, the target state data cannot be based on the validity period. The identification code is obtained. In this way, the identification code can be made valid within the validity period and invalid when the validity period is exceeded, which can avoid the risk that the target state data is not controlled by time and can be easily obtained at any time, thereby ensuring the security of the target state data.

In one embodiment, the identification code carries a target sharing object, and when the identification code is shared with the target sharing object, the target state data can be obtained based on the identification code, and is shared with other than the target sharing object. The target state data cannot be obtained based on the identification code when the non-target sharing object is not included. In this way, the identification code can be shared with the target sharing object according to the wishes of the user, so that the target sharing object can obtain the target state data, and the non-target sharing object cannot obtain the target state data, which can prevent the identification code from being unrestrictedly shared with other terminals. The device and any other terminal device can obtain the target state data, thereby ensuring the security of the target state data.

In an embodiment, the terminal device can share the identification code, that is, the method further includes: sharing the identification code with other terminal devices according to the user's first operation on the identification code on the display interface, so as to The other terminal equipment is made to obtain the target state data based on the identification code.

There are many ways to implement the first operation. For example, when you click and long-press the identification code, the word "Share" is displayed, and then select "Share"; or click the identification code, and then the "Share" button is displayed on the display interface, and then click the "Share" button; and many more. In this way, the identification code can be conveniently and quickly shared with other terminal devices, and other terminal devices can easily obtain the target state data based on the identification code.

For example, a good shooting work is very dependent on the photographer. The shooting technology and aesthetic communication of the operator, and the adjustment of shooting parameters will all affect the quality of a product. There is a lot to learn for newcomers on this path. After obtaining the consent of the master user, the photos and videos taken by the master user can be shared externally for newcomers to retake and learn. It is no longer difficult to shoot master-level good works.

In an embodiment, the terminal device can locally acquire target state data for re-shooting, that is, the method further includes: step S105 and step S106, as shown in FIG. 5 .

Step S105: According to the second operation of the user on the identification code on the display interface, the target state data is obtained based on the identification code. There are also many ways to implement the second operation. For example, when you click and long-press the identification code, the words "identification identification code" are displayed, and "identification identification code" is selected; or the identification code can be clicked; and so on.

Step S106: Control the drone to perform re-shooting according to the target state data.

When the terminal device does not save the target state data locally or has deleted the target state data, and the user wants to re-shoot again, the target state data can be obtained locally through the identification code for re-shooting. For example, this function can be used when shooting buildings, rivers and other locations that are often fixed-point shooting, or when users feel that the previously shot works are flawed and want to re-shoot. The user can also edit the acquired target state data before re-shooting, such as editing the waypoint or route of the drone, and adjusting its flight speed, shooting mode, shooting parameters of the shooting device, etc.

In this way, on the one hand, users who have repeated shooting of the same location can quickly and efficiently perform repeated shooting; on the other hand, it can also be used as a tool to help multiple users to cooperate with each other.

In an embodiment, the terminal device can obtain target state data corresponding to the identification code based on the identification code shared by other terminal devices to perform re-shooting, that is, the method further includes steps S107 and S108, as shown in FIG. 6 .

Step S107: Obtain target state data corresponding to the identification code based on the identification code shared by other terminal devices.

Step S108: Control the drone to perform re-shooting according to the target state data.

The implementation of the sharing of the identification code by the other terminal devices may be: other terminal devices actively share the identification code, or the local terminal device may actively scan the identification codes of the other terminal devices.

After the terminal device obtains the target state data corresponding to the identification code based on the identification code shared by other terminal devices, the user can also edit the obtained target state data before re-shooting, such as the waypoint or route of the drone. Edit, you can adjust its flight speed, shooting mode, shooting parameters of the shooting device, etc.

In one embodiment, the terminal device can determine whether the drone meets the re-shooting conditions from the perspective of safe flight of the drone before re-shooting, that is, in step S106 or step S108, the control is based on the target state data. Before the drone performs the re-shooting, the method may further include: determining whether the drone meets the re-shooting condition according to the flight state data in the target state data.

At this time, in step S106 or step S108, the controlling the drone to perform re-shooting according to the target state data may further include: if the drone meets the re-shooting conditions, according to the target state data, Control the drone to retake the shot.

In this embodiment, the re-shooting condition may refer to a safety condition related to the drone during re-shooting. For example, whether the drone has reached the position indicated in the flight status data, whether the flying altitude of the drone is appropriate, whether the position indicated in the no-flight status data is in the prohibited flight area, and so on. In this way, on the one hand, it ensures that the location of the re-shooting is as much as possible the location that the user wants, and on the other hand, it ensures the safety of the drone flight and helps reduce the risk of fried chicken when the drone performs flight tasks.

In one embodiment, the determining whether the drone meets the re-shooting condition may include: if the distance between the current position of the drone and the starting point position indicated by the flight status data is less than or equal to a preset If the distance threshold is set, it is determined that the UAV meets the conditions for re-shooting.

In this embodiment, the starting point position may refer to a position that can ensure the safe flight of the drone. Ideally, the current position of the UAV coincides with the starting position indicated by the flight status data. In general, the current position of the UAV and the starting point indicated by the flight status data are difficult to coincide. Therefore, if the distance between the current position of the UAV and the starting point indicated by the flight status data is less than or equal to the preset distance threshold, then It is determined that the drone meets the conditions for re-shooting. The preset distance threshold is set according to the actual situation, for example, it can usually be set to 200m or 500m.

In one embodiment, the determining whether the drone meets the re-shooting condition may include: if the positions of the waypoints indicated by the flight status data are all outside the area where flying is prohibited, determining that the drone is unmanned. The machine meets the re-shooting conditions. The drone flight needs to follow the relevant laws and regulations, and the position of the re-shooting cannot be in the prohibited area, otherwise it will violate the laws and regulations on the one hand, and may also cause safety problems on the other hand.

In one embodiment, whether the high-precision re-shooting or the low-precision re-shooting is determined according to whether the target state data includes image information obtained by the sensing camera. That is, in step S106 or step S108, the controlling the UAV to perform re-shooting according to the target state data may further include: if the target state data includes image information obtained by a sensing camera, obtaining image information based on the sensing camera control the drone to perform high-precision re-shooting; or, if the target state data does not include the image information obtained by the sensing camera, control the drone to perform low-precision re-shooting.

Since the perception camera can identify the content in the surveillance screen based on the intelligent analysis of the video, and perform semantic description and best picture capture, the image information obtained by the perception camera can provide more accurate location information, which can be used for drones. The position of the sensor is corrected, so that high-precision re-shooting can be performed based on the image information obtained by the sensory camera. If the target state data does not include the image information obtained by the perception camera, control the UAV to perform low-precision retakes.

In an embodiment, in step S103 on the terminal device side, the acquiring the target state data when the photographing device photographed the target image may include: downloading from the drone, the photographing data of the photographing device, according to the target image. The target state data when the target image is described, and a first correspondence relationship is established between the target image and the target state data. A first correspondence relationship is established between the target image and the target state data, and the target state data when the photographing device shoots the target image can be conveniently downloaded from the drone according to the target image.

In one embodiment, the terminal device uploads the target status data to the server, and generates an identification code according to the storage address of the target status data, that is, step S104, the generating an identification code according to the target status data may further include: sub-steps S1041, sub-step S1042 and sub-step S1043, as shown in FIG. 7 .

Sub-step S1041: Upload the target state data to a server, so that the server saves the target state data, and a second correspondence is established between the target image and the storage address of the target state data.

Sub-step S1042: Acquire a storage address of the target state data from the server according to the target image.

Sub-step S1043: Generate an identification code according to the storage address of the target state data.

Uploading the target state data to the server, so that the server saves the target state data, on the one hand, it can prevent the target state data from being stored locally occupying the storage space of the terminal device, and on the other hand, the server is used to specially store the target state data, which is convenient. The terminal device exchanges the storage address of the target state data through the identification code.

A second correspondence relationship is established between the target image and the storage address of the target state data. When specifically implemented, a second correspondence relationship can be established between the identification of the target image and the identification of the storage address of the target state data; or The target image can be stored in the same save address as the target state data; and so on. In this way, the storage address of the target state data can be easily obtained from the server according to the target image.

The identification code is generated according to the storage address of the target state data, and the storage address of the target state data can be obtained according to the identification of the identification code, and then the target state data is obtained through the server, thereby improving interaction efficiency and convenience.

The following describes other details of the drone side.

In one embodiment, the method at the UAV side further includes: saving the state data of the image in a local secure digital card or memory. This can protect user privacy and ensure data security.

In one embodiment, the method at the UAV side further includes: outputting prompt information according to the received instruction to format the secure digital card to prompt the user that the state data of the image is stored in the secure digital card, and please confirm whether to delete it. . In this way, it is possible to prevent the user from accidentally deleting the data.

Referring to FIG. 8, FIG. 8 is a schematic structural diagram of an embodiment of a terminal device of the present application. It should be noted that the terminal device of this embodiment can execute the steps in the above-mentioned data processing method on the terminal device side. For a detailed description of the relevant content, please refer to The relevant content of the above-mentioned data processing method at the terminal device side will not be repeated here.

The terminal device 100 includes: a memory 1 and a processor 2; the processor 2 and the memory 1 are connected through a bus.

Wherein, the processor 2 may be a microcontroller unit, a central processing unit or a digital signal processor, and so on.

Wherein, the memory 1 may be a Flash chip, a read-only memory, a magnetic disk, an optical disk, a U disk, a mobile hard disk, and the like.

The memory 1 is used to store a computer program; the processor 2 is used to execute the computer program and implement the following steps when executing the computer program:

Display the image captured by the camera of the UAV on the display interface of the terminal device; acquire the user's operation on the display interface, and determine the target image from the image captured by the UAV according to the operation; acquire the captured image Target state data when the device shoots the target image, the target state data includes flight state data and shooting state data; an identification code is generated according to the target state data, and the identification code is displayed on the display interface, wherein , the target state data can be obtained based on the identification code.

Wherein, the flight status data includes UAV waypoint information or UAV route information.

Wherein, the flight status data also includes the altitude information of the drone.

Wherein, the shooting state data includes at least one of image information obtained by the sensing camera, pan/tilt angle information, and shooting parameter information of the shooting device.

Wherein, the identification code is a text identification code or an image identification code.

Wherein, the identification code is an encrypted identification code.

Wherein, the identification code carries a validity period, within the validity period of the identification code, the target state data can be obtained based on the identification code, and beyond the validity period, the target state data cannot be based on the identification code Get it.

Wherein, the identification code carries a target sharing object, and when the identification code is shared with the target sharing object, the target state data can be obtained based on the identification code, and is shared with non-target sharing objects other than the target sharing object. When the target shares an object, the target state data cannot be obtained based on the identification code.

Wherein, when executing the computer program, the processor implements the following steps: sharing the identification code with other terminal devices according to the user's first operation on the identification code on the display interface, so that the Other terminal devices obtain the target state data based on the identification code.

Wherein, when executing the computer program, the processor implements the following steps: obtaining the target state data based on the identification code according to a second operation of the identification code by the user on the display interface; The target state data is described, and the drone is controlled to perform re-shooting.

Wherein, when executing the computer program, the processor implements the following steps: obtaining target state data corresponding to the identification code based on the identification code shared by other terminal devices; Retake.

Wherein, when executing the computer program, the processor implements the following steps: according to the flight state data in the target state data, determine whether the drone meets the re-shooting condition; if the drone meets the re-shooting condition; If the shooting conditions are met, the drone is controlled to perform re-shooting according to the target state data.

Wherein, when executing the computer program, the processor implements the following steps: if the distance between the current position of the UAV and the starting point position indicated by the flight status data is less than or equal to a preset distance threshold, determine The UAV meets the conditions for re-shooting.

Wherein, when executing the computer program, the processor implements the following steps: if the positions of the waypoints indicated by the flight status data are all outside the area where flying is prohibited, determine that the UAV meets the re-shooting conditions .

Wherein, when executing the computer program, the processor implements the following steps: if the target state data includes image information obtained by a sensing camera, controlling the drone to perform high-precision complex operations based on the image information obtained by the sensing camera or, if the target state data does not include the image information obtained by the sensing camera, control the drone to perform low-precision re-shooting.

Wherein, when the processor executes the computer program, the following steps are implemented: according to the target image, downloading the target state data when the photographing device shoots the target image from the drone, the target image and the target image. A first correspondence relationship is established between the target state data.

When executing the computer program, the processor implements the following steps: uploading the target state data to a server, so that the server saves the target state data, the difference between the target image and the target state data A second correspondence relationship is established between the storage addresses; the storage address of the target state data is acquired from the server according to the target image; an identification code is generated according to the storage address of the target state data.

Wherein, when executing the computer program, the processor implements the following steps: acquiring an operation of the user clicking on an image, selecting an image or saving an image on the display interface, and selecting an image from the image captured by the drone according to the operation The clicked image, the selected image or the favorited image is determined as the target image.

Referring to FIG. 9, FIG. 9 is a schematic structural diagram of an embodiment of an unmanned aerial vehicle of the present application. It should be noted that the unmanned aerial vehicle of this embodiment can execute the steps in the above-mentioned data processing method on the UAV side, and the relevant content is described in detail. , please refer to the relevant content of the above-mentioned data processing method on the UAV side, which will not be repeated here.

The UAV 200 is equipped with a photographing device 33, and the UAV 200 further includes: a communication module 44, a memory 11 and a processor 22; the processor 22 communicates with the memory 11, the photographing device 33 and the communication module 44 via a bus respectively connect.

The memory 11 is used to store a computer program; the processor 22 is used to execute the computer program and implement the following steps when executing the computer program:

The control communication module receives the request instruction sent by the terminal device, and the request instruction is used to instruct the drone to send the target state data when the shooting device of the drone shoots the target image, and the target state data includes the flight state data and the shooting status data; the control communication module sends the target status data to the terminal device, so that the terminal device generates an identification code according to the target status data, and the target status data can be obtained based on the identification code.

Wherein, when the processor executes the computer program, the following steps are implemented: saving the state data of the image in a local secure digital card or memory.

Wherein, when the processor executes the computer program, the following steps are implemented: according to the received instruction to format the secure digital card, output prompt information to prompt the user that the secure digital card has stored image status data, Please confirm whether to delete it.

Wherein, the shooting parameter information of the shooting device includes at least one of aperture, exposure time, sensitivity, white balance, resolution, and image ratio.

Referring to FIG. 10, FIG. 10 is a schematic structural diagram of an embodiment of an unmanned aerial vehicle system of the present application, and the unmanned aerial vehicle system includes the terminal device 100 described in any of the above and the unmanned aerial vehicle 200 described in any of the above, For a detailed description of the relevant content, please refer to the above-mentioned relevant content section, which will not be repeated here.

The present application also provides a computer-readable storage medium, where the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the processor enables the processor to implement any of the above data processing methods on the terminal device side. For a detailed description of the relevant content, please refer to the above-mentioned relevant content section, which will not be repeated here.

Wherein, the computer-readable storage medium may be an internal storage unit of the above-mentioned terminal device, such as a hard disk or a memory. The computer-readable storage medium may also be an external storage device, such as an equipped plug-in hard disk, smart memory card, secure digital card, flash memory card, and the like.

The present application also provides a computer-readable storage medium, where a computer program is stored in the computer-readable storage medium, and when the computer program is executed by a processor, the processor implements any of the above data processing methods on the UAV side . For a detailed description of the relevant content, please refer to the above-mentioned relevant content section, which will not be repeated here.

Wherein, the computer-readable storage medium may be an internal storage unit of the above-mentioned drone, such as a hard disk or a memory. The computer-readable storage medium may also be an external storage device, such as an equipped plug-in hard disk, smart memory card, secure digital card, flash memory card, and the like.

It should be understood that the terms used in the specification of the present application are only for the purpose of describing particular embodiments and are not intended to limit the present application.

It will also be understood that, as used in this specification and the appended claims, the term "and/or" refers to and including any and all possible combinations of one or more of the associated listed items.

The above are only specific embodiments of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art can easily think of various equivalents within the technical scope disclosed in the present application. Modifications or substitutions shall be covered by the protection scope of this application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims

A data processing method, characterized in that the method comprises:

Display the image captured by the camera of the UAV on the display interface of the terminal device;

acquiring the user's operation on the display interface, and determining the target image from the image captured by the drone according to the operation;

acquiring target state data when the shooting device shoots the target image, the target state data including flight state data and shooting state data;

An identification code is generated according to the target state data, and the identification code is displayed on the display interface, wherein the target state data can be obtained based on the identification code.
The method according to claim 1, wherein the flight status data includes UAV waypoint information or UAV route information.
The method according to claim 2, wherein the flight status data further comprises drone altitude information.
The method according to claim 1, wherein the shooting state data includes at least one of image information obtained by a sensory camera, pan-tilt angle information, and shooting parameter information of a shooting device.
The method according to claim 4, wherein the shooting parameter information of the shooting device includes one or more of aperture, exposure time, sensitivity, white balance, resolution, and image scale.
The method according to claim 1, wherein the identification code is a text identification code or an image identification code.
The method according to claim 1, wherein the identification code is an encrypted identification code.
The method according to claim 1, wherein the identification code carries a validity period, the identification code is within the validity period, and the target state data can be obtained based on the identification code, and when the validity period exceeds the validity period, The target state data cannot be obtained based on the identification code.
The method according to claim 1, wherein the identification code carries a target sharing object, and the target state data can be obtained based on the identification code when the identification code is shared with the target sharing object, and the sharing When given to a non-target sharing object other than the target sharing object, the target state data cannot be obtained based on the identification code.
The method according to claim 1, wherein the method further comprises:

According to the user's first operation on the identification code on the display interface, the identification code is shared with other terminal devices, so that the other terminal devices obtain the target state data based on the identification code.
The method according to claim 1, wherein the method further comprises:

According to the user's second operation on the identification code on the display interface, the target state data is obtained based on the identification code;

According to the target state data, the drone is controlled to perform re-shooting.
The method according to claim 1, wherein the method further comprises:

Obtain target state data corresponding to the identification code based on the identification code shared by other terminal devices;

According to the target state data, the drone is controlled to perform re-shooting.
The method according to claim 11 or 12, wherein before controlling the drone to perform re-shooting according to the target state data, the method comprises:

According to the flight state data in the target state data, determine whether the drone meets the re-shooting condition;

The controlling the drone to perform re-shooting according to the target state data includes:

If the drone meets the re-shooting conditions, the drone is controlled to perform re-shooting according to the target state data.
The method according to claim 13, wherein the determining whether the drone meets the re-shooting condition comprises:

If the distance between the current position of the drone and the starting point position indicated by the flight status data is less than or equal to a preset distance threshold, it is determined that the drone meets the re-shooting condition.
The method according to claim 13, wherein the determining whether the drone meets the re-shooting condition comprises:

If the positions of the waypoints indicated by the flight status data are all outside the prohibited flight area, it is determined that the UAV meets the re-shooting condition.
The method according to claim 11 or 12, characterized in that, according to the target state data, controlling the unmanned aerial vehicle to perform re-shooting, comprising:

If the target state data includes the image information obtained by the sensing camera, controlling the UAV to perform high-precision re-shooting based on the image information obtained by the sensing camera;

or,

If the target state data does not include the image information obtained by the sensing camera, the drone is controlled to perform low-precision re-shooting.
The method according to claim 1, wherein the acquiring the target state data when the shooting device shoots the target image comprises:

According to the target image, the target state data when the photographing device captures the target image is downloaded from the drone, and a first correspondence relationship is established between the target image and the target state data.
The method according to claim 17, wherein the generating an identification code according to the target state data comprises:

uploading the target state data to a server, so that the server saves the target state data, and a second correspondence is established between the target image and the storage address of the target state data;

Obtain the storage address of the target state data from the server according to the target image;

An identification code is generated according to the storage address of the target state data.
The method according to claim 1, wherein the acquiring a user's operation on the display interface, and determining a target image from an image captured by the drone according to the operation, comprises:

Obtain the operation of the user clicking on an image, selecting an image or saving an image on the display interface, and determining the clicked image, the selected image or the saved image as the target image from the images captured by the drone according to the operation .
A data processing method, characterized in that, applied to an unmanned aerial vehicle, the method comprising:

Receive a request instruction sent by the terminal device, where the request instruction is used to instruct the drone to send the target state data when the photographing device of the drone shoots the target image, and the target state data includes flight state data and shooting state data;

The target state data is sent to the terminal device, so that the terminal device generates an identification code according to the target state data, and the target state data can be obtained based on the identification code.
The method of claim 20, wherein the method further comprises:

Save the image's state data on a local Secure Digital Card or internal memory.
The method of claim 21, wherein the method further comprises:

According to the received instruction to format the security digital card, output prompt information to prompt the user that the security digital card has stored image status data, please confirm whether to delete it.
The method according to claim 20, wherein the flight status data comprises UAV waypoint information or UAV route information.
The method according to claim 23, wherein the flight status data further comprises drone altitude information.
The method according to claim 20, wherein the shooting status data includes at least one of image information obtained by a sensory camera, pan/tilt angle information, and shooting parameter information of a shooting device.
The method according to claim 25, wherein the shooting parameter information of the shooting device includes one or more of aperture, exposure time, sensitivity, white balance, resolution, and image scale.
A terminal device, characterized in that the terminal device comprises: a memory and a processor; the memory is used to store a computer program;

The processor is configured to execute the computer program and implement the following steps when executing the computer program:

Display the image captured by the camera of the UAV on the display interface of the terminal device;

acquiring the user's operation on the display interface, and determining the target image from the image captured by the drone according to the operation;

acquiring target state data when the shooting device shoots the target image, the target state data including flight state data and shooting state data;

An identification code is generated according to the target state data, and the identification code is displayed on the display interface, wherein the target state data can be obtained based on the identification code.
The terminal device according to claim 27, wherein the flight status data includes UAV waypoint information or UAV route information.
The terminal device according to claim 28, wherein the flight status data further comprises drone altitude information.
The terminal device according to claim 27, wherein the shooting state data includes at least one of image information obtained by the sensory camera, pan-tilt angle information, and shooting device shooting parameter information.
The terminal device according to claim 30, wherein the shooting parameter information of the shooting device includes one or more of aperture, exposure time, sensitivity, white balance, resolution, and image scale.
The terminal device according to claim 27, wherein the identification code is a text identification code or an image identification code.
The terminal device according to claim 27, wherein the identification code is an encrypted identification code.
The terminal device according to claim 27, wherein the identification code carries a validity period, and the identification code is within the validity period, and the target state data can be obtained based on the identification code, and when the validity period exceeds the validity period , the target state data cannot be obtained based on the identification code.
The terminal device according to claim 27, wherein the identification code carries a target sharing object, and the target state data can be obtained based on the identification code when the identification code is shared with the target sharing object, When sharing to a non-target sharing object other than the target sharing object, the target state data cannot be obtained based on the identification code.
The terminal device according to claim 27, wherein the processor implements the following steps when executing the computer program:

According to the user's first operation on the identification code on the display interface, the identification code is shared with other terminal devices, so that the other terminal devices obtain the target state data based on the identification code.
The terminal device according to claim 27, wherein the processor implements the following steps when executing the computer program:

According to the user's second operation on the identification code on the display interface, the target state data is obtained based on the identification code;

According to the target state data, the drone is controlled to perform re-shooting.
The terminal device according to claim 27, wherein the processor implements the following steps when executing the computer program:

Obtain the target state data corresponding to the identification code based on the identification code shared by other terminal devices;

According to the target state data, the drone is controlled to perform re-shooting.
The terminal device according to claim 37 or 38, wherein, when the processor executes the computer program, the following steps are implemented:

According to the flight state data in the target state data, determine whether the drone meets the re-shooting condition;

If the drone meets the re-shooting conditions, the drone is controlled to perform re-shooting according to the target state data.
The terminal device according to claim 39, wherein the processor implements the following steps when executing the computer program:

If the distance between the current position of the drone and the starting point position indicated by the flight status data is less than or equal to a preset distance threshold, it is determined that the drone meets the re-shooting condition.
The terminal device according to claim 39, wherein the processor implements the following steps when executing the computer program:

If the positions of the waypoints indicated by the flight status data are all outside the prohibited flight area, it is determined that the UAV meets the re-shooting condition.
The terminal device according to claim 37 or 38, wherein, when the processor executes the computer program, the following steps are implemented:

If the target state data includes the image information obtained by the sensing camera, controlling the UAV to perform high-precision re-shooting based on the image information obtained by the sensing camera;

or,

If the target state data does not include the image information obtained by the sensing camera, the drone is controlled to perform low-precision re-shooting.
The terminal device according to claim 27, wherein when executing the computer program, the processor implements the following steps:

According to the target image, the target state data when the photographing device captures the target image is downloaded from the drone, and a first correspondence relationship is established between the target image and the target state data.
The terminal device according to claim 43, wherein the processor implements the following steps when executing the computer program:

uploading the target state data to a server, so that the server saves the target state data, and a second correspondence is established between the target image and the storage address of the target state data;

Obtain the storage address of the target state data from the server according to the target image;

An identification code is generated according to the storage address of the target state data.
The terminal device according to claim 27, wherein the processor implements the following steps when executing the computer program:

Obtain the operation of the user clicking on an image, selecting an image or saving an image on the display interface, and determining the clicked image, the selected image or the saved image as the target image from the images captured by the drone according to the operation .
An unmanned aerial vehicle equipped with a photographing device, characterized in that the unmanned aerial vehicle comprises: a communication module, a memory and a processor;

the memory is used to store computer programs;

The processor is configured to execute the computer program and implement the following steps when executing the computer program:

The control communication module receives the request instruction sent by the terminal device, and the request instruction is used to instruct the drone to send the target state data when the shooting device of the drone shoots the target image, and the target state data includes the flight state data and the shooting status data;

The control communication module sends the target state data to the terminal device, so that the terminal device generates an identification code according to the target state data, and the target state data can be obtained based on the identification code.
The unmanned aerial vehicle according to claim 46, wherein, when the processor executes the computer program, the following steps are implemented:

Save the image's state data on a local Secure Digital card or in internal memory.
The unmanned aerial vehicle according to claim 47, wherein, when the processor executes the computer program, the following steps are implemented:

According to the received instruction to format the security digital card, output prompt information to prompt the user that the security digital card has stored image status data, please confirm whether to delete it.
The drone according to claim 46, wherein the flight status data includes drone waypoint information or drone route information.
The drone of claim 49, wherein the flight status data further comprises drone altitude information.
The drone according to claim 46, wherein the shooting status data includes at least one of image information obtained by a sensory camera, pan/tilt angle information, and shooting parameter information of a shooting device.
The drone according to claim 51, wherein the shooting parameter information of the shooting device includes at least one of aperture, exposure time, sensitivity, white balance, resolution and image scale.
An unmanned aerial vehicle system, characterized in that, the unmanned aerial vehicle system comprises the terminal device according to any one of claims 27-45 and the unmanned aerial vehicle according to any one of claims 46-52.
A computer-readable storage medium, characterized in that, the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the processor implements the process according to any one of claims 1-19 data processing method.
A computer-readable storage medium, characterized in that the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the processor implements the process according to any one of claims 20-26 data processing method.