WO2019000371A1

WO2019000371A1 - Image data processing method and image data processing system

Info

Publication number: WO2019000371A1
Application number: PCT/CN2017/091041
Authority: WO
Inventors: 缪宝杰; 艾楚越; 朱炼
Original assignee: 深圳市大疆创新科技有限公司
Priority date: 2017-06-30
Filing date: 2017-06-30
Publication date: 2019-01-03
Also published as: CN108513708A

Abstract

Provided are an image data processing method based on a movable platform, a movable platform, a terminal-based image data processing method, a terminal, and an image data processing method and an image data processing system. The image data processing method based on a movable platform comprises: (S702) detecting the state of a memory (126) of the movable platform so as to determine whether the memory (126) is in an abnormal state; (S704) sending an abnormal state indication signal when it is determined that the memory (126) is in an abnormal state; (S706) receiving a photography start instruction; (S708) acquiring image data; and (S710) transmitting the image data.

Description

Image data processing method and image data processing system

Copyright statement

The disclosure of this patent document contains material that is subject to copyright protection. This copyright is the property of the copyright holder. The copyright owner has no objection to the reproduction of the patent document or patent disclosure contained in the official records and files of the Patent and Trademark Office.

Technical field

The present disclosure relates to the field of data processing technologies, and more particularly to a mobile platform-based image data processing method and a mobile platform, a terminal-based image data processing method and terminal, and an image data processing method and an image data processing system.

Background technique

Aerial photography is a kind of photography that has emerged in recent years. Users can shoot various terrains, landscapes and people through various flight platforms such as helicopters, hot air balloons and drones. In addition to being a photographic art, it is also used in military, transportation, and disaster relief.

In order to store data such as images and videos obtained by aerial photography, current drones are usually provided with a memory card, such as an SD card. In the aerial photography process using a drone or the like, data such as images and videos obtained can be stored in the memory card in real time.

However, during the aerial photography, the memory card may be abnormal, such as the memory card is not inserted into the drone, the memory card is damaged, or the memory card is full. Under these circumstances, current drones are generally unable to perform aerial photography operations, thereby failing to achieve the intended shooting purpose, for example, missing the opportunity to photograph the current scenery or characters.

Summary of the invention

According to a first aspect of the present disclosure, a mobile data processing method based on a mobile platform is provided, the method may include: detecting a state of a memory of the movable platform to determine whether the memory is in an abnormal state; Determining that the memory is in an abnormal state, transmitting an abnormal state indication signal; receiving a shooting start command; acquiring image data; and transmitting the image data.

According to a second aspect of the present disclosure, a terminal-based image data processing method is provided, the method comprising: receiving an abnormal state indication signal, the abnormal state indication signal indicating that a memory of the movable platform is in an abnormal state; Activating a command; receiving image data; and storing the image data.

According to a third aspect of the present disclosure, there is provided a method of image data processing, the method comprising: detecting a state of a memory of a movable platform to determine whether the memory is in an abnormal state; and determining that the memory is in an abnormal state Sending an abnormal state indication signal to the terminal; the terminal sends a shooting start command; according to the shooting start command, the movable platform collects image data; the movable platform transmits the image data to the terminal; and And storing the image data in the terminal.

According to a fourth aspect of the present disclosure, a mobile platform is provided, comprising: a readable storage medium for storing executable instructions; and a processor for executing executable instructions stored in a readable storage medium, The executable instructions, when executed by the processor, cause the processor to perform the method according to the first aspect of the present disclosure.

According to a fifth aspect of the present disclosure, a terminal is provided, comprising: a readable storage medium for storing executable instructions; and a processor for executing executable instructions stored in a readable storage medium, the executable The instructions, when executed by the processor, cause the processor to perform the method according to the second aspect of the present disclosure.

According to a sixth aspect of the present disclosure, there is provided an image processing system comprising the movable platform according to the fourth aspect of the present disclosure and/or the terminal according to the fifth aspect of the present disclosure.

DRAWINGS

For a more complete understanding of the embodiments of the present disclosure and its advantages, reference will now be made to the following description

1 is a schematic structural diagram of an image data processing system according to an embodiment of the present disclosure;

Figure 2 is a block diagram showing the structure of the image data processing system shown in Figure 1;

3 is a flowchart of a method of image data processing according to an embodiment of the present disclosure;

4 is a schematic structural diagram of an image data processing system according to another embodiment of the present disclosure;

FIG. 5 is a schematic structural diagram of an image data processing system according to still another embodiment of the present disclosure; FIG.

Figure 6 is a block diagram showing the structure of the image data processing system shown in Figure 5;

7 is a flowchart of a mobile platform-based image data processing method according to an embodiment of the present disclosure;

FIG. 8 is a flowchart of a terminal-based image data processing method according to an embodiment of the present disclosure; and

9 is a block diagram showing an example hardware arrangement of a terminal for performing the mobile platform of the method illustrated in FIG. 7 or the method illustrated in FIG. 8 in accordance with an embodiment of the present disclosure.

In addition, the drawings are not necessarily to scale,

Detailed ways

Other aspects, advantages and salient features of the present disclosure will become apparent to those skilled in the <

In the present disclosure, the terms "comprising" and "including" and their derivatives are intended to be inclusive and not limiting.

In the present disclosure, the various embodiments described below for describing the principles of the present disclosure are merely illustrative and should not be construed as limiting the scope of the disclosure. The following description with reference to the drawings is intended to be a The description below includes numerous specific details to assist the understanding, but these details should be considered as merely exemplary. Accordingly, it will be appreciated by those skilled in the art that various changes and modifications may be made to the embodiments described herein without departing from the scope and spirit of the disclosure. In addition, descriptions of well-known functions and constructions are omitted for clarity and conciseness. Further, the same reference numerals are used throughout the drawings for the same or similar functions and operations. In addition, while the various features may be described in different embodiments, those skilled in the art will recognize that all or part of the features of the various embodiments can be combined to form without departing from the spirit and scope of the disclosure. New embodiment.

In the present disclosure, the expression "image data" may include data such as images and videos acquired or acquired during aerial photography. Accordingly, a data stream generated based on data such as images and videos may be referred to as an "image data stream." In the present disclosure, the processing of image data may include acquisition of image data, transmission of image data, storage of image data, and sharing of image data.

In the embodiment of the present disclosure, the image data processing system based on the drone mainly includes a sky end device and a ground end device, and image data collected by the sky end device is transmitted to the ground end device through a wireless link. For example, in some embodiments, the sky end device may include a drone and an image capture device (eg, a camera, a camera, etc.) carried on the drone, and the ground end device may include a remote controller and a mobile terminal, the image The image data collected by the acquisition device can be transmitted to the mobile terminal through a picture transmission system set in the drone and the remote controller. In some embodiments, the sky end device may include a drone and an image capture device carried on the drone The device can include a mobile terminal, and the image data collected by the image capturing device can be transmitted to the mobile terminal by wireless communication such as WIFI.

The techniques described in this disclosure may be applied to movable objects, such as movable objects in the air (eg, fixed-wing aircraft, such as airplanes, gliders, rotorcraft, such as helicopters, or other aircraft, such as a soft airship). , balloons), movable objects in the water (for example, submarines, boats, ships), movable objects on land (for example, motor vehicles, such as cars, motorcycles, buses, trucks, trucks; or poles, such as fish竿 or other types of movable supports or frames; and trains, subways, etc., movable objects in space (eg, satellites, space stations, spacecraft). The movable object can move freely in an environment (such as land, water, air, space), or along a preset path, track, or in an agreed manner. The movable object can move in one, two or three dimensions. A movable object can move automatically in response to a signal without manual movement. In some embodiments, the movable object may be a vehicle such as an aerial vehicle, a vehicle on land, a vehicle in water, a vehicle in space, or a combination thereof. The vehicle can move freely in one or more specified environments, or along a track or a fixed path. The vehicle can include a power system. The power system utilizes an electric motor, an engine, electronic components, magnetic mechanisms, gravity, wind, combustion, and/or other power mechanisms. In some embodiments, a manual power system, a human power system, or a power system by means of other organisms may also be applied to a movable object, such as a vehicle. In some embodiments, the moveable object may be a rotorcraft that may be driven or controlled by rotation of one or more blades. The movable object can be driven or repositioned by means of one or more rotating blades, propellers, wheels, magnets, tracks, or other mechanisms. In some embodiments, the movable object is an unmanned vehicle, such as an Unmanned Aerial Vehicle (UAV), which may also be referred to as a drone.

In the present disclosure, the expression "terminal" may include a remote control or other handheld or wearable device for manipulating the drone. For example, the terminal can include a smartphone, tablet, laptop, computer, watch, bracelet, glasses, helmet, or any suitable combination.

In the following, certain embodiments of the present disclosure will be described in terms of a mobile platform for a drone example.

Referring to FIG. 1, a schematic structural diagram of an image data processing system according to an embodiment of the present disclosure is shown. The image data processing system 10 can include a drone 12, a remote control 14 and a mobile terminal 16. In this embodiment, the drone 12 is a sky end device, and the remote controller 14 and the mobile terminal 16 are ground end devices.

As shown in FIG. 1, the image capture device 18 is mounted on the drone 12. In some embodiments of the present disclosure, the image capture device 18 may include a camera and/or a camera for capturing images and/or video. For example, in some embodiments, the camera and/or camera includes a high definition camera and/or camera that can capture 720p, 1080p or 4K video.

In some embodiments, the drone 12 is provided with a gimbal 122, as shown in FIG. The image capturing device 18 can be mounted on the pan/tilt head 122, and the drone 12 can adjust the shooting angle, orientation, and the like of the image capturing device 18 through the pan/tilt head 122. For example, pan/tilt head 122 may allow image capture device 18 to rotate about one, two, three or more axes. Alternatively or additionally, the pan/tilt head 122 may allow the image capture device 18 to move along one, two, three or more axes. The axes for the rotational or translational motion may or may not be orthogonal to one another. In some embodiments, the pan/tilt head 122 can control the pose of the camera and/or camera, including but not limited to pitch angles, roll angles, yaw angles, and the like.

In some embodiments, the image capture device 18 can be rigidly mounted or coupled to the drone 12 such that the image capture device 18 maintains a relatively stationary state relative to the drone 12. For example, the pan/tilt 122 connected to the drone 12 and the image capture device 18 may not allow the image capture device 18 to move relative to the drone 12. Alternatively, the image capture device 18 can be directly mounted on the drone 12 without the need for a pan/tilt.

In some embodiments, the remote control 14 can be a handheld remote control device disposed remotely from the drone 12 for operating the attitude of the drone 12 and its mounted image capture device 18, the gesture including However, it is not limited to the pitch angle, the roll angle, the yaw angle, and the like.

In some embodiments, the mobile terminal 16 can be a handheld or wearable device. For example, the mobile terminal 16 can include a smartphone, tablet, laptop, computer, watch, bracelet, glasses, helmet, or any suitable combination.

2 is a block diagram showing the structure of an image data processing system in accordance with one embodiment of the present disclosure. As shown in FIG. 2, the image data processing system includes a picture transmission system, and the picture transmission system may include an airborne image transmission module on the sky end and a ground image transmission module on the ground end for transmitting image data from the sky end to the ground end. . For example, the drone 12 may include an onboard image transmission module 124 for receiving images and/or video captured by the image capture device 18, that is, image data, and transmitting the image data to the remote controller 14 at the ground end. Correspondingly, the remote controller 14 can include a ground map transmission module 142 for receiving the image data sent by the onboard image transmission module 124.

As shown in FIG. 2, the image data processing system further includes a data transmission system, which may include a data transmission unit at the remote controller end and a data transmission unit at the terminal end for transmitting data such as image data from the remote controller end to Mobile terminal. For example, the remote controller 14 may include a first data transmission unit 144, and the mobile terminal 16 may include a second data transmission unit 164, the image data stream may be transmitted from the first data transmission unit 144 to the second data transmission. Unit 164. For example, the image data stream can be transmitted to the second data transmission unit 164 of the mobile terminal 16 via a wired communication link, such as an HDMI or USB data line. Alternatively, the image data stream may be transmitted to the second data transmission unit 164 of the mobile terminal 16 via a wireless communication link, such as a wireless communication link such as wifi, 3G, 4G.

Referring to FIG. 2, the drone 12 is further provided with a memory 126, such as an SD card. The image data collected by the image capture device 18 can be stored in the memory 126. For example, when the image capture device 18 includes a high definition camera and/or camera that can capture 1080p or 4K video, the raw image data of the 1080p or 4K format acquired therein can be stored in the memory 126.

In some embodiments, the image data processing system further includes an encoding and decoding system. For example, the drone 12 can include an encoding module 128 for compressing the raw image data acquired by the encoded image capturing device 18 to generate an image data stream. The remote control 14 and/or the mobile terminal may include a decoding module for decoding the image data stream. Taking a 1080p video source as an example, for a 1080P video source, 30 frames per second of video images, each frame of video image is encoded by H.264 compression to generate a video stream. The real-time video stream rate is usually 4 Mbps to 8 Mbps. The compressed video of each frame is sent by the airborne picture transmission module in a stream according to the fixed data packet size. The ground picture transmission module receives the data packet and sends the video code stream to the video code stream. The decoding module decodes the video code stream after receiving a complete frame of video data.

In some embodiments, the removable terminal 16 can include a cache 162 for receiving and storing image data streams from the drone 12.

In some embodiments, the mobile terminal 16 may further include a display unit 170 for displaying image data such as images and/or videos stored in the cache 162.

In some embodiments, an application (APP) 166 is installed on the mobile terminal 16, and by operating the application 166, various operations can be performed, for example, starting shooting, processing images stored in the cache 162. Data, sharing the processed image data to a third party platform. In some embodiments, the processing of image data stored in the cache 162 includes editing and/or editing images stored in the cache 162. And/or video, the sharing of the processed image data to a third party platform includes sharing the edited and/or clipped images and/or videos to Weibo, WeChat, and/or uploading to the cloud space.

In some embodiments, the removable terminal 16 can also include a storage unit 168. In some embodiments, by operating the application 166, the user can play image data such as images and/or videos stored in the cache 162 through the display unit 170, and then save the images and/or videos to be saved in the storage unit 168. in. In some embodiments, by operating the application 166, the user can save the processed image data in the storage unit 168.

In some embodiments, the mobile terminal 16 may further include an encoding unit 172 for encoding compression of the received image and/or video. In some embodiments, by operating the application 166, the user may store the encoded image and/or video encoded by the encoding unit 172 in the storage unit 168.

FIG. 3 illustrates a flow chart of a method of image data processing in accordance with one embodiment of the present disclosure. Referring to Figures 1-3, the image data processing method can include the following steps.

In step S301, the drone 12 detects the state of the memory 126.

In some embodiments, the drone 12 can detect the status of the memory 126 in real time to determine if the memory 126 is in an abnormal state. The abnormal state may include, but is not limited to, not detecting that the drone 12 is loaded with the memory 126 and not loading the memory 126, for example, the SD card is not inserted into the drone, or the memory 126 cannot Used or damaged, or the capacity of the memory 126 is full. For example, not detecting that the drone 12 is loaded with the memory 126 may include that the memory 126 is not loaded into the drone 12, and the memory 126 is not installed in the drone 12, For example, poor installation and so on.

In step S302, when the drone 12 detects that the memory 126 is in an abnormal state, the drone 12 transmits an abnormal state indication signal to the mobile terminal 16.

In step S304, the mobile terminal 16 issues a prompt message according to the abnormal state indication signal.

In some embodiments, the prompt information may include a status icon displayed on a user interface of the mobile terminal 16 to prompt the user that the memory 126 on the drone 12 is in the abnormal state, eg, an SD card. Not inserted, the SD card is damaged or the capacity of the SD card is full.

In step S306, the user starts shooting.

In some embodiments, the user can operate a shutter button on the remote control 14 or click a capture button or icon on the removable terminal 16 to initiate shooting. In some embodiments, the user can initiate the shooting with a particular gesture or voice command. It should be understood that embodiments of the present disclosure are not limited to the manner in which the shooting is initiated as described above, and the user may also initiate the shooting in any other suitable manner.

In step S308, the mobile terminal 16 issues a confirmation message to prompt the user to confirm the startup cache mode.

In some embodiments, a dialog box or window may be popped up on the user interface of the mobile terminal 16 for the user to confirm, thereby prompting the user to confirm the startup cache mode. In the cache mode, the image data collected by the image capture device 18 of the drone is transmitted and stored in the cache 162 of the mobile terminal.

In step S310, the mobile terminal 16 displays shooting parameter information.

In some embodiments, the shooting parameter information is displayed on a user interface of the mobile terminal 16, for example, the shooting parameter information may include the remaining number of sheets of the photographable photograph and/or the remaining length of the recordable video. In the embodiment of the present disclosure, the remaining number of sheets of the photographable photograph and the remaining length of the recordable video are calculated based on the remaining capacity of the cache 162 of the mobile terminal 16. In some embodiments, the shooting parameter information may further include at least one of sensitivity (commonly known as ISO value), aperture value, exposure compensation, shutter speed, focal length, auto focus mode, metering mode, and white balance. The autofocus mode includes at least one of a ranging autofocus method based on a distance measurement between a lens of the photographing device and a target to be photographed, and a focus detection autofocus method based on image sharpness. The metering method includes at least one of a spot metering method, a central portion metering method, a center-weighted average metering method, an average metering method, and a multi-zone metering method.

In step S312, the image capturing device collects image data.

In some embodiments, the image capture device 18 can include a camera and/or a camera to capture image data such as images and/or video. For example, the camera and/or camera can capture 720p, 1080p or 4K video.

In step S314, the drone transmits the image data to a remote controller, and the remote controller transmits the image data to a cache of the mobile terminal.

In some embodiments, the drone 12 transmits image data acquired by the image capture device 18 to the remote control 14 via the map transmission system 124, 142, and the remote control 14 passes through the

data transfer system

144, 164. The image data is transmitted to the cache 162 of the mobile terminal 16.

In some embodiments, the drone 12 can compress the raw image data acquired by the encoded image capture device 18 to generate an image data stream prior to transmitting the image data. After receiving the image data stream, the mobile terminal can decode the image data stream to play an image and/or video.

In some embodiments, the mobile terminal 16 can also activate an audio module of the terminal to collect ambient sounds; and store the ambient sounds in the cache 162. For example, the audio module can include a microphone and an audio encoder of the mobile terminal 16.

In step S316, the image data stored in the cache is processed.

The processing of the image data stored in the cache includes editing and/or editing images and/or video. In some embodiments, a user may edit and/or edit image data, such as images and/or video, stored in cache 162 through application 166 in mobile terminal 16.

In some embodiments, the processing of the image data stored in the cache further includes editing and/or editing the image data received from the drone 12 and the ambient sound collected by the audio module of the mobile terminal 16, for example, The image and/or video extracted from the image data received by the drone 12 and the ambient sound are mixed.

In step S318, the processed image data is shared, and/or the image data is stored in a storage unit of the mobile terminal.

In some embodiments, the user can directly share the edited image data to a third party platform, such as Weibo, WeChat, or other cloud space, by operating the application 166 in the mobile terminal 16. In some embodiments, the user can save the image data stored in the cache and/or the edited image data locally by operating the application 166 in the mobile terminal 16, for example, In the storage unit 168 of the mobile terminal 16.

In the embodiment of the present disclosure, in the case where an abnormal state occurs in a memory (for example, an SD card) on the drone, the buffer of the mobile terminal can be used for photographing, thereby enabling planned shooting purposes. Moreover, the user can directly edit the captured image and/or video using the application on the mobile terminal without jumping to the third party editing software. In addition, users can directly share captured images and/or videos for quick and easy shooting, editing and sharing.

In the above embodiment, the remote controller 14 and the mobile terminal 16 are separate independent components, however, according to another embodiment of the present disclosure, the remote controller 14 and the mobile terminal 16 may also be integrated. As shown in FIG. 4, the image data processing system 40 can include a drone 42 and a remote terminal 44. In this embodiment, the drone 42 is a sky end device and the remote terminal 44 is a ground end device.

In the embodiment of FIG. 4, the remote control terminal 44 has the functions of the remote controller 14 and the mobile terminal 16 in the above embodiment, and includes all components of the remote controller 14 and the mobile terminal 16, as described above. Descriptions of the remote controller 14 and the mobile terminal 16 will not be described herein.

Referring to FIG. 5, a schematic structural diagram of an image data processing system according to still another embodiment of the present disclosure is shown. The image data processing system 50 can include a drone 52 and a mobile terminal 56. In this embodiment, the drone 52 is a sky end device and the mobile terminal 56 is a terrestrial end device.

As shown in FIG. 5, the image capture device 58 is mounted on the drone 52. In some embodiments of the present disclosure, the image capture device 58 may include a camera and/or a camera for capturing images and/or video. For example, in some embodiments, the camera and/or camera includes a high definition camera and/or camera that can capture 720p, 1080p or 4K video.

In some embodiments, the drone 52 is provided with a pan/tilt 522, as shown in FIG. The image capturing device 58 can be mounted on the pan/tilt 522, and the drone 52 can adjust the shooting angle, orientation, and the like of the image capturing device 58 through the pan/tilt 522. For example, pan/tilt 522 may allow image capture device 58 to rotate about one, two, three or more axes. Alternatively or additionally, the pan/tilt 522 may allow the image capture device 58 to move along one, two, three or more axes. The axes for the rotational or translational motion may or may not be orthogonal to one another. In some embodiments, the pan/tilt 522 can control the pose of the camera and/or camera, including but not limited to pitch angles, roll angles, yaw angles, and the like.

In some embodiments, the image capture device 58 can be rigidly mounted or attached to the drone 52 such that the image capture device 58 maintains a relatively stationary state relative to the drone 52. For example, the pan/tilt 522 connected to the drone 52 and the image capture device 58 may not allow the image capture device 58 to move relative to the drone 52. Alternatively, the image capture device 58 can be directly mounted on the drone 52 without the need for a pan/tilt.

In some embodiments, the mobile terminal 56 can be a handheld or wearable device. For example, the mobile terminal 56 can include a smartphone, tablet, laptop, computer, watch, bracelet, glasses, helmet, or any suitable combination.

Fig. 6 is a block diagram showing the structure of the image data processing system of Fig. 5. As shown in FIG. 6, the image data processing system may include a data transmission system, and the data transmission system may include a data transmission unit at the sky end and a data transmission unit at the ground end for transmitting data such as image data from the sky end to the ground end. . For example, the drone 52 can include a first data transmission unit 524, which can include a second data transmission unit 564 that can be transmitted from the first data transmission unit 524 to the second data. Transmission unit 564. For example, the image data stream can be transmitted to the second data transmission unit 564 of the mobile terminal 56 via a wireless communication link, such as wifi.

In this embodiment, the drone communicates with the mobile terminal directly through a wireless communication link such as wifi, and the image data collected by the image capturing device on the drone can be directly transmitted to the mobile terminal through wifi without requiring a picture. Pass the system. It should be understood that the composition of the image data processing system and the image data processing method thereof according to the embodiment are similar to those of the embodiment described with reference to FIGS. 1-3, and details are not described herein again.

In the embodiment of the present disclosure, in the case where an abnormal state occurs in a memory (for example, an SD card) on the drone, the buffer of the mobile terminal can still be used for photographing, thereby enabling planned shooting purposes. Moreover, the user can directly edit the captured image and/or video using the application on the mobile terminal without jumping to the third party editing software. In addition, users can directly share captured images and/or videos for quick and easy shooting, editing and sharing.

Hereinafter, an image data processing method according to an embodiment of the present disclosure will be described from a sky end device and a ground end device, respectively, in conjunction with the accompanying drawings. In an embodiment of the present disclosure, the sky end device may include a mobile platform, such as a drone; the ground end device may include a terminal, such as a remote controller and a mobile terminal, or a remote control terminal, or only a mobile terminal .

As shown in FIG. 7, based on the movable platform, the image data processing method according to an embodiment of the present disclosure may include the following steps.

In step S702, a state of the memory of the movable platform is detected to determine whether the memory is in an abnormal state.

In some embodiments, the mobile platform can detect the status of its memory in real time to determine if the memory is in an abnormal state. The abnormal state may include, but is not limited to, not detecting that the movable platform is loaded with the memory, or that the memory is unusable or has been damaged, or that the capacity of the memory is full. For example, not detecting that the movable platform is loaded with the memory may include: the memory is not loaded in the movable platform, the memory is not installed in the movable platform, such as installation contact failure, etc. .

In step S704, when it is determined that the memory is in an abnormal state, an abnormal state indication signal is transmitted.

In step S706, a shooting start command is received.

In step S708, image data is acquired.

In some embodiments, the image capture device of the mobile platform can include a camera and/or a camera for acquiring image data such as images and/or video. For example, the camera and/or camera can capture 720p, 1080p or 4K video.

In step S710, the image data is transmitted.

In some embodiments, the mobile platform transmits image data collected by the image capture device to a ground end device through a map transmission system or wifi.

In some embodiments, before transmitting the image data, the movable platform may compress the original image data collected by the encoded image capturing device to generate an image data stream.

As shown in FIG. 8, based on the terminal, the image data processing method according to an embodiment of the present disclosure may include the following steps.

In step S802, an abnormal state indication signal is received, the abnormal state indication signal indicating that the memory of the movable platform is in an abnormal state.

In some embodiments, the abnormal state comprises: the removable platform is not loaded with the memory, the memory has been corrupted, and/or the capacity of the memory is full.

In step S804, a shooting start command is transmitted.

In some embodiments, the shooting can be initiated by operating a button, button or icon on the terminal. In some embodiments, the user can initiate the shooting with a particular gesture or voice command. It should be understood that embodiments of the present disclosure are not limited to the manner in which the shooting is initiated as described above, and the user may also initiate the shooting in any other suitable manner.

In step S806, image data is received.

In some embodiments, the terminal receives image data from the mobile platform via a wireless communication link such as a messaging system or wifi.

In step S808, the image data is stored in a cache of the terminal.

In some embodiments, the mobile platform generates a video data stream based on the original image data collected by the image capture device, the terminal receives the image data stream, and stores the image data stream in its cache. In this manner, photographing can still be achieved in the event of an abnormality in the memory (e.g., SD card) of the movable platform.

9 is a block diagram showing an example hardware arrangement 900 of a terminal for performing the mobile platform of the method illustrated in FIG. 7 or the method illustrated in FIG. 8 in accordance with an embodiment of the present disclosure. Hardware arrangement 900 can include a processor 906 (eg, a central processing unit (CPU), a digital signal processor (DSP), a microcontroller unit (MCU), etc.). Processor 906 can be a single processing unit or a plurality of processing units for performing different acts of the flows described herein. The arrangement 900 can also include an input unit 902 for receiving signals from other entities, and an output unit 904 for providing signals to other entities. Input unit 902 and output unit 904 may be arranged as a single entity or as separate entities.

Moreover, arrangement 900 can include at least one readable storage medium 908 in the form of a non-volatile or volatile memory, such as an electrically erasable programmable read only memory (EEPROM), flash memory, and/or a hard drive. The readable storage medium 908 includes computer program instructions 910 including code/computer readable instructions that, when executed by the processor 906 in the arrangement 900, cause the hardware arrangement 900 and/or include the hardware arrangement 900 The mobile platform can perform, for example, the flow described above in connection with FIG. 7 and any variations thereof.

In some embodiments, computer program instructions 910 can be configured as computer program instruction code having a computer program instruction module 910A-910E architecture, for example. Accordingly, in an example embodiment when the hardware arrangement 900 is used in, for example, a mobile platform, the code in the computer program instructions of the arrangement 900 includes a module 910A for detecting a state of the memory of the movable platform to determine the Whether the memory is in an abnormal state. The code in the computer program instructions further includes a module 910B for transmitting an abnormal state indication signal when the memory is determined to be in an abnormal state. The code in the computer program instructions further includes a module 910C for receiving a shooting start command. The code in the computer program instructions further includes: a module 910D for collecting image data. The code in the computer program instructions further includes a module 910E for transmitting the image data.

In some embodiments, computer program instructions 910 can be configured as computer program instruction code having a computer program instruction module 910A-910D architecture, for example. Accordingly, in an example embodiment when, for example, the hardware arrangement 900 is used in a terminal, the code in the computer program instructions of the arrangement 900 includes a module 910A for receiving an abnormal state indication signal indicating the movable platform The memory is in an abnormal state. The code in the computer program instructions further includes a module 910B for transmitting a shooting start command. The code in the computer program instructions further includes a module 910C for receiving image data. Generation in computer program instructions The code further includes: a module 910D, configured to store the image data in a cache of the terminal.

Although the code means in the embodiment disclosed above in connection with FIG. 9 is implemented as a computer program instruction module that, when executed in processor 906, causes hardware arrangement 900 to perform the actions described above in connection with FIG. 7 or 8, however, In an embodiment, at least one of the code means can be implemented at least in part as a hardware circuit.

The processor may be a single CPU (Central Processing Unit), but may also include two or more processing units. For example, a processor can include a general purpose microprocessor, an instruction set processor, and/or a related chipset and/or a special purpose microprocessor (eg, an application specific integrated circuit (ASIC)). The processor may also include an onboard memory for caching purposes. Computer program instructions may be hosted by a computer program instruction product coupled to the processor. The computer program instructions product can comprise a computer readable medium having stored thereon computer program instructions. For example, the computer program instructions product can be flash memory, random access memory (RAM), read only memory (ROM), EEPROM, and the computer program instructions modules described above can be distributed in the form of memory within the UE to alternative embodiments. Different computer program instruction products.

It should be noted that the functions described herein as being implemented by pure hardware, software and/or firmware may also be implemented by means of dedicated hardware, a combination of general hardware and software, and the like. For example, functions described as being implemented by dedicated hardware (eg, Field Programmable Gate Array (FPGA), Application Specific Integrated Circuit (ASIC), etc.) may be implemented by general purpose hardware (eg, central processing unit (CPU), digital signal processing (DSP) is implemented in a way that is combined with software and vice versa.

Although the present disclosure has been shown and described with respect to the specific exemplary embodiments of the present disclosure, it will be understood by those skilled in the art Various changes in form and detail are made to the present disclosure. Therefore, the scope of the present disclosure should not be limited to the above-described embodiments, but should be determined not only by the appended claims but also by the equivalents of the appended claims.

Claims

A method for processing image data based on a mobile platform, the method comprising:

Detecting a state of a memory of the movable platform to determine whether the memory is in an abnormal state;

Sending an abnormal state indication signal when determining that the memory is in an abnormal state;

Receiving a shooting start command;

Collecting image data; and

Transmitting the image data.
The method of claim 1 wherein said abnormal state comprises: detecting that said memory is loaded, said memory has been corrupted, and/or said memory is full.
The method according to claim 1 or 2, wherein transmitting the image data comprises: transmitting the image data through a map transmission system or wifi.
A terminal-based image data processing method, the method comprising:

Receiving an abnormal state indication signal indicating that a memory of the movable platform in communication with the terminal is in an abnormal state;

Send a shooting start command;

Receiving image data; and

The image data is stored.
The method of claim 4 wherein said abnormal state comprises: detecting that said memory is loaded, said memory has been corrupted, and/or said memory is full.
The method according to claim 4 or 5, wherein the method further comprises:

Sending a prompt message to indicate that the memory is in the abnormal state, and/or

A confirmation message is sent to prompt the user to confirm the boot cache mode.
The method according to claim 4 or 5, wherein the method further comprises: displaying shooting parameter information,

The shooting parameter information includes the remaining number of sheets of the photographable photograph and/or the remaining length of the recordable video, and the remaining number of sheets of the photographable photograph and the remaining duration of the recordable video are based on the remaining capacity of the cache of the terminal. Calculate.
The method according to claim 4 or 5, wherein the method further comprises: processing the stored image data,

The processing of the stored image data includes editing the stored image data by an application instruction installed in the terminal.
Method according to claim 4 or 5, characterized in that

The storing the image data includes: saving the image data in a cache,

The method further includes saving the image data stored in the cache to a storage unit of the terminal.
The method of claim 8 wherein:

The storing the image data includes: saving the image data in a cache,

The method further includes saving the processed image data stored in the cache to a storage unit of the terminal.
The method of claim 10, wherein the method further comprises:

The processed image data is shared to a third party platform.
The method according to claim 11, wherein the transmitting the shooting start command, processing the stored image data, and processing the processed image stored in the cache is performed by operating the same application on the terminal The data is saved to a storage unit of the terminal, and at least two of the processed image data are shared to a third party platform.
The method according to claim 4 or 5, wherein the method further comprises:

Activating an audio module of the terminal to collect an ambient sound; and

The ambient sound is stored.
The method according to claim 4 or 5, wherein the storing the image data comprises: storing the image data into a cache of a terminal.
An image data processing method, the method comprising:

Detecting a state of a memory of the movable platform to determine whether the memory is in an abnormal state;

When it is determined that the memory is in an abnormal state, sending an abnormal state indication signal to the terminal;

Sending, by the terminal, a shooting start instruction;

And the movable platform collects image data according to the shooting start command;

Transmitting the image data to the terminal; and

And storing the image data in the terminal.
The method of claim 15 wherein said abnormal state comprises: detecting that said memory is loaded, said memory has been corrupted, and/or said memory is full.
The method according to claim 15 or 16, wherein the method further comprises:

The terminal sends a prompt message to indicate that the memory is in the abnormal state.
The method according to claim 15 or 16, wherein the method further comprises: the terminal displaying shooting parameter information,

The shooting parameter information includes the remaining number of sheets of the photographable photograph and/or the remaining length of the recordable video, and the remaining number of sheets of the photographable photograph and the remaining duration of the recordable video are based on the remaining capacity of the cache of the terminal. Calculate.
The method according to claim 15 or 16, wherein the method further comprises: the terminal processing the stored image data,

The processing, by the terminal, the stored image data includes editing the stored image data by an application instruction installed in the terminal.
A method according to claim 15 or 16, wherein

The storing the image data in the terminal includes: saving the image data in a cache of the terminal,

The method further includes saving the image data stored in a cache of the terminal to a storage unit of the terminal.
The method of claim 19 wherein:

The storing the image data in the terminal includes: saving the image data in a cache of the terminal,

The method further includes saving the processed image data stored in a cache of the terminal to a storage unit of the terminal.
The method of claim 21, wherein the method further comprises:

The processed image data is shared to a third party platform.
The method according to claim 22, wherein the transmitting the shooting start command, processing the stored image data, and processing the processed image stored in the buffer of the terminal is performed by operating the same application on the terminal. The data is saved to a storage unit of the terminal, and at least two of the processed image data are shared to a third party platform.
The method according to claim 15 or 16, wherein the method further comprises:

The terminal sends a confirmation message to prompt the user to confirm the startup cache mode.
The method according to claim 15 or 16, wherein the method further comprises:

Activating an audio module of the terminal to collect an ambient sound; and

The ambient sound is stored in the terminal.
The method according to claim 15 or 16, wherein said storing said image data The terminal includes: storing the image data into a cache of the terminal.
A mobile platform that includes:

a readable storage medium for storing executable instructions;

a processor for executing executable instructions stored in a readable storage medium,

Characterized in that the executable instructions, when executed by the processor, cause the processor to:

Detecting a state of a memory of the movable platform to determine whether the memory is in an abnormal state;

Sending an abnormal state indication signal when determining that the memory is in an abnormal state;

Receiving a shooting start command;

Collecting image data; and

Transmitting the image data.
The mobile platform of claim 27, wherein the abnormal state comprises: not detecting that the memory is loaded, the memory has been corrupted, and/or the capacity of the memory is full.
The mobile platform according to claim 27 or 28, wherein the transmitting the image data comprises: transmitting the image data through a picture transmission system or wifi.
A terminal comprising:

a readable storage medium for storing executable instructions;

a processor for executing executable instructions stored in a readable storage medium,

Characterized in that the executable instructions, when executed by the processor, cause the processor to:

Receiving an abnormal state indication signal indicating that the memory of the movable platform is in an abnormal state;

Send a shooting start command;

Receiving image data; and

The image data is stored.
The terminal of claim 30, wherein the abnormal state comprises: not detecting that the memory is loaded, the memory has been corrupted, and/or the capacity of the memory is full.
A terminal according to claim 30 or 31, wherein said executable instructions, when executed by said processor, further cause said processor to:

Sending a prompt message to indicate that the memory is in the abnormal state, and/or

A confirmation message is sent to prompt the user to confirm the boot cache mode.
The terminal according to claim 30 or 31, wherein said executable instructions, when executed by said processor, further cause said processor to: display shooting parameter information,

The shooting parameter information includes the remaining number of sheets of the photographable photograph and/or the remaining length of the recordable video, and the remaining number of sheets of the photographable photograph and the remaining duration of the recordable video are based on the remaining capacity of the cache of the terminal. Calculate.
The terminal according to claim 30 or 31, wherein said executable instructions, when executed by said processor, further cause said processor to: process the stored image data,

The processing of the stored image data includes editing the stored image data by an application instruction installed in the terminal.
The terminal according to claim 30 or 31, wherein the storing the image data comprises: saving the image data in a cache of the terminal,

The executable instructions, when executed by the processor, further cause the processor to save the image data stored in a cache of the terminal to a storage unit of the terminal.
The method of claim 34, wherein

The storing the image data includes: saving the image data in a cache,

The method further includes saving the processed image data stored in the cache to a storage unit of the terminal.
The terminal of claim 36, wherein said executable instructions, when executed by said processor, further cause said processor to:

The processed image data is shared to a third party platform.
The terminal according to claim 37, wherein the operation of transmitting a shooting start command, processing the stored image data, and processing the processed image stored in the buffer is performed by operating the same application on the terminal The data is saved to a storage unit of the terminal, and at least two of the processed image data are shared to a third party platform.
A terminal according to claim 30 or 31, wherein said executable instructions, when executed by said processor, further cause said processor to:

Activating an audio module of the terminal to collect an ambient sound; and

The ambient sound is stored.
An image data processing system comprising:

Mobile platform; and

terminal,

The terminal is a terminal according to any one of claims 30-39, and/or the mobile platform is a mobile platform according to any one of claims 27-29.