WO2022021438A1

WO2022021438A1 - Image processing method, image control method, and related device

Info

Publication number: WO2022021438A1
Application number: PCT/CN2020/106441
Authority: WO
Inventors: 翁松伟; 王笑宇; 尹桂祥
Original assignee: 深圳市大疆创新科技有限公司
Priority date: 2020-07-31
Filing date: 2020-07-31
Publication date: 2022-02-03
Also published as: CN113841385A

Abstract

An image processing method, an image control method, and related devices. The image processing method comprises: acquiring an image frame that is photographed by a photographic apparatus according to a first frame rate (S201); when it is recognized that a preset condition is satisfied, performing speed change processing on the image frame that is photographed according to the first frame rate, wherein the preset condition comprises one or more of the following: a scenario photographed by the photographic apparatus conforming to a preset scenario, a moving posture of a movable platform that carries the photographic apparatus conforming to a preset posture, the current photographing time of the photographic apparatus reaching a preset switching time, and a trigger instruction sent by a control terminal of the movable platform being received (S202); and storing the image frame obtained after the speed change processing (S203). By means of performing intelligent speed regulation on an image photographed by a photographic apparatus in the movement process of a movable platform, on the basis of ensuring the effect of the image, the image processing efficiency is improved, and intelligent and automatic requirements of a user for performing speed regulation on an image in a photographing process are satisfied.

Description

An image processing method, image control method and related equipment

technical field

The present invention relates to the technical field of image processing, and in particular, to an image processing method, an image control method and related equipment.

Background technique

As a small, racing drone, the traversing drone has advantages that other types of drones do not have. It can shoot narrow and hidden scenes in the case of high-speed movement. During the flight of the crossover aircraft, due to its high-speed characteristics, in some special scenes, such as fast-motion and slow-motion shooting, the effect will be unsatisfactory. If you want to get fast motion or slow motion, you can only manually adjust the fast and slow motion of these special scenes through post-editing software after the shooting. However, by manually adjusting these special shooting scenes by using post-editing software to obtain fast or slow motion, the efficiency is low, and the picture effect cannot be guaranteed. Therefore, it is very important to obtain fast or slow motion in these special scenes more efficiently.

SUMMARY OF THE INVENTION

Embodiments of the present invention provide an image processing method, an image control method, and related equipment. By intelligently adjusting the speed of an image captured by a photographing device during the movement of a movable platform, the image quality is improved on the basis of ensuring the image effect. The processing efficiency satisfies the user's need for intelligent and automatic speed regulation of the images during the shooting process.

In a first aspect, an embodiment of the present invention provides an image processing method, including:

acquiring image frames shot by the photographing device according to the first frame rate;

When it is recognized that a preset condition is met, the speed change processing is performed on the image frame shot at the first frame rate, and the preset condition includes that the scene shot by the photographing device conforms to the preset scene, and the camera equipped with the photographing device can be One or more of the movement posture of the mobile platform conforms to the preset posture, the current photographing time of the photographing device reaches the preset switching time, and the trigger instruction sent by the control terminal of the mobile platform is received;

Image frames obtained after the variable speed processing are stored.

In a second aspect, an embodiment of the present invention provides an image control method, including:

Generate trigger instructions;

Send the trigger instruction to the movable platform equipped with the photographing device, and the photographing device shoots according to the first frame rate, and the trigger instruction is used to instruct the movable platform to perform the shooting of the photographing device according to the first frame rate. Image frames undergo variable speed processing.

In a third aspect, an embodiment of the present invention provides an image processing device, including a memory, a processor, and a communication interface;

the memory for storing program instructions;

The processor executes the program instructions stored in the memory, and when the program instructions are executed, the processor is configured to perform the following steps:

Image frames obtained after the variable speed processing are stored.

In a fourth aspect, an embodiment of the present invention provides a control terminal, including a memory, a processor, and a communication interface;

the memory for storing program instructions;

Generate trigger instructions;

The trigger instruction is sent to the movable platform equipped with the photographing device through the communication interface, the photographing device shoots according to the first frame rate, and the trigger instruction is used to instruct the movable platform to shoot the photographing device according to the first frame rate. The captured image frame is processed at variable speed.

In a fifth aspect, an embodiment of the present invention provides a movable platform, including:

body;

a power system configured on the fuselage for providing the movable platform with moving power;

Image processing equipment mounted on a movable platform;

processor for:

Image frames obtained after the variable speed processing are stored.

In a sixth aspect, an embodiment of the present invention provides a computer-readable storage medium, where the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, implements the image processing method described in the first aspect above or The image control method described in the second aspect.

In the embodiment of the present invention, by acquiring the image frames shot by the photographing device according to the first frame rate, when it is recognized that the preset conditions are met, the image frames shot according to the first frame rate are subjected to variable speed processing, and the images obtained after the variable speed processing are stored. frame, wherein the preset conditions include that the scene captured by the photographing device conforms to the preset scene, the moving posture of the movable platform equipped with the photographing device conforms to the preset posture, the current photographing time of the photographing device reaches the preset switching time, and the mobile platform is received. One or more of the trigger instructions sent by the control terminal. In this way, the intelligent speed regulation of the images captured by the photographing device during the movement of the movable platform can be realized, the accuracy of the intelligent speed regulation of the images can be improved, the effect of the images can be guaranteed, and the user's need for the capturing process can be satisfied. Intelligent and automated requirements for speed regulation of images in

Description of drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the accompanying drawings required in the embodiments will be briefly introduced below. Obviously, the drawings in the following description are only some of the present invention. In the embodiments, for those of ordinary skill in the art, other drawings can also be obtained according to these drawings without any creative effort.

1 is a schematic structural diagram of an image processing system provided by an embodiment of the present invention;

2 is a schematic flowchart of an image processing method provided by an embodiment of the present invention;

3 is a schematic diagram of a virtual pointing prompt for gap crossing provided by an embodiment of the present invention;

4 is a schematic flowchart of an image control method provided by an embodiment of the present invention;

5 is a schematic structural diagram of an image processing device provided by an embodiment of the present invention;

FIG. 6 is a schematic structural diagram of a control terminal provided by an embodiment of the present invention.

detailed description

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, but not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

Some embodiments of the present invention will be described in detail below with reference to the accompanying drawings. The embodiments described below and features in the embodiments may be combined with each other without conflict.

At present, most of the shooting devices mounted on the movable platform do not support the speed regulation of the captured image frame during the shooting process in the neighborhood of the traversing aircraft. Generally, a fixed frame rate is set in advance for shooting. If you want to adjust the speed of the captured image frame, you need to adjust the image frame through editing software after the shooting. to guarantee.

In view of the above problems, the embodiment of the present invention obtains the image frames captured by the camera mounted on the movable platform according to the first frame rate, and divides the obtained image frames of the first frame rate into two data processing channels, wherein, One channel of data is to transmit the acquired image frame of the first frame rate to the control terminal in real time, so that the control terminal transmits the image frame of the first frame rate to the image display device for display; In the process of capturing the image frames at the first frame rate, when it is recognized that the preset conditions are met, the intelligent variable speed processing is performed on the image frames of the first frame rate to perform frame rate conversion, and the image frames of the first frame rate are converted to fast-play or slow-play. Image frames to improve the efficiency of image processing while ensuring the image effect. By storing the image frames after variable speed processing, it is convenient for users to directly obtain fast-play or slow-play videos without post-processing, which is simple and fast , to improve the user experience.

In some prior art, it is mentioned that in the process of shooting images with a mobile phone, the user can trigger the adjustment of the shooting frame rate, which is different from this application. The method proposed in this application does not adjust the shooting frame rate. The image frame is captured at the first frame rate, and the image frame captured at the first frame rate is divided into two data for processing without changing the shooting frame rate. One data is the image obtained by shooting the first frame rate The frame is sent to the control terminal, so that the control terminal transmits the image frame of the first frame rate to the image display device for display without changing the shooting frame rate. The other way of data is to perform intelligent speed change processing on the image frames of the first frame rate obtained when it is recognized that the preset conditions are met, and store the image frames after the speed change processing in the storage device of the movable platform for the convenience of users. When you want to watch fast-playing or slow-playing videos, you can directly download and view them from the storage device of the removable platform, without post-processing, which is simple and fast, and improves the user experience.

The image processing method provided by the embodiments of the present invention may be performed by an image processing system. In some embodiments, the image processing system includes a movable platform and a control terminal. In some embodiments, the movable platform includes, but is not limited to, unmanned aerial vehicles, unmanned vehicles, robots, and other movable devices; in some embodiments, the UAVs include traversing aircraft. In some embodiments, the control terminal includes, but is not limited to, one or more of a remote control device, a smart phone, a tablet computer, a laptop computer, and a wearable device. In some embodiments, a communication connection is established between the movable platform and the control terminal. In some embodiments, a photographing device (eg, a camera) is mounted on the movable platform. In some embodiments, the image processing method provided by the embodiments of the present invention may be applied to image shooting or video shooting when the movable platform passes through a preset scene. In some embodiments, the preset scene includes but is not limited to the existence of Scenarios such as obstacles or gaps.

The image processing system provided by the embodiment of the present invention is schematically described below with reference to FIG. 1 .

Please refer to FIG. 1. FIG. 1 is a schematic structural diagram of an image processing system provided by an embodiment of the present invention. The image processing system includes: a movable platform 11 and a control terminal 12 . In some embodiments, a communication connection may be established between the movable platform 11 and the control terminal 12 through a wireless communication connection, wherein, in some scenarios, the movable platform 11 and the control terminal 12 may also be connected through The wired communication connection method establishes the communication connection. In some embodiments, a photographing device 111 is mounted on the movable platform 11 , and in some embodiments, the photographing device 111 establishes a wired or wireless communication connection with the movable platform 11 . In some embodiments, the control terminal 12 may include one or more of a remote control device, a smartphone, a tablet computer, a laptop computer, a wearable device, and the like. In some embodiments, the movable platform 11 includes, but is not limited to, one or more movable devices such as unmanned aerial vehicles, crossing aircraft, and unmanned vehicles.

In this embodiment of the present invention, the movable platform 11 is used to acquire the image frames captured by the photographing device 111 according to the first frame rate, and when it is recognized that the preset conditions are met, the variable speed processing is performed on the image frames captured according to the first frame rate, and The image frames obtained after the variable speed processing are stored, so as to realize the intelligent variable speed processing of the images captured by the photographing device during the movement of the movable platform 11, improve the accuracy of the intelligent speed regulation of the images, ensure the effect of the images, and satisfy the It meets the intelligent and automatic needs of users to adjust the speed of the images during the shooting process.

The image processing method and the image control method proposed by the embodiments of the present invention will be described below with reference to FIG. 2 to FIG. 4 .

Please refer to FIG. 2. FIG. 2 is a schematic flowchart of an image processing method provided by an embodiment of the present invention. The method can be executed by an image processing device, wherein the image processing device is set in a movable platform, and the The specific explanation of the movable platform is as described above. Specifically, the method in the embodiment of the present invention includes the following steps.

S201: Acquire an image frame captured by a capturing device according to a first frame rate.

In this embodiment of the present invention, the image processing device may acquire image frames captured by the capturing device according to the first frame rate.

In one embodiment, when acquiring the image frames shot by the shooting device according to the first frame rate, the image processing device may acquire a video shooting instruction sent by the control terminal, where the video shooting instruction carries the first frame rate, and In response to the video shooting instruction, the shooting device is controlled to shoot the image frame according to the first frame rate during the movement of the movable platform.

In one embodiment, the image processing device may send the image frames of the first frame rate to the control terminal in real time, so that the control terminal may send the image frames obtained in real time and captured by the photographing device at the first frame rate to the image display The device displays the video generated by the image frames captured at the first frame rate in real time. In this way, the image frame of the first frame rate can be displayed by image transmission.

S202: When it is identified that a preset condition is met, perform variable speed processing on the image frame shot at the first frame rate, where the preset condition includes that the scene shot by the photographing device conforms to the preset scene, and the photographing device is mounted. The moving posture of the movable platform conforms to the preset posture, the current photographing time of the photographing device reaches the preset switching time, and one or more of the trigger instructions sent by the control terminal of the mobile platform are received.

In the embodiment of the present invention, when it is identified that a preset condition is met, the image processing device may perform variable speed processing on the image frame captured at the first frame rate, and the preset condition includes that the scene captured by the photographing device meets the The preset scene, the moving posture of the movable platform carrying the photographing device conforms to the preset posture, the current photographing time of the photographing device reaches the preset switching time, and the trigger instruction sent by the control terminal of the mobile platform is received. one or more of.

In some embodiments, the preset scene, the preset posture, and the preset switching time may be set by default in the movable platform. In some embodiments, the preset scene, the preset posture, and the preset switching time may be set by the user through the control terminal and sent to the movable platform.

In one embodiment, when the movable platform obtains one or more of the preset scene, the preset posture, and the preset switching time sent by the control terminal, it can identify whether the scene captured by the photographing device is the same as the obtained scene. One or more of the preset scene, the preset posture, and the preset switching time sent by the control terminal match, and if they match, it is determined that the scene shot by the shooting device satisfies the preset condition. In this way, the user can set preset conditions such as the preset scene, the preset posture, and the preset switching time through the control terminal in real time according to the user's needs.

In some embodiments, the preset scene includes obstacles or gaps. In some embodiments, the obstacles may include but are not limited to walls, trees, wooden posts, etc. The gaps may include but are not limited to Caves, windows, tunnels, etc. In some embodiments, the trigger instruction is used to instruct to perform variable speed processing on the image frames captured at the first frame rate. In some embodiments, the movement attitude of the movable platform may be determined according to the attitude angle of the movable platform. In an example, taking the UAV as an example, the flight attitude angle of the UAV includes the pitch angle, Roll angle, offset angle.

In some embodiments, the preset switching time includes a start time node and an end time node, which are used to indicate the time period of the start time node and the end time node. Image frames undergo variable speed processing. In some embodiments, the start time node and the end time node may be time nodes preset by the user that need to perform variable speed processing on the image frames captured at the first frame rate.

In one embodiment, when it is recognized that the scene captured by the photographing device conforms to the preset scene, the image processing device can automatically enable the time corresponding to the recognition of the preset scene as the start time node, and when the preset scene is recognized At the end, the corresponding time is determined as the end time node. In this way, when the preset scene is recognized, the start time node and the end time node that need to perform variable speed processing on the image frames captured at the first frame rate can be automatically determined.

In one embodiment, the image processing device may acquire the time node selection operation input by the user at any time during the process of capturing the image frame by the capturing device according to the first frame rate, and determine the start time node and the end time node according to the time node selection operation . In some embodiments, the start time node may be determined according to the time node selection operation obtained for the first time, and the end time node may be determined according to the time node selection operation obtained for the second time. In other embodiments, the start time node and the end time node may also be determined by pressing a button or other methods, which are not specifically limited here. In this way, during the shooting process of the shooting device, the user can independently select the start time node and the end time node for performing variable speed processing on the image frames captured at the first frame rate according to the user's needs, so as to improve the user experience.

In one embodiment, when performing variable speed processing on the image frames captured at the first frame rate, the image processing device may perform fast playback processing on the image frames captured at the first frame rate; Slow-motion processing is performed on the image frames captured at the first frame rate.

In one embodiment, when performing fast playback processing on the image frames captured at the first frame rate, the image processing device may acquire the N frames of image frames captured at the first frame rate and the N frames captured at the first frame rate and the image frames captured at the first frame rate. The first time for capturing N image frames at a rate, N is an integer greater than 0, and controlling the N image frames to be played within a second time, wherein the second time is less than the first time. In some embodiments, the image processing device may determine the fast playback multiple for performing fast playback processing on the N image frames according to the frame number N of the image frames, the first time and the second time. In some embodiments, the second time may be any preset time shorter than the first time. In other embodiments, the playback time of N frames of image frames captured at the first frame rate may be adjusted by a preset fast zoom factor or by the user sending the fast zoom factor to the movable platform by controlling the terminal.

For example, assuming that the first frame rate is 60 frames/second, if 60 image frames captured at the first frame rate of 60 frames/second are obtained, it can be determined that the first time for capturing 60 image frames is 1 second. When fast-play processing is performed on 60 image frames shot at 60 frames/second, the fast-play processing can be realized by shortening the playback time. Assuming that the playback time is shortened to the second time of 0.5 seconds, the 60 images can be played within 0.5 seconds. It can be determined that the speed of playing the 60 image frames in 0.5 seconds is 2 times faster than that of playing 60 image frames in 1 second, so as to realize the fast playback processing of the image frames.

It can be seen that, by shortening the time for playing image frames of the same number of frames, the fast playback processing of the image frames can be implemented in a manner of accelerating the frame rate.

In one embodiment, when performing fast playback processing on the image frames captured at the first frame rate, the image processing device may further extract K frames of image frames from the N frames of image frames, and control the image frames to be displayed at the first frame rate. The K frames of image frames are played within two time periods.

In some embodiments, when extracting K image frames from the N image frames, the image processing device may extract K image frames at a specified position from the N image frames. In some embodiments, the specified position may be pre-set according to N frames of image frames. In one example, the specified position may be an image frame corresponding to the middle position of the N frames of image frames. In other examples, the frames may also be extracted at fixed intervals, for example, one frame is extracted every other frame.

For example, assuming that the first frame rate is 60 frames/second, if 60 image frames captured at 60 frames/second are obtained, it can be determined that the first time for capturing 60 frames of image frames is 1 second. When the 60-frame image frames shot in seconds are processed for fast playback, the first time of 1 second can be shortened to the second time of 0.5 seconds, and the 60-frame image frames can be extracted one frame at an interval to retain 30 image frames, and the rest 30 frames are discarded, and the 30 image frames extracted from the 60 image frames are played within 0.5 seconds, so that the fast playback processing of the image frames can be further realized.

It can be seen that by extracting part of the image frames from the image frames and playing them in the shortened playing time while shortening the playing time, fast playback processing of the image frames can be realized while keeping the frame rate unchanged.

In one embodiment, when performing slow-play processing on the image frames captured at the first frame rate, the image processing device may acquire the N frames of image frames captured at the first frame rate and the N frames captured at the first frame rate and the image frames captured at the first frame rate. The first time at which N frames of image frames are captured at a rate, N is an integer greater than 0, and the N frames of image frames are controlled to be played within a third time, wherein the third time is greater than the first time. In some embodiments, the image processing device may determine the slow-play multiple for performing the slow-play processing on the N image frames according to the frame number N of the image frames, the first time, and the third time. In some embodiments, the third time may be any preset time greater than the first time. In other embodiments, the playback time of N frames of image frames captured at the first frame rate may be adjusted by a preset slow playback multiple or the user sending the slow playback multiple to the movable platform by controlling the terminal.

For example, assuming that the first frame rate is 60 frames/second, if 60 image frames captured at 60 frames/second are obtained, it can be determined that the first time for capturing 60 frames of image frames is 1 second. When the 60-frame image frames shot in seconds are processed in slow motion, the first time of the playback time can be extended from 1 second to the third time of 2 seconds, and the 60-frame image frame can be played within 2 seconds, so that it can be determined that the playback time will be within 2 seconds. The 60-frame image frame is 1 times slower than the playback speed of 60-frame image frame in 1 second, which realizes the slow-play processing of the image frame.

It can be seen that, by extending the playing time to play the same number of image frames, the slow-play processing of the image frames can be implemented in a manner of reducing the frame rate.

In one embodiment, when the image processing device performs slow-play processing on the image frames captured at the first frame rate, it may further determine M frames of prediction frames according to the N frames of image frames, and control the third The N frames of image frames and the M frames of predicted frames are played in time. In some embodiments, the number of the M-frame predicted frames may be determined according to the first frame rate, and the M-frame predicted frames are image frames obtained by interpolation using N image frames. In some embodiments, the method for calculating the interpolation value may be to obtain a new image frame interpolated between the two adjacent frames by weighting the pixels corresponding to the pixel points or pixel regions of the two adjacent image frames.

For example, assuming that the first frame rate is 60 frames/second, if 60 image frames captured at 60 frames/second are obtained, it can be determined that the first time for capturing 60 frames of image frames is 1 second. When the 60-frame image frames shot in seconds are processed in slow motion, the first time of the playback time can be extended from 1 second to the third time of 2 seconds, and a similar 60-frame predicted frame can be interpolated according to the 60-frame image frame. The 60 frames of image frames and the 60 frames of predicted frames are played in the video frame, so that the slow-play processing of the image frames can be realized.

It can be seen that by extending the playing time and increasing the number of image frames to play the image frames after the number of image frames is increased, the slow playback process of the image frames can be realized while keeping the frame rate unchanged.

In one embodiment, when detecting that the scene shot by the photographing device satisfies the first preset condition, the image processing device may determine to perform slow-motion processing on the image frame shot at the first frame rate, wherein the The scene captured by the photographing device satisfies the first preset conditions, including but not limited to the speed and attitude of the movable platform. During one or more operations such as the moment of maneuvering, it may be determined that the first preset condition is satisfied, and slow playback processing is performed on the image frames at the first frame rate.

In one embodiment, when detecting that the scene shot by the photographing device satisfies the second preset condition, the image processing device may determine to perform fast playback processing on the image frame shot at the first frame rate, wherein the The scene photographed by the photographing device satisfies the second preset condition, including but not limited to a flat scene, a large aerial scene, etc. For example, when it is recognized that the scene photographed by the photographing device is a flat lawn, it can be determined that the second preset condition is met, and the first The image frame of the frame rate is processed by fast playback.

In one embodiment, the image processing device may determine to perform slow-play processing on the image frames captured at the first frame rate when detecting that the scene captured by the capturing device is a gap or an obstacle. Specifically, the image processing device may pre-fix the variable speed processing corresponding to the gap as the slow playback process. When the image processing device detects that the scene captured by the photographing device is a gap, it can perform the slow playback processing corresponding to the predetermined gap. Slow-motion processing is performed on the image frames captured at the first frame rate.

In one embodiment, the image processing device may identify whether the scene captured by the photographing device is a gap through one or more of a visual sensor, an infrared device, a zoom device, and a preset terrain model. In some embodiments, the implementation process of the slow play process is as described above, and details are not repeated here. In some embodiments, the user may create a terrain model in a preset scene in advance, so that the movable platform can recognize the preset scene based on the preset terrain model.

In one embodiment, the image processing device determines to perform fast playback processing on the image frames captured at the first frame rate when detecting that the scene captured by the capturing device does not include a gap or an obstacle. For example, when it is detected that the scene photographed by the photographing device is a lawn that does not include gaps or obstacles, it may be determined to perform fast playback processing on the image frames photographed at the first frame rate. In some embodiments, the implementation process of the fast playback process is as described above, which will not be repeated here.

In one embodiment, the image processing device may also acquire a movement control command sent by the control terminal during the movement of the movable platform, where the movement control command carries the movement parameters corresponding to the user's movement parameter setting operation, and controls the movement control command. The movable platform moves according to the movement parameter setting operation corresponding to the movement parameter.

In some embodiments, the movement parameters include any one or more of a movement speed of the movable platform, an acceleration of the movable platform, and an attitude of the movable platform. In some embodiments, the movement control instruction is determined according to the user's movement parameter setting operation on the control terminal.

In one embodiment, the image processing device may identify the scene shot by the photographing device, and when identifying that the scene photographed by the photographing device conforms to the preset scene, adjust the movable platform according to the preset scene. moving parameters, and controlling the movable platform to move according to the adjusted moving parameters. In some embodiments, the preset scene includes obstacles or voids.

In one embodiment, when it is recognized that the scene captured by the photographing device includes an obstacle or a gap, if the moving speed of the movable platform is too fast, it may collide with the obstacle or the gap. The parameters are adjusted to help prevent the movable platform from colliding with obstacles or gaps, and improve the safety of the movable platform when traversing scenes including obstacles or gaps.

In one embodiment, when adjusting the movement parameters of the movable platform if the movable platform according to the preset scene, the image processing device may determine the corresponding relationship between the preset scene and the movement parameter according to the corresponding relationship between the preset scene and the movement parameter. movement parameters corresponding to the scene, and control the movable platform to move according to the movement parameters corresponding to the preset scene.

In one embodiment, the preset scene includes a gap, and when the image processing device adjusts the movement parameters of the movable platform according to the preset scene, if it recognizes that the scene captured by the photographing device includes a gap, it can obtain the the size and/or depth of the gap in the preset scene, and adjust the movement parameters of the movable platform according to the size and/or depth of the gap, and control the movable platform to move according to the adjusted movement parameters , so that the movable platform traverses the gap.

For example, assuming that the image processing device obtains a void with a size of a circle with a radius of x when recognizing a scene including a void, and the depth of the void is y, the speed can be slowed down according to the size x and depth y of the circular void. The moving speed of the movable platform and the acceleration of the movable platform are adjusted, and the posture of the movable platform is adjusted so that the movable platform can safely and smoothly pass through the circular gap.

It can be seen that this method of adjusting the movement parameters of the movable platform according to the preset scene helps to ensure that the movable platform safely traverses the preset scene, and when passing through the preset scene, the shooting device captures a stable image. image frame.

In one embodiment, when acquiring the size and/or depth of the void in the preset scene, the image processing device may acquire consecutive n frames of images of the void captured by the photographing device, where n is an integer greater than 1, according to The size of the void is determined by the consecutive n frames of images; and/or, the depth of the void is acquired according to a vision sensor on the movable platform.

For example, the image processing device may acquire 10 consecutive frames of images of the void taken by the camera, determine the size of the void according to the 10 consecutive frames of images, and acquire the depth of the void according to the visual sensor on the movable platform.

In one embodiment, the image processing device may determine the depth of the void according to the echoes of the power system of the movable platform acquired by the echolocator. Taking the drone as an example, the image processing device can judge the depth of the void according to the echo of the drone's slurries.

In one embodiment, the image processing device may generate a void crossing virtual pointing prompt according to the size and/or depth of the void, and the void crossing virtual pointing prompt is used to indicate a path for the movable platform to pass through the void, and displaying the virtual pointing prompt output through the gap on the display device of the movable platform.

In some embodiments, the display device may be independent of the movable platform, and be disposed on the ground end for displaying the virtual pointing prompt for crossing the gap for the user to view. In some embodiments, the void-traversing virtual pointing cues may include, but are not limited to, one or more of text, lines, arrows, images, and the like.

Taking the crossing machine as an example, when the movable platform is the crossing machine, the display device is the glasses on the ground side configured by the crossing machine, the user can wear the glasses, and the image processing device can output the virtual pointing prompt output of the crossing machine and display it on the crossing machine. On the glasses for the user to view, through the gap to cross the virtual pointing prompt to assist the flight of the traversing aircraft, which helps to improve the safety of the traversing aircraft traversing the gap.

Specifically, FIG. 3 can be used as an example for description. FIG. 3 is a schematic diagram of a virtual pointing prompt for gap crossing provided by an embodiment of the present invention. As shown in FIG. According to the size and depth of the gap 31, a virtual pointing prompt 32 for passing through the gap can be generated, wherein the virtual pointing prompt 32 for passing through the gap is used to indicate the path of the movable platform passing through the gap 31, and the virtual pointing prompt 32 for passing through the gap is output and displayed. On a display device for viewing by the user and assisting the user in controlling the safe passage of the movable platform through the gap 31 .

It can be seen that when passing through a preset scene including a gap, the virtual pointing prompt for gap crossing is sent to the display device on the ground side for display for viewing by the user, which helps the user to determine the movable platform according to the virtual pointing prompt for crossing the gap. to assist the user to control the movable platform through the control terminal to safely traverse the gap.

In one embodiment, when adjusting the movement parameters of the movable platform according to the preset scene, the image processing device may perform zoom processing on the photographing device to determine the relationship between the movable platform and the preset scene. distance, and adjust the movement parameters of the movable platform according to the distance.

In one embodiment, if the image processing device determines that the distance between the movable platform and the preset scene is greater than the preset safety distance threshold, it can keep the movement parameters of the movable platform unchanged before the distance reaches the preset safety distance threshold, When it is determined that the distance is less than or equal to the preset safety distance threshold, the movement parameters of the movable platform are adjusted according to the change of the distance, so that the movable platform can safely traverse the preset scene.

Taking the drone as an example, assuming that the preset safe distance threshold is 10m, if it is determined that the current distance between the drone and the gap is 15m, you can continue to maintain the flight parameters of the drone to control the flight of the drone. When flying to a position with a distance of 10m from the gap, start to adjust the flight parameters of the drone according to the change of the distance between the drone and the gap, such as reducing the flying speed of the drone, adjusting the flying attitude of the drone, etc. The drone safely traverses the gap.

In one embodiment, if the image processing device determines that the distance between the movable platform and the preset scene is smaller than the preset hovering distance threshold, the image processing device can control the movable platform to brake in an emergency to force the hovering, and then adjust after hovering. The movement parameters of the movable platform control the movable platform to pass through the preset scene, so as to avoid the collision between the movable platform and the obstacles or gaps in the preset scene.

Taking the UAV as an example, assuming that the preset hovering distance threshold is 5m, if it is determined that the distance between the UAV and the preset scene is 4m, the UAV can be controlled to make an emergency brake to force the hovering and wait for it. After hovering, the drone can be restarted, and the flight parameters of the drone can be adjusted to control the drone to safely pass through the gap in the preset scene.

In one embodiment, the preset scene includes obstacles, and when adjusting the movement parameters of the movable platform according to the preset scene, the image processing device can acquire the size of the obstacles in the preset scene, and The moving parameter of the movable platform is adjusted according to the size of the obstacle, and the movable platform is controlled to move according to the adjusted moving parameter, so that the movable platform can bypass the obstacle. In some embodiments, the size of the obstacle includes, but is not limited to, length, height, radius, area, and the like.

Taking the UAV as an example, assuming that the obstacle is a tree, the image processing device can obtain the height and width of the tree, and adjust the flight parameters such as the flight attitude of the UAV according to the height and width of the tree, so as to make the UAV Fly in an adjusted flight attitude so that the drone bypasses this tree during flight.

S203: Store the image frame obtained after the speed change processing.

In this embodiment of the present invention, the image processing device may store the image frames obtained after the variable speed processing.

In one embodiment, after performing variable speed processing on the image frames captured at the first frame rate, the image processing device may generate a target video with a faster playback speed according to the image frames obtained after the fast playback processing; or, according to The image frame obtained after the slow-play processing generates a target video with a reduced playback speed.

For example, assuming that 60 image frames captured at the first frame rate of 60 frames/second are fast-played, the 60 image frames are played within 0.5 seconds, so that the playback speed can be accelerated to 60 frames/0.5 seconds target video.

For another example, it is assumed that the 60-frame image frames captured at the first frame rate of 60 frames/second are slow-played to complete the playback of the 60-frame image frames within 2 seconds, so that the playback speed can be slowed down to 60 frames/second. 2 seconds of target video.

In this embodiment of the present invention, the image processing device may acquire image frames shot by the photographing device according to the first frame rate, and when it is recognized that the scene photographed by the photographing device conforms to the preset scene and that the moving posture of the movable platform equipped with the photographing device conforms to the preset posture , when the current shooting time of the shooting device reaches the preset switching time, and receives any one or more of the trigger instructions sent by the control terminal of the mobile platform, perform variable speed processing on the image frames shot according to the first frame rate, and Image frames obtained after variable speed processing are stored. Through the method, the intelligent speed adjustment processing of the images captured by the photographing device during the movement of the movable platform can be realized, the accuracy of the intelligent speed adjustment of the images can be improved, the effect of the images can be guaranteed, and the user's ability to adjust the speed of the images during the shooting process can be satisfied. Intelligent and automated requirements for speed regulation.

Please refer to FIG. 4. FIG. 4 is a schematic flowchart of an image control method provided by an embodiment of the present invention. The method may be executed by a control terminal, wherein the specific explanation of the control terminal is as described above. The method of the embodiment of the present invention includes the following steps.

S401: Generate a trigger instruction.

In this embodiment of the present invention, the control terminal may generate a trigger instruction.

In one embodiment, the control terminal may generate the trigger instruction according to the start time node and the end time node set by the user, and the trigger instruction carries the start time node and the end time node, which are used to indicate that the start time node is at the start time node. and performing variable speed processing on the image frames captured at the first frame rate within the time period of the end time node.

In one embodiment, the control terminal may send a video shooting instruction to the movable platform before acquiring the image frames sent by the movable platform and shot by the shooting device according to the first frame rate, where the video shooting instruction carries the first frame rate, The video shooting instruction is used to instruct the movable platform to control the shooting device to shoot image frames according to the first frame rate.

S402: Send a trigger instruction to a movable platform equipped with a photographing device, the photographing device performs photography according to a first frame rate, and the trigger instruction is used to instruct the movable platform to record the images captured by the photographing device according to the first frame rate. Image frames undergo variable speed processing.

In this embodiment of the present invention, the control terminal may send the trigger instruction to a movable platform equipped with a photographing device, the photographing device performs photography at a first frame rate, and the trigger instruction is used to instruct the movable platform to The photographing device performs variable speed processing according to the image frames photographed at the first frame rate.

In some embodiments, the trigger instruction is used to instruct the movable platform to perform fast-play processing or slow-play processing on the image frames captured at the first frame rate, and store the fast-play processing or slow-play processing The resulting image frame after processing.

In one embodiment, the control terminal may also receive a preset scene set by a user for triggering the movable platform to perform speed change processing, a preset gesture for triggering the movable platform to perform speed change processing, and a preset gesture for triggering all One or more of the switching time for the variable speed processing by the movable platform, and send it to the movable platform, so that the movable platform can switch the time according to the received preset scene, preset posture, to determine whether the scene captured by the photographing device mounted on the movable platform satisfies the preset conditions of the speed change processing.

In one embodiment, the control terminal may also receive one or more of the magnification and duration of fast-play or slow-play set by the user for triggering the movable platform to perform variable speed processing, and send it to the movable platform platform, so that the movable platform can perform fast or slow playback processing on the image frames captured by the photographing device according to the first frame rate according to one or more of the obtained magnifications and durations of fast playback or slow playback.

In one embodiment, the control terminal may also acquire the user's movement parameter setting operation, generate movement control instructions according to movement parameters corresponding to the movement parameter setting operations, and send the movement control instructions to the movable platform , the movement control instruction is used to instruct the movable platform to move according to the movement parameters corresponding to the movement parameter setting operation, and to perform variable speed processing on the image frames captured at the first frame rate. In some embodiments, the movement parameters include any one or more of a movement speed of the movable platform, an acceleration of the movable platform, and an attitude of the movable platform.

In this embodiment of the present invention, the control terminal generates a trigger instruction and sends the trigger instruction to a movable platform equipped with a photographing device, so as to instruct the movable platform to perform variable speed processing on the image frames captured by the photographing device according to the first frame rate, Therefore, it is helpful to realize the intelligent speed change processing of the images captured by the photographing device during the movement of the movable platform, improve the accuracy of the intelligent speed regulation of the images, ensure the effect of the images, and satisfy the user's expectations for the images captured during the shooting process. Intelligent and automated requirements for image speed regulation.

Referring to FIG. 5 , FIG. 5 is a schematic structural diagram of an image processing device according to an embodiment of the present invention. Specifically, the image processing device in this embodiment as shown in the figure may include: one or more processors 501 ; one or more communication interfaces 502 and a memory 503 . The above-mentioned processor 501 , communication interface 502 and memory 503 are connected through a bus 504 . The memory 503 is used for storing instructions, and the processor 501 is used for executing the instructions stored in the memory 503 . Wherein, when the program instructions are executed, the processor 501 is configured to perform the following steps:

Image frames obtained after the variable speed processing are stored.

Further, the processor 501 is also used for:

The image frames of the first frame rate are sent to the control terminal in real time through the communication interface 502 .

Further, when the processor 501 performs variable speed processing on the image frames captured at the first frame rate, it is specifically used for:

Perform fast playback processing on the image frames captured at the first frame rate; or,

Slow-play processing is performed on the image frames captured at the first frame rate.

Further, after the processor 501 performs variable speed processing on the image frames captured at the first frame rate, the processor 501 is further configured to:

Generate a target video with accelerated playback speed according to the image frame obtained after the fast-play processing; or,

A target video whose playback speed is slowed down is generated according to the image frames obtained after the slow-play processing.

Further, when the processor 501 performs fast playback processing on the image frames captured at the first frame rate, it is specifically used for:

obtaining the N frames of image frames captured according to the first frame rate and the first time for capturing the N frames of image frames according to the first frame rate, where N is an integer greater than 0;

Controlling to play the N image frames within a second time, wherein the second time is less than the first time.

Further, the processor 501 is also used for:

Extract K frames of image frames from the N frames of image frames;

Controlling to play the K frames of image frames within the second time.

Further, when the processor 501 performs slow playback processing on the image frames captured at the first frame rate, it is specifically used for:

Controlling to play the N image frames within a third time, wherein the third time is greater than the first time.

Further, the processor 501 is also used for:

Determine M frames of prediction frames according to the N frames of image frames;

Controlling to play the N frames of image frames and the M frames of predicted frames within the third time.

When it is detected that the scene photographed by the photographing device includes a gap or an obstacle, determining to perform slow-motion processing on the image frame photographed at the first frame rate;

When it is detected that the scene photographed by the photographing device does not include a gap or an obstacle, it is determined to perform fast playback processing on the image frame photographed at the first frame rate.

Further, the preset switching time includes a start time node and an end time node, which are used to indicate that the image frame captured according to the first frame rate is changed within the time period of the start time node and the end time node. deal with.

Further, the processor 501 is also used for:

obtaining a movement control instruction sent by the control terminal, where the movement control instruction carries the movement parameters corresponding to the user's movement parameter setting operation;

The movable platform is controlled to move according to the movement parameter setting operation corresponding to the movement parameter.

Further, the processor 501 is also used for:

Identify the scene shot by the shooting device;

When it is recognized that the scene photographed by the photographing device conforms to the preset scene, adjusting the movement parameters of the movable platform according to the preset scene;

The movable platform is controlled to move according to the adjusted movement parameters.

Further, when the processor 501 adjusts the movement parameters of the movable platform according to the preset scene, it is specifically used for:

According to the corresponding relationship between the preset scene and the movement parameter, determine the movement parameter corresponding to the preset scene;

The movable platform is controlled to move according to the movement parameters corresponding to the preset scene.

performing zoom processing on the photographing device to determine the distance between the movable platform and the preset scene;

The movement parameters of the movable platform are adjusted according to the distance.

Further, the preset scene includes obstacles or gaps.

Further, the processor 501 is also used for:

Whether the scene photographed by the photographing device is a gap is identified by one or more of a visual sensor, an infrared device, a zoom device, and a preset terrain model.

Further, when the preset scene includes obstacles, when the processor 501 adjusts the movement parameters of the movable platform according to the preset scene, it is specifically used for:

obtain the size of the obstacle in the preset scene;

Adjust the movement parameters of the movable platform according to the size of the obstacle;

When the processor 501 controls the movable platform to move according to the adjusted movement parameters, it is specifically used for:

The movable platform is controlled to move according to the adjusted movement parameters, so that the movable platform bypasses the obstacle.

Further, the preset scene includes a gap; when the processor 501 adjusts the movement parameters of the movable platform according to the preset scene, it is specifically used for:

obtaining the size and/or depth of the void in the preset scene;

adjusting the movement parameters of the movable platform according to the size and/or depth of the void;

The movable platform is controlled to move according to the adjusted movement parameters, so that the movable platform passes through the gap.

Further, when the processor 501 acquires the size and/or depth of the void in the preset scene, it is specifically used for:

Acquiring continuous n frames of images in which the photographing device photographs the gap, where n is an integer greater than 1;

determining the size of the void according to the consecutive n frames of images; and/or,

The depth of the void is obtained from a vision sensor on the movable platform.

Further, the processor 501 is also used for:

based on the size and/or depth of the void, generating a void traversal virtual pointing cue for indicating a path for the movable platform to traverse the void;

The void crossing virtual pointing cue output is displayed on glasses of the movable platform.

Further, the movement parameters include any one or more of the movement speed of the movable platform, the acceleration of the movable platform, and the posture of the movable platform.

It should be understood that, in this embodiment of the present invention, the processor 501 may be a central processing unit (Central Processing Unit, CPU), and the processor may also be other general-purpose processors, digital signal processors (Digital Signal Processor, DSP) , Application Specific Integrated Circuit (ASIC), Field-Programmable Gate Array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.

The memory 503 may include read only memory and random access memory, and provides instructions and data to the processor 501 . A portion of memory 503 may also include non-volatile random access memory. For example, the memory 503 may also store device type information.

For the specific implementation of the processor 501 in this embodiment of the present invention, reference may be made to the description of the relevant content in the above-mentioned embodiments, and details are not described herein.

In this embodiment of the present invention, the image processing device may acquire image frames shot by the photographing device according to the first frame rate, and when it recognizes that the scene photographed by the photographing device conforms to the preset scene and that the moving posture of the movable platform equipped with the photographing device conforms to the preset posture , when the current shooting time of the shooting device reaches the preset switching time, and receives any one or more of the trigger instructions sent by the control terminal of the mobile platform, perform variable speed processing on the image frames shot according to the first frame rate, and The image frames obtained after the variable speed processing are stored to realize the intelligent speed regulation processing of the images captured by the photographing device during the movement of the movable platform, which improves the accuracy of the intelligent speed regulation of the images, ensures the effect of the images, and satisfies the It meets the intelligent and automatic needs of users to adjust the speed of the images during the shooting process.

Referring to FIG. 6, FIG. 6 is a schematic structural diagram of a control terminal provided by an embodiment of the present invention. Specifically, the terminal in this embodiment as shown in the figure may include: one or more processors 601 ; one or more communication interfaces 602 and a memory 603 . The above-mentioned processor 601 , communication interface 602 and memory 603 are connected through a bus 604 . The memory 603 is used for storing instructions, and the processor 601 is used for executing the instructions stored in the memory 603 . Wherein, when the program instructions are executed, the processor 601 is configured to perform the following steps:

Generate trigger instructions;

The trigger instruction is sent to the movable platform equipped with the photographing device through the communication interface 602, the photographing device performs the photographing according to the first frame rate, and the trigger instruction is used to instruct the movable platform to carry out the photographing device according to the first frame rate. The frame rate captured image frames undergo variable speed processing.

Further, the trigger instruction carries a start time node and an end time node, which are used to indicate that the image frame captured according to the first frame rate is subjected to variable speed processing within the time period of the start time node and the end time node. .

Further, the processor 601 is also used for:

Receive a preset scene set by a user for triggering the movable platform to perform variable speed processing, a preset posture for triggering the movable platform to perform variable speed processing, and a switching time for triggering the movable platform to perform variable speed processing. one or more of and sent to the removable platform; or,

One or more of the magnification and duration of fast playback or slow playback set by the user for triggering the movable platform to perform variable speed processing are received, and sent to the movable platform.

It should be understood that, in this embodiment of the present invention, the processor 601 may be a central processing unit (Central Processing Unit, CPU), and the processor may also be other general-purpose processors, digital signal processors (Digital Signal Processor, DSP) , Application Specific Integrated Circuit (ASIC), Field-Programmable Gate Array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.

The memory 603 may include read only memory and random access memory, and provides instructions and data to the processor 601 . A portion of memory 603 may also include non-volatile random access memory. For example, memory 603 may also store device type information.

For the specific implementation of the processor 601 in this embodiment of the present invention, reference may be made to the description of the relevant content in the above-mentioned embodiments, and details are not described herein.

An embodiment of the present invention further provides a movable platform, including: a body; a power system configured on the body, for providing the movable platform with moving power; a photographing device mounted on the movable platform; a processor , which is used to obtain the image frames shot by the photographing device according to the first frame rate; when it is recognized that a preset condition is met, perform variable speed processing on the image frames shot according to the first frame rate, and the preset conditions include the shooting The scene shot by the device conforms to the preset scene, the moving posture of the movable platform on which the shooting device is mounted conforms to the preset posture, the current shooting time of the shooting device reaches the preset switching time, and the control terminal that receives the mobile platform One or more of the sent trigger instructions; and store the image frames obtained after the variable speed processing.

Further, the processor is also used for:

Send the image frame of the first frame rate to the control terminal in real time.

Further, when the processor performs variable speed processing on the image frames captured at the first frame rate, it is specifically used for:

Further, after the processor performs variable speed processing on the image frames captured at the first frame rate, the processor is further configured to:

Further, when the processor performs fast playback processing on the image frames captured according to the first frame rate, it is specifically used for:

Further, the processor is also used for:

Extract K frames of image frames from the N frames of image frames;

Controlling to play the K frames of image frames within the second time.

Further, when the processor performs slow-play processing on the image frames captured at the first frame rate, it is specifically used for:

Further, the processor is also used for:

Identify the scene shot by the shooting device;

Further, when the processor adjusts the movement parameters of the movable platform according to the preset scene, it is specifically used for:

Zooming is performed on the photographing device to determine the distance between the movable platform and the preset scene;

Further, the preset scene includes obstacles or gaps.

Further, the processor is also used for:

Further, when the preset scene includes obstacles, when the processor adjusts the movement parameters of the movable platform according to the preset scene, it is specifically used for:

obtain the size of the obstacle in the preset scene;

When the processor controls the movable platform to move according to the adjusted movement parameters, it is specifically used for:

Further, the preset scene includes a gap; when the processor adjusts the movement parameters of the movable platform according to the preset scene, it is specifically used for:

obtaining the size and/or depth of the void in the preset scene;

Further, when the processor acquires the size and/or depth of the void in the preset scene, it is specifically used for:

The depth of the void is obtained from a vision sensor on the movable platform.

Further, the processor is also used for:

It should be understood that, in this embodiment of the present invention, the processor may be a central processing unit (Central Processing Unit, CPU), and the processor may also be other general-purpose processors, digital signal processors (Digital Signal Processor, DSP), Application Specific Integrated Circuit (ASIC), Field-Programmable Gate Array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.

The memory, which may include read-only memory and random access memory, provides instructions and data to the processor. A portion of the memory may also include non-volatile random access memory. For example, the memory may also store device type information.

For the specific implementation of the processor in the embodiment of the present invention, reference may be made to the description of the relevant content in the foregoing embodiments, which is not repeated here.

In this embodiment of the present invention, the movable platform may acquire image frames shot by the photographing device according to the first frame rate, and when it is recognized that the scene photographed by the photographing device conforms to the preset scene and the moving posture of the movable platform equipped with the photographing device conforms to the preset posture , when the current shooting time of the shooting device reaches the preset switching time, and receives any one or more of the trigger instructions sent by the control terminal of the mobile platform, perform variable speed processing on the image frames shot according to the first frame rate, and The image frames obtained after the variable speed processing are stored to realize the intelligent speed regulation processing of the images captured by the photographing device during the movement of the movable platform, which improves the accuracy of the intelligent speed regulation of the images, ensures the effect of the images, and satisfies the It meets the intelligent and automatic needs of users to adjust the speed of the images during the shooting process.

An embodiment of the present invention further provides a computer-readable storage medium, where the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, realizes the image described in the embodiment corresponding to FIG. 2 of the present invention The processing method or the image control method described in the embodiment corresponding to FIG. 4 can also implement the image processing device according to the embodiment of the present invention shown in FIG. 5 or the control terminal according to the embodiment of the present invention shown in FIG. 6 , It is not repeated here.

The computer-readable storage medium may be an internal storage unit of the device described in any of the foregoing embodiments, such as a hard disk or a memory of the device. The computer-readable storage medium can also be an external storage device of the device, such as a plug-in hard disk equipped on the device, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card , Flash Card (Flash Card) and so on. Further, the computer-readable storage medium may also include both an internal storage unit of the device and an external storage device. The computer-readable storage medium is used to store the computer program and other programs and data required by the terminal. The computer-readable storage medium can also be used to temporarily store data that has been or will be output.

Those of ordinary skill in the art can understand that all or part of the processes in the methods of the above embodiments can be implemented by instructing relevant hardware through a computer program, and the program can be stored in a computer-readable storage medium. During execution, the processes of the embodiments of the above-mentioned methods may be included. The storage medium may be a magnetic disk, an optical disk, a read-only memory (Read-Only Memory, ROM), or a random access memory (Random Access Memory, RAM) or the like.

The above disclosures are only preferred embodiments of the present invention, and of course, the scope of the rights of the present invention cannot be limited by this. Therefore, equivalent changes made according to the claims of the present invention are still within the scope of the present invention.

Claims

An image processing method, comprising:

acquiring image frames shot by the photographing device according to the first frame rate;

When it is recognized that a preset condition is met, the speed change processing is performed on the image frame shot at the first frame rate, and the preset condition includes that the scene shot by the photographing device conforms to the preset scene, and the camera equipped with the photographing device can be One or more of the movement posture of the mobile platform conforms to the preset posture, the current photographing time of the photographing device reaches the preset switching time, and the trigger instruction sent by the control terminal of the mobile platform is received;

Image frames obtained after the variable speed processing are stored.
The method according to claim 1, wherein the method further comprises:

Send the image frame of the first frame rate to the control terminal in real time.
The method according to claim 1, wherein the performing variable speed processing on the image frames captured at the first frame rate comprises:

Perform fast playback processing on the image frames captured at the first frame rate; or,

Slow-play processing is performed on the image frames captured at the first frame rate.
The method according to claim 3, wherein after performing the variable speed processing on the image frames captured at the first frame rate, the method further comprises:

Generate a target video with accelerated playback speed according to the image frame obtained after the fast-play processing; or,

A target video whose playback speed is slowed down is generated according to the image frames obtained after the slow-play processing.
The method according to claim 3, wherein the performing fast playback processing on the image frames captured at the first frame rate comprises:

obtaining the N frames of image frames captured according to the first frame rate and the first time for capturing the N frames of image frames according to the first frame rate, where N is an integer greater than 0;

Controlling to play the N image frames within a second time, wherein the second time is less than the first time.
The method according to claim 5, wherein the method further comprises:

Extract K frames of image frames from the N frames of image frames;

Controlling to play the K frames of image frames within the second time.
The method according to claim 3, wherein the performing slow-motion processing on the image frames captured at the first frame rate comprises:

obtaining the N frames of image frames captured according to the first frame rate and the first time for capturing the N frames of image frames according to the first frame rate, where N is an integer greater than 0;

Controlling to play the N image frames within a third time, wherein the third time is greater than the first time.
The method according to claim 7, wherein the method further comprises:

Determine M frames of prediction frames according to the N frames of image frames;

Controlling to play the N frames of image frames and the M frames of predicted frames within the third time.
The method according to claim 3, wherein the performing variable speed processing on the image frames captured at the first frame rate comprises:

When it is detected that the scene photographed by the photographing device includes a gap or an obstacle, determining to perform slow-motion processing on the image frame photographed at the first frame rate;

When it is detected that the scene photographed by the photographing device does not include a gap or an obstacle, it is determined to perform fast playback processing on the image frame photographed at the first frame rate.
The method of claim 1, wherein:

The preset switching time includes a start time node and an end time node, which are used to instruct to perform variable speed processing on the image frames captured at the first frame rate within the time period of the start time node and the end time node.
The method according to claim 1, wherein the method further comprises:

Obtain the movement control command sent by the control terminal, and the movement control command carries the movement parameter corresponding to the user's movement parameter setting operation;

The movable platform is controlled to move according to the movement parameter setting operation corresponding to the movement parameter.
The method according to claim 1, wherein the method further comprises:

Identify the scene shot by the shooting device;

When it is recognized that the scene photographed by the photographing device conforms to the preset scene, adjusting the movement parameters of the movable platform according to the preset scene;

The movable platform is controlled to move according to the adjusted movement parameters.
The method according to claim 12, wherein the adjusting the movement parameters of the movable platform according to the preset scene comprises:

According to the corresponding relationship between the preset scene and the movement parameter, determine the movement parameter corresponding to the preset scene;

The movable platform is controlled to move according to the movement parameters corresponding to the preset scene.
The method according to claim 12, wherein the adjusting the movement parameters of the movable platform according to the preset scene comprises:

performing zoom processing on the photographing device to determine the distance between the movable platform and the preset scene;

The movement parameters of the movable platform are adjusted according to the distance.
The method of claim 14, wherein the preset scene includes an obstacle or a gap.
The method of claim 15, wherein the method further comprises:

Whether the scene photographed by the photographing device is a gap is identified by one or more of a visual sensor, an infrared device, a zoom device, and a preset terrain model.
The method according to claim 15, wherein the preset scene includes obstacles, and the adjusting the movement parameters of the movable platform according to the preset scene includes:

obtain the size of the obstacle in the preset scene;

Adjust the movement parameters of the movable platform according to the size of the obstacle;

The controlling the movable platform to move according to the adjusted movement parameters includes:

The movable platform is controlled to move according to the adjusted movement parameters, so that the movable platform bypasses the obstacle.
The method according to claim 15, wherein the preset scene includes a gap; and the adjusting the movement parameters of the movable platform according to the preset scene includes:

obtaining the size and/or depth of the void in the preset scene;

adjusting the movement parameters of the movable platform according to the size and/or depth of the void;

The controlling the movable platform to move according to the adjusted movement parameters includes:

The movable platform is controlled to move according to the adjusted movement parameters, so that the movable platform passes through the gap.
The method according to claim 18, wherein the acquiring the size and/or depth of the void in the preset scene comprises:

Acquiring continuous n frames of images in which the photographing device photographs the gap, where n is an integer greater than 1;

determining the size of the void according to the consecutive n frames of images; and/or,

The depth of the void is obtained from a vision sensor on the movable platform.
The method of claim 19, wherein the method further comprises:

based on the size and/or depth of the void, generating a void traversal virtual pointing cue for indicating a path for the movable platform to traverse the void;

The void crossing virtual pointing prompt output is displayed on a display device of the movable platform.
The method according to any one of claims 11-18, wherein,

The movement parameters include any one or more of the movement speed of the movable platform, the acceleration of the movable platform, and the posture of the movable platform.
An image control method, comprising:

Generate trigger instructions;

Send the trigger instruction to the movable platform equipped with the photographing device, and the photographing device shoots according to the first frame rate, and the trigger instruction is used to instruct the movable platform to perform the shooting of the photographing device according to the first frame rate. Image frames undergo variable speed processing.
The method according to claim 22, wherein the trigger instruction carries a start time node and an end time node, which are used to indicate that within the time period of the start time node and the end time node, the Image frames captured at a frame rate are subject to variable speed processing.
The method of claim 22, wherein the method further comprises:

Receive a preset scene set by a user for triggering the movable platform to perform variable speed processing, a preset posture for triggering the movable platform to perform variable speed processing, and a switching time for triggering the movable platform to perform variable speed processing. one or more of and sent to the removable platform; or,

One or more of the magnification and duration of fast playback or slow playback set by the user for triggering the movable platform to perform variable speed processing are received, and sent to the movable platform.
An image processing device, comprising a memory, a processor and a communication interface;

the memory for storing program instructions;

The processor executes the program instructions stored in the memory, and when the program instructions are executed, the processor is configured to perform the following steps:

acquiring image frames shot by the photographing device according to the first frame rate;

When it is recognized that a preset condition is met, the speed change processing is performed on the image frame shot at the first frame rate, and the preset condition includes that the scene shot by the shooting device conforms to the preset scene, and the shooting device can be equipped with the shooting device. One or more of the movement posture of the mobile platform conforms to the preset posture, the current photographing time of the photographing device reaches the preset switching time, and the trigger instruction sent by the control terminal of the mobile platform is received;

Image frames obtained after the variable speed processing are stored.
The device of claim 25, wherein the processor is further configured to:

Send the image frame of the first frame rate to the control terminal in real time through the communication interface.
The device according to claim 25, wherein when the processor performs variable speed processing on the image frames captured at the first frame rate, the processor is specifically used for:

Perform fast playback processing on the image frames captured at the first frame rate; or,

Slow-play processing is performed on the image frames captured at the first frame rate.
The device according to claim 27, wherein after the processor performs variable speed processing on the image frames captured at the first frame rate, the processor is further configured to:

Generate a target video with accelerated playback speed according to the image frame obtained after the fast-play processing; or,

A target video whose playback speed is slowed down is generated according to the image frames obtained after the slow playback process.
The device according to claim 27, wherein when the processor performs fast playback processing on the image frames captured at the first frame rate, the processor is specifically used for:

obtaining the N frames of image frames captured according to the first frame rate and the first time for capturing the N frames of image frames according to the first frame rate, where N is an integer greater than 0;

Controlling to play the N image frames within a second time, wherein the second time is less than the first time.
The device of claim 29, wherein the processor is further configured to:

Extract K frames of image frames from the N frames of image frames;

Controlling to play the K frames of image frames within the second time.
The device according to claim 27, wherein when the processor performs slow-play processing on the image frames captured at the first frame rate, the processor is specifically configured to:

acquiring the N frames of image frames captured according to the first frame rate and the first time for capturing the N frames of image frames according to the first frame rate, where N is an integer greater than 0;

Controlling to play the N image frames within a third time, wherein the third time is greater than the first time.
The device of claim 31, wherein the processor is further configured to:

Determine M frames of prediction frames according to the N frames of image frames;

Controlling to play the N frames of image frames and the M frames of predicted frames within the third time.
The device according to claim 27, wherein when the processor performs variable speed processing on the image frames captured at the first frame rate, the processor is specifically used for:

When it is detected that the scene photographed by the photographing device is a gap, determining to perform slow-motion processing on the image frame photographed according to the first frame rate;

When it is detected that the scene photographed by the photographing device is an obstacle, it is determined to perform fast playback processing on the image frame photographed at the first frame rate.
The apparatus of claim 25, wherein:

The preset switching time includes a start time node and an end time node, which are used to instruct to perform variable speed processing on the image frames captured at the first frame rate within the time period of the start time node and the end time node.
The device of claim 25, wherein the processor is further configured to:

obtaining a movement control instruction sent by the control terminal, where the movement control instruction carries the movement parameters corresponding to the user's movement parameter setting operation;

The movable platform is controlled to move according to the movement parameter setting operation corresponding to the movement parameter.
The device of claim 25, wherein the processor is further configured to:

Identify the scene shot by the shooting device;

When it is recognized that the scene photographed by the photographing device conforms to the preset scene, adjusting the movement parameters of the movable platform according to the preset scene;

The movable platform is controlled to move according to the adjusted movement parameters.
The device according to claim 36, wherein when the processor adjusts the movement parameters of the movable platform according to the preset scene, it is specifically configured to:

According to the corresponding relationship between the preset scene and the movement parameter, determine the movement parameter corresponding to the preset scene;

The movable platform is controlled to move according to the movement parameters corresponding to the preset scene.
The device according to claim 36, wherein when the processor adjusts the movement parameters of the movable platform according to the preset scene, it is specifically configured to:

performing zoom processing on the photographing device to determine the distance between the movable platform and the preset scene;

The movement parameters of the movable platform are adjusted according to the distance.
The device of claim 38, wherein the preset scene includes an obstacle or a gap.
The device of claim 39, wherein the processor is further configured to:

Whether the scene photographed by the photographing device is a gap is identified by one or more of a visual sensor, an infrared device, a zoom device, and a preset terrain model.
The device according to claim 39, wherein the preset scene includes obstacles, and when the processor adjusts the movement parameters of the movable platform according to the preset scene, the processor is specifically configured to:

obtain the size of the obstacle in the preset scene;

Adjust the movement parameters of the movable platform according to the size of the obstacle;

When the processor controls the movable platform to move according to the adjusted movement parameters, it is specifically used for:

The movable platform is controlled to move according to the adjusted movement parameters, so that the movable platform bypasses the obstacle.
The device according to claim 39, wherein the preset scene includes a gap; when the processor adjusts the movement parameters of the movable platform according to the preset scene, it is specifically used for:

obtaining the size and/or depth of the void in the preset scene;

adjusting the movement parameters of the movable platform according to the size and/or depth of the void;

When the processor controls the movable platform to move according to the adjusted movement parameters, it is specifically used for:

The movable platform is controlled to move according to the adjusted movement parameters, so that the movable platform passes through the gap.
The device according to claim 42, wherein when the processor acquires the size and/or depth of the void in the preset scene, it is specifically used to:

Acquiring continuous n frames of images in which the photographing device photographs the gap, where n is an integer greater than 1;

determining the size of the void according to the consecutive n frames of images; and/or,

The depth of the void is obtained from a vision sensor on the movable platform.
The device of claim 43, wherein the processor is further configured to:

based on the size and/or depth of the void, generating a void traversal virtual pointing cue for indicating a path for the movable platform to traverse the void;

The void crossing virtual pointing prompt output is displayed on a display device of the movable platform.
The device according to any one of claims 35-42, characterized in that:

The movement parameters include any one or more of the movement speed of the movable platform, the acceleration of the movable platform, and the posture of the movable platform.
A control terminal, comprising a memory, a processor and a communication interface;

the memory for storing program instructions;

The processor executes the program instructions stored in the memory, and when the program instructions are executed, the processor is configured to perform the following steps:

Generate trigger instructions;

The trigger instruction is sent to the movable platform equipped with the photographing device through the communication interface, the photographing device shoots according to the first frame rate, and the trigger instruction is used to instruct the movable platform to shoot the photographing device according to the first frame rate. The captured image frame is processed at variable speed.
The terminal according to claim 46, wherein the trigger instruction carries a start time node and an end time node, which are used to indicate that the trigger instruction according to the first Image frames captured at a frame rate are subject to variable speed processing.
The terminal according to claim 47, wherein the processor is further configured to:

Receive a preset scene set by the user for triggering the movable platform to perform variable speed processing, a preset posture for triggering the movable platform to perform variable speed processing, and a switching time for triggering the movable platform to perform variable speed processing. one or more of and sent to the removable platform; or,

One or more of the magnification and duration of fast playback or slow playback set by the user for triggering the movable platform to perform variable speed processing are received, and sent to the movable platform.
A movable platform, characterized in that, comprising:

body;

a power system configured on the fuselage for providing the movable platform with moving power;

A camera mounted on a movable platform;

processor for:

acquiring image frames shot by the photographing device according to the first frame rate;

When it is recognized that a preset condition is met, the speed change processing is performed on the image frame shot at the first frame rate, and the preset condition includes that the scene shot by the shooting device conforms to the preset scene, and the shooting device can be equipped with the shooting device. One or more of the movement posture of the mobile platform conforms to the preset posture, the current photographing time of the photographing device reaches the preset switching time, and the trigger instruction sent by the control terminal of the mobile platform is received;

Image frames obtained after the variable speed processing are stored.
The movable platform of claim 49, wherein the processor is further configured to:

Send the image frame of the first frame rate to the control terminal in real time.
The movable platform according to claim 49, wherein when the processor performs variable speed processing on the image frames captured at the first frame rate, the processor is specifically used for:

Perform fast playback processing on the image frames captured at the first frame rate; or,

Slow-play processing is performed on the image frames captured at the first frame rate.
The movable platform according to claim 51, wherein after the processor performs variable speed processing on the image frames captured at the first frame rate, the processor is further configured to:

Generate a target video with accelerated playback speed according to the image frame obtained after the fast-play processing; or,

A target video whose playback speed is slowed down is generated according to the image frames obtained after the slow-play processing.
The movable platform according to claim 51, wherein when the processor performs fast playback processing on the image frames captured at the first frame rate, the processor is specifically used for:

obtaining the N frames of image frames captured according to the first frame rate and the first time for capturing the N frames of image frames according to the first frame rate, where N is an integer greater than 0;

Controlling to play the N image frames within a second time, wherein the second time is less than the first time.
The movable platform of claim 53, wherein the processor is further configured to:

Extract K frames of image frames from the N frames of image frames;

Controlling to play the K frames of image frames within the second time.
The movable platform according to claim 51, wherein when the processor performs slow-play processing on the image frames captured at the first frame rate, the processor is specifically used for:

obtaining the N frames of image frames captured according to the first frame rate and the first time for capturing the N frames of image frames according to the first frame rate, where N is an integer greater than 0;

Controlling to play the N image frames within a third time, wherein the third time is greater than the first time.
The movable platform of claim 55, wherein the processor is further configured to:

Determine M frames of prediction frames according to the N frames of image frames;

Controlling to play the N frames of image frames and the M frames of predicted frames within the third time.
The movable platform according to claim 51, wherein when the processor performs variable speed processing on the image frames captured at the first frame rate, the processor is specifically used for:

When it is detected that the scene photographed by the photographing device is a gap, determining to perform slow-motion processing on the image frame photographed according to the first frame rate;

When it is detected that the scene photographed by the photographing device is an obstacle, it is determined to perform fast playback processing on the image frame photographed at the first frame rate.
The movable platform of claim 49, wherein:

The preset switching time includes a start time node and an end time node, which are used to instruct to perform variable speed processing on the image frames captured at the first frame rate within the time period of the start time node and the end time node.
The movable platform of claim 49, wherein the processor is further configured to:

obtaining a movement control instruction sent by the control terminal, where the movement control instruction carries the movement parameters corresponding to the user's movement parameter setting operation;

The movable platform is controlled to move according to the movement parameter setting operation corresponding to the movement parameter.
The movable platform of claim 49, wherein the processor is further configured to:

Identify the scene shot by the shooting device;

When it is recognized that the scene photographed by the photographing device conforms to the preset scene, adjusting the movement parameters of the movable platform according to the preset scene;

The movable platform is controlled to move according to the adjusted movement parameters.
The movable platform according to claim 60, wherein when the processor adjusts the movement parameters of the movable platform according to the preset scene, it is specifically used for:

According to the corresponding relationship between the preset scene and the movement parameter, determine the movement parameter corresponding to the preset scene;

The movable platform is controlled to move according to the movement parameters corresponding to the preset scene.
The movable platform according to claim 60, wherein when the processor adjusts the movement parameters of the movable platform according to the preset scene, it is specifically used for:

performing zoom processing on the photographing device to determine the distance between the movable platform and the preset scene;

The movement parameters of the movable platform are adjusted according to the distance.
The movable platform of claim 62, wherein the preset scene includes an obstacle or a gap.
The movable platform of claim 63, wherein the processor is further configured to:

Whether the scene photographed by the photographing device is a gap is identified by one or more of a visual sensor, an infrared device, a zoom device, and a preset terrain model.
The movable platform according to claim 63, wherein the preset scene includes obstacles, and when the processor adjusts the movement parameters of the movable platform according to the preset scene, it is specifically used for:

obtain the size of the obstacle in the preset scene;

Adjust the movement parameters of the movable platform according to the size of the obstacle;

When the processor controls the movable platform to move according to the adjusted movement parameters, it is specifically used for:

The movable platform is controlled to move according to the adjusted movement parameters, so that the movable platform bypasses the obstacle.
The movable platform according to claim 63, wherein the preset scene includes a gap; when the processor adjusts the movement parameters of the movable platform according to the preset scene, it is specifically used for:

obtaining the size and/or depth of the void in the preset scene;

adjusting the movement parameters of the movable platform according to the size and/or depth of the void;

When the processor controls the movable platform to move according to the adjusted movement parameters, it is specifically used for:

The movable platform is controlled to move according to the adjusted movement parameters, so that the movable platform passes through the gap.
The movable platform according to claim 66, wherein when the processor acquires the size and/or depth of the void in the preset scene, it is specifically used for:

Acquiring continuous n frames of images in which the photographing device photographs the gap, where n is an integer greater than 1;

determining the size of the void according to the consecutive n frames of images; and/or,

The depth of the void is obtained from a vision sensor on the movable platform.
The movable platform of claim 67, wherein the processor is further configured to:

based on the size and/or depth of the void, generating a void traversal virtual pointing cue for indicating a path for the movable platform to traverse the void;

The void crossing virtual pointing prompt output is displayed on a display device of the movable platform.
The movable platform according to any one of claims 59-66, wherein,

The movement parameters include any one or more of the movement speed of the movable platform, the acceleration of the movable platform, and the posture of the movable platform.
A computer-readable storage medium storing a computer program, characterized in that, when the computer program is executed by a processor, the method according to any one of claims 1 to 24 is implemented.