WO2022016334A1 - Procédé et appareil de traitement d'image, drone de course, système d'optimisation d'image et support de stockage - Google Patents

Procédé et appareil de traitement d'image, drone de course, système d'optimisation d'image et support de stockage Download PDF

Info

Publication number
WO2022016334A1
WO2022016334A1 PCT/CN2020/103091 CN2020103091W WO2022016334A1 WO 2022016334 A1 WO2022016334 A1 WO 2022016334A1 CN 2020103091 W CN2020103091 W CN 2020103091W WO 2022016334 A1 WO2022016334 A1 WO 2022016334A1
Authority
WO
WIPO (PCT)
Prior art keywords
aircraft
image
shooting parameter
time
shooting
Prior art date
Application number
PCT/CN2020/103091
Other languages
English (en)
Chinese (zh)
Inventor
翁松伟
李斯奇
Original Assignee
深圳市大疆创新科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市大疆创新科技有限公司 filed Critical 深圳市大疆创新科技有限公司
Priority to CN202080005876.9A priority Critical patent/CN112913221A/zh
Priority to PCT/CN2020/103091 priority patent/WO2022016334A1/fr
Publication of WO2022016334A1 publication Critical patent/WO2022016334A1/fr

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/667—Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
    • G—PHYSICS
    • G08—SIGNALLING
    • G08C—TRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS
    • G08C17/00—Arrangements for transmitting signals characterised by the use of a wireless electrical link
    • G08C17/02—Arrangements for transmitting signals characterised by the use of a wireless electrical link using a radio link
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/63—Control of cameras or camera modules by using electronic viewfinders
    • H04N23/631—Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
    • H04N23/632—Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/67—Focus control based on electronic image sensor signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording

Definitions

  • the present disclosure relates to the field of image processing, and more particularly, to an image processing method, a device, a traversing machine, an image optimization system and a storage medium.
  • the shooting parameters are usually set higher. For example, to ensure Shutter speed, at the expense of sensitivity, is pulled higher, resulting in poor quality photos obtained by extracting frames from recorded video.
  • the purpose of the present disclosure is to provide an image processing method for a traversing machine, which can obtain a high-quality target video, and the target image obtained according to the target video has better picture quality.
  • an image processing method for a time-travel aircraft comprising: acquiring a flight state of a time-travel aircraft, the time-travel aircraft using first shooting parameters to shoot, the first shooting parameters and the time-travel aircraft The flight speed of the aircraft is related;
  • the flying state of the time-travelling aircraft is in a preset state, adjusting the first shooting parameter of the time-travelling aircraft to a second shooting parameter, and the second shooting parameter is related to the image quality;
  • an image processing apparatus wherein the image processing apparatus includes a processor, and the processor is configured to: acquire the flight status of the time-travelling aircraft, and the time-travelling aircraft uses first shooting parameters to shoot, and the The first shooting parameter is related to the flight speed of the crossing aircraft;
  • the flying state of the time-travelling aircraft is in a preset state, adjusting the first shooting parameter of the time-travelling aircraft to a second shooting parameter, and the second shooting parameter is related to the image quality;
  • a traversing aircraft comprising: a fuselage, a power system, and the image processing device according to the second aspect; wherein, the power system is installed on the fuselage, and is used for Provide flight power.
  • an image optimization system comprising: a remote control terminal and the traversing machine as described in the third aspect.
  • a computer-readable storage medium on which a computer program is stored, characterized in that, when the computer program is executed by a processor, the functions described in the first aspect of the embodiments of the present disclosure are implemented.
  • Image processing method for traversing machine
  • FIG. 1 is an architectural diagram of an image optimization system according to an exemplary embodiment of the present disclosure
  • FIG. 2 is a flowchart of an image processing method for a traversing machine according to an exemplary embodiment of the present disclosure
  • FIG. 3 is a flowchart of an image processing method for a traversing machine according to an exemplary embodiment of the present disclosure
  • FIG. 4 is a flowchart of an image processing method for a traversing machine according to an exemplary embodiment of the present disclosure
  • FIG. 5 is a flowchart of an image processing method for a traversing machine according to an exemplary embodiment of the present disclosure
  • FIG. 6 is a block diagram of a traversing machine according to an exemplary embodiment of the present disclosure.
  • FIG. 7 is a schematic diagram of a computer-readable storage medium according to an embodiment of the present disclosure.
  • Example embodiments will now be described more fully with reference to the accompanying drawings.
  • Example embodiments can be embodied in various forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concept of example embodiments to those skilled in the art.
  • the described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments.
  • numerous specific details are provided in order to give a thorough understanding of the embodiments of the present disclosure.
  • those skilled in the art will appreciate that the technical solutions of the present disclosure may be practiced without one or more of the specific details, or other methods, components, devices, steps, etc. may be employed.
  • well-known solutions have not been shown or described in detail to avoid obscuring aspects of the present disclosure.
  • FIG. 1 is an architectural diagram of an image optimization system according to an exemplary embodiment of the present disclosure.
  • the image optimization system 100 may include a remote control terminal 101 , a remote control terminal 102 and a traversing machine 104 .
  • the remote control terminal 101 and the remote control terminal 102 can communicate with the traversing machine 104 through the network 103, and the data transmission between the remote control terminal 101, the remote control terminal 102 and the traversing machine 104 can be carried out through wireless transmission, such as WiFi, Bluetooth, zigbee, etc. .
  • Communication between the remote control terminal 101, the remote control terminal 102 and the traversing machine 104 can be performed through traditional 4G, 5G, WiFi, or the Internet.
  • the remote control terminals 101 and 102 can, for example, send the user's operation instruction; for example, the traverse aircraft 104 can obtain the flight status of the traverse aircraft 104 after receiving the user's operation instruction, and can also automatically obtain the flight status of the traverse aircraft 104;
  • the first shooting parameter of the time-travelling machine 104 can be adjusted to the second shooting parameter, wherein the preset state can be, for example, that the time-travelling machine 104 is in a hovering state or a low-speed flying state;
  • Shooting can be performed based on the adjusted second shooting parameters to obtain the target video;
  • the pass-through machine 104 can store the target video in the pass-through machine 104, and can also extract frames from the target video to obtain the target image;
  • the pass-through machine can And/or the target image is sent to the remote control terminals 101 and 102;
  • the remote control terminals 101 and 102 can display the target video and/or the target image to the user.
  • the remote control terminals 101 and 102 can be, for example, but not limited to, a universal remote control or a dedicated remote control for the traversing aircraft 104, and can also be mobile terminals such as flying glasses, mobile phones, computers, tablet computers, handheld terminals, etc., on which corresponding application programs are run. , which can be used to remotely control the traversing machine 104.
  • a display device such as a display screen or a projection device, may be provided on the remote control terminals 101 and 102, which may be used to display the target video or target image sent by the traversing machine 104.
  • the remote control terminals 101 and 102 can receive the operation instructions input by the user, and the remote control terminals 101 and 102 can send the operation instructions to the through machine 104 .
  • FIG. 2 is a flowchart of an image processing method for a traversing machine according to an exemplary embodiment of the present disclosure.
  • the image processing method for a pass-through aircraft provided by the embodiments of the present disclosure may be executed by any electronic device with computing processing capability.
  • the image processing method 20 for a pass-through aircraft provided by an embodiment of the present disclosure may include steps S21-S23.
  • step S21 the flight status of the crossing aircraft is acquired.
  • the crossover machine can be a high-speed small UAV, a small quadcopter with a short battery life, and can be used to travel through woods, buildings, etc.
  • An image acquisition device may be set on the traversing machine for acquiring target images, for example, it may be used for taking photos and videos.
  • the drone uses a first shooting parameter to shoot during flight, and the first shooting parameter is related to the flight speed of the drone.
  • the first shooting parameter is related to the flight speed of the drone.
  • the shutter speed of the camera is usually set higher and the sensitivity is set higher.
  • the processor processes the image, it will also increase the image darkness. Brightening intensity in the area; the sensitivity and the brightening intensity in the dark area of the image are set higher, resulting in strong image noise, so the processor will also set the image noise reduction intensity higher and the image sharpening intensity higher.
  • the image acquisition device can be directly fixed on the traveling machine, or can be fixed on the traveling machine through a pan-tilt, for example, the pan-tilt can be used to change the direction of the image acquisition device.
  • the flight status of the TRX may include, for example, the environmental information of the TRX, the instrument data of the TRX, the navigation data of the TRX, the flight control status of the TRX, the instrument data of the TRX, and the like.
  • the flight status of the crossing aircraft may be acquired in real time, or the flight status of the crossing aircraft may be acquired periodically.
  • acquiring the flight status of the time-travelling aircraft includes: acquiring environmental information of the time-travelling aircraft, wherein the environmental information includes distance information between the time-travelling aircraft and a preset object.
  • the traversing aircraft may be provided with one or more sensors for acquiring environmental information around the traversing aircraft.
  • one or more sensors may be one or more infrared sensors, lidars, etc., which may be used to measure the distance from the traversing aircraft to the preset object.
  • the preset objects may be, for example, buildings around the crossing aircraft, trees around the crossing aircraft, aircraft around the crossing aircraft, and the like.
  • the time-travel aircraft can obtain the distance information between the time-travel aircraft and the preset object to determine whether there is a need to take pictures.
  • acquiring the flight status of the crossing aircraft includes: acquiring navigation data of the crossing aircraft.
  • the aircraft can obtain the navigation data of the aircraft, and the navigation system of the aircraft can provide the position, speed, and flight attitude of the reference coordinate system to the aircraft, and guide the aircraft to fly according to the designated route.
  • acquiring the flight status of the flying boat includes: acquiring instrument data of the flying boat, wherein the instrument data includes jitter information of the flying boat.
  • the instrument data can be acquired based on the IMU (Inertial measurement unit, inertial measurement unit) on the traversing aircraft.
  • IMU Inertial measurement unit, inertial measurement unit
  • acquiring the flight status of the time-travelling aircraft includes: acquiring instrument data of the time-travelling aircraft, wherein the instrument data includes jitter information of the gimbal.
  • the instrument data of the TRX can be obtained, and the instrument data can include the jitter information of the TRX and the gimbal, so as to obtain the jitter of the TRX and the gimbal.
  • acquiring the flight status of the time-traversing aircraft may include: after receiving an operation instruction sent by the target object or periodically, acquiring the flight state of the time-travelling aircraft.
  • the fly-through aircraft can periodically obtain the flight status of the fly-through aircraft.
  • the period can be set according to the actual situation, for example, it can be 30 seconds, 1 minute, and so on.
  • the flying machine After receiving the operation command sent by the target object, the flying machine can also obtain the flight status of the flying machine.
  • the target object may be, for example, the operator who controls the ride-through aircraft.
  • the operation instruction of the target object can be sent through the remote control terminal.
  • the target object can operate the buttons of the remote control terminal to send the operation instruction to the traversing machine.
  • the operation instructions of the target object can also be sent through the flying glasses.
  • the flying glasses can be head-mounted glasses, and the flying glasses can be provided with a touchpad and somatosensory control.
  • the flying glasses can be seamlessly combined with the panoramic function of the flying machine, presenting a panoramic view as if you are in the air overlooking the vast world, and rich multimedia playback.
  • the function can make the audio-visual more shocking.
  • the somatosensory control and panoramic view of the flying glasses can improve the user experience.
  • the flying glasses can obtain operation instructions by judging the operator's gesture or posture. For example, when the operator nods, the operation instructions can be triggered. After the flying glasses obtain the operator's nodding motion, the operation instructions are sent to the drone; When the pilot poses a preset gesture, the goggles can recognize the gesture, match it in the preset gesture pattern library, and after the matching is successful, it can send an operation command to the crossing aircraft.
  • the action triggering the operation instruction includes but is not limited to the nodding action, which can be set according to the user's needs, and the preset gesture mode library can be set according to the needs, and can also be continuously updated according to the needs.
  • the operation instruction can be, for example, a photographing instruction, and the photographing instruction can, for example, be an instruction to select a shooting mode, or it can include a preset object that the user wants to shoot; the operation instruction can also be other commands to control the flying machine, such as controlling the attitude and speed of the flying machine.
  • the operation instructions are not limited in the present disclosure.
  • step S22 when the flight state of the time-travel aircraft is in the preset state, the first shooting parameter of the time-travel aircraft is adjusted to the second shooting parameter.
  • the preset state may be that the traversing machine receives a photographing instruction sent by the user.
  • the aircraft can directly adjust the first shooting parameter of the aircraft to the second shooting parameter, or obtain the flight status of the aircraft after receiving the photographing command sent by the user.
  • Whether to adjust the first shooting parameter of the time-travelling aircraft to the second shooting parameter is determined by judging whether the flight state of the time-travelling aircraft is in the preset state.
  • the embodiment of the present disclosure can transmit the target video to the user for viewing in real time based on a single sensor.
  • the traverse machine can extract the target photo from the target video recorded in real time, and the target photo can be taken as the photo taken by the user.
  • This method can not interrupt the video recording.
  • the first shooting parameter can be adjusted to the second shooting parameter for shooting, and the target video obtained based on the second shooting parameter can be extracted from the target video.
  • the photos obtained from the frames have better picture quality and can meet the needs of users for taking pictures.
  • the preset state may be that the aircraft is in a hovering state or the flight speed of the aircraft is less than a first preset threshold.
  • the preset threshold if the aircraft is in the hovering state or the flight speed of the aircraft is lower than the preset threshold, the default user has a need to take pictures, or the default user wants to see the surrounding environment clearly, the aircraft can switch the shooting parameters at this time to ensure the quality of the picture. .
  • the first preset threshold can be set as required to ensure the flight safety of the crossing aircraft.
  • the drone obtains the flight speed of the drone, and judges whether the drone is in a hovering state or a low-speed flying state based on the flight speed.
  • adjust the first shooting parameter of the drone. is the second shooting parameter.
  • the first shooting parameter of the drone can be adjusted to the second shooting parameter to obtain a target video or target image with better picture quality.
  • the preset state may be that a preset object is photographed by the drone. For example, when the drone shoots a preset object, the first shooting parameter of the drone is adjusted to the second shooting parameter.
  • the preset objects may be buildings, animals and plants, for example.
  • the preset object can be set as required, or set according to the operation instruction sent by the user.
  • the operation command sent by the remote control terminal or the flying glasses may include the preset object as a tree, and when a tree is photographed by the flying machine, the first shooting parameter can be automatically adjusted to the second Shooting parameters to shoot.
  • the preset state of the traversing aircraft may be that the distance between the traversing aircraft and the preset object is less than the second preset threshold.
  • the first shooting parameter of the drone can be adjusted to the second shooting parameter; when the distance information between the drone and the preset object is greater than or equal to the second preset
  • the threshold is set, that is, when the drone is far away from the object to be photographed, the drone keeps the first shooting parameters and continues to shoot.
  • the second preset threshold can be set as required.
  • the preset state of the ride-through machine may be that the ride-through machine is in a steady state.
  • the instrument data obtained by the T-boat may include the jitter information of the T-boat, and whether the T-boat is in a stable state is judged by the jitter information of the T-boat; shooting parameters.
  • adjusting the shooting parameters for shooting can obtain high-quality target video or target photos under the condition of ensuring safety.
  • the preset state of the traversing machine may be that the gimbal is in a steady state.
  • the instrument data obtained by the PTZ may include the jitter information of the PTZ, and whether the PTZ is in a stable state is determined by the jitter information of the PTZ.
  • the first shooting parameter of the PTZ is adjusted to the second one. shooting parameters.
  • the second shooting parameter may be, for example, one or more of shutter speed, light sensitivity, aperture, image sharpening intensity, image noise reduction intensity, image dark area brightening intensity, or focal length.
  • adjusting the first shooting parameter of the traverse plane to the second shooting parameter includes: reducing shutter speed, reducing sensitivity, reducing aperture, reducing image sharpening intensity, reducing image noise reduction intensity, and reducing image dark area enhancement.
  • reducing shutter speed reducing sensitivity
  • reducing aperture reducing image sharpening intensity
  • reducing image noise reduction intensity reducing image dark area enhancement.
  • the shooting parameters of the video are usually set higher, and the target video obtained according to the higher shooting parameters , the target image obtained after frame extraction of the target video is of poor quality.
  • the shooting parameters of the traverse plane By reducing the shooting parameters of the traverse plane, adjusting the first shooting parameters to the second shooting parameters, and shooting according to the adjusted shooting parameters, the target video is obtained, and the target image obtained after the frame is extracted from the target video has a higher quality. Excellent, more in line with the shooting needs of users.
  • the shooting parameters are usually set higher.
  • the speed of the traversing machine is fast when traversing.
  • the shutter speed of the camera is usually set higher and the sensitivity is set higher.
  • the processor processes the image, it will also improve the image. Dark area brightening intensity; the sensitivity and image dark area brightening intensity are set higher, resulting in strong image noise, so the processor will also set the image noise reduction intensity higher, and the image sharpening intensity is set higher .
  • the focal length is set high, for example, the focal length is set to infinity, and the focal length is set to ultra-wide angle.
  • the target video obtained by shooting based on the first shooting parameters can be transmitted to the remote control terminal in real time for the user to watch when the flying machine is flying at high speed. .
  • the obtained target image may have the problem of blurred image quality , does not meet the user's requirements for photos.
  • the obtained target image has better picture quality and is more in line with the user's requirements for photos.
  • the purpose of the preset state set in this application is to identify whether the user needs to take pictures. If the preset state is met, it is recognized that the user has the need to take pictures. Therefore, the shooting parameters of the shooting device when recording are switched to the second one. Shooting parameters, the second shooting parameters are more in line with the user's shooting needs than the first shooting parameters. After switching to the second shooting parameter, the recorded video is more in line with the shooting parameters when taking pictures, and then a picture that meets the user's photographing needs can be extracted from the recorded video stream.
  • the first shooting parameter is switched to the second shooting parameter.
  • the shooting parameters also need to be switched. This is because the shooting parameters of the time-travel aircraft are usually set higher when flying at high speed, and it is obviously unreasonable to continue to use higher shooting parameters to shoot when the aircraft is flying at low speed or even hovering. It is necessary to adjust the shooting parameters to normal.
  • an exposure system can be set in the traverse machine, and the exposure system can intelligently switch the exposure strategy and automatically adjust the shooting parameters of the traverse machine.
  • reducing the sensitivity can reduce the sensitivity from 400 to 100.
  • the obtained target video or target image is simpler in post-processing, and there is no problem of overexposure of local areas.
  • the local area can be the target video or target image. sky area.
  • the focal length can be set to a preset distance, and the focal length can be adjusted from an ultra-wide-angle to a normal wide-angle, so that high-quality target videos and target images can be obtained.
  • the first shooting parameter and the second shooting parameter can be set according to the actual situation.
  • the first shooting parameter can be set according to the flight speed of the time-travel aircraft and the requirements for recording videos
  • the second shooting parameter can be set according to the user's requirements for the quality of the photos. set up.
  • the first shooting parameter is set according to whether the picture taken by the time-travel aircraft can be seen clearly by the user when flying at high speed; the second shooting parameter is set according to the user's requirement for the picture quality of the photographed picture.
  • the high-speed flight may be, for example, that the flight speed of the crossing aircraft is greater than a preset value, and the preset value may be set as required; for example, the first shooting parameter may also be determined according to the resolution of the captured video.
  • step S23 shooting is performed based on the second shooting parameters to obtain a target video.
  • the traversing machine can shoot according to the adjusted second shooting parameters to obtain high-quality target video.
  • the second shooting parameter may be, for example, one or more of shutter speed, sensitivity, aperture, image sharpening intensity, image noise reduction intensity, image dark area brightening intensity, or focal length.
  • the shutter speed of the first shooting parameter is higher than the shutter speed of the second shooting parameter
  • the sensitivity of the first shooting parameter is higher than the sensitivity of the second shooting parameter
  • the aperture of the first shooting parameter is greater than that of the second shooting parameter
  • the aperture of the parameter, the intensity of sharpening the image in the first shooting parameter is greater than the intensity of sharpening the image in the second shooting parameter
  • the intensity of noise reduction processing in the first shooting parameter is greater than the second shooting parameter.
  • the intensity of performing noise reduction processing on the image in the first shooting parameter or the intensity of brightening the dark area of the image in the first shooting parameter is greater than the intensity of brightening the dark area of the image in the second shooting parameter.
  • the obtained target video has less noise.
  • the obtained target video does not have serious distortion problems.
  • the image processing method for the time-travel aircraft by acquiring the flight state of the time-travel aircraft, when the flight state of the time-travel aircraft is in a preset state, adjusting the shooting parameters of the time-travel aircraft, and shooting based on the adjusted shooting parameters, A high-quality target video can be obtained, and the target image obtained according to the target video is of better quality.
  • FIG. 3 is a flowchart of an image processing method for a traversing machine according to an exemplary embodiment of the present disclosure.
  • the image processing method 30 for a pass-through machine shown in FIG. 3 may further include steps S31-S32.
  • step S31 a target image is acquired based on the target video.
  • the target image can be obtained by extracting frames from the target video based on the PIV (Photo In Video, obtaining a photo from a video) technology.
  • PIV Photo In Video, obtaining a photo from a video
  • a high-quality target image can be obtained by extracting frames from a high-quality target video shot by a traverse plane based on the PIV technology, or a target image can be obtained based on the target video based on other technologies.
  • Extracting frames from the target video can be achieved by using image processing tools, such as OpenCV (Open Computer Vision, open source computer vision) tool, which can process the target video according to the preset frame frequency and number of frames to obtain the target image.
  • the target image is a picture taken from the target video.
  • the target image can be set according to the user's needs.
  • the target image can be one or multiple.
  • the target image may be, for example, an image containing a preset object, such as an image of a tree, an image of a building, or the like.
  • the target image may be, for example, an image at a preset position or an image at a preset height.
  • the target image may be, for example, an image captured based on the second capturing parameter.
  • Extracting frames from the target video to obtain the target image may include: determining the number of images to be extracted from the target video based on the duration of the target video; extracting frames from the target video according to the duration of the target video and the number of images to be extracted to obtain the target video image.
  • the relationship between the duration range of the target video and the number of images to be extracted can be preset, the duration of the target video can be obtained, and the number of images to be extracted can be determined according to the duration of the target video and the preset relationship between the duration of the target video and the number of images to be extracted .
  • the extraction interval can be determined according to the duration of the target video and the number of images to be extracted.
  • frames can be extracted from the target video at every decimation interval to obtain the target image.
  • image processing can be performed on the target image, for example, the brightness and contrast of the target image can be adjusted, and the picture size, resolution, and compression rate of the target image can also be adjusted according to user requirements.
  • the method before performing frame extraction processing on the target video, the method may further include: cutting the target video, for example, according to user requirements, the part of the target video that does not meet the user's requirements may be cut off.
  • step S32 the target video or target image is sent or stored.
  • a memory can be provided on the traverse machine for storing the target video shot by the traverse machine and the target image obtained through the target video.
  • the traverse machine can store the target video in the traverse machine, and can send the target video to the remote control terminal or server, and the remote control terminal or server can process the target video to obtain the target image.
  • the traverse machine can store the target video and target image in the traverse machine, and can send the target image to the remote control terminal or server for display or processing.
  • the remote control terminal or server may be provided with a display device, and the display device may be, for example, a display screen or a projection device, etc., which can be used to display the target video or target image sent by the aircraft.
  • the display device may be, for example, a display screen or a projection device, etc., which can be used to display the target video or target image sent by the aircraft.
  • the flying machine can send the target video or target image to the flying glasses, and the flying glasses can show the target video or target image to the user in real time to improve the user experience.
  • the traversing machine can send the target video or target image to the remote control or mobile terminal, the remote control or mobile terminal can display the target video or target image to the user in real time, and the mobile terminal can process and store the target video or target image.
  • the traversing machine can send the target video or target image to the server, and the server can process the target video or target image, for example, can process the target video or target image through PS (Photoshop, image processing software).
  • PS Photoshop, image processing software
  • FIG. 4 is a flowchart of an image processing method for a traversing machine according to an exemplary embodiment of the present disclosure.
  • the image processing method 40 for a pass-through machine shown in FIG. 4 may further include steps S41 - S42 .
  • step S41 when the flying state of the time-travel aircraft is not in the preset state or reaches the preset time, the second shooting parameter of the time-travel aircraft is adjusted to the first shooting parameter of the time-travel aircraft.
  • the second shooting parameter of the time-travelling aircraft may be adjusted to the first shooting parameter.
  • the shooting parameters of the drone can be increased; the distance from the drone to the surrounding objects changes from greater than the second preset threshold to less than or equal to When the second preset threshold is used, the shooting parameters of the flying machine can be increased.
  • the second shooting parameter of the time-travelling machine may be adjusted to the first shooting parameter of the time-travelling machine.
  • the shooting parameter of the riding machine can be increased, wherein the preset time can be set according to actual needs.
  • adjusting the second shooting parameter of the traverse machine to the first shooting parameter includes: increasing the shutter speed, increasing the sensitivity, increasing the aperture, increasing the image sharpening intensity, increasing the image noise reduction intensity, increasing the image dark area improvement One or more of brightness intensity or adjusting focus.
  • step S42 shooting is performed based on the first shooting parameters of the traverse aircraft.
  • the time-travelling aircraft can continue to shoot based on the adjusted first shooting parameters, and adjusting the second shooting parameters of the time-travelling aircraft to the first shooting parameters can ensure the flight safety of the time-travelling aircraft during the flight.
  • FIG. 5 is a flowchart of an image processing method for a traversing machine according to an exemplary embodiment of the present disclosure.
  • the image processing method 50 for a traversing machine shown in FIG. 5 may further include step S51 .
  • step S51 when the flight state of the time-travelling aircraft is not in the preset state, shooting is performed based on the first shooting parameter.
  • the preset state includes that the time-travel aircraft receives a photographing instruction sent by the user, the time-travel aircraft is in a hovering state, the flight speed of the time-travel aircraft is less than a first preset threshold, or the time-travel aircraft captures a preset object.
  • the fly-through machine when it does not receive the photographing instruction sent by the user, it can photograph based on the first photographing parameter.
  • the shooting can be performed based on the first shooting parameter
  • the preset object can be set as required, and the preset object can be, for example, buildings, animals and plants, and the like.
  • the preset state of the traversing aircraft may be that the distance between the traversing aircraft and the preset object is less than the second preset threshold.
  • the first shooting parameter of the drone can be adjusted to the second shooting parameter; when the distance information between the drone and the preset object is greater than or equal to the second preset
  • the threshold is set, that is, when the drone is far away from the object to be photographed, the drone keeps the first shooting parameters and continues to shoot.
  • the second preset threshold can be set as required.
  • the preset state of the aircraft can be that the aircraft is in a hovering state or the flight speed of the aircraft is lower than a first preset threshold, and the first preset threshold can be set as required.
  • the drone can obtain the flight speed of the drone, and determine whether the drone is in a hovering state or a low-speed flying state based on the flight speed. When the drone is in a high-speed flight, shooting can be performed based on the first shooting parameter.
  • the preset state of the drone can be that the drone and the gimbal are in a stable state.
  • the instrument data that can be obtained by the traversing machine can include the jitter information of the traversing machine and the gimbal. It can be judged whether the traversing machine and the gimbal are in a stable state through the jitter information of the traversing machine and the gimbal. , and shooting can be performed based on the first shooting parameter.
  • the image processing method for the time-travel aircraft in the embodiment of the present disclosure can ensure the flight safety of the time-travel aircraft by acquiring the flight state of the time-travel aircraft, and when the flight state of the time-travel aircraft is not in the preset state, shooting based on the first shooting parameters .
  • aspects of the present invention may be implemented as a system, method or program product. Therefore, various aspects of the present invention can be embodied in the following forms: a complete hardware implementation, a complete software implementation (including firmware, microcode, etc.), or a combination of hardware and software aspects, which may be collectively referred to herein as implementations "Module” or "System”.
  • FIG. 6 is a block diagram of a traversing machine according to an exemplary embodiment of the present disclosure.
  • the crossing aircraft 600 may include: a camera 610, a body 620, a power system 630 and an image processing device 640; wherein, the power system 630 may be installed on the body to provide flight power; the image processing device 640 It can be used to: obtain the flight state of the time-travel aircraft; when the flight state of the time-travel aircraft is in a preset state, adjust the first shooting parameter of the time-travel aircraft to the second shooting parameter; shoot based on the second shooting parameter to obtain the target video.
  • the image processing apparatus 640 is further configured to obtain a target image based on the target video.
  • the image processing apparatus 640 is further configured to: send or store a target video or a target image.
  • the image processing device 640 is further configured to: when the flight state of the time-travel aircraft is not in the preset state or reaches a preset time, the second The shooting parameters are adjusted to the first shooting parameters of the time-travel aircraft; the shooting is performed based on the first shooting parameters of the time-travel aircraft.
  • acquiring the flight status of the time-travel aircraft includes: after receiving an operation instruction sent by the target object or periodically, acquiring the flight state of the time-travel aircraft.
  • the image processing device 640 is further configured to: when the flying state of the crossover aircraft is not in the preset state, shoot based on the first shooting parameter.
  • the preset state includes that the aircraft receives a photographing instruction sent by the user, the aircraft is in a hovering state, the flight speed of the aircraft is less than a first preset threshold, or the aircraft has photographed a preset object.
  • adjusting the first shooting parameter of the traverse plane to the second shooting parameter includes: reducing the shutter speed, reducing the sensitivity, reducing the aperture, reducing the image sharpening intensity, reducing the image noise reduction intensity, One or more of reducing the intensity of brightening in dark areas of the image or adjusting the focus.
  • acquiring the flight status of the flying machine includes: acquiring environmental information of the flying machine, wherein the environmental information includes distance information between the flying machine and a preset object; The distance of the object is greater than the second preset threshold.
  • acquiring the flight status of the TRX includes: acquiring navigation data of the TRX; the preset state is a hovering state or the flight speed of the TRX is lower than a first preset threshold.
  • acquiring the flight status of the RTX includes: acquiring instrument data of the RTX, wherein the instrument data includes jitter information of the RTX; and the preset state is that the RTX is in a stable state.
  • acquiring the flight status of the flying machine includes: acquiring instrument data of the flying machine, wherein the instrument data includes jitter information of the gimbal; and the preset state is that the gimbal is in a steady state.
  • acquiring the target image based on the target video includes: extracting frames from the target video based on the PIV technology to acquire the target image.
  • time-travel aircraft of the embodiments of the present disclosure by acquiring the flight state of the time-travel aircraft, when the flight state of the time-travel aircraft is in a preset state, adjusting the shooting parameters of the time-travel aircraft, and shooting based on the adjusted shooting parameters, can ensure flight safety. At the same time, high-quality target video is obtained.
  • the present application further provides an image processing apparatus, where the image processing apparatus includes a processor, and the processor is configured to execute executable program instructions to implement the technical solutions mentioned in the above method embodiments.
  • a program product 700 for implementing the above method according to an embodiment of the present disclosure is described, which can adopt a portable compact disk read only memory (CD-ROM) and include program codes, and can be stored in a terminal device, For example running on a personal computer.
  • a readable storage medium may be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, apparatus, or device.
  • the program product may employ any combination of one or more readable media.
  • the readable medium may be a readable signal medium or a readable storage medium.
  • the readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus or device, or a combination of any of the above. More specific examples (non-exhaustive list) of readable storage media include: electrical connections with one or more wires, portable disks, hard disks, random access memory (RAM), read only memory (ROM), erasable programmable read only memory (EPROM or flash memory), optical fiber, portable compact disk read only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.
  • a computer readable signal medium may include a propagated data signal in baseband or as part of a carrier wave with readable program code embodied thereon. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the foregoing.
  • a readable signal medium can also be any readable medium, other than a readable storage medium, that can transmit, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device.
  • Program code embodied on a readable medium may be transmitted using any suitable medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
  • Program code for performing the operations of the present disclosure may be written in any combination of one or more programming languages, including object-oriented programming languages—such as Java, C++, etc., as well as conventional procedural Programming Language - such as the "C" language or similar programming language.
  • the program code may execute entirely on the user's computing device, partly on the user's device, as a stand-alone software package, partly on the user's computing device and partly on a remote computing device, or entirely on the remote computing device or server execute on.
  • the remote computing device may be connected to the user computing device through any kind of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computing device (eg, using an Internet service provider business via an Internet connection).
  • LAN local area network
  • WAN wide area network
  • an external computing device eg, using an Internet service provider business via an Internet connection
  • modules or units of the apparatus for action performance are mentioned in the above detailed description, this division is not mandatory. Indeed, according to embodiments of the present disclosure, the features and functions of two or more modules or units described above may be embodied in one module or unit. Conversely, the features and functions of one module or unit described above may be further divided into multiple modules or units to be embodied.
  • the units described as separate components may or may not be physically separated, and components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solutions of the embodiments of the present disclosure.
  • each functional unit in each embodiment of the present disclosure may be integrated into one processing unit, or each unit may exist physically alone, or two or more units may be integrated into one unit.
  • the above-mentioned integrated units may be implemented in the form of hardware, or may be implemented in the form of software functional units.

Abstract

L'invention porte sur un procédé de traitement d'image et sur un appareil de traitement d'image pour un drone de course, sur le drone de course, sur un système d'optimisation d'image et sur un support de stockage lisible par ordinateur. Le procédé de traitement d'image pour le drone de course consiste : à acquérir l'état de vol du drone de course (S21), le drone de course utilisant un premier paramètre de photographie pour effectuer une photographie et le premier paramètre de photographie étant lié à la vitesse de vol du drone de course ; lorsque l'état de vol du drone de course est dans un état prédéfini, à régler le premier paramètre de photographie du drone de course pour qu'il soit un second paramètre de photographie (S22), le second paramètre de photographie étant associé à la qualité d'image ; et à faire des photos sur la base du second paramètre de photographie pour obtenir une vidéo cible (S23). Le procédé peut obtenir des vidéos cibles de haute qualité tout en assurant une sécurité de vol.
PCT/CN2020/103091 2020-07-20 2020-07-20 Procédé et appareil de traitement d'image, drone de course, système d'optimisation d'image et support de stockage WO2022016334A1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN202080005876.9A CN112913221A (zh) 2020-07-20 2020-07-20 图像处理方法、装置、穿越机、图像优化系统及存储介质
PCT/CN2020/103091 WO2022016334A1 (fr) 2020-07-20 2020-07-20 Procédé et appareil de traitement d'image, drone de course, système d'optimisation d'image et support de stockage

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2020/103091 WO2022016334A1 (fr) 2020-07-20 2020-07-20 Procédé et appareil de traitement d'image, drone de course, système d'optimisation d'image et support de stockage

Publications (1)

Publication Number Publication Date
WO2022016334A1 true WO2022016334A1 (fr) 2022-01-27

Family

ID=76112924

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/103091 WO2022016334A1 (fr) 2020-07-20 2020-07-20 Procédé et appareil de traitement d'image, drone de course, système d'optimisation d'image et support de stockage

Country Status (2)

Country Link
CN (1) CN112913221A (fr)
WO (1) WO2022016334A1 (fr)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105516595A (zh) * 2015-12-23 2016-04-20 小米科技有限责任公司 拍摄方法及装置
CN105959587A (zh) * 2016-05-27 2016-09-21 北京小米移动软件有限公司 快门速度获取方法和装置
CN108476288A (zh) * 2017-05-24 2018-08-31 深圳市大疆创新科技有限公司 拍摄控制方法及装置
US20190281209A1 (en) * 2016-12-02 2019-09-12 SZ DJI Technology Co., Ltd. Photographing control method, apparatus, and control device
CN110291776A (zh) * 2018-05-30 2019-09-27 深圳市大疆创新科技有限公司 飞行控制方法及飞行器

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105516595A (zh) * 2015-12-23 2016-04-20 小米科技有限责任公司 拍摄方法及装置
CN105959587A (zh) * 2016-05-27 2016-09-21 北京小米移动软件有限公司 快门速度获取方法和装置
US20190281209A1 (en) * 2016-12-02 2019-09-12 SZ DJI Technology Co., Ltd. Photographing control method, apparatus, and control device
CN108476288A (zh) * 2017-05-24 2018-08-31 深圳市大疆创新科技有限公司 拍摄控制方法及装置
CN110291776A (zh) * 2018-05-30 2019-09-27 深圳市大疆创新科技有限公司 飞行控制方法及飞行器

Also Published As

Publication number Publication date
CN112913221A (zh) 2021-06-04

Similar Documents

Publication Publication Date Title
WO2020177583A1 (fr) Procédé de recadrage d'image et dispositif électronique
US20170195561A1 (en) Automated processing of panoramic video content using machine learning techniques
US10402445B2 (en) Apparatus and methods for manipulating multicamera content using content proxy
WO2020076356A1 (fr) Systèmes et procédés pour fournir une rétroaction pour des dispositifs de capture d'image basée sur l'intelligence artificielle
JP2019106694A (ja) 撮像装置およびその制御方法
US20200059595A1 (en) Computational processing device and computational processing method
US11258949B1 (en) Electronic image stabilization to improve video analytics accuracy
WO2018133589A1 (fr) Dispositif, procédé de photographie aérienne, et véhicule aérien sans pilote
US9871994B1 (en) Apparatus and methods for providing content context using session metadata
US20200314331A1 (en) Image capturing apparatus, method for controlling the same, and storage medium
US9787862B1 (en) Apparatus and methods for generating content proxy
US20180124316A1 (en) Omnidirectional camera with movement detection
US10602064B2 (en) Photographing method and photographing device of unmanned aerial vehicle, unmanned aerial vehicle, and ground control device
WO2023041013A1 (fr) Procédé et appareil de capture de vidéo utilisant un véhicule aérien sans pilote, et véhicule aérien sans pilote et support de stockage
GB2599012A (en) Image processing apparatus, and control method, program and storage medium thereof
WO2019065454A1 (fr) Dispositif d'imagerie et procédé de commande associé
US20220368825A1 (en) Image capturing apparatus, method for controlling the same, and storage medium
TW202239184A (zh) 成像裝置和系統、捕獲圖像的方法以及電腦可讀儲存媒體
US11463617B2 (en) Information processing apparatus, information processing system, image capturing apparatus, information processing method, and memory
US20210152750A1 (en) Information processing apparatus and method for controlling the same
CN110809797B (zh) 微视频系统、格式和生成方法
CN110933297A (zh) 智能摄影系统的摄影控制方法、装置、存储介质及系统
CN112235510A (zh) 拍摄方法、装置、电子设备和介质
WO2022016334A1 (fr) Procédé et appareil de traitement d'image, drone de course, système d'optimisation d'image et support de stockage
CN108419052B (zh) 一种多台无人机全景成像方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20946130

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20946130

Country of ref document: EP

Kind code of ref document: A1