WO2021056297A1 - Procédé et dispositif de traitement d'image, véhicule aérien sans pilote, système et support de stockage - Google Patents

Procédé et dispositif de traitement d'image, véhicule aérien sans pilote, système et support de stockage Download PDF

Info

Publication number
WO2021056297A1
WO2021056297A1 PCT/CN2019/107977 CN2019107977W WO2021056297A1 WO 2021056297 A1 WO2021056297 A1 WO 2021056297A1 CN 2019107977 W CN2019107977 W CN 2019107977W WO 2021056297 A1 WO2021056297 A1 WO 2021056297A1
Authority
WO
WIPO (PCT)
Prior art keywords
light intensity
image
spectral
multispectral camera
wavebands
Prior art date
Application number
PCT/CN2019/107977
Other languages
English (en)
Chinese (zh)
Inventor
龚云
潘国秀
Original Assignee
深圳市大疆创新科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市大疆创新科技有限公司 filed Critical 深圳市大疆创新科技有限公司
Priority to CN201980032030.1A priority Critical patent/CN112106346A/zh
Priority to PCT/CN2019/107977 priority patent/WO2021056297A1/fr
Publication of WO2021056297A1 publication Critical patent/WO2021056297A1/fr

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70—Circuitry for compensating brightness variation in the scene
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/17—Systems in which incident light is modified in accordance with the properties of the material investigated
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/17—Systems in which incident light is modified in accordance with the properties of the material investigated
    • G01N21/25—Colour; Spectral properties, i.e. comparison of effect of material on the light at two or more different wavelengths or wavelength bands
    • G01N21/31—Investigating relative effect of material at wavelengths characteristic of specific elements or molecules, e.g. atomic absorption spectrometry
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/17—Systems in which incident light is modified in accordance with the properties of the material investigated
    • G01N21/25—Colour; Spectral properties, i.e. comparison of effect of material on the light at two or more different wavelengths or wavelength bands
    • G01N21/31—Investigating relative effect of material at wavelengths characteristic of specific elements or molecules, e.g. atomic absorption spectrometry
    • G01N21/35—Investigating relative effect of material at wavelengths characteristic of specific elements or molecules, e.g. atomic absorption spectrometry using infrared light
    • G01N21/3563—Investigating relative effect of material at wavelengths characteristic of specific elements or molecules, e.g. atomic absorption spectrometry using infrared light for analysing solids; Preparation of samples therefor
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/17—Systems in which incident light is modified in accordance with the properties of the material investigated
    • G01N21/25—Colour; Spectral properties, i.e. comparison of effect of material on the light at two or more different wavelengths or wavelength bands
    • G01N21/31—Investigating relative effect of material at wavelengths characteristic of specific elements or molecules, e.g. atomic absorption spectrometry
    • G01N21/35—Investigating relative effect of material at wavelengths characteristic of specific elements or molecules, e.g. atomic absorption spectrometry using infrared light
    • G01N21/359—Investigating relative effect of material at wavelengths characteristic of specific elements or molecules, e.g. atomic absorption spectrometry using infrared light using near infrared light
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/10—Terrestrial scenes
    • G06V20/188—Vegetation
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/17—Systems in which incident light is modified in accordance with the properties of the material investigated
    • G01N2021/1765—Method using an image detector and processing of image signal
    • G01N2021/177—Detector of the video camera type

Definitions

  • the present invention relates to the field of images, in particular to an image processing method, equipment, unmanned aerial vehicle, system and storage medium.
  • a drone when a drone is flying over an object, it can obtain an aerial image of the object. Due to some shooting reasons, the imaging effect of the image will be poor. In order to improve the imaging effect, the image can be compensated.
  • the UAV In order to effectively compensate for the aerial image, the UAV also needs to obtain multiple image compensation information when acquiring the aerial image, but not all the image compensation information can be obtained to compensate the image more accurately, which is easy to cause larger compensation error.
  • the present invention provides an image processing method, equipment, unmanned aerial vehicle, system and storage medium, which are used to solve the problem of more accurate image compensation.
  • the first aspect of the present invention is to provide an image processing method, including: acquiring the light intensity of multiple preset wavebands of the current environment; and determining at least the light intensity of the multispectral camera according to the light intensity of the multiple preset wavebands The light intensity corresponding to a spectral waveband; according to the light intensity corresponding to the spectral waveband of the multi-spectral camera, image compensation processing is performed on the current image acquired by the multi-spectral camera.
  • the second aspect of the present invention is to provide an image processing device, including: a light collection device for acquiring light intensity of multiple preset wavebands of the current environment; receiving light intensity of multiple incident wavebands; the image processing device It also includes: a memory and a processor, the memory is configured to store a computer program; the processor is configured to determine, according to the light intensity of the plurality of preset wavelength bands, at least one spectral band corresponding to the multispectral camera Light intensity; according to the light intensity corresponding to the spectral band of the multi-spectral camera, perform image compensation processing on the current image acquired by the multi-spectral camera.
  • the third aspect of the present invention is to provide an image processing device, including: an acquisition module for acquiring the light intensity of multiple preset wavebands of the current environment; The light intensity determines the light intensity corresponding to at least one spectral band of the multi-spectral camera; the compensation module is configured to perform image compensation on the current image acquired by the multi-spectral camera according to the light intensity corresponding to the spectral band of the multi-spectral camera deal with.
  • the fourth aspect of the present invention is to provide an unmanned aerial vehicle, including: a body and the image processing device according to the second aspect, the image processing device is provided on the body.
  • the fifth aspect of the present invention is to provide a computer-readable storage medium, the storage medium is a computer-readable storage medium, the computer-readable storage medium stores program instructions, and the program instructions are used in the first aspect.
  • the sixth aspect of the present invention is to provide an image processing method, including: receiving, through a drone, the illumination intensity of multiple preset wavebands of the current environment and the illumination intensity corresponding to at least one spectral waveband of the multispectral camera, the at least The light intensity corresponding to a spectral waveband is determined according to the light intensity of the multiple preset wavebands; according to the light intensity corresponding to the spectral waveband of the multispectral camera, the current image acquired by the multispectral camera is imaged Compensation processing; when the processed image is an image of vegetation, the vegetation growth index is determined according to the band feature extraction of the processed image.
  • the seventh aspect of the present invention is to provide an image processing system, including: a memory, a processor, and a communication component.
  • the memory is used to store a computer program;
  • the communication component is used to receive the light intensity of multiple preset wavebands of the current environment and the light intensity corresponding to at least one spectral waveband of the multispectral camera through the drone, and the at least The light intensity corresponding to a spectral band is determined according to the light intensity of the multiple preset wavebands;
  • the processor is configured to perform a measurement on the multi-spectral camera according to the light intensity corresponding to the spectral waveband of the multi-spectral camera.
  • the current image acquired by the camera is subjected to image compensation processing; when the processed image is an image of vegetation, the vegetation growth index is determined according to the band feature extraction of the processed image.
  • the eighth aspect of the present invention is to provide a computer-readable storage medium, characterized in that the storage medium is a computer-readable storage medium, and the computer-readable storage medium stores program instructions, and the program instructions are used for Implement the image processing method described in the sixth aspect.
  • the ninth aspect of the present invention is to provide an image processing device, including: a receiving module for receiving, through the drone, the illumination intensity of multiple preset wavebands of the current environment and the illumination corresponding to at least one spectral waveband of the multispectral camera Intensity, the light intensity corresponding to at least one spectral band is determined according to the light intensity of multiple preset bands; the compensation module is used to image the current image acquired by the multi-spectral camera according to the light intensity corresponding to the spectral band of the multi-spectral camera Compensation processing; extraction module, used when the processed image is an image of vegetation, and determine the vegetation growth index according to the band feature extraction of the processed image.
  • the image processing method, equipment, drone, system and storage medium provided by the invention can improve the imaging effect of the image.
  • FIG. 1 is a schematic flowchart of an image processing method provided by an embodiment of the present invention
  • FIG. 2 is a schematic diagram of a process for determining light intensity according to an embodiment of the present invention
  • FIG. 3 is a schematic diagram of a specific flow of image compensation processing provided by an embodiment of the present invention.
  • FIG. 4 is a schematic diagram of a specific flow of image compensation processing provided by an embodiment of the present invention.
  • FIG. 5 is a schematic structural diagram of an image processing device provided by an embodiment of the present invention.
  • FIG. 6 is a schematic structural diagram of an image processing device provided by an embodiment of the present invention.
  • FIG. 7 is a schematic flowchart of an image processing method provided by an embodiment of the present invention.
  • FIG. 8 is a schematic structural diagram of an image processing device provided by an embodiment of the present invention.
  • FIG. 9 is a schematic structural diagram of an image processing system provided by an embodiment of the present invention.
  • the drone can carry multiple imaging sensors.
  • the imaging sensor can generate the corresponding aerial image of the object through the reflected light of the object.
  • the UAV can also carry a light sensor.
  • the UAV can provide multiple real-time incident light intensity indexes of different bands. By selecting the real-time incident light intensity index, the aerial image can be compensated for compensation. Aerial image of the object behind. However, this compensation method is likely to cause large compensation errors, and the compensation effect often obtained is not ideal.
  • Fig. 1 is a schematic flowchart of an image processing method provided by an embodiment of the present invention
  • the method 100 provided by an embodiment of the present application can be executed by a flying device, such as a drone, and the drone can be provided with a light collection device, such as Light sensor.
  • Multiple image acquisition devices such as multiple image sensors, can also be provided on the drone.
  • Multiple image acquisition devices can be provided in the camera, and the camera can be provided on the drone.
  • the method 100 includes the following steps:
  • Step 101 Obtain the light intensity of multiple preset wavebands in the current environment.
  • Step 102 Determine the light intensity corresponding to at least one spectral waveband of the multispectral camera according to the light intensity of multiple preset wavebands.
  • Step 103 Perform image compensation processing on the current image acquired by the multispectral camera according to the light intensity corresponding to the spectral band of the multispectral camera.
  • the image processing method provided by the present invention determines the light intensity corresponding to at least one spectral waveband of the multispectral camera according to the acquired light intensity of multiple preset wavebands; according to the light intensity corresponding to the spectral waveband of the multispectral camera,
  • the current image acquired by the multispectral camera is subjected to image compensation processing, thereby solving the problem that the light intensity of the preset waveband cannot meet the more accurate compensation of the current image.
  • it can be selected from the light intensity of multiple preset wavebands. It can more accurately compensate the light intensity of the image.
  • performing image compensation processing on the current image can make the compensated image more accurately approach the real image, reduce compensation errors, and improve the imaging effect of the image. So as to further provide more accurate data for data analysis in subsequent images.
  • the embodiments of this application can also be applied to other equipment with shooting requirements, such as cameras, mobile phones, computers, monitoring equipment, etc., no matter what kind of execution device, the execution device Both can have a light collection device, and can also have multiple image collection devices as well.
  • the drone when the drone executes the embodiments of the present application, it can capture aerial images of objects, especially aerial images of vegetation, so that the distribution and growth conditions of vegetation can be analyzed.
  • drones have better flexibility and automation compared to other execution equipment. And it can fly into a very harsh geographic environment to take images, which is not easy to do with other execution equipment.
  • Step 101 Obtain the light intensity of multiple preset wavebands in the current environment.
  • the band refers to the division of the electromagnetic spectrum, especially the division of the light spectrum, for example, the 840nm (nanometer) band.
  • the preset waveband also referred to as the incident waveband refers to multiple known wavebands that are directly incident or irradiated by light waves in the current environment, for example, the 860nm waveband.
  • the preset waveband that is, the light intensity of multiple preset wavebands is obtained from the light sensor
  • the light collection device provided on the drone.
  • the light collection device can provide multiple preset wavebands of light intensity, such as 18, then when the light collection device acquires the preset waveband, it can directly obtain the waveband that meets the preset waveband length, for example, the preset 18 wavebands . Or when the light collecting device can collect a waveband within a range of waveband length, it can sequentially obtain 18 preset wavebands existing in the waveband length in the order of receiving. It should be understood that one preset waveband corresponds to one light intensity.
  • Illumination intensity refers to the energy of visible light received per unit area, referred to as illuminance; it can be used to indicate the intensity of illumination and the amount of illumination of the surface area of an object.
  • Step 102 Determine the light intensity corresponding to at least one spectral waveband of the multispectral camera according to the light intensity of multiple preset wavebands.
  • a multi-spectral camera refers to a camera that can receive multiple preset spectral bands (that is, spectral bands), and the camera can perform imaging according to the received multiple preset spectral bands.
  • the received spectral band also called the received reflection band
  • the received spectral band refers to the light wave irradiated on an object, such as vegetation, and the light wave band reflected by the vegetation, such as the 840nm (nanometer) band.
  • the light intensity of the spectral waveband can be obtained by using an image acquisition device provided in a multispectral camera, such as a narrowband image sensor.
  • Each image acquisition device corresponds to a spectral band, which can also be referred to as the working band of the image acquisition device.
  • FIG. 2 shows a method 200 for determining light intensity.
  • the method for determining light intensity corresponding to multiple spectral bands may include: Step 201: When multiple preset wavebands in the current environment and the multi-spectral camera receive When the two spectral bands do not match, two first preset wavebands are selected from a plurality of preset wavebands; Step 202: Determine the first light intensity corresponding to the first spectral waveband of the multispectral camera according to the two first preset wavebands.
  • the first spectral band belongs to one of the multiple spectral bands, and its light intensity is the first light intensity.
  • the first spectral band does not match each of the plurality of preset bands.
  • the first preset waveband is at least one waveband among a plurality of preset wavebands, and the first preset waveband does not match the first spectral waveband.
  • mismatch may be a complete mismatch or an incomplete match, that is, a partial mismatch and a partial match exist at the same time.
  • the first preset waveband is different from the first spectral waveband.
  • the UAV compares the narrowband bands (that is, spectral bands) corresponding to 5 narrowband image sensors with 18 different preset bands, when there are at least one narrowband band and 18 narrowband bands in the 5 narrowband bands.
  • Each of the different preset wavebands is different.
  • the narrowband waveband 840nm does not exist in the 18 different preset wavebands.
  • the UAV selects the light intensity of any two preset wavebands from the light intensity of 18 different preset wavebands, such as the light intensity of 860nm and the light intensity of 810nm. Determine the average value of the light intensity of the two preset wavebands as the first light intensity.
  • the method for determining the first light intensity may include the following two:
  • the linear interpolation method can be used to calculate the first light intensity according to the two first preset wavebands.
  • the linear interpolation method can be determined by the following formula 1):
  • x is the first spectral band
  • x 1 , x 2 are two different preset bands
  • f(x) is the first light intensity corresponding to the first spectral band
  • f(x 1 ) is x 1
  • the light intensity corresponding to the preset waveband x 1 , f(x 2 ) represents the light intensity corresponding to the preset wave band x 2.
  • the preset band x 1 ⁇ the preset band x 2 .
  • the UAV compares the narrowband bands (that is, spectral bands) corresponding to the 5 narrowband image sensors with 18 different preset bands.
  • Each of the preset wavebands is different.
  • the narrowband waveband 840nm does not exist in 18 different preset wavebands.
  • the drone selects the light intensity of any two different preset wavebands from the light intensity of 18 different preset wavebands, such as the light intensity of 860nm and the light intensity of 810nm.
  • the UAV determines the value of the first light intensity f(x) in the narrowband band of 840nm through the above formula 2).
  • the method of determining the first light intensity according to the ratio in the manner 2) can also be implemented through the specific implementation manner of the manner 1), which will not be repeated here.
  • the above-mentioned implementation basis for determining the light intensity has been able to determine the light intensity in the spectral band with a relatively precise degree.
  • the UAV can select the two presets closest to 840nm from the light intensity of the 18 different preset bands. Bands, 860nm and 810nm. Then, determine the value of the first light intensity f(x) in the narrowband wavelength band of 840nm through the above formula 2).
  • determining the light intensity corresponding to multiple spectral bands includes: obtaining the first spectral band from a multi-spectral camera; When the second preset waveband in the preset waveband matches the first spectral waveband of the multispectral camera, the first light intensity of the first spectral waveband is directly determined according to the second light intensity of the second preset waveband.
  • the second preset waveband among the multiple preset wavebands of the current environment matches the first spectral waveband of the multispectral camera, the second preset waveband is the same as the first spectral waveband.
  • the UAV determines that the narrowband band 840nm exists in 18 different preset bands, that is, the UAV receives the light intensity of the preset band 840nm through the light sensor, then the UAV The light intensity of the preset wavelength band of 840 nm is directly obtained as the light intensity of the narrowband wavelength band of 840 nm.
  • the monochrome image generated by the narrowband image sensor may have the problem of bad pixels, and the lack of clarity of each object in the image, it is necessary to compensate the monochrome image in order to facilitate the subsequent extraction of various information in the image. .
  • Step 103 Perform image compensation processing on the current image acquired by the multispectral camera according to the light intensity corresponding to the spectral band of the multispectral camera.
  • the light intensity corresponding to the spectral band of the multispectral camera may refer to the light intensity determined according to the foregoing embodiment, such as the light intensity determined by linear interpolation. It can also refer to determining the light intensity and the received light intensity of the spectral band, and the received light intensity is used to determine the image before compensation, that is, the current image.
  • the method of acquiring the current image may include: the multispectral camera receives the light intensity of multiple spectral bands, and obtains the light intensity of at least one preset spectral band from the received light intensity of the multiple spectral bands; One light intensity generates at least one image; according to the at least one image, the current image is acquired (that is, the second light intensity corresponding to the first spectral band is acquired through the multispectral camera, and the current image is acquired according to the second light intensity).
  • the way to obtain the current image may include:
  • the drone flies over the vegetation, and receives the light intensity of 20 vegetation reflection bands through the 5 narrowband image sensors in its multi-spectral camera.
  • the narrowband band corresponding to each narrowband image sensor can be different.
  • the narrowband band corresponding to the A narrowband image sensor is 450nm (that is, the spectral band), the narrowband band corresponding to the B narrowband image sensor is 560nm, and the narrowband band corresponding to the C narrowband image sensor is 640nm.
  • the narrowband waveband corresponding to the D narrowband image sensor is 730nm, and the narrowband waveband corresponding to the E narrowband image sensor is 840nm.
  • Each narrowband image sensor recognizes the corresponding narrowband spectral band and the light intensity of the spectral band.
  • the narrowband image sensor A recognizes the light intensity at the 450nm spectral band, and converts the light intensity into electric charge through the many photosensitive units of the image sensor.
  • each photosensitive unit can also be called a pixel unit.
  • the corresponding monochrome image in TIFF format is determined, such as a red image of vegetation growing in aerial photography.
  • each narrowband image sensor generates a corresponding monochrome image of vegetation aerial growth.
  • the 5 vegetation aerial growth monochrome images can be directly used as one target image, waiting for image compensation for each monochrome image, or they can be used as five target images.
  • multiple images can be combined according to the spatial position of each image sensor to synthesize a complete vegetation aerial growth monochrome image. For example, if five narrowband image sensors are arranged horizontally in sequence, the monochrome images generated by each image sensor are arranged horizontally to synthesize a complete monochrome image.
  • the narrowband image sensor may be a 2 million pixel global shutter image sensor, and may have a certain spatial arrangement layout.
  • image compensation processing for the current image may include the following two types:
  • Fig. 3 show a method 300 of image compensation processing, which includes: Step 301: Compensate for the second light intensity according to the first light intensity; Step 302: Compensate for the current image according to the compensated second light intensity Perform image compensation processing.
  • the UAV determines the light intensity corresponding to the narrowband waveband
  • it can directly use the value of the light intensity as the digital signal obtained by the corresponding narrowband image sensor (for example, a narrowband image sensor with a narrowband waveband of 840nm).
  • Data that is, compensated digital signal.
  • the compensated digital signal is combined with the original digital signal corresponding to the narrowband 840nm (ie, the digital signal corresponding to the band before image compensation), and a monochrome image is generated according to the data of the combined digital signal.
  • Manner 2 and Figure 4 show a method 400 of image compensation processing, which includes: Step 401: Obtain the second light intensity corresponding to the first spectral band from the multispectral camera; Step 402: According to the first light intensity and the second light intensity Intensity, perform image compensation processing on the current image acquired by the multispectral camera.
  • the drone can generate the current image according to the acquired second light intensity.
  • the UAV directly generates a compensated monochrome image from the compensated digital signal data, and combines the compensated monochrome image with the current image to complete the image compensation. It can also be implemented according to the specific implementation in the above manner 1), which will not be repeated here.
  • the second light intensity corresponding to the first spectral waveband can be used to generate the current image
  • the first light intensity corresponding to the first spectral waveband refers to the light intensity used to compensate the current image.
  • the compensated image can be more accurate, especially closer to the real image, or the real appearance of the object, especially the real aerial appearance of the object.
  • the compensated image can be processed differently according to different subsequent application scenarios. For example, in an application scenario of vegetation growth, the vegetation growth condition can be determined according to the compensated image. It is also possible to identify and track things to be monitored on the compensated image in the monitoring application scenario. It is also possible to retouch the compensated image in the application scene of photography. It is worth noting that in some application scenes, such as monitoring application scenes and photographing application scenes, it is possible to further perform color image processing on the compensated monochrome image, that is, to de-monochrome the compensated monochrome image. Color processing to obtain a compensated color image.
  • an application scenario of vegetation growth is taken as an example to describe the image processing after compensation:
  • the processing method may include: when the processed image is an image of vegetation, the vegetation growth index is determined according to the extraction of the band characteristics of the processed image.
  • the vegetation growth index (NDVI, Normalized Difference Vegetation Index) refers to the growth state of vegetation (one of the important parameters reflecting vegetation growth and nutritional information), vegetation coverage, and the elimination of some radiation errors. It can reflect the background influence of the plant canopy, such as soil, wet ground, snow, dead leaves, roughness, etc., and is related to vegetation cover.
  • the extraction process can be as follows. After the UAV obtains the compensated vegetation aerial monochromatic image, extracts the spectral features of the monochromatic image, and determines the NDVI based on the spectral features. Among them, NDVI is the sum of the difference between the reflection value of the near-infrared waveband and the reflection value of the red light waveband.
  • the NDVI can also be determined by other devices.
  • the NDVI is determined by other devices, such as image recognition devices (specifically, computers and servers), no The human-computer sends the compensated vegetation aerial monochrome image to the image recognition device through the network, and the image recognition device determines the NDVI.
  • image recognition devices specifically, computers and servers
  • the specific implementation of the determination process is the same as the specific implementation of the drone to determine the NDVI. Go into details again.
  • the embodiments of the present application may be applicable to different drone models, and the NDVI obtained by aerial photography of the same vegetation at different flight times by different drones is the same. Therefore, it is possible to detect the NDBVI of a certain vegetation obtained in a certain aerial photography according to this characteristic.
  • the detection process may include: determining multiple vegetation growth indexes corresponding to the same vegetation through different flight equipment and/or different flight times; If multiple vegetation growth indexes are the same, confirm that the vegetation growth index is correct. When it is determined that multiple NDVI of the same vegetation are the same, the NDVI is correct.
  • FIG. 5 is a schematic structural diagram of an image processing device provided by an embodiment of the present invention; the device 500 can be applied to flying equipment, such as a drone, and the device 500 can execute the above-mentioned image processing method.
  • the device 500 includes: an acquisition module 501, a determination module 502, and a compensation module 503. The following is a detailed description of the functions of each module:
  • the obtaining module 501 is configured to obtain the light intensity of multiple preset wavebands in the current environment.
  • the determining module 502 is configured to determine the light intensity corresponding to at least one spectral waveband of the multispectral camera according to the light intensity of multiple preset wavebands.
  • the compensation module 503 is configured to perform image compensation processing on the current image acquired by the multi-spectral camera according to the light intensity corresponding to the spectral band of the multi-spectral camera.
  • the structure of the image processing apparatus 500 shown in FIG. 5 may be implemented as an electronic device, and the electronic device may be an image processing device, such as various devices such as a mobile phone, a tablet computer, and a server.
  • the image processing device 600 may include: one or more processors 601, one or more memories 602, and a light collecting device 603.
  • the memory 602 is used to store a program that supports the electronic device to execute the image processing method provided in the embodiment shown in FIG. 1 to FIG. 4 above.
  • the electronic device may also include a camera 604; the camera includes an image acquisition device; and the processor 601 is configured to execute a program stored in the memory 602.
  • the program includes one or more computer instructions, where one or more computer instructions can implement the following steps when executed by the processor 601:
  • the light collecting device 603 is configured to obtain the light intensity of multiple preset wavebands in the current environment; and receive the light intensity of multiple incident wavebands.
  • the processor 601 is specifically configured to: when multiple preset wavebands of the current environment and multiple spectral wavebands received by the multispectral camera do not match, select two first preset wavebands from the multiple preset wavebands , And determine the first light intensity corresponding to the first spectral waveband of the multispectral camera according to the two first preset wavebands.
  • the image processing device 600 further includes: a communication component; the communication component is configured to obtain the second light intensity corresponding to the first spectral band through the multi-spectral camera, and obtain the current image according to the second light intensity.
  • the processor 601 is specifically configured to: compensate the second light intensity according to the first light intensity; and perform image compensation processing on the current image according to the compensated second light intensity.
  • the communication component is used to obtain the second light intensity corresponding to the first spectral band from the multi-spectral camera.
  • the processor 601 is specifically configured to: perform image compensation processing on the current image acquired by the multispectral camera according to the first light intensity and the second light intensity.
  • the processor 601 is further configured to: use a linear interpolation method to calculate the first light intensity according to the two first preset wavebands.
  • the processor 601 is specifically configured to determine the first light intensity according to the ratio of the difference between the light intensity of the two first preset wavebands and the difference between the two first preset wavebands.
  • the two first preset wavebands are closest to the first spectral waveband.
  • the communication component is also used to: obtain the first spectral band from the multispectral camera;
  • the processor 601 is specifically configured to: when the second preset waveband of the multiple preset wavebands of the current environment matches the first spectral waveband of the multispectral camera, directly determine the second light intensity of the second preset waveband The first light intensity in a spectral band.
  • the light intensity of a plurality of preset wavebands is obtained from the light sensor.
  • the processor 601 is further configured to: when the processed current image is an image about vegetation, determine the vegetation growth index according to the band feature extraction of the processed image.
  • the processor 601 is further configured to: determine multiple vegetation growth indices corresponding to the same vegetation through different flying equipment and/or different flight times; when the multiple vegetation growth indices are the same, determine that the vegetation growth index is correct.
  • an embodiment of the present invention provides a computer-readable storage medium, the storage medium is a computer-readable storage medium, the computer-readable storage medium stores program instructions, and the program instructions are used to implement the images shown in FIGS. 1 to 4 above. Approach.
  • An embodiment of the present invention provides an unmanned aerial vehicle; specifically, the unmanned aerial vehicle includes a body and the image processing device shown in FIG. 6, and the image processing device is arranged on the body.
  • the UAV also includes: a multi-spectral camera; a multi-spectral camera, used to provide the image processing device with a current image and used to determine the light intensity of the current image; the light intensity is determined by the spectral band obtained by the multi-spectral camera.
  • FIG. 7 is a schematic flowchart of an image processing method provided by an embodiment of the present invention
  • the method 700 provided by an embodiment of the present application is executed by an image processing system with computing capabilities, such as a computer and a server, etc., or a virtual server, Cloud server, etc.
  • the method 700 includes the following steps:
  • the vegetation growth index is determined according to the band feature extraction of the processed image.
  • the method 700 can be executed by a device, such as a computer.
  • the computer When the computer is executed, it needs to receive the light intensity of multiple preset wavebands and the light intensity of at least one spectral waveband sent by the drone.
  • the light intensity of multiple preset wavebands and the light intensity of at least one spectral waveband are obtained by the drone through the specific implementation described above.
  • the computer After receiving this information, the computer can perform image compensation and determine the vegetation growth index.
  • FIG. 8 is a schematic structural diagram of an image processing device provided by an embodiment of the present invention
  • the device 800 can be applied to image processing systems with computing capabilities, such as computers and servers, and also virtual servers, cloud servers, etc.
  • the device 800 can execute the above-mentioned image processing method.
  • the device 800 includes: a receiving module 801, a compensation module 802, and an extraction module 803. The following is a detailed description of the functions of each module:
  • the receiving module 801 is configured to receive the light intensity of multiple preset wavebands of the current environment and the light intensity corresponding to at least one spectral waveband of the multispectral camera through the drone, and the light intensity corresponding to the at least one spectral waveband is based on the multiple presets The light intensity of the band is determined.
  • the compensation module 802 is configured to perform image compensation processing on the current image acquired by the multispectral camera according to the light intensity corresponding to the spectral band of the multispectral camera.
  • the extraction module 803 is used to determine the vegetation growth index according to the extraction of the band characteristics of the processed image when the processed image is an image about vegetation.
  • the structure of the image processing apparatus 800 shown in FIG. 8 can be implemented as an electronic device, and the electronic device can be an image processing system, such as various devices such as a mobile phone, a tablet computer, and a server.
  • the image processing system 900 may include: one or more processors 901, one or more memories 902, and one or more communication components 903.
  • the memory 902 is used to store a program that supports the electronic device to execute the image processing method provided in the embodiment shown in FIG. 7.
  • the processor 901 is configured to execute a program stored in the memory 902.
  • the program includes one or more computer instructions, and when one or more computer instructions are executed by the processor 901, the following steps can be implemented:
  • the communication component 903 is configured to receive the light intensity of multiple preset wavebands of the current environment and the light intensity corresponding to at least one spectral waveband of the multispectral camera through the drone, and the light intensity corresponding to the at least one spectral waveband is based on the multiple presets The light intensity of the band is determined.
  • an embodiment of the present invention provides a computer-readable storage medium.
  • the storage medium is a computer-readable storage medium.
  • the computer-readable storage medium stores program instructions. The program instructions are used to implement the image processing method of FIG. 7 described above.
  • the related detection device for example: IMU
  • the embodiments of the remote control device described above are merely illustrative.
  • the division of the modules or units is only a logical function division. In actual implementation, there may be other division methods, such as multiple units or components. It can be combined or integrated into another system, or some features can be ignored or not implemented.
  • the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, remote control devices or units, and may be in electrical, mechanical or other forms.
  • the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the objectives of the solutions of the embodiments.
  • the functional units in the various embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit.
  • the above-mentioned integrated unit can be implemented in the form of hardware or software functional unit.
  • the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer readable storage medium.
  • the technical solution of the present invention essentially or the part that contributes to the existing technology or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium.
  • the aforementioned storage media include: U disk, mobile hard disk, Read-Only Memory (ROM), Random Access Memory (RAM, Random Access Memory), magnetic disks or optical disks and other media that can store program codes.

Landscapes

  • Physics & Mathematics (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • General Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Chemical & Material Sciences (AREA)
  • Analytical Chemistry (AREA)
  • Biochemistry (AREA)
  • Immunology (AREA)
  • Pathology (AREA)
  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Theoretical Computer Science (AREA)
  • Image Processing (AREA)

Abstract

L'invention concerne un procédé et un dispositif de traitement d'image, un véhicule aérien sans pilote, un système et un support de stockage. Le procédé consiste à : acquérir l'intensité d'éclairage de chaque bande d'une pluralité de bandes prédéfinies de l'environnement actuel (101) ; en fonction de l'intensité d'éclairage de chaque bande de la pluralité de bandes prédéfinies, déterminer l'intensité d'éclairage correspondant à au moins une bande spectrale d'une caméra multispectrale (102) ; et, en fonction de l'intensité d'éclairage correspondant à la bande spectrale de la caméra multispectrale, effectuer un traitement de compensation d'image sur l'image actuelle acquise par la caméra multispectrale (103). Lesdits procédé et dispositif de traitement d'image, véhicule aérien sans pilote, système et support de stockage permettent d'améliorer l'effet d'imagerie d'une image.
PCT/CN2019/107977 2019-09-25 2019-09-25 Procédé et dispositif de traitement d'image, véhicule aérien sans pilote, système et support de stockage WO2021056297A1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201980032030.1A CN112106346A (zh) 2019-09-25 2019-09-25 图像处理方法、设备、无人机、系统和存储介质
PCT/CN2019/107977 WO2021056297A1 (fr) 2019-09-25 2019-09-25 Procédé et dispositif de traitement d'image, véhicule aérien sans pilote, système et support de stockage

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2019/107977 WO2021056297A1 (fr) 2019-09-25 2019-09-25 Procédé et dispositif de traitement d'image, véhicule aérien sans pilote, système et support de stockage

Publications (1)

Publication Number Publication Date
WO2021056297A1 true WO2021056297A1 (fr) 2021-04-01

Family

ID=73749616

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/107977 WO2021056297A1 (fr) 2019-09-25 2019-09-25 Procédé et dispositif de traitement d'image, véhicule aérien sans pilote, système et support de stockage

Country Status (2)

Country Link
CN (1) CN112106346A (fr)
WO (1) WO2021056297A1 (fr)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115173221A (zh) * 2021-12-10 2022-10-11 山东大学 一种查表式多波段脉冲光调参控制系统及方法
CN116297243A (zh) * 2023-02-28 2023-06-23 北京市农林科学院信息技术研究中心 烤烟氮肥追施量估计方法、装置、电子设备及存储介质

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115396601A (zh) * 2022-07-07 2022-11-25 航天科工仿真技术有限责任公司 补光强度数据的确定方法和装置、电子设备和存储介质

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100287830A1 (en) * 2009-05-18 2010-11-18 Sinetics Associates International Taiwan Ltd. Full spectrum sunshine simulation apparatus for developing biological growth
CN103575917A (zh) * 2013-10-15 2014-02-12 中国农业大学 一种多光谱图像采集方法和装置
CN110024648A (zh) * 2019-04-11 2019-07-19 哈尔滨工业大学 基于深度神经网络的川贝母精准种植方法
CN110057451A (zh) * 2019-05-30 2019-07-26 深圳市道创智能创新科技有限公司 多光谱数据采集系统及方法
CN110166704A (zh) * 2019-05-30 2019-08-23 深圳市道创智能创新科技有限公司 多光谱相机的校准方法及装置

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120007979A1 (en) * 2008-04-16 2012-01-12 Elbit Systems Ltd. Advanced Technology Center Multispectral enhanced vision system and method for aircraft landing in inclement weather conditions
US20160006954A1 (en) * 2014-07-03 2016-01-07 Snap Vision Technologies LLC Multispectral Detection and Processing From a Moving Platform
CN108896022A (zh) * 2018-08-17 2018-11-27 山东农业大学 一种植被覆盖度估算方法

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100287830A1 (en) * 2009-05-18 2010-11-18 Sinetics Associates International Taiwan Ltd. Full spectrum sunshine simulation apparatus for developing biological growth
CN103575917A (zh) * 2013-10-15 2014-02-12 中国农业大学 一种多光谱图像采集方法和装置
CN110024648A (zh) * 2019-04-11 2019-07-19 哈尔滨工业大学 基于深度神经网络的川贝母精准种植方法
CN110057451A (zh) * 2019-05-30 2019-07-26 深圳市道创智能创新科技有限公司 多光谱数据采集系统及方法
CN110166704A (zh) * 2019-05-30 2019-08-23 深圳市道创智能创新科技有限公司 多光谱相机的校准方法及装置

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115173221A (zh) * 2021-12-10 2022-10-11 山东大学 一种查表式多波段脉冲光调参控制系统及方法
CN115173221B (zh) * 2021-12-10 2024-05-31 山东大学 一种查表式多波段脉冲光调参控制系统及方法
CN116297243A (zh) * 2023-02-28 2023-06-23 北京市农林科学院信息技术研究中心 烤烟氮肥追施量估计方法、装置、电子设备及存储介质
CN116297243B (zh) * 2023-02-28 2024-02-02 北京市农林科学院信息技术研究中心 烤烟氮肥追施量估计方法、装置、电子设备及存储介质

Also Published As

Publication number Publication date
CN112106346A (zh) 2020-12-18

Similar Documents

Publication Publication Date Title
US11810272B2 (en) Image dehazing and restoration
O’Connor et al. Cameras and settings for aerial surveys in the geosciences: Optimising image data
US20180268239A1 (en) Method and System of Image-Based Change Detection
WO2021056297A1 (fr) Procédé et dispositif de traitement d'image, véhicule aérien sans pilote, système et support de stockage
Rabatel et al. Getting simultaneous red and near-infrared band data from a single digital camera for plant monitoring applications: Theoretical and practical study
US11948355B2 (en) Synthetic infrared data for image classification systems and methods
CN110660088A (zh) 一种图像处理的方法和设备
JP2017005389A (ja) 画像認識装置、画像認識方法及びプログラム
Zhang et al. Extraction of tree crowns damaged by Dendrolimus tabulaeformis Tsai et Liu via spectral-spatial classification using UAV-based hyperspectral images
JP7160037B2 (ja) 画像処理装置、画像処理方法、並びにプログラム
KR101928391B1 (ko) 다중분광 영상과 레이더 영상의 융합방법 및 장치
Kedzierski et al. Methodology of improvement of radiometric quality of images acquired from low altitudes
WO2021084907A1 (fr) Dispositif de traitement d'images, procédé de traitement d'images et programme de traitement d'images
Ramirez‐Paredes et al. Low‐altitude Terrestrial Spectroscopy from a Pushbroom Sensor
US10817754B2 (en) Systems and methods for object classification and selective compression in aerial imagery
US20210272300A1 (en) Automatic co-registration of thermal and visible image pairs
Sey et al. Deep learning-based framework for vegetation hazard monitoring near powerlines
CN109377476A (zh) 遥感影像云检测特征参数的动态阈值获取方法及装置
CN113272855B (zh) 用于重叠多图像应用的响应归一化
CN110647781B (zh) 一种基于谱图融合的农作物生长信息获取方法及装置
CN108335329B (zh) 应用于飞行器中的位置检测方法和装置、飞行器
CN114359425A (zh) 正射图像生成方法及装置、正射指数图生成方法及装置
CN113674331A (zh) 图像对齐方法和装置、电子设备和计算机可读存储介质
CN114511781A (zh) 无人机搭载多光谱相机对伪装人员识别的方法、装置及介质
Miraki et al. Using canopy height model derived from UAV imagery as an auxiliary for spectral data to estimate the canopy cover of mixed broadleaf forests

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19946446

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19946446

Country of ref document: EP

Kind code of ref document: A1