EP4209957A1 - Image shadow detection method and system, and image segmentation device and readable storage medium - Google Patents

Image shadow detection method and system, and image segmentation device and readable storage medium Download PDF

Info

Publication number
EP4209957A1
EP4209957A1 EP20952203.6A EP20952203A EP4209957A1 EP 4209957 A1 EP4209957 A1 EP 4209957A1 EP 20952203 A EP20952203 A EP 20952203A EP 4209957 A1 EP4209957 A1 EP 4209957A1
Authority
EP
European Patent Office
Prior art keywords
image
value
segmentation
chrominance
region
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
EP20952203.6A
Other languages
German (de)
French (fr)
Other versions
EP4209957A4 (en
Inventor
Shaoming Zhu
Xue REN
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Suzhou Cleva Precision Machinery and Technology Co Ltd
Original Assignee
Suzhou Cleva Precision Machinery and Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Suzhou Cleva Precision Machinery and Technology Co Ltd filed Critical Suzhou Cleva Precision Machinery and Technology Co Ltd
Publication of EP4209957A1 publication Critical patent/EP4209957A1/en
Publication of EP4209957A4 publication Critical patent/EP4209957A4/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/0002Inspection of images, e.g. flaw detection
    • AHUMAN NECESSITIES
    • A01AGRICULTURE; FORESTRY; ANIMAL HUSBANDRY; HUNTING; TRAPPING; FISHING
    • A01BSOIL WORKING IN AGRICULTURE OR FORESTRY; PARTS, DETAILS, OR ACCESSORIES OF AGRICULTURAL MACHINES OR IMPLEMENTS, IN GENERAL
    • A01B69/00Steering of agricultural machines or implements; Guiding agricultural machines or implements on a desired track
    • A01B69/001Steering by means of optical assistance, e.g. television cameras
    • AHUMAN NECESSITIES
    • A01AGRICULTURE; FORESTRY; ANIMAL HUSBANDRY; HUNTING; TRAPPING; FISHING
    • A01DHARVESTING; MOWING
    • A01D34/00Mowers; Mowing apparatus of harvesters
    • A01D34/006Control or measuring arrangements
    • A01D34/008Control or measuring arrangements for automated or remotely controlled operation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/40Image enhancement or restoration using histogram techniques
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/70Denoising; Smoothing
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/10Segmentation; Edge detection
    • G06T7/12Edge-based segmentation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/10Segmentation; Edge detection
    • G06T7/136Segmentation; Edge detection involving thresholding
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/90Determination of colour characteristics
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/20Image preprocessing
    • G06V10/26Segmentation of patterns in the image field; Cutting or merging of image elements to establish the pattern region, e.g. clustering-based techniques; Detection of occlusion
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/20Image preprocessing
    • G06V10/28Quantising the image, e.g. histogram thresholding for discrimination between background and foreground patterns
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/20Image preprocessing
    • G06V10/32Normalisation of the pattern dimensions
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/40Extraction of image or video features
    • G06V10/44Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/40Extraction of image or video features
    • G06V10/50Extraction of image or video features by performing operations within image blocks; by using histograms, e.g. histogram of oriented gradients [HoG]; by summing image-intensity values; Projection analysis
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/40Extraction of image or video features
    • G06V10/56Extraction of image or video features relating to colour
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/40Extraction of image or video features
    • G06V10/60Extraction of image or video features relating to illumination properties, e.g. using a reflectance or lighting model
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/70Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/74Image or video pattern matching; Proximity measures in feature spaces
    • G06V10/75Organisation of the matching processes, e.g. simultaneous or sequential comparisons of image or video features; Coarse-fine approaches, e.g. multi-scale approaches; using context analysis; Selection of dictionaries
    • G06V10/751Comparing pixel values or logical combinations thereof, or feature values having positional relevance, e.g. template matching
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/56Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
    • AHUMAN NECESSITIES
    • A01AGRICULTURE; FORESTRY; ANIMAL HUSBANDRY; HUNTING; TRAPPING; FISHING
    • A01DHARVESTING; MOWING
    • A01D2101/00Lawn-mowers
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10024Color image

Definitions

  • the present invention relates to an image shadow detection method, a system, an image segmentation device and a readable storage medium, in particular to an image shadow detection method, a system, an image segmentation device and a readable storage medium for effectively reducing shadow misjudgment.
  • the commonly used shadow detection methods are divided into two categories: methods based on geometric models and methods based on shadow features.
  • the method based on geometric model is to build shadow model by using the prior information of scene, moving object and illumination conditions, which is usually used in specific scenes.
  • the method based on shadow features is to identify the shadow region by using the geometric features, brightness, color, texture and other information, among which color and texture are the two most widely used properties at present.
  • the existing shadow detection methods have some limitations, and often misjudge the lawn in shadow area or the lawn under strong light as a non-lawn area.
  • the present invention provides an image shadow detection method, a system, an image segmentation device and a readable storage medium for effectively reducing shadow misjudgment.
  • the present invention provides an image shadow detection method; the method comprises the following steps:
  • the method comprises: carrying out the corresponding image processingbased on the judgment result, the carrying out the corresponding image processingbased on the judgment resultcomprising: if the judgment result is that there is a shadow, segmenting the image by a second segmentation rule based on the chrominance component of the image and a preset chrominance interval to acquire a second segmentation result, and taking the second segmentation result as the final segmentation result; if the judgment result is that there is no shadow, taking the first segmentation result as the final segmentation result.
  • the first segmentation result comprises a first region and a second region
  • the feature value comprises any one or a combination of a first average luminance value of the first region, a second average luminance value of the second region, a luminance difference between the first average luminance value and the second average luminance value, a first roughness value of the first region, a second roughness value of the second region, or the roughness ratio of the first roughness value and the second roughness value
  • each feature value is provided with a corresponding preset threshold value
  • the carrying out the comparison processing to judge whether the image has shadowbased on the feature value and the preset threshold value comprisesthe comparison processing based on each feature value and the corresponding preset threshold value, and judging whether the image has a shadow based on any comparison result or a combination comparison result.
  • the acquiring the chrominance component of the image comprises:
  • the calculating a feature value of the image relative to the first segmentation result comprises: calculating a first average luminance value of the first region, a second average luminance value of the second region, and the luminance difference between the first average luminance value and the second average luminance value based on luminance components of the first region or the second region.
  • the calculating a feature value of the image relative to the first segmentation result comprises:
  • the present invention also provides a walking control method of the intelligent lawn mower, comprising the following steps:
  • the present invention also provides an image shadow detection system, comprising:
  • the present invention also provides an image processing device, comprising a memory and a processor, the memory having a computer program stored therein, when the processor executes the computer program, implementing the steps of the image shadow detection method.
  • the present invention also provides a readable storage medium,having stored therein a computer program, when executed by theprocessor, the computer program implements the steps of the image shadow detection method.
  • segmentation processing is performed on an image by a first segmentation rule and a first segmentation result is acquired, wherein the first segmentation result is acquired based on the chrominance component and is not affected by shadows, and the shadow area is identified by combining the first segmentation result with the judgment of feature values, thus reducing the possibility of shadow misjudgment.
  • corresponding image processing is carried outbased on the judgment result, the segmentation processing is carried out by selecting the second segmentation rule under the condition of shadow, and segmentation processing is carried out by selecting the first segmentation rule under the condition of no shadow, so that the final segmentation result is not affected by shadow, therebyreducing the possibility of false segmentation.
  • the segmentation threshold is acquired based on the peak and the valley, the segmentation threshold may be dynamically adjusted based on different images, and the fixed segmentation threshold is no longer used, thereby effectively reducing false segmentation.
  • filtering processing and smoothing processing are performed on the chrominance component histogram, interference signals in the chrominance component histogram is reduced, thereby further reducing false segmentation.
  • the peak and the valley in the chrominance component histogram are determined, so as to improve the speed of identifying the peak and the valley.
  • an image shadow detection method a system, an image segmentation apparatus, and a readable storage medium effectively reducing shadow misjudgments.
  • the invention provides an image shadow detection method; the method comprises the following steps:
  • the chrominance component in the S10 may be acquired directly or indirectly, the chrominance component in the HSV image may be acquired directly after separation, and the chrominance component of an image such as RGB may be acquired after processing such as color space conversion.
  • the judgment result of S40 provides a basis for subsequent image processing.
  • the following image processing further comprises: carrying out corresponding image processing based on the judgment result, and the subsequent image processing comprising acquiring corresponding final segmentation result based on the judgment result, or selecting corresponding image adjustment parameters to further process the image, wherein the specific flow of image segmentation by judging the result is as follows, and the image shadow detection method comprises the following steps:
  • the feature value comprises any one or a combination of: a first average luminance value of the first region, a second average luminance value of the second region, a luminance difference between the first average luminance value and the second average luminance value, a first roughness value of the first region, a second roughness value of the second region, or a roughness ratio of the first roughness value and the second roughness value, and each feature value is provided with a corresponding preset threshold value, wherein, the carrying out the comparison processing to judge whether the image has shadow based on the feature value and the preset threshold valuecomprises carrying out the comparison processing based on each feature value and the corresponding preset threshold value, and judging whether the image has a shadow based on any comparison result or a combination comparison result.
  • the S10 comprises:
  • S30 comprises: S310: calculating a first average luminance value Va of the first region, a second average luminance value Vb of the second region, and the luminance difference Dv between the first average luminance value Va and the second average luminance value Vbbased on luminance components of the first region or the second region.
  • the S30 comprises:
  • S20 comprises:
  • the preset chrominance interval in the S30 may be determined according to needs, and different preset chrominance intervals are set for different use scenarios.
  • the preset chrominance interval may be set to 15-95 when the image is used for lawn identification after segmented by the image segmentation method based on chrominance components according to the present invention, .
  • the preset peak and valley setting conditions in S30 comprise:
  • the peaks and valleys in the chrominance component histogram are determined only when the preset peak-valley setting conditions 1, 2 and 3 are simultaneously satisfied. If the preset peak-valley setting condition 1 and the preset peak-valley setting condition 3 are satisfied, but the preset peak-valley setting condition 2 is not satisfied, the peak with the largest peak frequency is selected as the peak in the chrominance component histogram, and the remaining peaks are not regarded as the peaks in the chrominance component histogram.
  • S204 comprises:
  • S2043 comprises:
  • a first segmentation threshold value [lowValue, highValue] is acquired from the second peak chrominance value h1i, the third peak chrominance value h2i and the segmentation chrominance value li.
  • a comparison process is performed based on the second peak chrominance value h1i and a preset second peak threshold value, and the third peak chrominance value h2i and the preset third peak threshold value to acquire a peak chrominance value comparison result, and a first segmentation threshold value [lowValue, highValue] is acquired based on the peak chrominance value comparison result.
  • the minimum value of the preset chrominance interval (which may also be other values of the preset chrominance interval) is set as the minimum value lowValue of the first segmentation threshold, and the segmentation chrominance value li is set as the maximum value high Value of the first segmentation threshold.
  • the segmentation chrominance value li is set as the minimum value lowValue of the first segmentation threshold, and the maximum value of the preset chrominance interval (which may also be other values of the preset chrominance interval) is set as the maximum value high Value of the first segmentation threshold.
  • the first segmentation result in the S20 comprises a first region and a second region via the segmentation processing by the first segmentation threshold [lowValue, high Value] , wherein the chrominance value corresponding to one of the first region and the second region is within the range of a first segmentation threshold [lowValue, high Value], and the chrominance value corresponding to the another region of the first region and the second region is within the range of a preset chrominance interval and the chrominance value is not within the range of the first segmentation threshold [low Value, highValue].
  • the first region is a region with a chrominance value of [15, li] and the second region is a region with a chrominance value of [li, 95].
  • the segmentation chrominance value li is acquired using the OTSU threshold method (OTSU), and a first segmentation threshold [low Value, highValue] is acquired based on the number of peaks.
  • OTSU OTSU threshold method
  • the lowest boundary point is searched from the minimum value of the preset chrominance interval, and if the lowest boundary point exists, the second peak chrominance value and the third peak chrominance value are preset by the first preset rule; if there is no lowest boundary point, the second peak chrominance value and the third peak chrominance value are preset by the second preset rule.
  • the chrominance value of the lowest boundary point is mi, and the frequency corresponding to mi is greater than the frequency corresponding to mi+1 and mi+2.
  • the chrominance value of some grasses in lawn is located in the yellow-red degree range (specific chrominance). By finding the lowest boundary point, the yellow-red degree grasses may be avoided from being segmented into non-grass areas after segmentation.
  • the second peak chrominance value and the third peak chrominance value are preset based on the number of peaks by the first preset rule.
  • the second peak chrominance value h1i is set to the lowest boundary point chrominance value mi
  • the third peak chrominance value h2i is set to the maximum value of the preset chrominance interval (may also be other values of the preset chrominance interval).
  • the number of peaks is 1, the chrominance value of the peaks is h1, the second peak chrominance value h1i is set to the lowest boundary point chrominance value, and the third peak chrominance value is set to h1.
  • the second peak chrominance value h1i and the third peak chrominance value h2i are preset based on the number of peaks by a second preset rule.
  • the second peak chrominance value h1i is set to a minimum value of a preset chrominance interval (or other value of the preset chrominance interval)
  • the third peak chrominance value h2i is set to a maximum value of the preset chrominance interval (or other value of the preset chrominance interval).
  • the chrominance value of the peaks is h1
  • the second peak chrominance value h1i is set to h1
  • the third peak chrominance value is set to h1.
  • the segmentation chrominance value li, the second peak chrominance value h1i, and the third peak chrominance value h2i are compared to acquirethe peak chrominance value comparison result, and a first segmentation threshold value is acquired based on the peak chrominance value comparison result.
  • the comparison results comprise:
  • the second peak chrominance value h1i is compared with a preset second peak threshold value
  • the third peak chrominance value h2i is compared with a preset third peak threshold value to acquire a peak chrominance value comparison result
  • a first segmentation threshold value is acquired based on the peak chrominance value comparison result.
  • the comparison process in which the number of peaks is 1 is the same as the comparison process in which the number of peaks j is not less than 2, referring to the specific procedure of S2043.
  • the second segmentation rule is different from the first segmentation rule.
  • the second segmentation rule segments the image through a second segmentation threshold,
  • the second segmentation threshold is a fixed threshold, for example, the minimum value lowValue of the second segmentation threshold is the minimum value of the preset chrominance interval (or other values of the preset chrominance interval), and the maximum value high Value of the second segmentation threshold is the maximum value of the preset chrominance interval (or other values of the preset chrominance interval).
  • the S40 comprises:
  • Whether a shadow exists in an image is judged based on any one of the feature values or a combination thereof.
  • the combination of the feature values used for judging the shadow may be determined according to the need. For example, the combination of part of the feature values is taken as the judgment basis:
  • the image shadow detection method of the present invention comprises a plurality of judgment basis.
  • Each judgment basis comprises any one or combination of feature values, and if any judgment basis or a plurality of judgment basis is met, the image has shadow; if any judgment basis is not met, there is no shadow in the image.
  • the present invention also provides a method for detecting the shadow of a lawn image, comprising the following steps:
  • the present invention also provides a walking control method of an intelligent lawn mower, comprising the following steps:
  • the first segmentation rule may refer to Figs. 4 and 5 , and a first segmentation result maybe acquired.
  • a first chrominance component histogram orgLabelsMat is generated in S201, and a second chrominance component histogram labelsMat is generated in S202; the peaks and valleys are identified by S203, and the first segmentation threshold and the first segmentation result dstMat are acquired by S2043 or S2044.
  • a partial feature value (luminance feature value) based on the first segmentation result and the luminance component is acquired in S310
  • an edge image cannyMat is acquired in S322
  • a partial feature value (roughness feature value) based on the first segmentation result and the edge image cannyMat is acquired in S323.
  • a second segmentation result is acquired by a second segmentation rule (for example, by a second segmentation threshold [15, 95]) and the second segmentation result is determined as a final segmentation result dstMat; when there is no shadow (as shown in Fig. 10 ) the first segmentation result is taken as the final segmentation result dstMat.
  • a second segmentation rule for example, by a second segmentation threshold [15, 95]
  • an image shadow detection system 10 comprising:
  • the present invention also provides an image processing device, comprising a memory and a processor, the memory storing a computer program, and the processor implementing the steps of the image shadow detection method when executing the computer program.
  • the present invention also provides a readable storage medium,storing a computer program thereon, executing the steps of the image shadow detection methodwhen the computer program is executed by the processor.
  • segmentation processing is performed on an image by a first segmentation rule and a first segmentation result is acquired, wherein the first segmentation result is acquired based on a chrominance component and is not affected by shadows, and the shadow area is identified by combining the first segmentation result with the judgment of feature values, thus reducing the possibility of shadow misjudgment.
  • corresponding image processing is carried out based on the judgment result, segmentation processing is carried out byselecting the second segmentation rule under the condition of shadow, and segmentation processing is carried out by selecting the first segmentation rule under the condition of no shadow, so that the final segmentation result is not affected by shadow and the possibility of false segmentation is reduced.
  • the segmentation threshold is acquired based on the peak and the valley, the segmentation threshold may be dynamically adjusted based on different images, and the fixed segmentation threshold is no longer used, thereby effectively reducing false segmentation.
  • filtering processing and smoothing processing is performed on the chrominance component histogram, interference signals in the chrominance component histogram is reduced, thereby further reducing false segmentation.
  • the peak and the valley in the chrominance component histogram is determinedbased on the preset chrominance interval and the preset peak-valley setting conditions, so as to improve the speed of identifying the peak and the valley.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Environmental Sciences (AREA)
  • Software Systems (AREA)
  • Health & Medical Sciences (AREA)
  • Soil Sciences (AREA)
  • Artificial Intelligence (AREA)
  • Computing Systems (AREA)
  • Databases & Information Systems (AREA)
  • Evolutionary Computation (AREA)
  • General Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Mechanical Engineering (AREA)
  • Quality & Reliability (AREA)
  • Image Analysis (AREA)

Abstract

Disclosed in the present invention is an image shadow detection method, a system, an image segmentation device and a readable storage medium. The method comprises the following steps: acquiring a chrominancecomponent of an image; segmenting the image by a first segmentation rule based on the chrominancecomponent of the image and the preset chrominance interval and acquiringa first segmentation result, the first segmentation result comparing a first region and a second region; calculating feature values of the first region or the second region in the image; carrying out the comparison processing to judge whether the image has shadowbased on the feature value and the preset threshold value. According to the present invention, the image is segmented bythe first segmentation rule and the first segmentation result is acquired. The first segmentation result is acquired based on the chrominance component and is not affected by shadows. The shadow area is identified by combining the first segmentation result with the judgment of feature values, thus reducing the possibility of shadow misjudgment.

Description

    TECHNICAL FIELD OF THE INVENTION
  • The present invention relates to an image shadow detection method, a system, an image segmentation device and a readable storage medium, in particular to an image shadow detection method, a system, an image segmentation device and a readable storage medium for effectively reducing shadow misjudgment.
  • BACKGROUND OF THE INVENTION
  • At present, the commonly used shadow detection methods are divided into two categories: methods based on geometric models and methods based on shadow features. The method based on geometric model is to build shadow model by using the prior information of scene, moving object and illumination conditions, which is usually used in specific scenes. The method based on shadow features is to identify the shadow region by using the geometric features, brightness, color, texture and other information, among which color and texture are the two most widely used properties at present. However, the existing shadow detection methods have some limitations, and often misjudge the lawn in shadow area or the lawn under strong light as a non-lawn area.
  • SUMMARY OF THE INVENTION
  • The present invention provides an image shadow detection method, a system, an image segmentation device and a readable storage medium for effectively reducing shadow misjudgment.
  • The present invention provides an image shadow detection method; the method comprises the following steps:
    • acquiringthe chrominance component of the image;
    • segmenting the image by a first segmentation rule based on the chrominance component of the image and a preset chrominance interval and acquiring a first segmentation result;
    • calculating a feature value of the image relative to the first segmentation result;
    • carrying out the comparison processing to judge whether the image has shadowbased on the feature value and the preset threshold value.
  • Alternatively, after the carrying out the comparison processing to judge whether the image has shadowbased on the feature value and the preset threshold value, the method comprises: carrying out the corresponding image processingbased on the judgment result, the carrying out the corresponding image processingbased on the judgment resultcomprising: if the judgment result is that there is a shadow, segmenting the image by a second segmentation rule based on the chrominance component of the image and a preset chrominance interval to acquire a second segmentation result, and taking the second segmentation result as the final segmentation result; if the judgment result is that there is no shadow, taking the first segmentation result as the final segmentation result.
  • Alternatively, the first segmentation result comprises a first region and a second region, and the feature value comprises any one or a combination of a first average luminance value of the first region, a second average luminance value of the second region, a luminance difference between the first average luminance value and the second average luminance value, a first roughness value of the first region, a second roughness value of the second region, or the roughness ratio of the first roughness value and the second roughness value, and each feature value is provided with a corresponding preset threshold value, wherein, the carrying out the comparison processing to judge whether the image has shadowbased on the feature value and the preset threshold value comprisesthe comparison processing based on each feature value and the corresponding preset threshold value, and judging whether the image has a shadow based on any comparison result or a combination comparison result..
  • Alternatively, the acquiring the chrominance component of the image comprises:
    • acquiring HSV image;
    • carrying out the separation processing on the HSV image and acquiring an H-channel image and a V-channel image, wherein the H-channel image comprises a chrominance component and the V-channel image comprises a luminance component.
  • Alternatively, the calculating a feature value of the image relative to the first segmentation result comprises: calculating a first average luminance value of the first region, a second average luminance value of the second region, and the luminance difference between the first average luminance value and the second average luminance value based on luminance components of the first region or the second region.
  • Alternatively, the calculating a feature value of the image relative to the first segmentation result comprises:
    • pre-processing the V-channel image to acquire a pre-processed image, wherein the pre-processing comprises filtering processing and normalization processing;
    • performing edge extraction on the pre-processed image to acquire an edge image;
    • calculatinga first roughness value of the first region, a second roughness value of the second region, and a roughness ratio of the first roughness value to the second roughness value in the edge image.
  • The present invention also provides a walking control method of the intelligent lawn mower, comprising the following steps:
    • acquiring the chrominance component of lawn image;
    • segmenting the lawn image by a first segmentation rule based on the chrominance component of the lawn image and a preset lawn chrominance interval and acquiring a first segmentation result;
    • calculating an feature value of the lawn image relative to the first segmentation result;
    • carrying out the comparison processing to judge whether the image has shadows based on the feature value and the preset threshold value;
    • carrying out the corresponding image processing based on the judgment resultto control the walking direction of the intelligent lawn mower.
  • The present invention also provides an image shadow detection system, comprising:
    • a chrominance component acquisition module for acquiring a chrominance component of an image;
    • an image segmentation module for segmenting the image by a first segmentation rule based on the chrominance component of the image and a preset chrominance interval and acquiring a first segmentation result;
    • a feature processing module for calculating a feature value of the image relative to the first segmentation result;
    • a shadow identification module for carrying out the comparison processing to judge whether the image has shadows based on the feature value and the preset threshold value.
  • The present invention also provides an image processing device, comprising a memory and a processor, the memory having a computer program stored therein, when the processor executes the computer program, implementing the steps of the image shadow detection method.
  • The present invention also provides a readable storage medium,having stored therein a computer program, when executed by theprocessor, the computer program implements the steps of the image shadow detection method.
  • Compared with the prior art, according to the present invention, segmentation processing is performed on an image by a first segmentation rule and a first segmentation result is acquired, wherein the first segmentation result is acquired based on the chrominance component and is not affected by shadows, and the shadow area is identified by combining the first segmentation result with the judgment of feature values, thus reducing the possibility of shadow misjudgment. According to the present invention, corresponding image processing is carried outbased on the judgment result, the segmentation processing is carried out by selecting the second segmentation rule under the condition of shadow, and segmentation processing is carried out by selecting the first segmentation rule under the condition of no shadow, so that the final segmentation result is not affected by shadow, therebyreducing the possibility of false segmentation. According to the present invention, whether the image has shadow is judged by the combined comparison result of a plurality of feature values, and the possibility of shadow misjudgment is reduced. According to the present invention, the segmentation threshold is acquired based on the peak and the valley, the segmentation threshold may be dynamically adjusted based on different images, and the fixed segmentation threshold is no longer used, thereby effectively reducing false segmentation. According to the present invention, filtering processing and smoothing processing are performed on the chrominance component histogram, interference signals in the chrominance component histogram is reduced, thereby further reducing false segmentation. According to the present invention, based onthe preset chrominance interval and the preset peak-valley setting conditions, the peak and the valley in the chrominance component histogram are determined, so as to improve the speed of identifying the peak and the valley.
  • BRIEF DESCRIPTION OF THE DRAWINGS
    • Fig. 1 is a flowchart of a first embodiment of an image shadow detection method of the present invention;
    • Fig. 2 is a flowchart of a second embodiment of the image shadow detection method of the present invention;
    • Fig. 3 is a flowchart of a third embodiment of the image shadow detection method of the present invention;
    • Fig. 4 is a flowchart of S20 in Fig. 1;
    • Fig. 5 is a flowchart of S204 in Fig. 4;
    • Fig. 6 is a flowchart of the image shadow detection method of the present invention;
    • Fig. 7 is a flowchart of the walking control method of the intelligent lawn mower of the present invention;
    • Fig. 8 is a result graph of detecting whether a shadow exists in a first image and performing an image segmentation process according to an image shadow detection method of the present invention;
    • Fig. 9 is a result graph of detecting whether a shadow exists in a second image and performing an image segmentation process according to an image shadow detection method of the present invention;
    • Fig. 10 is a result graph of detecting whether a shadow exists in a third image and performing image segmentation processing according an image shadow detection method of the present invention;
    • Fig. 11 is a block diagram of the principle of the image shadow detection system of the present invention.
    DESCRIPTION OF THE PREFERRED EMBODIMENTS
  • In order for those skilled in the art to have a better understanding of the technical solutions of the present invention, a clear and complete description of the technical solutions of the embodiments of the present invention will be given below in conjunction with the accompanying drawings in the embodiments of the present invention, and it will be apparent that the described embodiments are only part of the embodiments of the present invention, not all of them. On the basis of the embodiments in the present invention, all other embodiments acquired by those skilled in the art without making creative efforts should fall within the scope of protection of the present invention.
  • Referring to Fig. 1, an image shadow detection method, a system, an image segmentation apparatus, and a readable storage medium effectively reducing shadow misjudgments.
  • The invention provides an image shadow detection method; the method comprises the following steps:
    • S10: acquiring the chrominance component of the image;
    • S20: segmenting the image by a first segmentation rule based on the chrominance component of the image and a preset chrominance interval and acquiring a first segmentation result;
    • S30: calculating a feature value of the image relative to the first segmentation result;
    • S40: carrying out the comparison processing to judge whether the image has shadow based on the feature value and the preset threshold value.
  • The chrominance component in the S10 may be acquired directly or indirectly, the chrominance component in the HSV image may be acquired directly after separation, and the chrominance component of an image such as RGB may be acquired after processing such as color space conversion.
  • Referring to Fig. 2, in another embodiment of the present invention, the judgment result of S40 provides a basis for subsequent image processing. After S40, the following image processing further comprises: carrying out corresponding image processing based on the judgment result, and the subsequent image processing comprising acquiring corresponding final segmentation result based on the judgment result, or selecting corresponding image adjustment parameters to further process the image, wherein the specific flow of image segmentation by judging the result is as follows, and the image shadow detection method comprises the following steps:
    • S10: acquiring the chrominance component of the image;
    • S20: segmenting the image by a first segmentation rule based on the chrominance component of the image and a preset chrominance interval and acquiring a first segmentation result;
    • S30: calculating a feature value of the image relative to the first segmentation result;
    • S40: carrying out the comparison processing to judge whether the image has shadow based on the feature value and the preset threshold value;if the judgment result is that there is a shadow, executing S50; if the judgment result is that there is no shadow, executing S60;
    • S50: segmenting the image by a second segmentation rule based on a chrominance component of the image and a preset chrominance interval and acquiring a second segmentation result, and taking the second segmentation result as the final segmentation result;
    • S60: takingthe first segmentation result as the final segmentation result.
  • In another embodiment of the present invention, the feature value comprises any one or a combination of: a first average luminance value of the first region, a second average luminance value of the second region, a luminance difference between the first average luminance value and the second average luminance value, a first roughness value of the first region, a second roughness value of the second region, or a roughness ratio of the first roughness value and the second roughness value, and each feature value is provided with a corresponding preset threshold value, wherein, the carrying out the comparison processing to judge whether the image has shadow based on the feature value and the preset threshold valuecomprises carrying out the comparison processing based on each feature value and the corresponding preset threshold value, and judging whether the image has a shadow based on any comparison result or a combination comparison result.
  • In another embodiment of the present invention, the S10 comprises:
    • acquiring HSV image;
    • carrying out the separation processing on the HSV image and acquiring an H-channel image and a V-channel image, wherein the H-channel image comprises a chrominance component and the V-channel image comprises a luminance component.
  • Referring to Fig. 3, in another embodiment of the present invention, S30 comprises:
    S310: calculating a first average luminance value Va of the first region, a second average luminance value Vb of the second region, and the luminance difference Dv between the first average luminance value Va and the second average luminance value Vbbased on luminance components of the first region or the second region.
  • In another embodiment of the present invention, the S30 comprises:
    • S321: pre-processing the V-channel image to acquire a pre-processed image, wherein the pre-processing comprises filtering processing and normalization processing;
    • S322: performing edge extraction on the pre-processed image to acquire an edge image;
    • S323: calculatinga first roughness value Sa of the first region, a second roughness value Sb of the second region, and a roughness ratio Rs of the first roughness value to the second roughness value in the edge image.
  • Referring to Fig. 4, in another embodiment of the present invention, S20 comprises:
    • S201, generating a first color component histogram based on the chrominance component;
    • S202: filtering and smoothing the first color component histogram to acquire a second color component histogram;
    • S203: determining the peak and the valley in the second color component histogrambased on the preset chrominance interval and the preset peak and valley setting conditions;
    • S204: acquiring a first segmentation threshold based on the peak and the valley;
    • S205: segmenting the image based on a first segmentation threshold and acquiring a first segmentation result.
  • In another embodiment of the present invention, the preset chrominance interval in the S30 may be determined according to needs, and different preset chrominance intervals are set for different use scenarios. For example, the preset chrominance interval may be set to 15-95 when the image is used for lawn identification after segmented by the image segmentation method based on chrominance components according to the present invention, .
  • In another embodiment of the present invention, the preset peak and valley setting conditions in S30 comprise:
    • presettingpeak-valley setting condition 1: peak frequency > k* valley frequency, where k is a constant, comprising positive integer, fraction or decimal, etc.;
    • presettingpeak-valley setting condition 2: the distance between adjacent peaks conforms to the preset distance between peaks,
    • presettingpeak-valley setting condition 3: peak frequency > frequency threshold.
  • The peaks and valleys in the chrominance component histogram are determined only when the preset peak- valley setting conditions 1, 2 and 3 are simultaneously satisfied. If the preset peak-valley setting condition 1 and the preset peak-valley setting condition 3 are satisfied, but the preset peak-valley setting condition 2 is not satisfied, the peak with the largest peak frequency is selected as the peak in the chrominance component histogram, and the remaining peaks are not regarded as the peaks in the chrominance component histogram.
  • Referring to Fig. 5, in another embodiment of the present invention, S204 comprises:
    • S2041: counting the number of the peaks;
    • S2042, judging whether the number of peaks is not less than two; executing S2043if the number of peaks is not less than two; executing S2044if the number of peaks is less than two;
    • S2043: acquiring a first segmentation threshold [lowValue, high Value] by a peak-valley segmentation method;
    • S2044: acquiring a first segmentation threshold [low Value, high Value] by the OTSU threshold method.
  • In another embodiment of the present invention, S2043 comprises:
    • finding a group of peaks and valleys with the largest peak-valley ratio from the peaks and valleys as target peaks and valleys, and acquiring the position of the valleys in the target peaks and valleys as the first position;
    • finding a second position of the maximum peak and valley of the left side on the left side of the first position, finding a third position of the maximum peak and valley of the right side on the right side of the first position, acquiring a chrominance value corresponding to the second position as a second peakchrominance value h1i, and acquiring a chrominance value corresponding to the third position as a third peakchrominance value h2i;
    • findinga chrominance value corresponding to the minimum frequency value between the second position and the third position as a segmentation chrominance value li;
  • A first segmentation threshold value [lowValue, highValue] is acquired from the second peak chrominance value h1i, the third peak chrominance value h2i and the segmentation chrominance value li. A comparison process is performed based on the second peak chrominance value h1i and a preset second peak threshold value, and the third peak chrominance value h2i and the preset third peak threshold value to acquire a peak chrominance value comparison result, and a first segmentation threshold value [lowValue, highValue] is acquired based on the peak chrominance value comparison result.
  • When the comparison result of the peakchrominance value satisfies "the second peak chrominance value h1i> the preset second peak threshold value and the third peak chrominance value h2i> the preset third peak threshold value", the minimum value of the preset chrominance interval (which may also be other values of the preset chrominance interval) is set as the minimum value lowValue of the first segmentation threshold, and the segmentation chrominance value li is set as the maximum value high Value of the first segmentation threshold.
  • When the peak chrominance value comparison result does not satisfy "the second peak chrominance value h1i> the preset second peak threshold value, and the third peak chrominance value h2i> the preset third peak threshold value", the segmentation chrominance value li is set as the minimum value lowValue of the first segmentation threshold, and the maximum value of the preset chrominance interval (which may also be other values of the preset chrominance interval) is set as the maximum value high Value of the first segmentation threshold.
  • For example, when the preset chrominance interval [15, 95], the preset second peak threshold value = 30, and the preset third peak threshold value = 75, lowValue = 15 and high Value = liif h1i > 30 and h2i > 75 (large peak is bluish); otherwise, lowValue = li, high Value = 95.
  • The first segmentation result in the S20 comprises a first region and a second region via the segmentation processing by the first segmentation threshold [lowValue, high Value] , wherein the chrominance value corresponding to one of the first region and the second region is within the range of a first segmentation threshold [lowValue, high Value], and the chrominance value corresponding to the another region of the first region and the second region is within the range of a preset chrominance interval and the chrominance value is not within the range of the first segmentation threshold [low Value, highValue]. Assuming a preset chrominance interval [15, 95], a first segmentation threshold [low Value, high Value], whereinlowValue = 15 and high Value = li; then the first region is a region with a chrominance value of [15, li] and the second region is a region with a chrominance value of [li, 95].
  • In another embodiment of the present invention, if the number of peaks j is less than two, the segmentation chrominance value li is acquired using the OTSU threshold method (OTSU), and a first segmentation threshold [low Value, highValue] is acquired based on the number of peaks.
  • In order to accurately segment the specific chrominance region in the preset chrominance interval in the image, the lowest boundary point is searched from the minimum value of the preset chrominance interval, and if the lowest boundary point exists, the second peak chrominance value and the third peak chrominance value are preset by the first preset rule; if there is no lowest boundary point, the second peak chrominance value and the third peak chrominance value are preset by the second preset rule. Wherein, the chrominance value of the lowest boundary point is mi, and the frequency corresponding to mi is greater than the frequency corresponding to mi+1 and mi+2. Taking lawn image segmentation as an example, the chrominance value of some grasses in lawn is located in the yellow-red degree range (specific chrominance). By finding the lowest boundary point, the yellow-red degree grasses may be avoided from being segmented into non-grass areas after segmentation.
  • If there is a lowest boundary point, the second peak chrominance value and the third peak chrominance value are preset based on the number of peaks by the first preset rule. When the number of peaks is 0, the second peak chrominance value h1i is set to the lowest boundary point chrominance value mi, and the third peak chrominance value h2i is set to the maximum value of the preset chrominance interval (may also be other values of the preset chrominance interval). When the number of peaks is 1, the chrominance value of the peaks is h1, the second peak chrominance value h1i is set to the lowest boundary point chrominance value, and the third peak chrominance value is set to h1.
  • If there is no lowest boundary point, the second peak chrominance value h1i and the third peak chrominance value h2i are preset based on the number of peaks by a second preset rule. When the number of peaks is 0, the second peak chrominance value h1i is set to a minimum value of a preset chrominance interval (or other value of the preset chrominance interval), and the third peak chrominance value h2i is set to a maximum value of the preset chrominance interval (or other value of the preset chrominance interval). When the number of peaks is 1, the chrominance value of the peaks is h1, the second peak chrominance value h1i is set to h1, and the third peak chrominance value is set to h1.
  • When the number of peaks is 0, the segmentation chrominance value li, the second peak chrominance value h1i, and the third peak chrominance value h2i are compared to acquirethe peak chrominance value comparison result, and a first segmentation threshold value is acquired based on the peak chrominance value comparison result.
  • When the number of peaks is 0, the comparison results comprise:
    • 1-1 When the peak chrominance value comparison result satisfies the "segmentation chrominance value li > the third peak chrominance value h2i", the segmentation chrominance value li is set as the minimum value lowValue of the first segmentation threshold, and the maximum value of the preset chrominance interval (or other values of the preset chrominance interval) is set as the maximum value high Value of the first segmentation threshold.
    • 1-2 When the peak chrominance value comparison result satisfies the "segmentation chrominance value li < second peak chrominance value h1i", the minimum value of the preset chrominance interval (or other values of the presetchrominance interval) is set as the minimum value lowValue of the first segmentation threshold, and the segmentation chrominance value li is set as the maximum value high Value of the first segmentation threshold.
    • 1-3 When the peak chrominance value comparison result satisfies "second peak chrominance value h1i ≤ segmentation chrominance value li ≤ third peak chrominance value h2i", the second peak chrominance value h1i is set as the minimum value lowValue of the first segmentation threshold, and the third peak chrominance value h2i is set as the maximum value high Value of the first segmentation threshold.
  • When the number of peaks is 1, the second peak chrominance value h1i is compared with a preset second peak threshold value, and the third peak chrominance value h2i is compared with a preset third peak threshold value to acquire a peak chrominance value comparison result, and a first segmentation threshold value is acquired based on the peak chrominance value comparison result. The comparison process in which the number of peaks is 1 is the same as the comparison process in which the number of peaks j is not less than 2, referring to the specific procedure of S2043.
  • The second segmentation rule is different from the first segmentation rule. The second segmentation rule segments the image through a second segmentation threshold, The second segmentation threshold is a fixed threshold, for example, the minimum value lowValue of the second segmentation threshold is the minimum value of the preset chrominance interval (or other values of the preset chrominance interval), and the maximum value high Value of the second segmentation threshold is the maximum value of the preset chrominance interval (or other values of the preset chrominance interval).
  • In another embodiment of the present invention, the S40 comprises:
    • carryingout comparison processing based on the feature value and the preset threshold value to acquire a feature value comparison result;
    • acquiring a peak chrominance value comparison result based onthe comparison processing of the second peakchrominance value and the preset second peak threshold value, and of the third peakchrominance value and the preset third peak threshold value;
    • determining whether the image has a shadow by combining the feature value comparison result with the peak chrominance value comparison result.
  • Whether a shadow exists in an image is judged based on any one of the feature values or a combination thereof. The combination of the feature values used for judging the shadow may be determined according to the need. For example, the combination of part of the feature values is taken as the judgment basis:
    • Judgment basis: 1: h1i > 34 and h2i < 75 (color region being green range) and dv > 45
    • Judgment basis 2: Vb< 50 and Dv> 40
    • Judgment basis 3: Rs< 2, Dv> 35 and Sa> 0.1
  • The image shadow detection method of the present invention comprises a plurality of judgment basis. Each judgment basis comprises any one or combination of feature values, and if any judgment basis or a plurality of judgment basis is met, the image has shadow; if any judgment basis is not met, there is no shadow in the image.
  • Referring to Fig. 6, the present invention also provides a method for detecting the shadow of a lawn image, comprising the following steps:
    • S110: acquiring the chrominance component of lawn image;
    • S120: segmenting the lawn image by a first segmentation rule based on the chrominance component of the lawn image and a preset lawn chrominance interval and acquiring a first segmentation result;
    • S130: calculating a feature value of the lawn image relative to the first segmentation result;
    • S140: carrying out the comparison processing to judge whether the image has shadows based on the feature value and the preset threshold value.
  • Referring to Fig. 7, the present invention also provides a walking control method of an intelligent lawn mower, comprising the following steps:
    • S210: acquiring the chrominance component of lawn image;
    • S220: segmenting the lawn image by a first segmentation rule based on the chrominance component of the lawn image and a preset lawn chrominance interval and acquiring a first segmentation result;
    • S230: calculating a feature value of the lawn image relative to the first segmentation result;
    • S240: carrying out the comparison processing to judge whether the image has shadows based on the feature value and the preset threshold value;
    • S250: carrying out corresponding image processing to control the walking direction of the intelligent lawn mowerbased on the judgment result.
  • Referring to Figs. 8-10, assuming a preset chrominance interval [15, 95], the first segmentation rule may refer to Figs. 4 and 5, and a first segmentation result maybe acquired. After the image orgMat in S10 is separated to acquire an H channel image, a first chrominance component histogram orgLabelsMat is generated in S201, and a second chrominance component histogram labelsMat is generated in S202; the peaks and valleys are identified by S203, and the first segmentation threshold and the first segmentation result dstMat are acquired by S2043 or S2044.
  • After acquiring the first segmentation result dstMat, a partial feature value (luminance feature value) based on the first segmentation result and the luminance component is acquired in S310, an edge image cannyMat is acquired in S322, and a partial feature value (roughness feature value) based on the first segmentation result and the edge image cannyMat is acquired in S323.
  • After acquiring the feature value, whether there is a shadow may be judged based on the feature value. When there is a shadow (as shown in Figs. 8 and 9), a second segmentation result is acquired by a second segmentation rule (for example, by a second segmentation threshold [15, 95]) and the second segmentation result is determined as a final segmentation result dstMat; when there is no shadow (as shown in Fig. 10) the first segmentation result is taken as the final segmentation result dstMat.
  • Referring to Fig. 11, the present invention also provides an image shadow detection system 10 comprising:
    • achrominance component acquisition module 11, for acquiring a chrominance component of an image;
    • animage segmentation module 12, for segmenting the image by a first segmentation rule based on a chrominance component of the image and a preset chrominance interval and acquiring a first segmentation result;
    • afeature processing module 13, for calculating a feature value of the image relative to the first segmentation result;
    • a shadow identification module 14, for carrying out the comparison processing based on the feature value and the preset threshold value to judge whether the image has shadows.
  • The present invention also provides an image processing device, comprising a memory and a processor, the memory storing a computer program, and the processor implementing the steps of the image shadow detection method when executing the computer program.
  • The present invention also provides a readable storage medium,storing a computer program thereon, executing the steps of the image shadow detection methodwhen the computer program is executed by the processor.
  • To sum up, According to the present invention, segmentation processing is performed on an image by a first segmentation rule anda first segmentation result is acquired, wherein the first segmentation result is acquired based on a chrominance component and is not affected by shadows, and the shadow area is identified by combining the first segmentation result with the judgment of feature values, thus reducing the possibility of shadow misjudgment. According to the invention, corresponding image processing is carried out based on the judgment result, segmentation processing is carried out byselecting the second segmentation rule under the condition of shadow, and segmentation processing is carried out by selecting the first segmentation rule under the condition of no shadow, so that the final segmentation result is not affected by shadow and the possibility of false segmentation is reduced. According to the present invention, whether the image has shadow is judged by the combination comparison result of a plurality of feature values, thereby reducing the possibility of shadow misjudgment. According to the present invention, the segmentation threshold is acquired based on the peak and the valley, the segmentation threshold may be dynamically adjusted based on different images, and the fixed segmentation threshold is no longer used, thereby effectively reducing false segmentation. According to the present invention, filtering processing and smoothing processing is performed on the chrominance component histogram, interference signals in the chrominance component histogram is reduced, thereby further reducing false segmentation. According to the present invention, the peak and the valley in the chrominance component histogramis determinedbased on the preset chrominance interval and the preset peak-valley setting conditions, so as to improve the speed of identifying the peak and the valley.
  • In addition, it should be understood that, while this specification is described in accordance with embodiments, each embodiment does not contain only an independent technical solution, and the description is onlyfor clarity. Those skilled in the art should take the description as a whole, and the technical solutions in each embodiment may be suitably combined to form other embodiments that may be understood by those skilled in the art.
  • The series of detailed descriptions set forth above are intended to be specific to feasible embodiments of the present invention only and are not intended to limit the scope of protection of the present invention, and any equivalent embodiments or modifications made without departing from the technical spirit of the present invention should be falling within the scope of protection of the present invention.

Claims (10)

  1. An image shadow detection method; characterized in that the method comprises the following steps:
    acquiringthe chrominance component of the image;
    segmentingthe image by a first segmentation rule based on the chrominance component of the image and a preset chrominance interval and acquiring a first segmentation result;
    calculatinga feature value of the image relative to the first segmentation result;
    carrying out the comparison processing to judge whether the image has shadowbased on the feature value and the preset threshold value.
  2. The image shadow detection method according to claim 1, characterized by after the carrying out the comparison processing to judge whether the image has shadowbased on the feature value and the preset threshold value comprising the following steps: carrying out the corresponding image processingbased on the judgment result, the carrying out the corresponding image processingbased on the judgment resultcomprising: if the judgment result is that there is a shadow, segmenting the image by a second segmentation rule based on the chrominance component of the image and a preset chrominance interval to acquire a second segmentation result, and taking the second segmentation result as the final segmentation result; if the judgment result is that there is no shadow, taking the first segmentation result as the final segmentation result.
  3. The image shadow detection method according to claim 2, characterized in that, the first segmentation result comprises a first region and a second region, and the feature value comprises any one or a combination of a first average luminance value of the first region, a second average luminance value of the second region, a luminance difference between the first average luminance value and the second average luminance value, a first roughness value of the first region, a second roughness value of the second region, or the roughness ratio of the first roughness value and the second roughness value, and each feature value is provided with a corresponding preset threshold value, wherein, the carrying out the comparison processing to judge whether the image has shadowbased on the feature value and the preset threshold value comprisesthe comparison processing based on each feature value and the corresponding preset threshold value, and judging whether the image has a shadow based on any comparison result or a combination comparison result.
  4. The image shadow detection method according to claim 3, characterized in thatacquiring the chrominance component of the image comprises:
    acquiring HSV image;
    carrying out the separation processing on the HSV image and acquiring an H-channel image and a V-channel image, wherein the H-channel image comprises a chrominance component and the V-channel image comprises a luminance component.
  5. The image shadow detection method according to claim 4, characterized in that, the calculating a feature value of the image relative to the first segmentation resultcomprises: calculating a first average luminance value of the first region, a second average luminance value of the second region, and the luminance difference between the first average luminance value and the second average luminance value based on luminance components of the first region or the second region.
  6. The image shadow detection method according to claim 4, characterized in thatthe calculating a feature value of the image relative to the first segmentation result comprises:
    pre-processing the V-channel image to acquire a pre-processed image, wherein the pre-processing comprises filtering processing and normalization processing;
    performingedge extraction on the pre-processed image to acquire an edge image;
    calculatinga first roughness value of the first region, a second roughness value of the second region, and a roughness ratio of the first roughness value to the second roughness value in the edge image.
  7. A walking control method of an intelligent lawn mower, characterized in that the method comprises the following steps:
    acquiringthe chrominance component of lawn image;
    segmentingthe lawn image by a first segmentation rule based onthe chrominance component of the lawn image and a preset lawn chrominance interval and acquiring a first segmentation result;
    calculatingan feature value of the lawn image relative to the first segmentation result;
    carrying out the comparison processing to judge whether the image has shadowsbased on the feature value and the preset threshold value;
    carrying out the corresponding image processing based on the judgment resultto control the walking direction of the intelligent lawn mower.
  8. An image shadow detection system, characterized in that the system comprises:
    achrominance component acquisition module for acquiring a chrominance component of an image;
    animage segmentation module for segmenting the image by a first segmentation rule based on the chrominance component of the image and a preset chrominance interval and acquiring a first segmentation result;
    afeature processing module for calculating a feature value of the image relative to the first segmentation result;
    a shadow identification module for carrying out the comparison processing to judge whether the image has shadows based on the feature value and the preset threshold value.
  9. An image processing apparatus, comprising a memory and a processor, the memory having a computer program stored therein, characterized in that, when the processor executes the computer program, implementing the steps of the image shadow detection method of any one of claims 1 to 6.
  10. A readable storage medium, having stored therein a computer program, characterized in that, when executed by a processor, the computer program implements the steps of the image shadow detection method of any one of claims 1-6.
EP20952203.6A 2020-09-02 2020-10-28 Image shadow detection method and system, and image segmentation device and readable storage medium Pending EP4209957A4 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202010907601.6A CN114202496A (en) 2020-09-02 2020-09-02 Image shadow detection method, system, image segmentation device and readable storage medium
PCT/CN2020/124360 WO2022047961A1 (en) 2020-09-02 2020-10-28 Image shadow detection method and system, and image segmentation device and readable storage medium

Publications (2)

Publication Number Publication Date
EP4209957A1 true EP4209957A1 (en) 2023-07-12
EP4209957A4 EP4209957A4 (en) 2024-07-10

Family

ID=80491623

Family Applications (1)

Application Number Title Priority Date Filing Date
EP20952203.6A Pending EP4209957A4 (en) 2020-09-02 2020-10-28 Image shadow detection method and system, and image segmentation device and readable storage medium

Country Status (4)

Country Link
US (1) US20240020845A1 (en)
EP (1) EP4209957A4 (en)
CN (1) CN114202496A (en)
WO (1) WO2022047961A1 (en)

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103295013A (en) * 2013-05-13 2013-09-11 天津大学 Pared area based single-image shadow detection method
CN105049679B (en) * 2014-04-17 2019-02-22 株式会社摩如富 Image processing apparatus and image processing method
CN105913441B (en) * 2016-04-27 2019-04-19 四川大学 It is a kind of for improving the shadow removal method of target detection performance in video
CN107846583B (en) * 2017-10-27 2020-09-01 维沃移动通信有限公司 Image shadow compensation method and mobile terminal
CN107945106B (en) * 2017-11-30 2022-02-15 Oppo广东移动通信有限公司 Image processing method, image processing device, electronic equipment and computer readable storage medium

Also Published As

Publication number Publication date
CN114202496A (en) 2022-03-18
EP4209957A4 (en) 2024-07-10
US20240020845A1 (en) 2024-01-18
WO2022047961A1 (en) 2022-03-10

Similar Documents

Publication Publication Date Title
CN110378945B (en) Depth map processing method and device and electronic equipment
US7639878B2 (en) Shadow detection in images
WO2021051604A1 (en) Method for identifying text region of osd, and device and storage medium
CN105184763B (en) Image processing method and device
CN105913082B (en) Method and system for classifying targets in image
US20200250840A1 (en) Shadow detection method and system for surveillance video image, and shadow removing method
CN108563979B (en) Method for judging rice blast disease conditions based on aerial farmland images
KR102074073B1 (en) Method for detecting vehicles and apparatus using the same
CN111695373B (en) Zebra stripes positioning method, system, medium and equipment
CN111476804B (en) Efficient carrier roller image segmentation method, device, equipment and storage medium
CN114127784A (en) Method, computer program product and computer readable medium for generating a mask for a camera stream
CN112380973A (en) Traffic signal lamp identification method and system
WO2024016632A1 (en) Bright spot location method, bright spot location apparatus, electronic device and storage medium
CN113449639A (en) Non-contact data acquisition method for instrument by gateway of Internet of things
CN117095015A (en) Image segmentation method, device, computer equipment and readable storage medium
CN107977608B (en) Method for extracting road area of highway video image
US11308624B2 (en) Adhered substance detection apparatus
US20210089818A1 (en) Deposit detection device and deposit detection method
EP4209957A1 (en) Image shadow detection method and system, and image segmentation device and readable storage medium
CN117496109A (en) Image comparison and analysis method and device, electronic equipment and storage medium
CN111429487A (en) Sticky foreground segmentation method and device for depth image
US20230351603A1 (en) Chrominance Component-Based Image Segmentation Method and System, Image Segmentation Device, and Readable Storage Medium
CN112926676B (en) False target identification method and device and computer equipment
CN112329572B (en) Rapid static living body detection method and device based on frame and flash point
US20190197349A1 (en) Image identification method and image identification device

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20230227

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
REG Reference to a national code

Ref country code: DE

Ref legal event code: R079

Free format text: PREVIOUS MAIN CLASS: H99Z9999999999

Ipc: G06V0010440000

A4 Supplementary search report drawn up and despatched

Effective date: 20240610

RIC1 Information provided on ipc code assigned before grant

Ipc: A01D 34/00 20060101ALI20240604BHEP

Ipc: G06V 10/50 20220101ALI20240604BHEP

Ipc: G06V 10/28 20220101ALI20240604BHEP

Ipc: G06T 7/136 20170101ALI20240604BHEP

Ipc: G06T 7/12 20170101ALI20240604BHEP

Ipc: G06V 10/26 20220101ALI20240604BHEP

Ipc: G06V 20/56 20220101ALI20240604BHEP

Ipc: G06V 10/60 20220101ALI20240604BHEP

Ipc: G06V 10/56 20220101ALI20240604BHEP

Ipc: G06V 10/44 20220101AFI20240604BHEP