EP3877902A1 - Procédé pour régler le fonctionnement d'une machine utilisée pour récolter des plantes sarclées - Google Patents

Procédé pour régler le fonctionnement d'une machine utilisée pour récolter des plantes sarclées

Info

Publication number
EP3877902A1
EP3877902A1 EP19808698.5A EP19808698A EP3877902A1 EP 3877902 A1 EP3877902 A1 EP 3877902A1 EP 19808698 A EP19808698 A EP 19808698A EP 3877902 A1 EP3877902 A1 EP 3877902A1
Authority
EP
European Patent Office
Prior art keywords
image
conveying
test
evaluation device
movement
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
EP19808698.5A
Other languages
German (de)
English (en)
Inventor
Wolfram STROTHMANN
Daniel Bösenberg
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Grimme Landmaschinenfabrik GmbH and Co KG
Original Assignee
Grimme Landmaschinenfabrik GmbH and Co KG
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Grimme Landmaschinenfabrik GmbH and Co KG filed Critical Grimme Landmaschinenfabrik GmbH and Co KG
Publication of EP3877902A1 publication Critical patent/EP3877902A1/fr
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G06V10/56—Extraction of image or video features relating to colour
    • A—HUMAN NECESSITIES
    • A01—AGRICULTURE; FORESTRY; ANIMAL HUSBANDRY; HUNTING; TRAPPING; FISHING
    • A01D—HARVESTING; MOWING
    • A01D17/00—Digging machines with sieving and conveying mechanisms
    • A01D17/10—Digging machines with sieving and conveying mechanisms with smooth conveyor belts, lath bands or rake bands
    • A—HUMAN NECESSITIES
    • A01—AGRICULTURE; FORESTRY; ANIMAL HUSBANDRY; HUNTING; TRAPPING; FISHING
    • A01D—HARVESTING; MOWING
    • A01D33/00—Accessories for digging harvesters
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/24—Classification techniques
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/0002—Inspection of images, e.g. flaw detection
    • G06T7/0004—Industrial image inspection
    • G06T7/001—Industrial image inspection using an image reference approach
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/20—Image preprocessing
    • G06V10/255—Detecting or recognising potential candidate objects based on visual cues, e.g. shapes
    • A—HUMAN NECESSITIES
    • A01—AGRICULTURE; FORESTRY; ANIMAL HUSBANDRY; HUNTING; TRAPPING; FISHING
    • A01D—HARVESTING; MOWING
    • A01D17/00—Digging machines with sieving and conveying mechanisms
    • A01D17/10—Digging machines with sieving and conveying mechanisms with smooth conveyor belts, lath bands or rake bands
    • A01D2017/105—Driving means for the belt
    • A—HUMAN NECESSITIES
    • A01—AGRICULTURE; FORESTRY; ANIMAL HUSBANDRY; HUNTING; TRAPPING; FISHING
    • A01D—HARVESTING; MOWING
    • A01D33/00—Accessories for digging harvesters
    • A01D2033/005—Yield crop determination mechanisms for root-crop harvesters
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30108—Industrial image inspection
    • G06T2207/30128—Food products
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/60—Type of objects
    • G06V20/68—Food, e.g. fruit or vegetables
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V2201/00—Indexing scheme relating to image or video recognition or understanding
    • G06V2201/06—Recognition of objects for industrial automation

Definitions

  • the invention relates to a method for regulating the operation of a machine for harvesting root crops and the machine.
  • at least one test image of crops advanced by means of at least one conveyor element relative to a machine frame is recorded by at least one optical image acquisition unit.
  • the crop includes root crops.
  • a conveying speed of the conveying element is set on the basis of a test data record generated on the basis of the test image or formed by the test image.
  • the test image shows crop that was previously picked up by the machine for harvesting root crops.
  • the conveyor element as part of the machine serves the locomotion of the crop within the machine, with at least part of the crop being in direct contact with the conveyor element.
  • the conveying speed at which the conveying element moves is set with the test data record.
  • US 2018/0047177 A1 discloses a method in which a speed of the conveying element is determined on the basis of the test image. The conveying speed of the conveying element is adjusted on the basis of this determined speed.
  • a disadvantage of the known, generic methods is that, depending on the harvesting conditions, associated separation units cause significant damage to the root crops or to a large amount of admixtures among the root crops unloaded from the machine.
  • the object of the present invention is to provide a method for optimizing the utilization of the conveying element in favor of an improved protection of the root crops.
  • the object is achieved by a generic method in which an evaluation device based on the test data set generates a conveyor speed signal independent of a speed of the crop to adjust the conveyor speed.
  • an evaluation device based on the test data set generates a conveyor speed signal independent of a speed of the crop to adjust the conveyor speed.
  • who the or the test data sets for the conveying speed signal on which the speed of the crop shown with the test image and in particular the conveyor element has no influence.
  • the speed of the crop is understood to be the direction-independent speed of the crop transported by means of a conveyor element. Accordingly, under a (conveying) speed of the conveying element, its direction-independent speed amount understood, for example, the speed of rotation of a belt, a screen star or a roller.
  • the machine is a self-propelled or towed vehicle for harvesting root crops, especially potatoes, beets, carrots or chicory.
  • the machine is moved in particular in the direction of rows, in particular planting embankments, of the root crops to be harvested and these are taken up as part of the crop in a continuous process from the ground.
  • After picking up the crop it is at least partially moved relative to the machine frame of the machine by the at least one conveyor element.
  • the conveying element also serves to separate the root crops from additions and is in particular part of a separating device comprising at least one separating element for separating the root crops arranged on the conveying element from additions arranged on the conveying element.
  • the machine can also be a machine for separating root crops from additions to the crop, e.g. of clods, stones or earth.
  • the conveying element is rotating or rotating.
  • the conveying element is preferably designed as a sieve star, sieve belt, hedgehog belt, ring elevator or as a conveyor roller, in particular comprising a roller table.
  • the winningge speed is in particular a lateral speed of the crop contacting conveyor element section, a circulation or a rotational speed.
  • the optical image acquisition unit is arranged in a stationary manner on the machine, in particular above the conveyor element.
  • the image acquisition unit is directed at the conveying element and thus during operation at a flow of crops conveyed by the conveying element.
  • the method according to the invention is carried out in particular exclusively during the harvesting with the machine and is preferably repeated cyclically. In particular, transitions between individual conveying elements, e.g. in the form of drop levels, and supply and discharge conveying elements in front of and behind separating elements of separating devices.
  • the test image is, in particular, a multidimensional, preferably two-dimensional, image, on which at least part of the harvested crop with root crops, quantities and / or the conveying element is depicted.
  • the test data record is either already generated by the image acquisition unit or by the evaluation device. Alternatively, the test data record can be formed by the test image itself. This applies in particular to image acquisition units whose test images already have a format suitable for the subsequent analysis in the evaluation device.
  • the test data record is, in particular, one that is created by processing, for example filtering and / or other images, and is at least temporarily available in the system. gender data set, the information of which, for example, color values, is evaluated in the evaluation device.
  • test image or the test data record is transmitted from the image acquisition unit to the evaluation device.
  • the optical image capture unit is designed in particular as a digital photo or video camera for two-dimensional recording of the test image or as a line scan camera. Insofar as reference is subsequently made to the test image in connection with the processing of the image information in the evaluation device, this can be the test data record in this context.
  • the evaluation device is used to evaluate the test data set.
  • the evaluation device comprises at least one processor and is designed either as a central computing unit or as a decentralized system comprising at least one processor and at least one memory with different positions on components of the machine. It is therefore a local system to carry out any evaluations directly on site and to make the results available directly.
  • the conveying speed signal for setting the conveying speed is sent by the evaluation device, in particular to a conveying speed control device of the machine or the conveying element itself.
  • the conveying speed signal is preferably a digital data record which is transmitted in a wired or wireless manner. This preferably triggers an increase, a decrease or a maintenance of the present conveying speed.
  • the Conveyor speed signal corresponds in particular to a load characteristic value calculated on the basis of the test data set, which characterizes the workloads of the conveyor element, and is interpreted in particular by the conveyor speed control device.
  • an electrical signal is emitted by the conveyor speed control device, which in an advantageous embodiment of the invention is comprised of the same computing unit as the evaluation device.
  • the conveying speed control device in particular by the electrical signal, in particular a hydraulic pressure, a pneumatic pressure, a current, a voltage, a force and / or a moment is adapted to drive the conveying element.
  • the conveying speed control device receives further signals, in particular with higher priority, by means of which it adjusts the conveying speed.
  • the advantage of a conveyor speed signal that is independent of a speed of crop flow objects is that the error entered by determining the crop or conveyor element speed, which makes it difficult or impossible to detect that the conveyor element is too small or too dense, is avoided.
  • the winninggeschwin speed signal is dependent on other dynamic, ie related to the movement of the crop or the conveying element, or stationary, ie on a movement of their independent, quantities. In a majority of these, a significant correlation to the utilization of the conveyor element could be determined, so that the utilization can now be reliably controlled using the conveyor speed signal. The necessary for the generation of the necessary signal capacity is also reduced.
  • the setting of the conveying speed is carried out in particular automatically and independently of the driving speed of the self-propelled or towed machine, as a result of which operating personnel are less distracted.
  • the evaluation device preferably compares the test data record with an output data record generated on the basis of an output image or formed by the latter.
  • the output data record created on the basis of the output image or formed by it was recorded with the same optical image acquisition unit in time before the test image.
  • the output data record results from processing that is the same as that for processing the test data record.
  • brightness values, contrasts or color values are compared.
  • By comparing the test data set with the output data set an evaluation of the dynamic behavior of the crop is simplified and / or trends in the composition can be identified, as a result of which further information on the operating state of the machine and its development can be determined. On the basis of this information, a more functional conveying speed signal can be provided and it can be a temporary one improved utilization can be achieved.
  • the comparison of brightness values, contrasts or color values can also include a statistical evaluation of these respective values.
  • the conveying speed signal for setting the conveying speed which is generated on the basis of the test data set and the output data set, is preferably independent of the speed of the crop and / or of the conveying element, or at least only additionally.
  • the test data set serves as a starting data set for a first execution of the method in a further execution of the method.
  • the test data record of a first embodiment of the method thus resembles the output data record of a further embodiment of the method.
  • both a test image and an output image are recorded each time the method is carried out.
  • the optical image acquisition unit records images with a frequency between 0.1 and 1000 Hertz, preferably a comparison of the test data record with the output data record with a lower frequency, in particular from 0.1 to 10 Hertz, takes place.
  • the method according to the invention is characterized in that the evaluation device determines the conveying speed signal on the basis of an evaluation of the optical flow of the crop resulting from the test and the output data set.
  • the optical flow, which results from the test and the output data record is a data record with movement information of the objects or objects visible in the test image, in particular in the reference system of the imaging optics of the image acquisition unit.
  • the evaluation device preferably calculates at least one movement characteristic data record, in particular for determining the optical flow.
  • the movement characteristic data set identifies a movement, in particular a direction of movement, of at least one object which is at least partially imaged by the test image, in particular by a part of the test image.
  • several objects can be imaged on at least part of the test image at the same time, so that the movement characteristic data record at least indirectly indicates the direction of movement thereof.
  • the conveyor speed signal is generated on the basis of the movement characteristic data record.
  • the movement characteristic data record preferably contains only one piece of information or a numerical value or a plurality of pieces of information or numerical values.
  • the movement characteristic data record is calculated in particular on the basis of both the test data record and the output data record or their comparison, alternatively only on the basis of the test data record.
  • the movement characteristic data record contains an indication by which a movement of the object or objects at least partially depicted is at least partially specified.
  • the movement characteristic data record has information on the direction.
  • the movement data record can have information on a plurality of directions or on an overall direction of movement.
  • the object can be any at least partial representation of an imaged body with a physical extension, in particular in particular at least part of a root crop, a herb, a clod, earth, the conveying element, or combinations thereof.
  • the movement information of any objects or combinations of objects in the test image and in the output image are determined in the determination of the optical flow by comparing at least partially recoverable areas in both images.
  • These retrievable areas can be, for example, the size of a pixel or can be characterized by a pixel, so that no object recognition in the sense of a detection of objects in the form of root crops, stones or the like is necessary.
  • a detailed conclusion about a movement situation of the harvested crop can be calculated.
  • a movement situation arises solely from the consideration of the direction of the movement, preferably without considering the speed.
  • the conveying speed signal and a consequent change in conveying speed can influence the movement situation particularly continuously and in a manner that is particularly error-free and thus achieve an optimal throughput of crop.
  • the movement characteristic data record preferably contains two numerical values, on the basis of which a vector can be generated.
  • the movement characteristic data record preferably comprises two lines in different directions or alternatively an angle and a line.
  • at least one vector can be generated, which is preferably displayed to the user with the test image on a visualization unit. The user thereby receives an image of the movement situation and can check the conveying speed change made by the evaluation device, if desired, for its success.
  • a test sub-data set that is generated on the basis of a first partial image area of the test image is compared with a plurality of output sub-data sets that are generated on the basis of further partial image areas of the output image.
  • an output sub-data record that is generated on the basis of a first partial image area of the output image is compared with a plurality of test sub-data records that are generated on the basis of further partial image areas of the test image.
  • a match between the respective test and initial sub-data sets is assessed.
  • exactly one test sub-data record with exactly one gear sub-record compared.
  • a match between a test and an output sub-data record is particularly good when the sub-picture areas described by them have a great visual similarity.
  • brightnesses, contrasts and / or color values can be compared.
  • the correspondence is evaluated in particular only on the basis of the respective test and output data sets, alternatively on the basis of further data of the test and output data sets.
  • the correspondence is also assessed on the basis of further information that is not part of the test and output data sets and that is recorded in particular by sensors of the machine.
  • an auxiliary variable such as a rotational speed of the conveying element, is taken into account for the evaluation of the match.
  • an expected positional deviation of two partial image areas from the test and the output data record is preferably predetermined and is included in the evaluation of the match.
  • the correspondence is preferably assessed on the basis of a contrast of the components of the test and output sub-data sets on which the partial image areas are based.
  • a determined contrast of the first image area is compared with at least partially matching contrasts of the further partial image areas and the agreement of the contrasts is evaluated, in particular on the basis of a brightness or color gradient or a spatial extension of the contrast.
  • the movement characteristic data record of an object shown by the first partial image area is particularly preferably calculated on the basis of position characteristic values of the test data record and the output data record, which are assigned to the two best matching test and output sub-data records.
  • Both the test data record and the output data record thus contain positional values which represent the position under different image areas of the test image or the output image relative to other image areas or image reference markings or absolutely.
  • the direction of movement is calculated in particular on the basis of a calculation of two differing position characteristic values, for which purpose the position characteristic values include position data of at least two different dimensions.
  • the direction of movement thus indicates from where to where an image area or object represented by the test image or by the output image has moved between the recording of the output image and the recording of the test image, and is in particular different by two movement paths Reference directions defined. This allows a make particularly precise statements regarding the movement situation on the conveyor element and in particular determine whether the crop is blocked or unhindered movement.
  • the evaluation device divides both the test image and the output image into a plurality of image areas which are preferably of equal size, each image area of the test image or of the output image being assigned an image region of the output image or test image which best matches it.
  • Each image area is based in particular on a test or output sub-data record. This enables a plurality of movement characteristic data sets, in particular directions of movement, to be determined and the movement situation to be determined in a higher resolution.
  • a degree of correspondence characterizing the degree of correspondence between a test sub-data set and an output sub-data set has an influence on the conveying speed signal.
  • the direction of movement calculated on the basis thereof has a different meaning in the calculation of the conveying speed signal.
  • the evaluation device preferably generates a movement characteristic data set for different objects at least partially represented with the test image or different first image areas, which in particular comprise exactly one pixel of the test and / or the output image.
  • one movement characteristic data record is determined for a plurality of test and / or output sub-data records, independently of objects shown by the respective images.
  • a movement characteristic data record is particularly preferably generated in each case in particular comprising a movement direction for a plurality of pixels of the test and / or the output image.
  • a movement characteristic data record is generated for each pixel of the test and / or the output image or, alternatively, preferably at least for each pixel of a selected, contiguous section of the test and / or the output image.
  • the evaluation device preferably calculates a movement characteristic data record for a plurality of image areas each comprising at least a first number of pixels and in a later calculation step and taking into account those calculated in the first calculation step Motion characteristic data sets each a further movement characteristic data record for a higher number of deviating image areas which comprise a smaller number of pixels.
  • the evaluation device calculates a movement characteristic data record for a smaller number of larger image areas and in the later calculation step a larger number of movement characteristic data records for smaller image areas, which, when put together, give the same overall picture as the larger picture areas.
  • the movement characteristic data sets calculated in the last calculation step which are assigned in particular to each pixel, are determined by an iterative approximation, and thus the probability of incorrect movement characteristic data sets, which in particular include movement directions that do not correspond to the real movement directions of the objects on the conveying element, minimized.
  • the at least one movement characteristic data record preferably includes at least temporarily a first movement path in a first direction and a second movement path in a second direction and / or a direction and / or a rich direction that deviates from the first, in particular by 90 ° in the image plane total movement distance independent of the direction.
  • the direction and thus the direction of movement of the movement characteristic data set is calculated on the basis of the first and the second movement distance.
  • the movement distances and / or the total movement distance are specified in particular as relative values which are dependent on the positioning, in particular on the orientation of the image acquisition unit and do not require any separate calibration.
  • the evaluation device calculates a utilization characteristic on the basis of at least one movement characteristic of the at least one movement characteristic data characterizing a direction of movement and in particular on the basis of at least one reference characteristic value assigned to the movement characteristic.
  • a utilization characteristic is calculated on the basis of its plurality of movement characteristic values, each movement characteristic value being part of a different movement characteristic data record.
  • the movement characteristic value specifies in particular the extent of a movement in a transverse direction deviating from the conveying direction of the conveying element or specifies a direction of movement, for example an angular indication.
  • the movement parameters are either offset as such to the utilization characteristic or initially offset against the assigned reference characteristic.
  • the reference characteristic value specifies in particular an ideal or global direction in which the crop has to move. Deviations of the movement characteristic values from the reference characteristic value or the reference characteristic values are thus preferably used to calculate the utilization characteristic value.
  • the reference parameters are preferably all the same and indicate the direction in which the crop has to move overall and / or have have different values that assign each image area or test or output sub-record its own direction of movement to be compared.
  • the evaluation device particularly preferably statistically evaluates a plurality of movement characteristic values, which are comprised by different movement characteristic data sets, in order to calculate the utilization characteristic value.
  • the movement characteristics of the pixels of at least part of the test image are preferably involved.
  • the evaluation device calculates a standard deviation of the movement characteristic values, which in particular characterize a direction of movement, from the respective reference characteristic values or from the uniform reference characteristic value.
  • the amounts of the deviation from the movement and reference values are used in particular in that an average amount-based deviation is first calculated.
  • the statistical evaluation of the movement characteristic values and thus the determination of the load characteristic value preferably takes place independently of the amount of the speed of the crop represented by the test image.
  • the differences between the deviations from the mean deviation are then formed and then squared.
  • the squared differences are summed up and divided by the number of movement parameters and the square root of the result is taken.
  • the utilization characteristic value is calculated as the mean value of the movement characteristic values which indicate the direction of movement, or their amounts or their amount-related deviation from the reference characteristic value (s).
  • the mean value is calculated for movement characteristic values which indicate a total movement distance or an average quadratic deviation of these movement characteristic values. In these cases too, the load factor has a significant correlation with the actual tendency of the machine to clog.
  • a statistical evaluation of only the directions of movement of the objects at least partially depicted on the test images is generally provided, in particular using the standard deviation of the direction of movement to one indicated by the main conveying direction (s) of the associated conveying element. given reference direction for determining the conveying speed signal be particularly well suited.
  • the utilization characteristic value is calculated as the mean value of the movement characteristic values, which indicate the direction of movement, or their amounts or their amount-related deviation from the reference characteristic value (s).
  • the mean value is calculated for movement characteristic values which indicate a total movement distance or an average quadratic deviation of these movement characteristic values.
  • the load factor has a significant correlation with the actual tendency of the machine to clog.
  • statistical characteristics that can describe the flow behavior and can be used individually or together with other values as input variables for speed regulation, percentiles over flow lengths or orientations, statistical, absolute or central moments 1., 2.,. .. kth order, or especially histogram comparisons of the current histograms with pre-configurable normal histograms can be used.
  • the evaluation device calculates at least one first portion of the test image formed by at least one image area.
  • the at least one image area at least partially depicts a defined component of the crop or the machine.
  • Utilization characteristic or another utilization characteristic is calculated.
  • the load characteristic value is to be equated with the share in many exemplary embodiments.
  • the component that is statistically represented by the first share is predefined.
  • the test image and / or the test data set are in particular divided into a plurality of preferably equally large image areas.
  • the portion is in particular a portion of these image areas, which at least partially show the constituent parts, of the entire image, the first portion being formed on the basis of a ratio of the number of image areas or on the basis of their common areas.
  • the first portion is a measure of the extent of image areas that depict the component and thus a measure of the density of the component in the field of view of the image acquisition unit or the portion of the test image to be viewed.
  • the component is, in particular, at least partially a root crop component, as a result of which the first fraction at least approximately indicates a concentration of root crops.
  • An image area is in particular evaluated as a component and is assigned to the first component if at least 50% to 100% of its area shows the component.
  • the at least one image area can also be assigned only partially to the first portion or preferably partially assigned to different portions. This is particularly advantageous if, within the framework of the preferably model-based classification method, it is not possible to clearly assign the image area to a corresponding component.
  • probabilities for the allocation to different shares are determined.
  • the image areas are particularly preferably assigned proportionately or partly to different proportions according to the probabilities. As a result, the relationships between the components are mapped even more precisely.
  • the characteristic value is calculated, which in particular characterizes the composition of the crop.
  • the conveying speed can be regulated particularly advantageously, since the cleaning performance of the conveying element or the separating device comprising the conveying element is strongly dependent on the composition of the crop.
  • the conveying speed can preferably be increased with increasing first portion in order to produce a lower occupancy in favor of a larger separating, in particular sieving, effect.
  • the load factor is preferably calculated at least on the basis of the first component or is equal to the first component.
  • the conveying speed signal is preferably dependent on a speed of the crop or of the conveying element. Using a speed value that represents this speed, it is possible in particular to calculate the utilization characteristic value, which therefore has a different informative value.
  • the at least one image area, which forms the first portion, is preferably based in particular on a test data generated on the basis of the image area. set, identified as showing the defined component.
  • the image area is identified on the basis of a test value contained in the test image and / or in the test sub-data record, preferably color information.
  • the color information includes, in particular, black-and-white, gray and / or color channel values of a color space.
  • the test sub-data set, the test value or the color information is preferably classified by a model-based, statistical classification method.
  • An image area is therefore assigned to the first portion in particular if the result of the classification process is assigned to the defined component of the crop or the machine.
  • the classification method uses in particular a neural network, a random forest, a Bayesian classifier, a support vector machine and / or a decision tree. By using the classification method, the result of the calculation of the first portion, in particular of different portions, is particularly robust and powerful in terms of the composition of the crop.
  • the test value or the color information is particularly preferably compared with one or more reference values or reference areas and, based on this, an image area is either assigned to the first portion or not.
  • the reference image is preferably to be acquired by the optical image acquisition unit, with a user in particular having to mark different parts of the reference image as different components. This form of differentiation enables particularly reliable identification of a enables the component on the test image.
  • at least one of the test values of the test sub-data set which in particular comprises the color information, is compared with at least one reference value and an image area is particularly assigned to the first component if at least the at least one test value of the test sub-data set lies within an assigned reference value range .
  • This reference value range is limited in particular by a maximum value and by a minimum value, with different test values preferably having to lie in assigned reference value ranges in order to add the image range to the first portion.
  • the evaluation device automatically or automatically further develops a model on which the classification method is based upon the input of exemplary image areas of the reference image which are to be attributed to the first portion.
  • the evaluation device automatically calculates or changes the at least one reference value range upon input of exemplary image areas of a reference image that are to be attributed to the first portion.
  • the reference values, the reference value ranges or the model or model parameters thereof are therefore at least not completely manually predefined by the user. Instead, it is sufficient to enter at least one exemplary image area, which shows the component, for starting up the evaluation device. Based on the image area, the evaluation device automatically determines the at least one reference value, the at least one reference value area or the model or model parameters thereof.
  • the evaluation device is based on different applications largely independently. The greater the number of image areas entered, the more precisely the reference values, the reference value areas or the model or model parameters thereof can be determined.
  • the method is particularly robust when the entered image areas show the component under different brightness and / or soil conditions. The method can therefore be used reliably even under different application conditions.
  • the evaluation device particularly preferably adjusts the at least one reference value or the reference value ranges during the repeated execution of the method, if necessary with exemplary identification of relevant components by the operator, from which training data for the algorithm can be mapped.
  • the evaluation device automatically extends the scope of the reference data, in particular on the basis of further sensors such as brightness sensors for measuring the ambient brightness, which the evaluation device assigns to test data records recorded essentially at the same time.
  • the user of the method ie in particular the driver or operator of the machine or a machine coupled to it, has the option of manually marking the at least one component on visualized test images in order to expand the scope of the reference data of the evaluation device.
  • the user can differentiate between, for example, potatoes, cabbage, stones and clods and calculate the respective proportions.
  • the method according to the invention is preferably carried out automatically after it has started, with the exception of entering any training data that may be present in the form of marking components.
  • the driver or operator of the machine is easier to operate.
  • the image areas forming the first portion are preferably identified on the basis of image sub-data sets generated on the basis of respectively adjacent image areas or formed thereby.
  • color information preferably also comprising black-and-white and / or gray values, included in the test sub-data sets is used for this purpose.
  • the evaluations of the image areas therefore do not take place solely on the basis of the data assigned to them, but will also use additional data assigned to the surrounding image areas. In this way, brightness and / or color gradients can be determined and the identification takes place on the basis of a broader data basis.
  • the different image areas are preferably weighted differently when calculating the first portion.
  • the contribution of the image areas forming the first part is therefore different. This makes it possible not to calculate the first portion purely on the basis of the perspective representations of the test image, but rather to give particular weight to image regions which show a component of the crop that is further away from the image acquisition unit than image regions which show a component closer to the image acquisition unit . This allows form a perspective-adjusted first part and thus achieve a particularly realistic picture of the crop composition on the conveyor element.
  • the entire test image or a coherent part of the test image is preferably subdivided into, for example, previously described partial image areas.
  • the partial image areas in particular each comprise the same number of pixels of the test image, preferably exactly one pixel.
  • the test image part is a part or section of the test image which comprises a plurality of partial image areas. To calculate the first portion, only the image areas showing the portion that belong to the part of the test image are taken into account. For this purpose, the part of the test image is particularly defined so that it depicts sensitive and monitored zones within the machine.
  • the image area forming the first portion thus comprises, in particular, a plurality of partial image areas of a test image part.
  • the test image or part of the test image is in particular rastered into a plurality of partial image areas, each of which is preferably rectangular.
  • the sub-image areas are formed by exactly one pixel, a particularly large database for evaluating the condition of the crop with regard to its individual components is created, and thus a particularly sensitive control of the operating parameter is made possible.
  • the data supplied by conventional 2D digital cameras with a maximum of a few million pixels as a rule can be processed promptly for an evaluation device equipped with one or more current processors.
  • the test image preferably comprises a plurality of test image parts, for each of which the evaluation device calculates a first portion, in particular a plurality of portions of image areas.
  • the test image parts in particular show different sections of the same conveying element or different conveying elements.
  • test image parts show sections of a conveying element, one of which is arranged in the conveying direction in front of a separating device or a separating element thereof and another behind the separating device or a separating element thereof.
  • the test image parts show different conveying elements, which represent alternative conveying paths for different components of the crop (for example, a conveying element for cleaned root crops, a conveying element for sorted additives).
  • the first portion of a crop flow to the separating device can be compared with the first portion of a root crop mixture outflow from the separating element or the separating device and thus the effectiveness of the separating device can be determined.
  • the conveying speed is set so that, for example, congestions occurring at short notice can be remedied by a slower request or faster removal.
  • an occupancy with crop can be set in relation to an occupancy in the run-up to this area, for example to increase the conveying speed if the occupancy in front of the deflection device is too low.
  • the test image parts depicted or present in the respective test data records can show part of a conveying element in front of a separating or deflecting element of the separating device and part of the conveying element after the separating or deflecting element. If the image analysis shows that too large proportions of e.g.
  • the conveying speed can be adjusted accordingly.
  • the test image parts preferably show different conveying elements after a separating device, in particular a conveying element for discharging a root crop mixture and a conveying element for discharging additions after the same separating device.
  • a first proportion of a component for example root crops
  • different proportions are calculated for the different parts of the test pattern. This makes it possible, for example, to compare a portion of admixtures in the root crop mixture outflow with a portion of root crops in a stream of sorted admixtures and, based on this, adjust the speed of a conveying element assigned to the separating device.
  • the image areas forming the first portion preferably show root crops or parts thereof and a second portion forming image areas or portions thereof.
  • the evaluation device thus calculates at least two different parts.
  • the evaluation device particularly preferably calculates at least four shares le includes a share for machine components, a share for root crops, a share for herb components, a share for soil or clods, a share for stones and / or a share for damaged areas.
  • a share for machine components a share for root crops, a share for herb components, a share for soil or clods, a share for stones and / or a share for damaged areas.
  • the total of the shares is in particular ⁇ 1.
  • a plurality of parts in the calculation of the evaluation device can provide a more precise picture of the composition of the crop or the occupancy of the conveying element.
  • all image areas of the test image or of a test image part are necessarily assigned to a portion.
  • a degree of agreement between test sub-data sets calculated on the basis of the image areas and reference sub-data records is preferably evaluated and each image area is assigned to the part for which the agreement is greatest.
  • the load factor is based on a deviation of the first portion from a threshold value calculated by the evaluation device.
  • the threshold value characterizes an optimal utilization of the conveying element, a deviation from a defined amount triggering an increase or decrease in the conveying speed.
  • the load factor is based in particular on a plurality of components and preferably further data, in particular sensor data.
  • the conveying speed signal is calculated on the basis of a plurality of utilization characteristic values, in particular calculated chronologically one after the other, or at least one previously calculated utilization characteristic value is included in the calculation of the utilization characteristic value.
  • a moving average of the load characteristic is calculated and is the basis of the conveying speed signal or the load characteristic curve is smoothed, in particular using a low-pass filter.
  • At least one sensor transmits sensor data to the evaluation device, which are incorporated into the calculation of the conveying speed signal.
  • the sensor is in particular a sensor, preferably a touch sensor or an ultrasonic sensor, for measuring a crop layer thickness on the conveying element and / or a rotational speed sensor, in particular for measuring a rotational speed of a conveying element drive.
  • It is preferably a sensor for measuring the drive power, for example in the form of a pressure sensor for measuring a hydraulic oil pressure.
  • a slip of the conveying element is determined on the basis of the speed sensor and is transmitted to the evaluation device in the form of the sensor data.
  • a moisture sensor information can also flow into the calculation of the conveying speed signal.
  • the evaluation device has a much more precise picture of the utilization situation in the area of the conveyor element, which in turn can better influence the conveyor speed.
  • the evaluation device preferably triggers either acceleration or deceleration of the conveying speed of at least individual conveying elements of the harvesting machine by means of different conveying speed signals.
  • the evaluation device or the conveying speed control device comprises a three-point controller, which alternatively triggers either the acceleration, the deceleration or a maintenance of the current conveying speed. Acceleration is triggered in particular when the load factor exceeds a predefined first threshold value, a deceleration is triggered accordingly when the load factor falls below a predefined second threshold value.
  • the current absolute value can advantageously be taken into account again.
  • a conveying speed gradient triggered by the conveying speed signal and / or the difference in conveying speeds before and after acceleration or deceleration depending on the utilization is particularly preferred.
  • a speed increment is preferably greater, the smaller the load factor is and / or smaller, the larger the load factor is.
  • exactly one conveying speed is assigned to each load characteristic, which is continuously adjusted to the load characteristic.
  • the evaluation device receives in particular a signal from a speed or speed sensor which is used to monitor the rotational speed of the conveying element.
  • the signal or the circulation speed can be used to calculate how long the period is theoretical. This configuration of the method avoids over-regulation of the conveying speed and the necessary inertia Changes in the movement situation of the crop and thus the load factor are taken into account.
  • the conveying speed signal is preferably transmitted by wire, in particular by means of CAN bus or Ethernet, or wirelessly to the conveying speed control device, the setting of the conveying element preferably having to be released beforehand by an operator via an input at an interface.
  • This form of data transmission makes it particularly easy to integrate the conveyor speed signal into existing data infrastructures and thus easily change the conveyor speed based on the conveyor speed signal.
  • the reliability of the method is increased in particular by the fact that an operator is shown the resulting or to be made setting of the conveying element instead of an automatic setting in particular in the driver's cabin and at an interface (e.g. in the form of a Fluman interface device) via a corresponding Has to release input.
  • the object is also achieved by a machine for harvesting root crops.
  • the machine comprises a machine frame, at least one conveying element, at least one optical image acquisition unit and an evaluation device and is designed to carry out the method described above.
  • the image capture unit is in particular a 2D or 3D camera, preferably a photo or video camera for recording color or black and white images.
  • the image capture unit is preferably assigned at least one light source which illuminates the objects represented by the test image during operation. This allows the movement characteristics rates, in particular on the basis of the contrasts to be determined, are simplified and calculated more reliably.
  • the evaluation device preferably comprises a graphic processor unit, in particular a GPU (Graphical Processing Unit) or GPGPU (General Pur pose Graphical Processing Unit) and / or an FPGA (Field Programmable Gate Array) -based processor unit.
  • a graphic processor unit in particular a GPU (Graphical Processing Unit) or GPGPU (General Pur pose Graphical Processing Unit) and / or an FPGA (Field Programmable Gate Array) -based processor unit.
  • GPU Graphic Processing Unit
  • GPGPU General Pur pose Graphical Processing Unit
  • FPGA Field Programmable Gate Array
  • the machine has at least one sensor coupled to the evaluation device, in particular a tactile or ultrasonic sensor for measuring a crop layer thickness on the conveying element, a sensor for measuring a drive power, for example a pressure sensor for measuring a hydraulic oil pressure, and a moisture sensor and / or a speed sensor arranged on a conveyor element.
  • a sensor for measuring a drive power for example a pressure sensor for measuring a hydraulic oil pressure
  • a moisture sensor and / or a speed sensor arranged on a conveyor element.
  • the machine preferably has a plurality of image recording units which record at least one test image from the same conveying element during operation.
  • the machine preferably has several, in operation, at least one test image of image capturing units accommodating different conveying elements.
  • a plurality of image acquisition units can be used to track the composition of the crop, in particular a course of the first portion along a conveyor line of the machine.
  • the conveying speeds of different conveying elements can thus be set using different, first shares.
  • the conveying element is preferably designed as a sieve belt or as a hedgehog belt.
  • the crop lies on it at least temporarily during operation.
  • the conveying element runs in particular under at least one deflecting roller which extends transversely across the conveying element and crops deflecting therefrom.
  • the steering roller rotates in particular about an axis of rotation, which is set in a plan view of the conveying element by ⁇ 90 ° to the conveying direction of the conveying element.
  • the conveying element and the deflecting roller form a separating device in this case, which is to be monitored using the method according to the invention.
  • the conveying element is designed as a screen star or conveying roller, the conveying speed being a rotational speed thereof.
  • the sieve star promotes the harvested crop in particular by lying on the sieve star with the sieve star rotating at least 135 °, in particular at least 180 °, the axis of rotation of which extends essentially vertically.
  • the conveying element is designed as a conveying roller, it is in particular encompassed by a roller table, with an axis of rotation of the conveying roller in particular being arranged essentially horizontally.
  • the image acquisition unit is preferably arranged such that the test image shows at least two alternative conveying paths for different crop components. As a result, two conveying elements can be monitored with the aid of an image capturing unit, one test image part of the test image each depicting a section of the different conveying elements or crops thereon.
  • one of the conveying elements is designed to convey sorted additions and another of the conveying elements is designed to convey cleaned root crops. This enables a particularly comprehensive picture of the cleaning performance and thus the utilization of the conveying element and / or the separating device comprising the conveying element to be captured.
  • 4 shows a program flow chart for evaluating the conveying speed signal
  • 5 is a view of a test image and its partial evaluation
  • FIG. 8 Fig. 8 u. 9 the object according to FIG. 7 in different side views
  • Fig. 10 likes a partial view of the object. 7 element with a winningele
  • FIG. 11 is a detailed view of a portion shown in FIG. 10 area of the device according to FIG. 7,
  • FIG. 13 is an illustration of the test image of the image acquisition unit according to FIG. 11;
  • Fig. 14 like a separator of the machine. 7 with an image acquisition unit, 15 is a schematic test image taken from the perspective of the image acquisition unit shown in FIG. 14;
  • Fig. 16 like another separator of the machine. 7 with an image acquisition unit
  • 17 is a schematically illustrated test image taken from the perspective of the image acquisition unit shown in FIG. 16,
  • FIG. 19 is a schematic illustration of a test image viewed from the perspective of the image acquisition unit according to FIG. 18,
  • the method according to the invention serves to regulate the operation of a machine 2 for harvesting root crops 4 (cf. FIGS. 6 to 8).
  • at least one test image 8 is recorded by at least one optical image acquisition unit 6, which shows at least one conveying element, initially generally numbered 10, relative to a machine frame 12 of the machine 2, showing crops comprising root crops 4.
  • test image 8 is transmitted to an evaluation device, which generates a separator setting signal for setting at least one operating parameter of a separating device of the machine 2 on the basis of a test data record generated on the basis of the test image 8 or formed by it.
  • the images shown as test images or output images only show schematically the parts relevant for the invention without any borders or boundaries.
  • Digital images taken by a camera may have additional information not shown in the figures. For example, these can already be masked or filtered on the camera side or when a test data record is being created or edited.
  • a crop flow 1.1 of a separating device is captured by means of a first image capturing unit 6 (block 1.2, FIG. 1).
  • the crop flow from two further optical image acquisition units is additionally monitored (blocks 1.3 and 1.4), for example after the exit of the separating device and in the area of a discharge belt for admixtures 5, which by means of of the separator are disconnected.
  • utilization characteristic values LS_1 to LS_3 are determined for the respective measuring points or areas captured by the image acquisition units 6 (blocks 1.5, 1.6,
  • a test image 8 comprising crop is first recorded on a conveyor element 10 (block 3, corresponds to block 1.1) by the image acquisition unit.
  • a relevant image section or part of the test image 8 is extracted according to a first method sequence according to the invention by means of a corresponding filtering or masking.
  • a mask or a region of interest (ROI) is predefined, on the basis of which sections of the test image 8 to be taken into account and not taken into account are distinguished (block 13.1).
  • a movement characteristic value is calculated for a plurality of image areas, in particular for each pixel of the image section (block 13.2).
  • the movement characteristic includes in particular a direction of movement.
  • the majority of movement parameters are then statistically evaluated (block 13.3).
  • the movement parameters are each compared with assigned reference values, which are preferably machine-specific and in particular Update-capable database are provided (block 13.4), and a difference between them is calculated or the movement parameters are compared with a uniform reference parameter and a deviation therefrom is calculated.
  • the movement characteristic values or the calculated deviations are statistically evaluated by the evaluation device, in particular a standard deviation of the movement characteristic values from the reference characteristic values is calculated.
  • a low-pass filter then goes over the continuously evaluated statistics to smooth the determined values (block 13.5).
  • a predefined and, in particular, predeterminable filter time constant is used (block 13.6), which specifies the extent of smoothing.
  • LS load factor
  • the relevant parts of the test image are first extracted (block 2.1).
  • a mask or region of interest can be predefined based on the position of the image acquisition unit 6 (block 2.2), on the basis of which the distances between the test image 8 to be taken into account and not to be taken into account can be distinguished.
  • the proportions of the image regions showing individual crop components are now calculated (block 2.3). In particular, the color information can be evaluated here. These values can be taken from a reference table or can also be specified by operating personnel (block 2.4).
  • the deviations of the calculated proportions from the threshold value are calculated (block 2.6).
  • the threshold value is, for example, an ideal value for the proportion considered (e.g. root crop, quantity 1, quantity 2). This is followed by low-pass filtering in order to smooth the determined deviations (block 2.7). This will be a pleasure.
  • Block 2.8 defined filter time constant used. Subsequently, a further load factor or the load factor LS is calculated based on the smoothed values of the deviations for the individual positions along the conveyor line and the respective proportions (block 2.9).
  • the winning speed signal will be generated based on the or the load characteristic LS, for example by means of a three-point controller described below (block 2.10).
  • Fig. 3 shows a program flow chart for the calculation of the utilization characteristic LS to the conveying speed signal.
  • the load factor LS has a value of -1, 0 or 1 and has been described as above generated.
  • the device listens to or waits for a new utilization characteristic value LS (block 14.1).
  • LS utilization characteristic value
  • the respective utilization characteristic values which in the present case are also simply referred to as “LS”, must be differentiated and are therefore referred to in FIG. 3 as LS_x.
  • the load factor After the load factor has been transferred, the process continues depending on its size.
  • a load characteristic value LS_x of 0 represents a desired load of the separator, a load characteristic of -1 an underload, ie insufficient load of the separator and a load characteristic of 1 an overload, ie an excessive load with a risk of constipation.
  • the utilization characteristic value is 0 this is entered in the memory 14.2 of the last utilization characteristic values (block 14.3) without sending out a conveying speed signal for changing the conveying speed.
  • the utilization characteristic value is 1, a previous utilization characteristic value stored in the memory 14.2 is queried (block 14.4) and then it is determined whether an overload has already been determined after the last stored utilization characteristic value of 0 (block
  • the evaluation device sends out a conveying speed signal to reduce the speed (delay signal, block.
  • the program flow can be optimized by accelerating only after a certain sequence in number of load characteristic values indicating an underload or underload. For example, it is monitored for the respective areas of the conveyor line whether there is an underload (block 14.9) and only then is an acceleration pulse sent (block 14.10).
  • Fig. 4 shows a program flow chart for evaluating the conveyor speed signal.
  • a conveying speed increment or decrement for changing the conveying speed is calculated on the basis of the conveying speed signal 17.1 (block 17.2).
  • values such as the extent of the load factor can be included in the calculation.
  • it can also be taken into account whether the machine is moving further away from the in a fine control range of the speed, e.g. close to the load limit (e.g. difference less than 10%) or in a rough control range Utilization limit is found.
  • the utilization limit can preferably be in the evaluation device as the value is defined from which an excessively large deviation signaling a build-up of material occurs.
  • the conveyor speed increment or decrement is converted by the evaluation device into a speed specification for a separator drive (block 17.5).
  • the resulting conveyor speed signal is sent to the separator device drive (block 17.6). This results in a conveying speed of the separating device (17.4).
  • FIG. 5 and 6 show an example of the evaluation of individual test images.
  • An output image 9 and a test image 8 are shown schematically in FIG. 5, each with root crops 4 on a conveyor line comprising two conveyor elements 10A and 10B.
  • funding elements are generally also numbered “10”.
  • a conveyor element 10 are then one or more conveyor elements from the set of conveyor elements (10A, 10B, 10C, 10D, ).
  • the evaluation device compares the output image 9 with the test image 8 in that the directions of movement of objects shown on the images are determined.
  • An object does not necessarily identify a coherent body, but merely represents in the test image 8 an area which can be identified with regard to its movement and which in particular has the size of an area reproduced via a pixel of the test image 8.
  • the evaluation device thus calculates a direction of movement for each pixel of the Test image 8, evaluates their deviation from a reference direction known for each area - in particular each pixel - and evaluates these deviations statistically.
  • 5 shows an example of a calculated direction of movement in the form of a superimposed vector per root crop 4, regardless of the observation of the movement at the pixel level.
  • Each arrow represents a characteristic movement value
  • the movement characteristic values 20 are statistically evaluated.
  • the movement parameters 20 only comprise a movement direction, not a movement distance possibly indicated by the arrow length.
  • FIG. 5 also shows a histogram with one column per movement characteristic 20. Each column indicates a deviation in the amount of the corresponding movement characteristic 20 from a uniform reference characteristic 22.
  • a utilization characteristic value LS indicated by line 14
  • a standard deviation of these movement characteristic value deviations from the reference characteristic value 22 is formed in particular.
  • the deviations can in particular be squared and then summed up. This sum is then divided by the number of movement parameters 20 and the square root of the resulting quotient is formed.
  • the resulting value is the load factor LS, which is given in the histogram shown.
  • first image areas 16 of the test image 8 are compared with further image areas 18 of the output image 9, each image area 16, 18 comprising the same number of pixels and in particular being rectangular. For a simplified illustration, only a few exemplary image areas 16, 18 are shown in FIG. 9. This results in a motion characteristic value 20 for each image area 16, in particular for each pixel of the test image 8.
  • the evaluation device can determine which load leads to a reduction or increase in the conveyor speed. For example, a speed increase can be carried out with a standard deviation of less than 10 °, the speed can be maintained with a standard deviation of 10 ° to 20 ° and the conveying speed can be reduced with a larger standard deviation.
  • a speed increase can be carried out with a standard deviation of less than 10 °
  • the speed can be maintained with a standard deviation of 10 ° to 20 °
  • the conveying speed can be reduced with a larger standard deviation.
  • it can be determined for the present case as a drop between two conveyor elements 10A and 10B designed as sieve belts based on the evaluation of the recognized directions and their standard deviation whether a crop jam occurs on the conveyor element 10B below.
  • the evaluation device outputs a conveying speed signal for accelerating the conveying element 10B, alternatively or in addition to a reduction in the conveying speed of the conveying element 10A to be conveyed.
  • Fig. 6 shows an example in the upper part of the figure, a test image 8, which also represents the transition from the conveying element 10A to the conveying element 10B.
  • this conveyor section there are root crops 4 and 5 seeds, which can include stones and herbs.
  • the classifiers defined in the training of the algorithm or specified via a database, for example a table with color values in HSV format, individual partial image areas 16 are checked for the presence of the same components.
  • A1 thus shows the portion of root crops 4 in test image 8 and the corresponding test data set, A2 the percentage of cabbage and A3 the percentage of stones.
  • This assignment is preferably carried out on the basis of the color information, preferably also comprising black, white and / or gray values of the individual pixels, ie an image area 19 which is assigned to a portion corresponds in particular to an area of a pixel.
  • the load factor is based on an example, although preferably based on a deviation of the first portion A1 from a threshold value, again generally designated R, which indicates an optimal share distribution of root crops on the observed point on the conveyor line.
  • the load characteristic value LS is set to 1 in the event of a deviation of> 50% from the cleaning threshold value and to 0 in the event of a deviation of ⁇ 50% from the cleaning threshold value.
  • the machine 2 is designed as a pulled potato harvester, with a large number of conveying elements 10 and their associated separating devices being held by a machine frame 12 which is only partially numbered.
  • a machine frame 12 which is only partially numbered.
  • image capturing units 6 which include the crops transported on the conveying elements 10 comprising root crops 4.
  • the optical image acquisition units 6 form individual measuring points for monitoring the respective separation devices.
  • the positions for image acquisition units 6 indicated in FIG. 7 are an area immediately after a lifting device 29 (measuring point MS1), a transition from a first conveying element 10A in the form of a wire belt to a second conveying element 10B in the form of a wire belt, which is additionally enclosed by a coarse herb belt (measuring point MS2), around the transition from this second sieve belt 10B to a further conveying element 10C, comprising a further separating device (measuring point MS3).
  • a conveying element 10E leading to the picking table is monitored with a further image acquisition unit 6 (measuring point MS4), at the same time a further conveying element 10F provided for residues of admixtures 5, in particular stones, is detected.
  • another optical image acquisition unit 6 is present at the picking table 45 (measuring point MS5).
  • An evaluation device can be positioned at any, but preferably in the vicinity of the reading table, centrally accessible location. From The evaluation device can, for example, be given information relating to the setting of the separating devices to an operator on a towing vehicle via a cable 12.1 which can be seen in FIG. 7.
  • the machine 2 shown in FIGS. 8 and 9 in a side view clarifies the positions of the optical image acquisition units 6.
  • the image acquisition unit 6 located at the reading table 45 in the United States can be arranged directly on a drop stage leading to a bunker 33.
  • the conveying element 10A is a screen belt which, coming from a digging device 29, already screens part of the admixtures 5, in particular earth, and via a drop stage to a wide range of res conveyed as a belt conveyor element 10B.
  • This conveying element 10B additionally has a coarse herb belt which is provided for separating the herb present on the potatoes or in the crop.
  • stripping devices 32 are arranged across the width of the conveying element 10B.
  • a height H of the stripping device 32 above the conveying plane of the conveying element 10B is also adjustable.
  • the conveying speeds of the conveying elements 10A and 10B can be set using the method according to the invention.
  • FIG. 11 shows only a coarse herb belt 43 and not the actual conveying element 10B which is designed in the form of a sieve belt (cf. FIG. 13).
  • a test image 8 resulting from the field of view of the optical image acquisition unit 6 shown in dashed lines in FIG. 12 is shown in detail in FIG. 13 (without crop).
  • the evaluations described above are carried out on the basis of the detected movement directions of the crop and / or on the basis of the respective proportions of the crop components and, if necessary, the conveying speeds of the conveying elements are adapted.
  • the crop still present is transferred to a further conveying element 10C with a conveying direction 1C.
  • This is a separator in the form of several superimposed, rotating Umlenkwal zen 24 assigned.
  • the crop is transported in the direction of the conveying element 10D via a pulse exerted by the latter (FIG. 14).
  • a distance H between the conveying element 10C and the lower deflection roller 24 can be set by the operating personnel for the purpose of varying a separation performance.
  • the speeds of at least the conveying and conveying conveyor elements 10C and 10D designed as sieve belts can be varied.
  • a variation of the separation performance or deflection can be achieved via the adjustability of the circulation speeds of the deflection rollers 24.
  • the image acquisition unit 6 shown in FIG. 14 generates the test image shown in FIG. 15, in which a test image part 8A is defined by filtering or masking.
  • a test image part 8B which is viewed behind the deflection rollers 24 from a conveying direction 1C, is defined by filtering.
  • the area of the conveying element 10C located in front of and behind the separating element formed by the deflecting rollers 24 is thus monitored. It is possible to create respective test data sets for both image areas 8A and 8B, or the respective evaluations for the two image areas 8A and 8B can result from the corresponding partial areas of a test data set.
  • the evaluation can only be based on the areas 8A and 8C located in front of the deflecting rollers 24 and bordered by broken lines. For these two areas, for example, permissible component densities can be defined via the respective threshold values R. If, for example, a portion associated with excessive build-up immediately in front of the deflecting rollers, for example of root crops 4, is exceeded, the conveyor belt 10C can be run faster, alternatively or additionally a conveyor belt can be run faster.
  • a height H of the lower ends of fingers 26 of a separator designed as a finger band 26.1 can also be set by the operating personnel as one of several operating parameters.
  • the height H describes the distance of the fingers 26 from the upper edge of the conveyor element designed as a hedgehog belt.
  • an angle of attack of the finger band 26.1 can be designed to be adjustable to a perpendicular to the conveying plane of the conveying element. The same applies to the running speed of the finder tape 26.1.
  • FIG. 16 Another optical image acquisition unit 6 arranged in the area of the conveyor belts 10C and 10D is shown in FIG. 16.
  • This image acquisition unit 6 can be used in addition to the image acquisition unit according to FIG. 14 in order to monitor the crop transport in the inspection image area 8D. In particular, it also serves to monitor the effect of the separating and deflecting device formed by the deflecting rollers 24. In particular, depending on the results of the evaluation of the test images 8 of the optical monitoring unit 6 according to FIG. 14, the conveying element 10D can be adjusted in its conveying speed.
  • a monitoring unit 6 according to FIG. 16 is also assigned a light source 7 for better illumination of the monitored area 8D.
  • Another optical image acquisition unit 6 is provided with an associated light source 7 above a reading table with a view of a conveying element 10E and a conveying element. derelement 10F arranged (Fig. 18).
  • a perspective cleanup is carried out on the basis of the “fish-eye” representation of the image acquisition unit 6.
  • the test image parts 8A and 8B shown in the test image 8 according to FIG. 19 are selected which, on the one hand, serve as a conveying path, the conveying element 10E with conveying direction 1E for the removal of root crops, and, on the other hand, as another conveying path, the conveying element 10F with conveying direction 1 F for conveying away additions 5 monitor in the form of stones.
  • the evaluation described above is used to check whether the proportions of root crops 4 on the conveying element 10F are too large. If this is the case, the upstream conveying element 10D is set more slowly by means of the evaluation device by means of the method according to the invention.
  • the finger band 26.1 shown above the conveyor element 10D designed as a hedgehog belt can be adapted with respect to its separating effect with the fingers 26 shown by way of example and in broken lines behind the cover 40 located in front of it. For example, the distance of the fingers 26 from the conveying element 10D is reduced in order to convey more crop material in the form of root crops 4 onto the conveying element 10E via an associated chute 41.
  • FIG. 20 illustrates the arrangement of optical image acquisition units 6 on pointing measuring points MS1 to MS5 in the case of a schematically illustrated conveying path of a machine 2 designed as a beet harvester.
  • the image acquisition units 6 are in the wake of a lifting device 29 above a roller table 10M and at the end of a roller conveyor Conveyor element 10N arranged (measuring represent MS1 and MS2).
  • a further optical image acquisition unit 6 monitors in particular a conveyor element 10P (measuring point MS3) designed as a screen star.
  • the subsequent conveyor element 10Q which is designed as a star, is also monitored in the same way as a conveyor element 10R, which is designed as a ring elevator (measuring points MS4 and MS5).
  • this can be made to run faster at the instigation of the evaluation device. According to one of several possible control scenarios, this can initially only take place for a certain time until a next check or until a monitoring system detects the removal of the critical state.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Multimedia (AREA)
  • Environmental Sciences (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Data Mining & Analysis (AREA)
  • Quality & Reliability (AREA)
  • Artificial Intelligence (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Evolutionary Biology (AREA)
  • Evolutionary Computation (AREA)
  • General Engineering & Computer Science (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Investigating Materials By The Use Of Optical Means Adapted For Particular Applications (AREA)
  • Harvesting Machines For Root Crops (AREA)
  • Investigating Or Analysing Materials By Optical Means (AREA)

Abstract

L'invention concerne un procédé pour régler le fonctionnement d'une machine (2) pour récolter des plantes sarclées (4). Ce procédé consiste : à enregistrer, par l'intermédiaire d'au moins une unité d'acquisition d'image (6) optique, au moins une image de vérification (8) de produits de récolte comprenant des plantes sarclées (4), qui sont déplacés par rapport à un bâti de machine (12) à l'aide d'au moins un élément de transport (10), et une vitesse de transport de l'élément de transport (10) est réglée sur la base d'un enregistrement de vérification généré au moyen de l'image de vérification (8) ou formé par celle-ci. Un dispositif d'évaluation génère, sur la base de l'enregistrement de vérification, un signal de vitesse de transport indépendant de la vitesse des produits de récolte pour régler la vitesse de transport. Cette invention concerne en outre ladite machine.
EP19808698.5A 2018-11-07 2019-11-05 Procédé pour régler le fonctionnement d'une machine utilisée pour récolter des plantes sarclées Pending EP3877902A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
DE102018127844.6A DE102018127844A1 (de) 2018-11-07 2018-11-07 Verfahren zur Regelung des Betriebs einer Maschine zum Ernten von Hackfrüchten
PCT/EP2019/080263 WO2020094654A1 (fr) 2018-11-07 2019-11-05 Procédé pour régler le fonctionnement d'une machine utilisée pour récolter des plantes sarclées

Publications (1)

Publication Number Publication Date
EP3877902A1 true EP3877902A1 (fr) 2021-09-15

Family

ID=68654436

Family Applications (1)

Application Number Title Priority Date Filing Date
EP19808698.5A Pending EP3877902A1 (fr) 2018-11-07 2019-11-05 Procédé pour régler le fonctionnement d'une machine utilisée pour récolter des plantes sarclées

Country Status (10)

Country Link
US (1) US20210378167A1 (fr)
EP (1) EP3877902A1 (fr)
JP (1) JP7339336B2 (fr)
CN (1) CN112997194A (fr)
BR (1) BR112021005034A2 (fr)
CA (1) CA3118776A1 (fr)
DE (1) DE102018127844A1 (fr)
EA (1) EA202191204A1 (fr)
IL (1) IL282955A (fr)
WO (1) WO2020094654A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2022189537A1 (fr) 2021-03-12 2022-09-15 Grimme Landmaschinenfabrik Gmbh & Co. Kg Procédé de fonctionnement d'une machine de transport de plantes sarclées

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102020103941A1 (de) 2020-02-14 2021-08-19 Grimme Landmaschinenfabrik Gmbh & Co. Kg Verfahren zum Betrieb einer Maschine zum Ernten und/oder Trennen von Hackfrüchten, zugehörige Maschine und zugehöriges Computerprogrammprodukt
DE102020124037A1 (de) 2020-09-15 2022-03-17 Grimme Landmaschinenfabrik Gmbh & Co. Kg Verfahren zur Bestimmung einer Beschaffenheit von durch eine Hackfruchtfördervorrichtung gefördertem Erntegut
CN114287224B (zh) * 2022-01-05 2023-01-13 山东理工大学 马铃薯收获机简谐激励双重扰动波浪形分离工艺及装置
CN115191212B (zh) * 2022-08-05 2023-06-27 中国热带农业科学院农业机械研究所 一种木薯收获机的挖掘深度自动控制装置及控制方法

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6119441A (en) * 1999-04-19 2000-09-19 Glopak Inc. Automatic bagging machine
US6119442A (en) * 1999-05-14 2000-09-19 Case Corporation Combine setting autoadjust with machine vision
US6484810B1 (en) * 2001-06-11 2002-11-26 Richard D. Bendix Mechanical harvester for harvesting bulb crops
DE102005043991A1 (de) * 2005-09-14 2007-08-09 Claas Selbstfahrende Erntemaschinen Gmbh Verfahren zur Einstellung eines Arbeitsaggregats einer Erntemaschine
JP2007112603A (ja) * 2005-10-24 2007-05-10 Yokogawa Electric Corp 画像処理を用いた制御システム
US8284248B2 (en) * 2009-08-25 2012-10-09 Frito-Lay North America, Inc. Method for real time detection of defects in a food product
IE20120388A1 (en) 2012-09-07 2014-03-12 Odenberg Engineering Ltd Method and apparatus for handling harvested root crops
JP6257423B2 (ja) * 2014-04-07 2018-01-10 日清食品株式会社 搬送装置及び搬送方法
JP6486643B2 (ja) * 2014-10-16 2019-03-20 国立大学法人電気通信大学 粉粒体の流量計測方法とそのプログラム
WO2018035082A1 (fr) * 2016-08-15 2018-02-22 Raptor Maps, Inc. Systèmes, dispositifs et procédés de surveillance et d'évaluation des caractéristiques de cultures spécialisées récoltées
DE102016118244A1 (de) * 2016-09-27 2018-03-29 Claas Selbstfahrende Erntemaschinen Gmbh Gutflussüberwachung einer Erntegutaufnahmevorrichtung
CA3094519A1 (fr) * 2018-03-21 2019-09-26 10691976 Canada Ltd. Semoir pour systeme de croissance des cultures

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2022189537A1 (fr) 2021-03-12 2022-09-15 Grimme Landmaschinenfabrik Gmbh & Co. Kg Procédé de fonctionnement d'une machine de transport de plantes sarclées

Also Published As

Publication number Publication date
WO2020094654A1 (fr) 2020-05-14
US20210378167A1 (en) 2021-12-09
DE102018127844A1 (de) 2020-05-07
CA3118776A1 (fr) 2020-05-14
IL282955A (en) 2021-06-30
CN112997194A (zh) 2021-06-18
JP7339336B2 (ja) 2023-09-05
JP2022506703A (ja) 2022-01-17
EA202191204A1 (ru) 2021-09-28
BR112021005034A2 (pt) 2021-06-08

Similar Documents

Publication Publication Date Title
EP3877902A1 (fr) Procédé pour régler le fonctionnement d'une machine utilisée pour récolter des plantes sarclées
DE102019214038B4 (de) Kornqualitätskontrollsystem und -verfahren
EP3877903A1 (fr) Procédé pour régler le fonctionnement d'une machine utilisée pour récolter des plantes sarclées
EP3877901A1 (fr) Procédé pour régler le fonctionnement d'une machine utilisée pour récolter des plantes sarclées
DE102018116990A1 (de) Landwirtschaftliche Arbeitsmaschine
EP3300019A1 (fr) Surveillance d'écoulement de produit dans un dispositif de collecte de récolte
EP2057882A2 (fr) Procédé de contrôle de la qualité de récoltes
DE112008002646T5 (de) Fahrzeuginterne Bildverarbeitungsvorrichtung, Bildverarbeitungsverfahren und Programm
EP2918159A1 (fr) Agencement et procédé de reconnaissance et documentation de qualité de paille
DE102015116572A1 (de) Verfahren zum Erkennen von Störungen einer Erntegutbergungsanordnung
EP4150317A1 (fr) Procédé de détermination de la répartition granulométrique de parties d'un matériau en vrac introduit sur une bande transporteuse
EP2691217A1 (fr) Dispositif et procédé de surveillance automatique d'un dispositif de traitement de produits viandeux
DE102013112080B4 (de) Landwirtschaftliche Arbeitsmaschine mit einer optischen Sensoreinheit
WO2008077680A1 (fr) Procédé et dispositif de contrôle optique d'objets
BE1026709B1 (de) Verfahren zur Regelung des Betriebs einer Maschine zum Ernten von Hackfrüchten
AT523807B1 (de) Verfahren zur Staubniederhaltung bei Brechern mit Sprüheinrichtungen
EP4119230A1 (fr) Machine d'usinage de roche à capture d'image et à traitement des images au moyen d'un réseau de neurones
WO2021160607A1 (fr) Procédé pour faire fonctionner une machine pour récolter et/ou séparer des plantes sarclées, machine correspondante et produit-programme informatique correspondant
DE102018124015B4 (de) System und Verfahren zur Erfassung von Bildern
DE102021106119A1 (de) Verfahren zum Betrieb einer Hackfruchtfördermaschine
DE102021105274A1 (de) Verfahren zur Erkennung von Längen eines Partikels

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: UNKNOWN

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20210527

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

TPAC Observations filed by third parties

Free format text: ORIGINAL CODE: EPIDOSNTIPA

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20230714

TPAA Information related to observations by third parties modified

Free format text: ORIGINAL CODE: EPIDOSCTIPA