Classifications

• • A—HUMAN NECESSITIES
  • A01—AGRICULTURE; FORESTRY; ANIMAL HUSBANDRY; HUNTING; TRAPPING; FISHING
  • A01M—CATCHING, TRAPPING OR SCARING OF ANIMALS; APPARATUS FOR THE DESTRUCTION OF NOXIOUS ANIMALS OR NOXIOUS PLANTS
  • A01M7/00—Special adaptations or arrangements of liquid-spraying apparatus for purposes covered by this subclass
  • A01M7/0089—Regulating or controlling systems
• • G—PHYSICS
  • G05—CONTROLLING; REGULATING
  • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
  • G05B19/00—Programme-control systems
  • G05B19/02—Programme-control systems electric
  • G05B19/18—Numerical control [NC], i.e. automatically operating machines, in particular machine tools, e.g. in a manufacturing environment, so as to execute positioning, movement or co-ordinated operations by means of programme data in numerical form
  • G05B19/4155—Numerical control [NC], i.e. automatically operating machines, in particular machine tools, e.g. in a manufacturing environment, so as to execute positioning, movement or co-ordinated operations by means of programme data in numerical form characterised by programme execution, i.e. part programme or machine function execution, e.g. selection of a programme
• • G—PHYSICS
  • G05—CONTROLLING; REGULATING
  • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
  • G05B2219/00—Program-control systems
  • G05B2219/30—Nc systems
  • G05B2219/45—Nc applications
  • G05B2219/45013—Spraying, coating, painting

Definitions

• the present invention relates generally to systems for the intelligent spraying of plants in agriculture.
• a spraying system for the treatment of plants in agriculture comprising a spray boom provided with a plurality of spray nozzles supplied by a spray control device, and comprising a set of cameras capable of taking images of a cultivation area, a digital processing device capable of analyzing the images taken by the camera, of identifying plants to be treated and of applying instructions to the spraying control device with a view to spray a product selectively on plants to be treated.
• a spray nozzle to be activated and an instant of start of spraying is determined as a function of a certain number of parameters including the position of a plant to be treated in an image, the height of the camera relative to the ground, the orientation of the main axis of the camera and the forward speed of the system.
• the present invention aims to fulfill at least one of the following three objectives:
• a system for the treatment of plants, in particular in agriculture, comprising a spray boom provided with a plurality of spray nozzles supplied by a spray control device, and comprising a set of cameras capable of taking images. of an area to be treated, a digital processing device capable of analyzing the images taken by the camera, of identifying plants to be treated and of applying instructions to the spraying control device with a view to spraying a product selectively on plants to be treated.
• each camera being able to take images of the cultivation area, characterized in that it comprises a memory in which are stored correspondence data between a camera frame of reference and a spray frame of reference, and in that the circuit digital processing is able, from said correspondence data, to apply to the images taken by each camera data of s ubdivision of the image into cells corresponding to areas of spraying on the ground by respective spray nozzles, thereby to determine directly from said subdivision data at least one nozzle to be activated and its moment of activation when a plant to be treated is identified in a given cell of the image.
• the subdivision data comprises a grid having columns of cells corresponding to the trajectory of respective spray nozzles during the advancement of the system, and rows of cells corresponding to instants of spraying.
• the nozzles are oriented so as to spray a treatment product in a general vertical direction, and the axes of the cameras are inclined obliquely forward and downward with respect to the advancement of the boom.
• the system comprises a device for dynamically determining at least one geometric parameter of each camera with respect to the ground and for dynamically adjusting the subdivision data as a function of the variations of the geometric parameter (s).
• the geometric parameter includes a height of each camera measured from the ground.
• the geometric parameter includes a signal to control the height of each camera in relation to the ground.
• the processing circuit is able to determine a rate of presence of plant to be treated in each cell where the presence of the plant is determined.
• the system is able to activate a spray nozzle corresponding to a given cell only if said rate is greater than a threshold.
• the system is able to activate a spray nozzle corresponding to a given cell as a function of the type of plant identified by the digital processing circuit.
• the system is able to activate a spray nozzle corresponding to at least one neighboring cell of a cell in which the presence of a plant to be treated is detected.
• RP generally flat ground in front of the boom (RP), itself positioned at a predetermined height relative to the ground, a reference pattern comprising a marking representative of the anticipated displacement of one or more spray nozzles on the ground during the progress of the system,
• a method of selective spraying of an area of a field on which a system as defined above is moving is also proposed, characterized in that it comprises the following steps:
• FIG. 1 is a schematic profile view of part of a system according to the invention moving over an agricultural area to be treated
• FIG. 2A is a view of an area to be treated taken by a camera of the system of Figure 1,
• FIG. 2B is a view of the same area with the projection on this area of a virtual subdivision grid
• FIGS. 3A to 3E are schematic top views of the left half of the inventive spray system in different positions and in different states.
• a processing system to which the present invention applies is for example that described in document WO2018142371A1 or WO2018154490A1 in the name of the Applicant, to which those skilled in the art will refer for more details.
• such a system here comprises a tractor T from which extends to the left and to the right a spray boom RP, only the left half of this system being illustrated in Figures 3A to 3E.
• the boom is equipped with a set of BPi spray nozzles regularly spaced or not and connected by respective control valves to a source of product to be sprayed under pressure, and a set of CAk cameras whose sight axes are plunging towards the 'before, extending preferably, but not necessarily, in vertical planes parallel to a longitudinal axis AL of the system.
• the system moves over an agricultural area to be treated at V speed. More generally, it can be a system that moves over any type of land to be treated.
• the lateral pitch of CAk cameras can be independent of the pitch of the nozzles. Its order of magnitude is typically a multiple of the lateral pitch of the nozzles.
• the system also includes communication and digital CT processing circuits to receive the images captured by the CAk cameras, to determine, typically by learning processes, the presence of weeds in the images taken (by distinguishing them from cultivated species, or on bare ground), and to deliver individual spray control signals to the valves so as to essentially limit product spraying to areas occupied by weeds.
• WO2018154490A1 describes determining when a valve is actuated based on the position of a weed in a captured image and a number of system parameters.
• Each camera of such a system as described above captures images of the agricultural area to be treated with a plunging front sight axis which touches the ground at a distance of X meters in front of the camera, and the aperture of the camera is such that the dimension of the part of the area to be treated captured by the image, in the direction of advance of the system, is Y meters, as illustrated in FIGS. 1, 2A and 2B.
• the digital processing circuits CT of the system are able to subdivide each image taken into a plurality of sub-images or cells according to a subdivision grid G such as illustrated in FIG. 2B and FIGS. 3A-3E, the shape of which is such that each cell in the image corresponds to a rectangular or square sub-area of the agricultural area to be treated.
• the grid G here adopts a trapezoidal contour shape, the horizontal lines being transverse to the progress of the system and the other lines corresponding to vanishing lines in the bird's eye view generated by the camera. Note that in the case of a camera whose line of sight is oriented vertically, the outline of the grid G is rectantular.
• the digital processing device takes into account in particular the geometric values defining the position of the camera (orientation of the line of sight along the 3 axes, height of the camera in relation to on the ground, distance between the camera and the spray nozzles
• the digital processing device can also take into account any distortion of the image (vignetting, etc.) linked to its optics.
• This subdivision in a first embodiment, is based on the one hand on the spacing between the nozzles, such that the center line MRi of a longitudinal row RLi of the grid G is located directly above a given nozzle BPi. In a particular case, there may be only one longitudinal row.
• the grid is also based on a temporal subdivision, a delay or spraying delay ATj corresponding to a transverse row RTj of the grid G.
• an initialization of the system is carried out on the basis of stored digital information typically comprising the position of each nozzle and each camera in a common three-dimensional frame of reference, the viewing angle of each camera (if necessary in the three planes of the frame of reference), a direction (most often vertical) and a pattern (shape of the cone) of spraying the nozzles, the speed V of the system advancement (which can typically be determined in real time and supplied to the system).
• This information makes it possible in particular to deduce essential information such as the pitch of the nozzles and their relation with the position of the cameras both in the vertical direction, in the lateral direction and in the direction of advance of the system, and in combination with the information.
• speed V or position of the system, the grid is constructed.
• the speed or the position can be determined by different types of sensors including inertial unit, precision GPS unit, LIDAR, SLAM type simultaneous location and mapping system, etc.
• the direction of sight of the camera (s) may be transverse to the direction of advance of the system, or even oblique.
• an initial calibration of the system can be carried out by placing the spraying system on a flat surface and by affixing to this surface a tarpaulin or flexible sheet having a marking comprising a set of lines representing the trajectories of the nozzles on the ground when the system moves along its path - therefore spaced laterally by a distance equal to the pitch between the nozzles.
• the system is then moved along this trajectory and the calibration images taken by each of the cameras comprise, on a plain background, a set of lines whose positions in the images correspond to the median lines of the subdivisions of the grid, the longitudinal lines of the latter being able to be determined and stored by simple extrapolation from the median lines captured.
• the transverse lines of the grid are in turn determined from the camera orientation data, and will most often be horizontal lines in the pixel matrix of the captured images, whose positions in the image are calculated to correspond to intervals at constant ground, and therefore at constant travel times when the system is moving at its set speed.
• the system can incorporate any other type of initialization or calibration.
• This subdivision thus achieves a correspondence (“mapping” in English terminology) between each sub-zone of the agricultural zone to be treated, resulting from the subdivision by the grid G, and a pair (nozzle number, spray time).
• the system determines in real time, by the aforementioned correspondence, which spray nozzle should be. activated, and when it should be activated.
• the duration of spraying essentially depends on the size of the spray pattern on the ground relative to the size of a cell of the grid between two successive transverse separation lines, as will be described in detail below.
• the smaller the dimension of the spray pattern in the direction of movement of the system the longer the spray time should be so as to cover the entire subdivision on the ground with sufficient product application.
• the instant of the start of spraying is determined on the one hand from the position of the subdivision concerned in the grid, and on the other hand from the overall duration required between the moment when an image is captured and where the valve associated with the nozzle to be activated actually opens, this duration generally being a controlled delay constituting an intrinsic parameter of the system, which possibly depends on the position of the nozzle BPi on the ramp RP.
• the system admits as input not a speed of movement of the system, but an instantaneous position of the system, as permanently determined by a GPS unit of precision, in particular centimetric GPS or other.
• the lines of transverse subdivisions of the grid G are no longer determined by the measured speed of the system, but from the instantaneous position of the system as a function of time, given by the GPS unit.
• the correspondence between the subdivision of the agricultural area to be treated and the nozzle spray map may become incorrect.
• the system calculates a coefficient of weed development or rate of presence of weeds in that cell.
• this coefficient is the percentage of the area of the subdivision occupied by weeds relative to the total area of the cell.
• FIGS. 3A to 3E An example of the implementation of this functionality will be illustrated with reference to FIGS. 3A to 3E, on which the main equipment of the system as described above has been illustrated firstly, and secondly the projection on the ground Gk 'of the grid Gk used to subdivide the images taken by the camera CAk, and thirdly hatched areas materializing the presence of plants to be sprayed, typically weeds identified by the processing circuit in the images taken by said camera CAk.
• Figure 3A illustrates a first phase of the movement of the system, arriving on a region of the area to be treated where such weeds are present and illustrated by dotted circles ADx whose size is related to the size or density of the weeds.
• Figures 3B and 3C illustrate the position of the system after the elapse of a time equal to approximately 2 x Ai and 4 x At, respectively, where Ai is the spacing between two transverse subdivision lines, with a factor equal to the speed of advance of the system as explained above.
• Figure 3D the grid Gk 'in relation to the weeds at a given moment in a new situation of presence of weeds.
• the different sub-zones of the soil corresponding to the respective cells of the grid are designated by a combination of a letter and a number as illustrated.
• the subdivisions X-1 to X-6 correspond to the paths of six respective spray nozzles BP1 to BP6 aligned substantially on the center of these subdivisions.
• the AD1 weed zone located in the lower left corner of the figure straddles several subdivisions.
• the system can also take into account the type of plant to be treated, in particular the type of weed, as detected in a captured image, in particular by modifying the presence level threshold. .
• the shape of the spray pattern is generally circular, while each cell is rectangular. Consequently, the zone actually sprayed never exactly corresponds to the cell considered.
• a spray pattern is chosen whose ground area is at least equal to the air of the corresponding cell located directly above the nozzle. In this way, in this case, the No.1 nozzle will continue to spray the weed or the set of weeds even in its part located, at the time of Figure 3D, in cell F1.
• provision can be made to adjust the instants of the start and end of spraying for a given nozzle so that the zone effectively sprayed covers, in the direction of advance, more than the cells where the rate of coverage by the weeds is above the threshold.
• the effective spraying starts one cell earlier (on J1) and ends four cells later (on C1 inclusive), so as to ensure a wider spraying than the plant to be treated. herself.
• This makes it possible, for example, to guarantee, in particular in the event of system drift, wind liable to deflect the cone of sprayed liquid, etc., that the weed zone to be treated is effectively and sufficiently covered.
• the system will then activate nozzle No. 2 (in this case no nozzle No. 0 because it is located at the end of the ramp) at the same time as nozzle No.
• This choice of activating sputtering in neighboring cells can also be determined as a function of the type of weed identified in the image captured by the processing circuits.
• the herbicide treatment is improved by at least one of the following aspects:
• the present invention finds application in particular in the localized weeding of different types of land: agricultural land, traffic routes, in particular railways, etc.

Applications Claiming Priority (2)

Publications (1)

Family

ID=73543307

Family Applications (1)

Country Status (3)

Families Citing this family (3)

Family Cites Families (8)

• 2020
  • 2020-11-09 WO PCT/IB2020/060534 patent/WO2021090294A1/fr unknown
  • 2020-11-09 US US17/775,134 patent/US20220408715A1/en active Pending
  • 2020-11-09 EP EP20811446.2A patent/EP4054326A1/de active Pending

Also Published As

Similar Documents

Legal Events