WO2016123656A1

WO2016123656A1 - Horticultural harvesting system and apparatus using revolving shells

Info

Publication number: WO2016123656A1
Application number: PCT/AU2016/000028
Authority: WO
Inventors: Mark Calleija; Salah Sukkarieh; Robert FITCH
Original assignee: The University Of Sydney
Priority date: 2015-02-05
Filing date: 2016-02-05
Publication date: 2016-08-11

Abstract

An apparatus for harvesting horticultural produce from plants includes an encapsulation mechanism movable between an open configuration to receive at least one selected item of horticultural produce, and a closed configuration to substantially encapsulate the selected item of horticultural produce. A drive mechanism effects movement of the encapsulation mechanism between the open and closed configurations, and a detachment means is operable to detach the encapsulated produce from the associated plant.

Description

Horticultural harvesting system and apparatus using revolving shells

Field of the Invention

[0001] The present invention relates generally to horticulture, and more particularly to an apparatus, method and system for automated harvesting of horticultural produce.

[0002] The invention has been developed primarily for harvesting fruit from fruit trees and will be described primarily in this context. It should be appreciated, however, that the invention is not limited to this particular field of use, being potentially also applicable to harvesting vegetables, nuts, seeds, herbs, grains, flowers or fungi from the associated trees, plants, vines, roots or other growth sources.

Background of the Invention

[0003] The following discussion of the prior art is intended to place the invention in an appropriate technical context and enable its advantages to be more fully appreciated. However, any references to prior art throughout this specification should not be construed as an express or implied admission that such art is widely known or is common general knowledge in the relevant field.

[0004] Various harvesting techniques are known. However, there are many horticultural industries and sectors in which the most efficient and cost-effective techniques currently available involve extensive use of manual labour. For example, many fruits are still hand-picked, as a consequence of which the harvesting process is highly labour-intensive, expensive and dependent upon the availability of adequate labour resources when needed. These problems are exacerbated significantly by fluctuations in demand due to seasonality factors, and in circumstances or locations where appropriate manual labour is in short supply.

[0005] In response to these limitations, various devices and techniques have been proposed to mechanise or partially automate aspects of the harvesting process, including for example fruit-picking mechanisms utilising mechanical grippers, suction cups or other vacuum devices in order to hold the fruit to be harvested. However, such systems have suffered from a variety of problems, limitations, shortcomings and failings, which have compromised their practical or commercial viability and have hitherto impeded widespread adoption on a commercial scale.

[0006] Such problems and limitations of known mechanised systems include damage to the fruit or other produce, damage to the associated plants, poor grip of the produce during handling, difficulties detaching the produce, control system complexity, path planning complexity, sensing complexity, electrical complexity, mechanical complexity, high computational requirements, high cost, low speed, low reliability, low ingress protection rating and cross-contamination problems.

[0007] It is an object of the present invention to overcome or ameliorate one or more disadvantages of the prior art, or at least to provide a useful alternative.

Summary of the Invention

[0008] Accordingly, in a first aspect, the invention provides an apparatus for harvesting horticultural produce from plants, the apparatus including:

an encapsulation mechanism movable between an open configuration to receive at least one selected item of horticultural produce, and a closed configuration to substantially encapsulate the selected item of horticultural produce;

a drive mechanism to effect movement of the encapsulation mechanism between the open and closed positions; and

detachment means operable to detach the encapsulated produce from the associated plant.

[0009] Preferably, the encapsulation mechanism includes at least two shells supported for relative rotation between the open configuration and the closed configuration. Preferably, the shells at least partially overlap in the open configuration. In one embodiment, the shells include an inner shell and an outer shell. In one embodiment, the inner and outer shells are substantially hemispherical in shape, and are supported for relative rotation about a diametrical hinge axis common to both shells. [0010] Preferably, in the open position or configuration the inner shell is substantially nested within the outer shell, and in the closed position the inner and outer shells together define a substantially spherical or partially spherical encapsulation chamber. In the closed position, the encapsulation chamber may be almost entirely closed, or partially open, depending upon the shape of the particular produce to be harvested and other structural or functional constraints. In some embodiments, the shells and hence the encapsulation chamber may be perforated by apertures, slots, holes, vents or other openings formed in the shells. In some embodiments, the shells may be defined in whole or in part by wire frame, lattice or similar structures.

[001 1] In a further embodiment, the inner and outer shells are substantially elliptical in cross-sectional profile and the encapsulation chamber is generally in the form of a prolate spheroid. In this embodiment, the shells may be supported for relative rotation about a hinge axis corresponding to either a minor or major axis of the prolate spheroid defined by the shells. It should be appreciated, however, that the shells may be formed in virtually any revolved profile, according to the shape of the targeted produce. For example, for harvesting pears, complementary pear- shaped or oblate spheroidal profiles (or partial segments thereof) could be adopted for the shells.

[0012] In further embodiments, a larger number of shell portions such as three, four, five or more, may be provided thereby to enable a greater degree of retraction in the open configuration. In one variation, the multiple shell-portions are adapted for overlapping nested or inter-leaving engagement in the open position. In certain embodiments, the multiple shell-portions may have a degree of overlap or interleaving engagement in the closed position. In such embodiments, the control for closing each shell can be determined with respect to one or more predetermined parameters such as, for example, position and torque. It will be appreciated that such control of the shell portions, when the shell portions reach an obstacle such as the fruit stem or adjacent branch, can advantageously protect the closing mechanism, fruit and surrounding environment against damage during the harvesting process. In some embodiments, the leading edge of the closing shell portions may be configured (e.g. tapered and/or spring loaded) to facilitate both smooth docking and securing of the target when docked. [0013] In some embodiments, the shell portions are formed by a plurality of discrete elements (e.g. fingers - curved or straight, etc) which can either be separated or intertwining so that the stem of the produce automatically passes between the fingers when closing.

[0014] In some embodiments, the encapsulation mechanism may also incorporate a supplementary retention mechanism, such as a suction cup, suction pad, inflatable/deflatable bladder, linear actuated supporting pad (e.g. using a solenoid or pneumatic cylinder to push a soft grip pad), granular jamming mechanism etc.), to help locate and hold the fruit in place without damaging the fruit, whilst supplying a sufficient grip to enable manipulation of the fruit when detaching and removing the fruit from the tree. In various embodiments, the supplementary retention mechanism may be activated upon coming into contact with the fruit, by reference to the position of the fruit relative to the encapsulation mechanism, or by reference to the relative position of the shells. For example, the supplementary retention mechanism may be activated once the shells are in a predetermined position relative to one another (e.g. upon initial movement away from the fully open position, a partially closed position of a predetermined percentage, or the fully closed position).

[0015] By way of example, the supplementary retention mechanism may be in the form of an inflatable bladder which can be inflated to a predetermined pressure once the end effector is closed to provide a reliable and positive engagement or grip on the fruit. Similarly, one or more solenoids with a soft grip pad for engaging the fruit can be used in a force control mode to achieve a similar positive engagement or grip function. Similarly, the shell portions may be adapted to be controlled to move inwardly (i.e. shrink in volume) once the fruit is encapsulated by means of a sensing/control device, until the shrinking force reaches a predetermined value such that the shell portions and/or supplementary retaining mechanism lightly squeezes the fruit (so as not to damage the fruit).

[0016] In some embodiments, the shells may be formed at least partially from a flexible material, or incorporate a relatively soft or flexible inner lining, to reduce the risk of inadvertent damage to or bruising of the produce. [0017] In some embodiments, the encapsulation mechanism includes fluid delivery means, which may be adapted for a variety of purposes. For example, water spray may be introduced to wash or cool the produce contained within the encapsulation chamber. Additionally or alternatively, pressurised air may be introduced to dry, heat or cool the produce. Heating in particular may be used in some circumstances to reduce risks of cross-contamination. Oils, emulsions, herbicides, pesticides, disinfectants, preservatives or other horticultural chemicals may also be introduced to the encapsulation region and thereby applied to the produce by substantially the same mechanism.

[0018] In one embodiment, cutting blades or cutting edges are integrated with or attached to the circumferential edges of the shells whereby upon movement of the shells into the closed position, the stem of the encapsulated produce is automatically severed from the associated plant. In this form of the invention, it will be appreciated that the detachment means take the form of a cutting mechanism directly associated with, or formed integrally with, the encapsulation mechanism.

[0019] In other embodiments, the apparatus may be adapted to snap, twist, pull or otherwise separate the produce from the associated stem or spur of the supporting plant, by rotational and/or translational displacement of the encapsulated produce itself. In that case, the detachment means are integral with the encapsulation mechanism or an associated supporting apparatus.

[0020] In further embodiments, the detachment mechanism may be separate from or external to the encapsulation mechanism, and operable either during the encapsulation process or after the produce has been encapsulated. In such embodiments, the detachment mechanism may take the form of independently operable cutting blades, knives, shears, scissor mechanisms, rotary cutters or alternative stem severing means incorporated into the apparatus.

[0021] In one embodiment, at least one of the shells incorporates a slot, optionally tapered, to receive and locate the stem of the produce, thereby providing a guidance or "docking" mechanism to facilitate more accurate initial positioning and encapsulation of the produce. In one embodiment, the separate detachment mechanism is positioned closely adjacent the guidance or docking mechanism. In further embodiments, the separate detachment mechanism may be contained substantially within the encapsulation mechanism.

[0022] In some embodiments, the detachment means may include cutting blades, knives, shears or the like separate from the encapsulation mechanism, but operable in direct response to movement of the encapsulation mechanism toward the closed position, for example by means of intermediate mechanical, electrical, hydraulic or pneumatic linkages or connections.

[0023] In one embodiment, the drive mechanism includes one or more electronically controlled servo motors adapted to regulate rotation of the shells, with respect to one another and/or with respect to a supporting element of the apparatus, thereby to effect controlled movement between the open and closed positions. The same or separate motors may be used to operate the detachment mechanism. In alternative embodiments, hydraulic, pneumatic, electro-mechanical or other suitable forms of actuator may additionally or alternatively be used.

[0024] Preferably, the apparatus further includes an articulated robotic arm incorporating a support assembly for the encapsulation mechanism, whereby the robotic arm is adapted to support the encapsulation mechanism as an end-effector of the arm. In further variations, multiple encapsulation mechanisms may be supported by the robotic arm, either as end-effectors or at intermediate positions along the arm.

[0025] The robotic arm preferably includes a base and a plurality of links connected in series by a corresponding plurality of revolute joints, the links and joints thereby forming a kinematic chain terminating with the encapsulation mechanism as the end-effector. Each of the revolute joints preferably incorporates an actuator, ideally in the form of an independently operable electric servo motor. In some embodiments, one or more of the links may include a telescopic extension mechanism to provide additional degrees of freedom in the kinematic chain, and additional operating range for the robotic arm.

[0026] In some preferred embodiments, the robotic arm incorporates multiple redundant degrees of freedom, thereby to provide additional flexibility in terms of the spatial location of the encapsulation mechanism, the orientation of the opening of the encapsulation mechanism and the path from each location to the next target.

[0027] In one embodiment, the support assembly for the encapsulation mechanism may also be adapted for movement around additional rotational and/or along additional translational control axes, such that the resultant additional degrees of freedom facilitate optimal encapsulation and detachment of the targeted produce. In one embodiment, the support assembly takes the form of an articulated wrist mechanism disposed intermediate the robotic arm and the encapsulation mechanism, providing additional control around at least pan and tilt axes. For example, a 3-axis pan, tilt and yaw gimbal can be used to orient the encapsulation mechanism to further assist the docking and detachment procedure, as the gimbal enables twisting and rolling of the fruit in all directions. In such embodiments, sensors (e.g. force and torque) can be used to sense and control the amount of torque being applied in various rotational degrees of freedom, and force in the various translational degrees of freedom. This functionality can also be useful in selective harvesting of the produce, where the system can be adapted to automatically apply only a limited amount of force or torque in any given combination of axes such that fruit that is not ready to be picked will be indentified as being harder to detach will not be forcibly harvested by the system, but rather will be automatically left for harvesting in future passes.

[0028] Preferably, the apparatus further includes a sensing system for sensing aspects of a surrounding environment and generating data indicative thereof. In one embodiment, a classification system is preferably provided for identifying targets within the environment on the basis of data from the sensing system, such targets corresponding to specified produce such as fruit, vegetables, flowers, nuts, or seeds to be harvested.

[0029] The apparatus preferably further includes a control system adapted to control the robotic arm to position the encapsulation mechanism around targeted produce identified by the classification system, to close the encapsulation mechanism, to activate the detachment mechanism, and thereby to harvest the targeted produce. [0030] The control system is preferably further adapted to regulate the robotic arm and the encapsulation mechanism, in order to subsequently deposit the harvested produce in a designated transfer chute or storage receptacle, before proceeding to the next identified target. In one embodiment, the apparatus is specifically adapted for picking fruit from fruit trees, although it should be understood that other embodiments may be specifically adapted for targeting and harvesting other specified forms of produce, including but not limited to harvesting of vegetables, nuts, seeds, seed pods, berries, herbs, grains, flowers, fungi or other value crops from associated trees, plants, vines, roots or other growth sources. The system may also be adapted to target other objects such as pests, rubbish or weeds.

[0031] In one embodiment, the apparatus includes a second sensing system for sensing in real time the position and orientation of the encapsulation mechanism, as part of a feedback control loop. In other embodiments, however, it will be appreciated that these parameters may alternatively be determined or calculated by means of an open loop control strategy, optionally utilising respective pre-defined intermediate reference or waypoints for actuators regulating the position, orientation and/or encapsulation status of the robotic arm and encapsulation mechanism. In one embodiment, at least one sensor of the sensing system is substantially co-located with the encapsulation mechanism, to facilitate targeting and route-planning.

[0032] In one embodiment, the apparatus is attached to or integrated with an unmanned ground vehicle (UGV), the control of which may be partially or fully automated, as part of an overall environmental scanning, produce targeting, route planning and harvesting control methodology, optionally networked with a plurality of like or complementary autonomous vehicles. In one embodiment, the vehicle is adapted to systematically traverse successive rows of fruit trees, crops, vines or garden beds as part of an automated harvesting process.

[0033] In further embodiments, the apparatus may be attached to a fixed base station, optionally in conjunction with a plurality of like base stations disposed in predetermined spaced apart relationship with adjoining or overlapping target zones and operating in concert to provide effective coverage of a defined area to be harvested. In yet further embodiments, the apparatus is mounted to an autonomous unmanned aerial vehicle (UAV). [0034] In some embodiments, multiple harvesting robots are networked and configured to communicate with a central control system, which is adapted to store state information and generate higher level harvesting plans. Another variation utilises a decentralised control system, wherein multiple harvesting robots can communicate and coordinate directly between themselves, thereby obviating the need for a central control system.

[0035] In some embodiments, the sensor comprises a camera adapted to generate a 2-D image of the environment, and the control system includes a mathematical transformation algorithm to correlate the pixel space of the image from the camera to the positions of the actuators in the targeting mechanism and/or the robotic arm. More sophisticated embodiments utilise 3-D imaging and multi-modal sensing for mapping and localisation. Examples of sensors that may be used for mapping and localisation include infrared, ultraviolet, visual, laser ranging or Lidar, hyperspectral, inertial, acoustic and radar-based sensing systems.

[0036] Preferably, the control system includes a prioritisation algorithm for prioritisation of targets for the apparatus. In one embodiment, the algorithm is based on a relatively simple "first-in-first-out" (FIFO) prioritisation strategy. In other embodiments, however, additional optimisation parameters may be incorporated into the control strategy, including angle of approach, vehicle velocity (if relevant), time or distance required for the encapsulation mechanism to reach the target, errors in measurement, historical inputs derived from historical system performance in comparable situations, estimated probability of a missed target (e.g. based on range, potential obstacles and other measured or calculated variables), opportunity value parameters (e.g. based on degree of ripeness of target produce), or the like.

[0037] In further aspects, the invention provides automated methods and systems for harvesting horticultural produce, using the apparatus as described.

[0038] In some embodiments, the apparatus may include optical flow sensors on the encapsulation mechanism/end effector in order to assist the encapsulation mechanism to dock to the target. This may be particularly useful when the apparatus incorporates a level of dynamic behaviour, increasing the difficulty in docking the encapsulation mechanism. [0039] In some embodiments, the apparatus may include may incorporate jets, propellers or other thrusters in order to effectively control the encapsulation mechanism/manipulator when docking or undocking with the target produce. Again, this may be particularly useful when the encapsulation mechanism acts as the end effector and incorporates a level of dynamic behaviour which increases the difficulty in precisely and accurately locating the encapsulation mechanism. In a similar way, the encapsulation mechanism may be formed as part of a tethered aerial vehicle, where the tether provides a low cost means for spatially constraining the encapsulation mechanism, whilst providing power and communications to the encapsulation mechanism.

[0040] In certain embodiments, the encapsulation mechanism may include a separate mechanism for assisting the docking procedure, for example, the encapsulation mechanism may incorporate a separate conical shaped protrusion such that it lowers the localisation tolerance when docking, as the larger diameter of the cone can funnel the target towards the smaller diameter of the cone (and shells) as the encapsulation mechanism approaches the target.

[0041] In some embodiments, the apparatus may also incorporate a means to pack the target (e.g. apple) in a package by wrapping it as the encapsulation mechanism closes. The encapsulation mechanism may incorporate a means for sealing the packaging in such a way that it protects, preserves or seals the target. This may be by way of a spool of packing bags located at the encapsulation mechanism, or as individual packages that are picked up by the encapsulation mechanism prior to docking with and packaging the target.

[0042] In some embodiments, the apparatus may form part of a system which incorporates a conveyer system (e.g. belts, buckets, rollers) or tubes (e.g. gravity feed, vacuum, peristaltic etc.) whereby the targets can be output from the encapsulation mechanism in order to move them from the encapsulation mechanism to a destination (e.g. a basket, tub, refrigerator, freezer, etc).

[0043] In certain preferred embodiments, the shells can rotate past the point of closure, so as to form a second open configuration on the opposite side of entry of the produce, thereby to allow rapid output from the end effector through to the destination (e.g. basket, conveyor etc.).

[0044] In one embodiment, one or more sensors (e.g. visual, laser, ultrasound, switches) are installed as part of the encapsulation mechanism to determine the state of the target produce (e.g. apple) throughout the docking or encapsulating procedure. This may be a simple state representation (e.g. Target DOCKED, Target NOT DOCKED) or a more measured approach (e.g. Target 14.6mm from DOCKED). Similarly, rotary encoders (absolute or incremental) or switches may be installed to sense any rotational offset between the shells and the main chassis.

[0045] In certain preferred embodiments, the encapsulation mechanism incorporates various sensors to measure characteristics of the target. For example, scales and strain gauges can be used to measure weight, imaging sensors can measure colour/ripeness, temperature sensors can measure the temperature of the produce, ranging and distance sensors can measure size, etc. The information obtained from these sensors may be used for data collection purposes, or more actively as a higher level methodology where only targets meeting a certain criteria are harvested (e.g. only harvest apples larger than 7cm diameter and 90g mass). Such information could be used for selective harvesting via connection to a separate or integrated computer system that identifies which fruit, for example, is to be picked using various sensors, and controls the encapsulation mechanism and related devices to harvest the fruit. In some forms, the operator can interact with the system at a high level to input high level commands, thereby to enhance the efficiency and accuracy of the computer control system to a level at which the apparatus/system can operated substantially autonomously independently with high speed, complex computation and high precision and accuracy, reporting back for operator review or input only selected critical details.

Brief Description of the Drawings

[0046] Preferred embodiments of the invention will now be described, by way of example only, with reference to the accompanying drawings in which:- [0047] Figure 1 is a perspective view showing part of a horticultural harvesting apparatus with the encapsulation mechanism in the open position adjacent a targeted item of horticultural produce in the form of a piece of fruit to be harvested, according to a first embodiment of the invention;

[0048] Figure 2 is a perspective view showing the apparatus of Figure 1 with the encapsulation mechanism in a partially closed position around the fruit;

[0049] Figure 3 is a perspective view of the apparatus of Figures 1 and 2 with the encapsulation mechanism in a closed configuration, with the fruit disposed within the chamber defined by the revolving shells of the encapsulation mechanism;

[0050] Figure 4 is a perspective view showing the apparatus of Figures 1 to 3 mounted to a first form of support assembly, with the revolving shells of the encapsulation mechanism supported for rotation about a transverse axis;

[0051] Figure 5 is a perspective view showing the apparatus of Figures 1 to 3 mounted to a second form of support assembly, with the revolving shells of the encapsulation mechanism supported for rotation about a longitudinal axis;

[0052] Figure 6 is a perspective view showing a further embodiment of the invention, in which the encapsulation mechanism is mounted as the end-effector of a robotic arm by means of an intermediate support assembly of the type shown in Figure 4;

[0053] Figure 7 is a perspective view showing a further embodiment of the invention, in which the encapsulation mechanism is mounted to a UAV by means of a support assembly of the type shown in Figure 4;

[0054] Figure 8 is a perspective view showing a further embodiment of the invention, comprising a system incorporating a plurality of UAVs of the type shown in Figure 7, and a supporting UGV including a receptacle adapted to receive produce harvested and deposited by the UAVs; [0055] Figure 9 is a perspective view showing a further embodiment of the invention, in which the encapsulation mechanism is mounted to a UGV by means of a support assembly on the remote end of an extensible manipulator;

[0056] Figure 10 is a flowchart showing a diagrammatic representation of a high- level control methodology for a harvesting apparatus and system in accordance with one embodiment of the invention;

[0057] Figure 11 is a flowchart showing a diagrammatic representation of control logic for a targeting strategy of the system;

[0058] Figure 12 is a flowchart showing a diagrammatic representation of control logic for harvesting targeted produce, using the apparatus and system of the invention; and

[0059] Figure 13 is a perspective view showing a further embodiment of the invention, in which the encapsulation mechanism is mounted to a collection canister for the harvested fruit, and the revolving shells include a plurality of discrete finger elements in a partially closed position around the targeted fruit.

Preferred Embodiments of the Invention

[0060] Referring initially to Figures 1 to 3, the invention provides an apparatus 1 for harvesting horticultural produce such as fruit, vegetables, nuts, berries, seeds, seed pods, herbs, grains, flowers or fungi from associated trees, plants, vines, roots or other growth sources. The particular embodiment of the invention as shown is intended for harvesting apples, oranges or similar fruits and is shaped accordingly. It should be understood, however, that the invention is not limited to this particular application, and may be shaped and configured in a variety of different ways to suit other forms of produce as required.

[0061] The apparatus 1 includes an encapsulation mechanism 2 movable between an open position or configuration (as best seen in Figure 1) to receive at least one selected item of horticultural produce 3 such as an apple or similar fruit, and a closed position or configuration (as best seen in Figure 3) to substantially encapsulate the selected item of produce. Figure 2 shows the encapsulation mechanism in an intermediate position, between the open and closed configurations, with the targeted fruit partially encapsulated.

[0062] The apparatus further includes a drive mechanism 5 to effect movement of the encapsulation mechanism between the open and closed positions, and a detachment mechanism 6 operable to detach the encapsulated produce from the plant by cutting, rolling, twisting, pulling, breaking or otherwise severing the associated stem 7, as described in more detail below. When picking fruit, the stem of the fruit preferably stays with the fruit and breaks free from the connecting spur on the tree. The connecting spur preferably stays with the tree such that the fruit, fruit stem, tree and connecting spur are not damaged. When cutting or otherwise separating the fruit from the tree in a way that is not a clean break between the stem and the spur, the connecting spur on the tree preferably remains in relatively good condition to avoid loss of yield in the next harvest and the fruit maintains a stem in sufficient condition to avoid rotting. In instances where more than one fruit and stem is joined at a single spur, the system can coordinate multiple end effectors to harvest the fruit that will become separated and that may otherwise fall to the ground by harvesting other fruit connected to the same spur.

[0063] The encapsulation mechanism in this embodiment includes a pair of shells 8 supported for relative rotation between the open and closed configurations. More specifically, the encapsulation mechanism comprises an inner shell 8A and an outer shell 8B, each shell being substantially hemispherical in shape and supported for relative rotation about a diametrical hinge axis, common to both shells. As best seen in Figure 1 , in the open position, the inner shell 8A is substantially nested within the outer shell 8B, whereas in the closed position, the inner and outer shells together define a substantially spherical or partially spherical encapsulation chamber 10.

[0064] The drive mechanism preferably includes one or more electronically controlled servo motors adapted to regulate rotation of the shells with respect to one another and/or with respect to a supporting element of the apparatus, thereby to effect controlled movement of the shells between the open and closed positions. The same or separate servo motors may be used to regulate the detachment mechanism. ln alternative embodiments, hydraulic, pneumatic, electro-mechanical or other suitable forms of actuator may additionally or alternatively be used for either function.

[0065] In some embodiments (not shown), the shells and hence the encapsulation chamber may be perforated by apertures, slots, holes, vents or other openings formed in one or both of the shells. In some embodiments, the shells may be defined in whole or in part by wire frame, lattice, grate, honeycomb or similar structures. In further embodiments (also not shown), the inner and outer shells may be substantially elliptical in cross-sectional profile, in which case it will be appreciated that the encapsulation chamber generally takes the form of a prolate spheroid. In such embodiments, the shells may be supported for relative rotation about a common hinge axis corresponding to either a minor or major axis of the prolate spheroid defined by the encapsulation shells.

[0066] In further embodiments, a larger number such as three, four, five or more shell portions may be provided to enable a greater degree of retraction of the encapsulation mechanism in the open position. Preferably in such embodiments, the multiple shell portions are adapted for overlapping nested or inter-leaving engagement in the open position.

[0067] In some embodiments, the shells may be formed at least partially from a flexible material, or incorporate a soft or flexible inner lining, to reduce the risk of inadvertent damage or bruising of the produce during the containment and harvesting process. In some embodiments, the encapsulation mechanism may also incorporate a supplementary retention mechanism, such as a suction cup or suction pad to help locate and hold the fruit in place. This may be advantageous, for example, in embodiments incorporating a larger number of relatively smaller shell portions, which do not fully cup or optimally locate the targeted produce in the open configuration.

[0068] In some embodiments, the encapsulation mechanism includes a fluid delivery mechanism, which may be adapted for a variety of purposes. For example, water spray may be introduced to wash or cool the produce. Pressurised air may be introduced to dry, heat, cool or clean the produce. Heating may be used in some circumstances to reduce the risk of contamination. Oils, emulsions, herbicides, pesticides, fungicides, disinfectants, preservatives, nutrients or other horticultural chemicals, additives, treatments or coatings may also be introduced into the encapsulation chamber and thereby applied to the produce by substantially the same mechanism during the harvesting process.

[0069] As best seen in Figures 4 and 5, the apparatus preferably further includes a support assembly 20 disposed to support the encapsulation mechanism and facilitate the positioning and orientation of the associated shells. In the embodiment of Figure 4, it will be seen that the shells of the encapsulation mechanism are supported for coaxial rotation about a transverse axis between a yoke formation defined by yoke arms 21. In the embodiment of Figure 5, the shells are supported for rotation about a longitudinal axis defined by an axial stem formation 23.

[0070] Cutting blades or cutting edges 30 are preferably integrated with or attached to the circumferential edges of the shells, whereby upon movement of the shells into the closed position (see Figure 3), the stem 7 of the encapsulated fruit or other produce is automatically severed from the associated plant. In this form of the invention, it will be appreciated that the detachment mechanism 6 takes the form of a cutting mechanism directly associated with, and effectively integral with, the encapsulation mechanism itself.

[0071] In other embodiments, the apparatus may be adapted to snap, twist, pull or otherwise separate the produce from the associated stem or spur of the supporting plant, by rotational and/or translational displacement of the encapsulated produce, by means of the encapsulation mechanism or an associated support mechanism. In further embodiments, a separate detachment mechanism incorporating cutting blades, shears or alternative stem severing means may be provided and activated substantially independently of the encapsulation mechanism.

[0072] At least one of the shells and optionally both shells incorporate a guide slot (not shown), optionally tapered, to receive and locate the stem 7 of the produce to be harvested, thereby providing a guide or "docking" mechanism to facilitate more accurate initial positioning and subsequent encapsulation of the produce. In some embodiments, the guide slot may also incorporate sharpened edges, blades, teeth, serrations or other formations to assist in the process of separating the produce from its stem upon closure or subsequent displacement of the encapsulation mechanism. [0073] As best seen in Figure 6, the apparatus in one preferred embodiment further includes an articulated robotic arm 40 incorporating a plurality of links 42 connected in series by a corresponding plurality of revolute joints 43 to provide additional degrees of freedom of movement and/or a larger operational envelope. Each of the revolute joints preferably incorporates an actuator, ideally in the form of an independently operable electric servo motor.

[0074] The number of links, joints and actuators in the arm will be determined by the intended application and operational requirements. However, the robotic arm ideally incorporates multiple redundant degrees of freedom, to provide additional flexibility in terms of the spatial location of the encapsulation mechanism, the orientation of the opening of the encapsulation mechanism in each location, and the optimal path from each location to the next target for harvesting. One or more of the links may also be adjustably extensible if required.

[0075] In the embodiment shown, the support assembly 20 of Figure 4 is utilised to connect the encapsulation mechanism 2 as an end-effector of the robotic arm 40. In some embodiments, the support assembly itself may be adapted for movement around additional rotational and/or along additional translational control axes, such that the resultant supplementary degrees of freedom facilitate optimal targeting, encapsulation and detachment of the produce. In one embodiment (not shown), for example, the support assembly takes the form of an articulated wrist mechanism disposed intermediate the robotic arm and the encapsulation mechanism, providing additional control around pan and tilt axes.

[0076] The apparatus further includes a sensing system for sensing aspects of the surrounding environment and generating data indicative thereof and a classification system for identifying targets within the environment on the basis of data from the sensing system, such targets corresponding to produce such as fruit, vegetables, flowers, nuts, seeds to be harvested.

[0077] The sensing system and classification system form part of an overall control system adapted to control the robotic arm so as to position the encapsulation mechanism around targeted produce identified by the classification system, close the encapsulation mechanism, activate the detachment mechanism, and thereby harvest the targeted produce. The control system is preferably further adapted to regulate the robotic arm and the encapsulation mechanism in order subsequently to deposit the harvested produce in a designated transfer chute or storage receptacle before proceeding to the next identified target, as described more fully below.

[0078] Figure 7 shows a further embodiment of the invention, in which the apparatus is integrated into an unmanned aerial vehicle (UAV) 60 by means of a support assembly 20 of the type shown in Figure 4. Control of the UAV is automated as part of an overall environmental scanning, targeting, route planning and control methodology, optionally networked and operating systematically in conjunction with a number of like or complementary autonomous vehicles.

[0079] The UAV 60 incorporates a body 61 , four independent rotors 62, drive motors 63 and auxiliary equipment including an onboard power supply, remote communications module, navigational control system including GPS and related hardware and software components, the configuration of which will be generally familiar to those skilled in the art. It will be appreciated that in other embodiments, any number of rotors may be employed on the UAV, for example from one to eight or more. Multiple encapsulation mechanisms may be mounted to the same UAV. Other forms of UAV such as hovercraft, and alternative forms of propulsion such as turbofans, may also be used as appropriate in particular applications.

[0080] The sensing system of the apparatus includes a camera 66 adapted to generate a 2-D image of the environment and the control system 67 includes a mathematical transformation algorithm to correlate the pixel space of the image from the camera to the position of the encapsulation mechanism, or to the position of actuators in a targeting or support mechanism regulating the position of the encapsulation mechanism, based on an overall control logic described more fully below. More sophisticated embodiments utilise 3-D imaging and multi-modal sensing for mapping and localisation. Examples of sensors that may be used for mapping and localisation include infrared, ultraviolet, visual, laser ranging or Lidar, hyperspectral, inertial, acoustic and radar-based sensing systems.

[0081] Figure 8 shows a series of UAVs 60 similar to that shown in Figure 7, networked and operable in conjunction with an unmanned ground vehicle (UGV) 70. The UGV is a compact, omni-directional vehicle incorporating a body 71 , and four independently driven and independently steerable wheels 72. The UGV incorporates a storage receptacle 75 into which the UAVs deposit harvested produce, one item at a time. When the receptacle 75 is full, the UGV is diverted by a control system to a central repository (not shown) to deposit the harvested fruit before being redeployed.

[0082] In some embodiments, the harvesting robots are networked and configured to communicate with a central control system, which is adapted to store state information and generate higher level harvesting plans. Another variation utilises a decentralised system, wherein multiple harvesting robots can communicate and coordinate directly between themselves and the UGV, thereby obviating the need for a centralised control system.

[0083] Figure 9 shows a further embodiment, in which the apparatus is attached directly to or integrated with an omni-directional UGV 70 of similar type to that shown in Figure 8. Again, this vehicle may be networked with a series of like or complementary autonomous vehicles, operating under a centralised or decentralised harvesting control strategy. In this case, the encapsulation mechanism 2 is mounted, by means of a support assembly 20 of the type shown in Figure 4, as the end-effector of a robotic manipulator 90. The manipulator is mounted to a chassis or support platform on the UGV for controlled rotation about at least two non-parallel axes (such as pan and tilt axes). The main boom of the manipulator is also telescopically extensible.

[0084] Further degrees of freedom to facilitate positioning and orientation of the encapsulation mechanism as the end-effector are provided by the omni-directional mobile platform of the UGV itself. The encapsulation mechanism may alternatively be attached to the UGV by means of a robotic arm of the type shown in Figure 6.

[0085] It should also be understood that a wide variety of other ground-based vehicles are envisaged, with different numbers of wheels, tracks, legs or skids, including rail-mounted carriages, and a range of options for motive power, steering, navigation and the like are contemplated. In one embodiment, a multi-legged autonomous walking vehicle or robot is used. Moreover, with weight being less of a limiting factor with ground-based vehicles, multiple harvesting apparatus may be mounted to a single vehicular platform for substantially simultaneous, co-ordinated operation. Various embodiments of the system may a!so be retrofitted to existing agricultural equipment or vehicles including tractors, trailers, ploughs, harvesters, quads or the fike.

[0086] In othe embodiments (not shown), the apparatus may be attached to a fixed base station, optionally in conjunction with a piuraiity of like stations disposed in spaced apart relationship, with adjoining or overlapping target zones, and operating in concert to provide effective coverage of a defined target area to be harvested.

[0087] Illustrative examples of high-levei control logic and control methodologies will now be described with reference to Figures 10 to 12. The detailed implementation of these methodologies for particular embodiments and applications of the invention will be within the knowledge and expertise of those skilled in the art.

[0088] Figure 10 is a simpie flowchart of a high-level control strategy, which should be understood in the context of the apparatus and related system components previously described. In its most basic form, with some details omitted, the system logic in broad overview is as foliows;-

• evaluation of target environment,

• generation of sensor data based on target environment,

• activation of automatic target recognition and harvesting system,

• harvesting targeted produce with encapsulation mechanism (revoiving shells),

• re-evaluation of target environment, and

• generation of new sensor data.

[0089] The flowchart of Figure 11 illustrates in more detail one example of a methodology for target identification and acquisition within a defined target environment. This relatively basic system looks for targets in the initial area, assumes the apparatus and supporting vehicle are stationary, harvests the targets in that area, and moves to the next area. The system involves a classifier for example with selected produce, plant stems, extraneous foliage and ground as the primary classes. Since this particular system assumes the apparatus is stationary, it wilt be more relevant to ground vehicles than UAVs. The methodology in broad overview is as follows:

• acquisition of sensor data from the initial target area,

• segmentation of sensor data from initial target area,

• classification of segmented data,

• location of targets based on segmented and classified data,

• location of targets in local coordinate frame,

• prioritisation of targets based on locations of targets in iocat coordinate frame,

• harvesting of targets in order of priority,

• completion of harvesting for all targets in initial target area, and

• moving of vehicle to next target area.

[0090] The prioritisation algorithm may be based on a relatively simple "first-in- first-out" (FIFO) prioritisation strategy. In other embodiments, however, additional optimisation parameters may be incorporated into the control strategy, including angle of approach of the encapsuiation mechanism, vehicle velocity, time or distance required for the encapsulation mechanism to reach the target, inputs derived from historical system performance in comparable situations, estimated probability of a missed target (e.g. based on range, potential obstacles and other measured or calculated variables), opportunity value parameters (e.g. degree of ripening of produce based on colour gradations ), or the like.

[0091] Figure 12 shows a more detailed example of a methodology for target acquisition. This example assumes that a target has been identified, prioritised and located pursuant to the methodology outlined above in connection with Figure 11. In more sophisticated embodiments, targets may also be registered with a target memory in global coordinates, based on local estimates of target positions in a global coordinate frame of reference. This enables generation of a "world map" including localisation and state information based on registered and updated targets in global coordinates.

[0092] irrespective of the targeting methodology, the control methodology for the harvesting process itself in broad overview is as follows:-

• identification of target for harvesting, • movement of harvesting apparatus to target,

• engagement or docking of encapsulation mechanism (in open position) with target,

• movement of encapsulation mechanism into closed position by rotation of shells,

• continue rotation of shells until fully closed,

• activation of detachment mechanism {e.g. using cutters on shells to sever stem upon closure, or "roll" produce to break stem),

• separation of target from plant or stem,

• movement of encapsulated target object to destination,

• movement of encapsulation mechanism to open position,

• release of target object at destination,

• updating of world map (if relevant), and

• identification of next target for harvesting,

[0093] The implementation of such control strategies under the rules, guidelines, procedures and objectives as outlined herein wilf be well within the capabilities of those skilled in the art, and so will not be described in more detail, it will be equally understood that various additional, complementary or alternative control strategies and methodologies may be utilised for particular applications, within the scope of the inventive concepts as described. For example, in some embodiments, the classification process may be used to differentiate between targets of different size, shape or colour to determine the degree of deveiopment or ripening and this data may in turn be used to refine the targeting and/or prioritisation processes for harvesting. Thus, for example, harvesting of unripe fruit may be de-prioritised and deferred for a subsequent pass at a later time, while overripe fruit may be bypassed altogether, or deposited in a separate receptacle for rejection.

[0094] The invention in its various preferred embodiments provides a relatively simple, robust and reliable harvesting apparatus enabling a wide variety of produce to be harvested and gathered efficiently, effectively and without damage to either the produce or the associated plant. The apparatus readily lends itself to automation in conjunction with complementary robotic platforms and/or autonomous vehicles to provide a flexible range of harvesting apparatus, methods and systems. In these and other respects, the invention represents a practical and commercially significant improvement over the prior art.

[0095] Although the invention has been described with reference to specific examples, it will be appreciated by those skilled in the art that the invention may be embodied in many other forms.

Claims

1. An apparatus for harvesting horticultural produce from plants, the apparatus including:

a drive mechanism to effect movement of the encapsulation mechanism between the open and closed configuration; and

2. An apparatus according to claim 1 , wherein the encapsulation mechanism includes at least two shells supported for relative rotation between the open configuration and the closed configuration, wherein the shells at least partially overlap in the open configuration.

3. An apparatus according to claim 2, including an inner shell and an outer shell.

4. An apparatus according to claim 3, wherein the inner and outer shells are substantially hemispherical in shape, and are supported for relative rotation about a diametrical hinge axis common to both shells.

5. An apparatus according to claim 2 or claim 3, wherein in the open configuration the inner shell is substantially nested within the outer shell, and in the closed configuration the inner and outer shells together define a substantially spherical encapsulation chamber.

6. An apparatus according to claim 5, wherein the encapsulation chamber is perforated.

7. An apparatus according to claim 1 , wherein the encapsulation mechanism includes three or more shell-portions.

8. An apparatus according to claim 7, wherein the multiple shell-portions are adapted for overlapping nested or inter-leaving engagement in the open configuration, thereby to enable a greater degree of retraction in the open configuration.

9. An apparatus according to any one of claims 2 to 8, wherein the encapsulation mechanism incorporates a supplementary retention mechanism to help locate and hold the fruit in place.

10. An apparatus according to claim 9, wherein the supplementary retention mechanism includes a suction cup.

1 1. An apparatus according to any one of claims 2 to 10, wherein the encapsulation mechanism is formed at least partially from a flexible material.

12. An apparatus according to any one of claims 2 to 1 1 , wherein the encapsulation mechanism includes an inner lining, to reduce the risk of inadvertent damage to the produce.

13. An apparatus according to any one of claims 2 to 12, wherein the encapsulation mechanism includes fluid delivery means, whereby a fluid can be selectively introduced to the encapsulation region and thereby applied to the produce.

14. An apparatus according to claim 13, wherein the fluid delivery means is adapted to introduce fluid to the encapsulation region so as to wash, cool, dry, heat or treat the produce.

15. An apparatus according to any one of claims 2 to 14, wherein the detachment means includes a cutting mechanism associated with the encapsulation mechanism, whereby upon movement of the encapsulation mechanism into the closed configuration, the stem of the encapsulated produce is automatically severed from the associated plant.

16. An apparatus according to claim 15, wherein the cutting mechanism is formed integrally with the encapsulation mechanism.

17. An apparatus according to any one of claims 2 to 16, wherein the detachment means is separate from the encapsulation mechanism, but operable in direct response to movement of the encapsulation mechanism toward the closed configuration by means of intermediate connections.

18. An apparatus according to any one of claims 15 to 17, wherein the cutting mechanism includes one or more cutting blades arranged at least partially about the circumferential edges of the shells.

19. An apparatus according to any one of claims 2 to 14, wherein the detachment mechanism is adapted to separate the produce from the associated stem or spur of the supporting plant, by rotational and/or translational displacement of the encapsulated produce itself.

20. An apparatus according to any one of claims 2 to 19, wherein at least one of the shells incorporates a slot adapted to receive and locate the stem of the produce, thereby providing a guidance mechanism to facilitate more accurate initial positioning and encapsulation of the produce.

21. An apparatus according to any one of claims 2 to 20, wherein the drive mechanism includes one or more electronically controlled servo motors adapted to regulate rotation of the shells, with respect to one another, thereby to effect controlled movement between the open and closed configurations.

22. An apparatus according to claim 21 , wherein the electronically controlled servo motors also operate the detachment mechanism.

23. An apparatus according to any one of claims 2 to 22, including a support assembly disposed to support the encapsulation mechanism and facilitate the positioning and orientation of the associated shells.

24. An apparatus according to any one of claims 2 to 22, including an articulated robotic arm incorporating a support assembly for the encapsulation mechanism, whereby the robotic arm is adapted to support the encapsulation mechanism as an end-effector of the arm.

25. An apparatus according to claim 24, wherein multiple encapsulation mechanisms are supported by the robotic arm, either as end-effectors or at intermediate positions along the arm.

26. An apparatus according to claim 24 or claim 25, wherein the robotic arm incorporates multiple redundant degrees of freedom, thereby to provide additional flexibility in terms of the spatial location of the encapsulation mechanism, the orientation of the opening of the encapsulation mechanism and the path from each location to the next target.

27. An apparatus according to any one of claims 24 to 26, wherein the support assembly for the encapsulation mechanism is adapted for movement around additional rotational and/or along additional translational control axes, such that the resultant additional degrees of freedom facilitate optimal encapsulation and detachment of the targeted produce.

28. An apparatus according to any one of claims 24 to 27, including a sensing system for sensing aspects of a surrounding environment and generating data indicative thereof, and a classification system for identifying targets within the environment on the basis of data from the sensing system, such targets corresponding to specified produce to be harvested.

29. An apparatus according to claim 28, including a control system adapted to control the robotic arm to position the encapsulation mechanism around targeted produce identified by the classification system, to close the encapsulation mechanism, to activate the detachment mechanism, and thereby to harvest the targeted produce.

30. An apparatus according to claim 28 or claim 29, including a second sensing system for sensing in real time the position and orientation of the encapsulation mechanism, as part of a feedback control loop.

31. An apparatus according to any one of claims 28 to 30, wherein at least one sensor of the sensing system is substantially co-located with the encapsulation mechanism, to facilitate targeting and route-planning.

32. An apparatus according to any one of the preceding claims and integrated with an unmanned ground vehicle (UGV), the control of which is at least partially automated as part of a harvesting control methodology.

33. An apparatus according to any one of claims 1 to 31 and mounted to an autonomous unmanned aerial vehicle (UAV), the control of which is at least partially automated as part of a harvesting control methodology.