WO2020082175A1 - Self-powered apparatus, system and method for automated remote detection of biological infestation - Google Patents

Self-powered apparatus, system and method for automated remote detection of biological infestation Download PDF

Info

Publication number
WO2020082175A1
WO2020082175A1 PCT/CA2019/051497 CA2019051497W WO2020082175A1 WO 2020082175 A1 WO2020082175 A1 WO 2020082175A1 CA 2019051497 W CA2019051497 W CA 2019051497W WO 2020082175 A1 WO2020082175 A1 WO 2020082175A1
Authority
WO
WIPO (PCT)
Prior art keywords
pest
imaging device
side section
power
image
Prior art date
Application number
PCT/CA2019/051497
Other languages
French (fr)
Inventor
David T. Southwell
Laura R. SOUTHWELL
Original Assignee
Proxilogica Corp.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Proxilogica Corp. filed Critical Proxilogica Corp.
Publication of WO2020082175A1 publication Critical patent/WO2020082175A1/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/188Capturing isolated or intermittent images triggered by the occurrence of a predetermined event, e.g. an object reaching a predetermined position
    • AHUMAN NECESSITIES
    • A01AGRICULTURE; FORESTRY; ANIMAL HUSBANDRY; HUNTING; TRAPPING; FISHING
    • A01MCATCHING, TRAPPING OR SCARING OF ANIMALS; APPARATUS FOR THE DESTRUCTION OF NOXIOUS ANIMALS OR NOXIOUS PLANTS
    • A01M1/00Stationary means for catching or killing insects
    • A01M1/02Stationary means for catching or killing insects with devices or substances, e.g. food, pheronones attracting the insects
    • AHUMAN NECESSITIES
    • A01AGRICULTURE; FORESTRY; ANIMAL HUSBANDRY; HUNTING; TRAPPING; FISHING
    • A01MCATCHING, TRAPPING OR SCARING OF ANIMALS; APPARATUS FOR THE DESTRUCTION OF NOXIOUS ANIMALS OR NOXIOUS PLANTS
    • A01M1/00Stationary means for catching or killing insects
    • A01M1/02Stationary means for catching or killing insects with devices or substances, e.g. food, pheronones attracting the insects
    • A01M1/026Stationary means for catching or killing insects with devices or substances, e.g. food, pheronones attracting the insects combined with devices for monitoring insect presence, e.g. termites
    • AHUMAN NECESSITIES
    • A01AGRICULTURE; FORESTRY; ANIMAL HUSBANDRY; HUNTING; TRAPPING; FISHING
    • A01MCATCHING, TRAPPING OR SCARING OF ANIMALS; APPARATUS FOR THE DESTRUCTION OF NOXIOUS ANIMALS OR NOXIOUS PLANTS
    • A01M1/00Stationary means for catching or killing insects
    • A01M1/14Catching by adhesive surfaces
    • A01M1/145Attracting and catching insects using combined illumination or colours and adhesive surfaces
    • AHUMAN NECESSITIES
    • A01AGRICULTURE; FORESTRY; ANIMAL HUSBANDRY; HUNTING; TRAPPING; FISHING
    • A01MCATCHING, TRAPPING OR SCARING OF ANIMALS; APPARATUS FOR THE DESTRUCTION OF NOXIOUS ANIMALS OR NOXIOUS PLANTS
    • A01M1/00Stationary means for catching or killing insects
    • A01M1/14Catching by adhesive surfaces
    • A01M1/16Fly papers or ribbons
    • GPHYSICS
    • G08SIGNALLING
    • G08CTRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS
    • G08C17/00Arrangements for transmitting signals characterised by the use of a wireless electrical link
    • G08C17/02Arrangements for transmitting signals characterised by the use of a wireless electrical link using a radio link
    • HELECTRICITY
    • H02GENERATION; CONVERSION OR DISTRIBUTION OF ELECTRIC POWER
    • H02JCIRCUIT ARRANGEMENTS OR SYSTEMS FOR SUPPLYING OR DISTRIBUTING ELECTRIC POWER; SYSTEMS FOR STORING ELECTRIC ENERGY
    • H02J13/00Circuit arrangements for providing remote indication of network conditions, e.g. an instantaneous record of the open or closed condition of each circuitbreaker in the network; Circuit arrangements for providing remote control of switching means in a power distribution network, e.g. switching in and out of current consumers by using a pulse code signal carried by the network
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/70SSIS architectures; Circuits associated therewith
    • H04N25/76Addressed sensors, e.g. MOS or CMOS sensors
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04QSELECTING
    • H04Q9/00Arrangements in telecontrol or telemetry systems for selectively calling a substation from a main station, in which substation desired apparatus is selected for applying a control signal thereto or for obtaining measured values therefrom
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W4/00Services specially adapted for wireless communication networks; Facilities therefor
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W4/00Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/30Services specially adapted for particular environments, situations or purposes
    • H04W4/38Services specially adapted for particular environments, situations or purposes for collecting sensor information
    • HELECTRICITY
    • H01ELECTRIC ELEMENTS
    • H01GCAPACITORS; CAPACITORS, RECTIFIERS, DETECTORS, SWITCHING DEVICES OR LIGHT-SENSITIVE DEVICES, OF THE ELECTROLYTIC TYPE
    • H01G11/00Hybrid capacitors, i.e. capacitors having different positive and negative electrodes; Electric double-layer [EDL] capacitors; Processes for the manufacture thereof or of parts thereof
    • HELECTRICITY
    • H02GENERATION; CONVERSION OR DISTRIBUTION OF ELECTRIC POWER
    • H02JCIRCUIT ARRANGEMENTS OR SYSTEMS FOR SUPPLYING OR DISTRIBUTING ELECTRIC POWER; SYSTEMS FOR STORING ELECTRIC ENERGY
    • H02J50/00Circuit arrangements or systems for wireless supply or distribution of electric power
    • H02J50/20Circuit arrangements or systems for wireless supply or distribution of electric power using microwaves or radio frequency waves
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04QSELECTING
    • H04Q2209/00Arrangements in telecontrol or telemetry systems
    • H04Q2209/40Arrangements in telecontrol or telemetry systems using a wireless architecture
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04QSELECTING
    • H04Q2209/00Arrangements in telecontrol or telemetry systems
    • H04Q2209/80Arrangements in the sub-station, i.e. sensing device
    • H04Q2209/88Providing power supply at the sub-station
    • H04Q2209/886Providing power supply at the sub-station using energy harvesting, e.g. solar, wind or mechanical
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W4/00Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/02Services making use of location information
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W84/00Network topologies
    • H04W84/02Hierarchically pre-organised networks, e.g. paging networks, cellular networks, WLAN [Wireless Local Area Network] or WLL [Wireless Local Loop]
    • H04W84/10Small scale networks; Flat hierarchical networks
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02EREDUCTION OF GREENHOUSE GAS [GHG] EMISSIONS, RELATED TO ENERGY GENERATION, TRANSMISSION OR DISTRIBUTION
    • Y02E10/00Energy generation through renewable energy sources
    • Y02E10/50Photovoltaic [PV] energy

Definitions

  • the present invention relates to a self-powered apparatus, system, and method for providing automated remote detection of biological infestation.
  • the present invention relates to a self-powered apparatus, system, and method for providing automated remote detection of biological infestation, particularly early detection.
  • the invention comprises an apparatus for detecting biological infestation comprising: a frame comprising a first side section, a second side section, and a middle section therebetween; a pest-trapping element coupled to the first side section and comprising an attractant to trap pests; an electronic support coupled to the second side section and having an imaging device mounted thereon and facing the attractant; a power source operatively connected to the imaging device; and a controller operatively connected to the imaging device and the power source.
  • the invention comprises a system for detecting biological infestation comprising: at least one pest detection apparatus comprising a pest-trapping element to trap at least one pest, an imaging device to image the at least one pest, and a communication unit configured to communicate across a communication network; at least one network access point; and a local server operatively connected to the at least one network access point.
  • the invention comprises a method for detecting biological infestation using a pest detection apparatus comprising an imaging device, a controller, and at least one power source, the method comprising: trapping the at least one pest in the pest detection apparatus; enabling power to the imaging device from the at least one power source; and capturing at least one image of the at least one pest via the imaging device.
  • the apparatus generally comprises an imaging device in the form of a self-powered camera probe capable of imaging at least one pest trapped on the pest-trapping element or present on a plant, and wirelessly communicating with a back-end comprising standard wireless networking and server infrastructure hosting custom image analysis software.
  • the apparatus generally includes a controller.
  • the apparatus may be powered by a power source selected from one or more photovoltaic cells, microwave antenna, or a primary battery that charges an energy storage device such as a supercapacitor or rechargeable secondary battery, or by direct electrical connections.
  • the activity of the apparatus is periodically triggered by a timer device.
  • the apparatus includes a printed circuit board supporting and electrically connecting all the electronic components except the photovoltaic cells and the pest-trapping element.
  • the imaging device and a light source to illuminate the pest-trapping element are oriented towards the pest-trapping element. Proper orientation of the imaging device and pest-trapping element may be assured by tension wires.
  • the energy harvested from the power source accumulates in the power storage device.
  • a very low power timer device continuously operates,“waking up” the controller at regular intervals.
  • the controller illuminates the pest trapping element, captures an image of the pest-trapping element which may contain pests thereon, and wirelessly transmits the image to server infrastructure.
  • the image is processed and analysed for content. If the system determines that a new feature of interest (typically a trapped pest) has been found, it records the possible infestation in a central database and transmits a request for prompt human intervention if required.
  • a new feature of interest typically a trapped pest
  • each apparatus has a unique serial number for identification, so a pest warning report can be associated with its originating probe.
  • a pest warning report can be associated with its originating probe.
  • the system is configured such that multiple apparatuses may be deployed in a growing facility, allowing high quality coverage of the crop during its entire life cycle.
  • FIG 1 is a side view of one embodiment of an apparatus of the present invention.
  • FIG 2 is a top view of the apparatus of FIG 1.
  • FIG 3 is a front end view of the apparatus of FIG 1.
  • FIG 4A is a perspective view of one embodiment of an apparatus comprising a wire-based frame.
  • FIG 4B is a perspective view of one embodiment of an apparatus comprising a modified wire-based frame for attaching a pest-trapping element using adhesive tape.
  • FIG 5A is a side view of one embodiment of an apparatus of the present invention.
  • FIG 5B is a top view of the apparatus of FIG. 5 A.
  • FIG 5C is a rear end view of the apparatus of FIG 5 A.
  • FIG 6 is an electrical schematic of one embodiment of an apparatus.
  • FIG 7 shows a system including one embodiment of an apparatus in wireless communication with multiple wireless access points operably connected to downstream infrastructure.
  • the present invention relates to a self-powered apparatus, system, and method for providing automated remote detection of biological infestation.
  • biological infestation broadly refers to the presence of an organism regarded as a pest which may attack, damage, and/or consume one or more plants cultivated in indoor or outdoor horticultural and agricultural facilities or areas.
  • the term“pest” broadly refers to insects (for example, wireworms, cutworms, thrips, flea beetles, armyworms, aphids, com borers, moths, flies, mealybugs, etc.), parasites (for example, protozoa, helminths, arthropods, etc.), pathogens (for example, fungi including molds, bacteria, viruses, etc.), and vermin (for example, rats, mice, etc.).
  • insects for example, wireworms, cutworms, thrips, flea beetles, armyworms, aphids, com borers, moths, flies, mealybugs, etc.
  • parasites for example, protozoa, helminths, arthropods, etc.
  • pathogens for example, fungi including molds, bacteria, viruses, etc.
  • vermin for example, rats, mice, etc.
  • the present invention comprises an apparatus for detecting biological infestation.
  • the apparatus generally comprises: a frame comprising a first side section, a second side section, and a middle section therebetween; a pest-trapping element coupled to the first side section and comprising an attractant to trap pests; an electronic support coupled to the second side section and having an imaging device mounted thereon and facing the attractant; a power source operatively connected to the imaging device; and a controller operatively connected to the imaging device and the power source.
  • the present invention comprises a system for detecting biological infestation.
  • the system generally comprises: at least one pest detection apparatus comprising a pest-trapping element to trap at least one pest, an imaging device to image the at least one pest, and a communication unit configured to communicate across a communication network; at least one network access point; and a local server operatively connected to the at least one network access point.
  • the present invention comprises a method for detecting biological infestation using a pest detection apparatus comprising an imaging device, a controller, and at least one power source.
  • the method generally comprises: trapping the at least one pest in the pest detection apparatus; enabling power to the imaging device from the at least one power source; and capturing at least one image of the at least one pest via the imaging device.
  • the invention may be sensitive, accurate, lightweight, and cost-effectively deployed to provide automated detection of pests across a large physical area, particularly early detection. Early detection and identification of pests, their eggs, or pest-induced damage may be a valuable line of defence against catastrophic crop loss.
  • the apparatus 16 includes a printed circuit board (hereinafter“PCB”) 1, a frame 2, a power source in the form of one or more photovoltaic (hereinafter“PV”) cells 3, a pest-trapping element 4, a power storage device 7, an imaging device 8, a light source 9, and a controller 10.
  • PCB printed circuit board
  • PV photovoltaic
  • the PCB 1 supports and electrically connects all electronic components of the apparatus 16. Methods of manufacturing a PCB are well-known in the art and will not be described in detail.
  • the electronic components of the apparatus 16 are generally soldered onto the PCB 1 to mechanically fasten and electrically connect them to the PCB 1.
  • all electronic components of the apparatus 16 are soldered onto the PCB 1, with the exception of the PV cells 3 which are supported by the frame 2 and electrically connected to the PCB 1 by wires.
  • the PV cells 3 are attached to the base of the frame 2.
  • the PV cells 3 are attached to the rear of the frame 2, facing away from the PCB 1 and the imaging device 8.
  • the PCB 1 is a multilayer PCB.
  • the multilayer PCB 1 has a width of about 20 mm, a height of about 30 mm, and a thickness of about 0.5 mm.
  • the PCB 1 supports the power storage device 7, imaging device 8, light source 9, and controller 10, all of which will be further described.
  • the PCB 1 may be protected against harsh environments, moisture, electrical contact with surroundings, damage, contamination, and the like by being enclosed in a shell formed of a suitable material such as plastic or metal; encapsulated in conformal coatings commonly used in industrial applications to avoid explosion hazards from sparks and water intrusion; or immersed in potting compounds that effectively seal the apparatus 16 in a block of resin, while making provision for the imaging device 8, light source 9, and other components that may need to remain exposed for operation.
  • the power source may be selected from one or more PV cells 3, microwave antenna, or a primary battery that charges the power storage device 7 (for example, a supercapacitor or rechargeable secondary battery) or by direct electrical connections.
  • the imaging device 8 comprises an integrated camera device comprising a complementary metal oxide semiconductor (CMOS) or charge- coupled device (CCD) image sensor and associated optics.
  • CMOS complementary metal oxide semiconductor
  • CCD charge- coupled device
  • the imaging device 8 comprises a CMOS or CCD image sensor paired with discrete optics.
  • the imaging device 8 may be protected from moisture by including an anti-bead coating on the lens of the imaging device 8. The coating may mitigate image degradation due to humidity-induced condensation on the lens.
  • the light source 9 comprises a light emitting diode (LED) which illuminates the pest-trapping element 4 when activated by the controller 10.
  • LED light emitting diode
  • the controller 10 comprises a System on a Chip (hereinafter“SOC”).
  • SOC 10 comprises a microprocessor complex equipped with volatile and non-volatile storage, wireless communication, an interface to the imaging device 8, and the ability to control the light source 9 to illuminate the pest-trapping element 4.
  • the microprocessor complex comprises a field programmable gate array (FPGA) implementing SOC functions, and may be implemented using several integrated circuits to separately provide processor, memory, imaging device interface and network interface functions.
  • FPGA field programmable gate array
  • an integral electrical heater for example, a resistor
  • the apparatus 16 may include one or more sensors 21 to detect one or more environmental parameters including, but not limited to, temperature, humidity, carbon dioxide or other gases, ambient light, airflow, and the like. Such sensors 21 may augment the function of the imaging device 8.
  • the SOC 10 not only configures the sensors 21 but also obtains readings from the sensors 21.
  • the light source 9 may be in the form of a LED capable of narrowband illumination to energize bio-fluorescence effects in a pest.
  • the imaging device 8 may include one or more narrowband filters for capturing narrowband signatures and such stimulated bio-fluorescence effects.
  • the frame 2 supports and interconnects the PCB 1, the PV cells 3, and the pest-trapping element 4.
  • the frame 2 comprises a first side section, a second side section, and a middle section therebetween.
  • the pest-trapping element 4 is coupled to the first side section, while the PCB 1 is coupled to the second side section.
  • the frame 2 may be constructed from any suitable material or combination of materials including, but not limited to, aluminum, plastic, wire, or other appropriate materials known to those skilled in the art.
  • the frame 2 may be constructed from aluminum in the form of a sheet which may be stamped with ridges and folds to increase rigidity.
  • the frame 2 may be attached to the PCB 1 using suitable attachment means including, but not limited to, screws, adhesive tape, or glue.
  • the frame 2 may be attached to the PV cells 3 using suitable attachment means including, but not limited to, adhesive tape or glue.
  • the frame 2 may be attached to the pest-trapping element 4 using bendable tabs or the adhesive of the pest-trapping element 4.
  • the frame 2 may be constructed from plastic molded into the shape of the frame 2.
  • the PCB 1, PV cells 3, and pest-trapping element 4 may be attached to the plastic frame using the same attachment means as described above for use with the aluminum frame, or may be clipped into place using slots and tabs pre formed within the plastic frame.
  • a connector interconnects the first side section and second side section to stabilize the frame 2.
  • the connector comprises one or more tension wires 6.
  • the tension wire 6 has a first end coupled to the PCB 1, and a second end coupled to the second side section of the frame 2.
  • the tension wires 6 connect the top two comers of the PCB 1 with the top two comers of the frame 2 that supports the pest-trapping element 4.
  • the tension wires 6 may be in the form of relatively thin filaments which are in tension when installed.
  • the tension wires 6 act to confer stiffness and to align the imaging device 8 and the frame 2 in a parallel orientation, thereby optimally positioning the imaging device 8 and the pest-trapping element 4 for imaging pest while avoiding focusing problems and trapezoidal image distortion.
  • the tension wires 6 may also serve as wireless communication antennae in order to improve wireless communication efficiency (for example, data rate, range or energy consumption of the radios).
  • the frame 2 may be constructed of one or more segments of wire 11 that are soldered onto or attached directly to the PCB 1.
  • the PV cells 3 may be attached to the top of the apparatus 16 and serve to stiffen and align the imaging device 8 and the frame 2 in a parallel orientation, thereby optimally positioning the imaging device 8 and the pest-trapping element 4 for imaging pests.
  • Suitable materials for the wire 11 may include, but are not limited to, stainless steel and the like.
  • the pest-trapping element 4 may be attached to the wire 11 using adhesive tape positioned along each vertical side.
  • the frame 2 comprises segments of wire 11 oriented vertically and angled, allowing the rear surface of the pest-trapping element 4 to be attached to the wire 11 using adhesive tape 12.
  • the pest-trapping element 4 may comprise a relatively stiff card-like material defining curved slots for engaging the wire 11, thereby allowing the wire 11 to secure the pest-trapping element 4 in position.
  • the frame 2 constructed of the wire 11 could be configured to clip under compression into holes and slots defined by the PCB 1, permitting assembly to the PCB 1 without requiring permanent attachment means such as, for example, solder, glue, or adhesive tape.
  • spring steel wires 22 having tensile strength may be used to maintain the imaging device 8 and the pest-trapping element 4 at a controlled distance and under tension during assembly, and facilitating disassembly without tools for flat storage and shipping in an envelope.
  • the PV cells 3 and power storage device 7 are not shown for clarity, but may be attached to the rear of the frame 2, facing away from the PCB 1 and the imaging device 8.
  • the pest-trapping element 4 may comprise one or more attractants suitable for trapping pests.
  • attractants to lure and catch pests 5 include trap paper having an adhesive surface for capturing pests 5 which inadvertently contact the adhesive surface through flying or walking; chemical attractants (for example, pheromones, kairomones); colours or graphical patterns; or substrates impregnated or coated with growth medium to enable the detection of pathogens including, but not limited to, fungi including molds, bacteria, and viruses, of which colonies may grow sufficiently large enough to be imaged by the imaging device 8
  • non-pest organisms performing useful functions such as pollination (for example, bees and bumblebees) or preying upon undesirable pests (for example, ladybugs) may be deliberately introduced.
  • Such non-pest organisms may be significantly larger in size than the pests 5 for which the pest-trapping element 4 is intended.
  • Deterrents may be used to prevent useful non-pest organisms from being trapped by the pest-trapping element 4.
  • a mesh screen having a mesh size selected to exclude non-pest organisms may be positioned proximate the attractant of the pest-trapping element 4 in order to avoid trapping any non-pest organisms.
  • the mesh screen may be formed of suitable materials including, but not limited to, wire or plastic.
  • the pest-trapping element 4 may be removable to allow the imaging device 8 to aim directly at plants or portions thereof, thereby enabling sampling and determination of the presence of any pest directly on the plants or portions thereof, and/or plant status such as, for example, the quantitative growth and maturation metrics.
  • Installation of the apparatus 16 may be temporary or permanent.
  • the apparatus 16 may be clipped or attached using suitable fastening means to either the plants being monitored or fixed structures (for example, pots, planters, boxes, beds, grow bags, trays, saucers, stakes, supports, cages, trellises, railing, fencing, etc.) proximate to the plants being monitored.
  • suitable fastening means may include adhesives (for example, tape, glue, etc.), wire, string, clips, staples, and the like.
  • the apparatus 16 may be mounted on a grid or framework to provide systematic coverage of an area under surveillance for biological infestation, where the apparatus 16 is powered and networked directly by fixed wire infrastructure.
  • the apparatus 16 may be configured to be installed for the duration of a plant’s life cycle which may be lengthy. Over many months of continuous operation, the pest trapping element 4 may become coated with pests or contaminated with obscuring material (for example, dust, soil, dirt) such that generation of meaningful data becomes impaired.
  • the system may be configured to identify and locate any pest-trapping element 4 requiring replacement or cleaning based on radio telemetry, and subsequently transmit a request for human assistance in replacing or cleaning the pest-trapping element 4.
  • Various factors may trigger the need for replacement or cleaning of the pest-trapping element 4 including, but not limited to, the type, size, number, or density of trapped pests, or presence of contaminants.
  • the apparatus 16 requires electrical energy which can be harvested from the PV cells 3; however, the PV cells 3 may not produce sufficient instantaneous power to operate the controller 10 and associated peripherals under all light conditions.
  • the controller 10 comprises a SOC. When installed under the growth canopy or when operating during times of darkness (when pests may be most active), there may be insufficient direct power.
  • the PV cells 3 may instead produce energy for the power storage device 7 which charges up and has the power delivery capacity to operate the apparatus 16 in short bursts. Even under low light conditions, the
  • PV cells 3 are able to make progress charging the power storage device 7 when it is used only infrequently and periodically.
  • the power storage device
  • Supercapacitors may tolerate virtually unlimited numbers of charge/discharge cycles without suffering significant capacity, leakage or internal impedance degradation.
  • Other various embodiments may select rechargeable batteries such as lithium polymer or lithium-ion batteries. Such batteries have price, volumetric energy and volumetric power density advantages over supercapacitors; however, they are more volatile and less durable.
  • the apparatus 16 may be able to execute a minimum number of bursts to meet plant surveillance requirements. This requirement informs the energy storage capacity and also the self-discharge rate of the apparatus 16 while it is waiting between activity bursts.
  • An energy management circuit 13 ensuring positive charging from the PV cells 3 and minimisation of leakage paths ensures the power storage device 7 operates as efficiently as possible.
  • the apparatus 16 When the apparatus 16 is idling between activity bursts, it is able to accumulate electrical energy. During these intervals, the power consumption of the apparatus 16 may be as low as possible. For this reason during these times, power is electrically isolated from the main power draws (the SOC 10, imaging device 8, power source 9, radio/WiFi antenna 15) using a power transistor and only a dedicated timer device 14 is allowed to run.
  • the timer device 14 is configured to wait for a specified period of time measured in minutes or even hours, and then to trigger a wake up of the SOC 10 to initiate an activity burst.
  • each burst comprises the following steps:
  • Timer device 14 enables power to the SOC 10 and associated peripherals and triggers the SOC 10 to boot from internal non-volatile storage - typically flash memory.
  • SOC 10 boots into its Real Time Operating System (RTOS) and loads its application executable.
  • RTOS Real Time Operating System
  • the application reads a wake counter from non-volatile storage, increments it and writes it back to non-volatile storage. If the counter is still below a fixed threshold, the apparatus 16 decides this is not the time to wake up and jumps directly to step 10 below. However if the counter has reached the threshold, then image capture and transmission occurs.
  • This mechanism is designed to allow finer control over the effective wake up interval.
  • the wakeup timer may be configured by a resistor value to wake up the SOC 10 every 10 minutes which is likely too frequent since it would drain the power storage device 7 too quickly. By using the counter mechanism longer, effective intervals can be implemented with 10 minute granularity with only a slight energy budget penalty.
  • a TCP/IP or UDP session is opened with the wireless network access point it was associated with when first deployed.
  • the imaging device 8 is initialised for image capture. [72] 6. A series of frames is captured with ramping LED illumination durations until a correctly exposed image is received. This approach may be necessary because the ambient illumination conditions will vary dramatically from full sunlight in a greenhouse during the day to complete darkness during the night or certain phases of crop maturation which call for darkness.
  • the optimally exposed image is optionally compressed and then transmitted to the server infrastructure over the wireless network.
  • Metadata such as the unique ID of the apparatus 16 and other readings that may be available are appended to the transmitted data package along with the image.
  • the SOC 10 initiates a shutdown which causes all power to be removed from the SOC 10 subsystem until the next wake up event.
  • Each activity burst lasts a few seconds and therefore consumes a minimal amount of energy. Due to the time and energy constraints, the apparatus 16 may be limited to data capture and transmission - all processing, archival and analysis may occur within much faster computer systems downstream of the apparatus 16.
  • an apparatus 16 is within wireless communication range of several wireless access points 17(i), 17(H) & 17(iii).
  • the access points 17(i-iii) are connected using wired network links to a network switch/router 18.
  • the switch 18 also connects a local server 19 and provides a link 20 to remote data centres across the Internet or dedicated circuits.
  • the apparatus 16 When the apparatus 16 is first deployed and activated, it examines the access points it can detect and ranks them in order of signal strength, identifying an affinity to its preferred access point which is generally the one located closest to it. This information is stored in the probe’s non-volatile memory so it can automatically connect to it during an activity burst.
  • each access point 17(i-iii) can measure the signal strength.
  • the access points 17(i-iii) can estimate the physical location of each particular apparatus 16 as identified by a unique ID or even the MAC address embedded in the broadcast packets.
  • the access points 17(i-iii) can model a volumetric region in which each apparatus 16 resides.
  • Various factors such as signal attenuation due to obscuring objects, reflections, and anisotropic antenna characteristics will distort this estimate so a heuristic algorithm complete with the ability to discard outlier readings that are inconsistent with near consensus among large populations of access points 17(i-iii) is suggested.
  • Possible alternative methods for establishing apparatus 16 location fixes include radio flight time measurements and direct optical detection of strobed lights from the apparatus 16 recovering information regarding the position of the apparatus 16 photogrammetrically.
  • Local analysis of the images transmitted by populations of apparatus 16 is performed in the local server(s) 19 and/or by servers in remote data centres.
  • Local servers 19 collect data from the access points 17(i-iii) and decide if the images reported by each apparatus 16 show significant differences from the previous image reported by that apparatus 16, after normalising for global image changes due to varying illumination levels. If the apparatus 16 may have new data to report, the image and associated metadata are in turn transmitted to a remote data centre for detailed analysis.
  • Such analysis may include conventional image processing techniques for normalisation and feature enhancement, as well as pattern recognition algorithms designed or trained to identify pests 5 caught in the pest-trapping element 4. This information may simply be archived or may also trigger alarms that would result in further investigations by the operators of the facility to determine if intervention may be required.
  • a mesh topology may be used wherein nodes communicate in a peer to peer fashion, forwarding data across numerous nodes, rather than all directly beaming data to individual WiFi access points.
  • mesh radio networks and/or cellular network gateways or direct connection at the sensor node level may be used for outdoor operations. Outdoor applications imply longer distances for communication and harsher operating environments.

Landscapes

  • Life Sciences & Earth Sciences (AREA)
  • Pest Control & Pesticides (AREA)
  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Zoology (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Insects & Arthropods (AREA)
  • Wood Science & Technology (AREA)
  • Environmental Sciences (AREA)
  • Multimedia (AREA)
  • Power Engineering (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Catching Or Destruction (AREA)

Abstract

An apparatus for detecting biological infestation includes a frame having a first side section, a second side section, and a middle section therebetween; a pest-trapping element coupled to the first side section and having an attractant to trap pests thereon; an electronic support coupled to the second side section and having an imaging device mounted thereon and facing the attractant; a power source operatively connected to the imaging device; and a controller operatively connected to the imaging device and the power source. A system and method using the apparatus are also provided.

Description

SELF-POWERED APPARATUS, SYSTEM AND METHOD
FOR AUTOMATED REMOTE DETECTION OF BIOLOGICAL INFESTATION
CROSS-REFERENCE TO RELATED APPLICATIONS
[1] The present application claims priority to Canadian Patent Application No. 3,021,755, entitled“Self-Powered Remote Camera Probes for Automated Horticultural Pest Detection,” and fded on October 22, 2018, the entirety of which is hereby incorporated by reference herein.
FIELD OF THE INVENTION
[2] The present invention relates to a self-powered apparatus, system, and method for providing automated remote detection of biological infestation.
BACKGROUND
[3] In the fields of horticulture and agriculture, biological infestation is a continuous threat to the health, yield, and quality of a crop. In particular, infestation can spread rapidly due to air circulation systems actively rotating air throughout indoor grow facilities. The trend towards increasingly large scale greenhouses and indoor grow facilities for reasons of cost efficiency at scale increases the net value of crops at risk of infestation, especially if a single crop type is grown throughout an entire space.
[4] For certain crops that are grown organically, there are few options to limit the spread of infestation once detected and it is necessary to remove affected plants as quickly as possible in attempt to avoid widespread damage. It is not uncommon for entire crops to be lost in large operations due to uncontrollable infestation that was detected too late to contain.
[5] Due to the sheer size of industrial-scale facilities, direct visual inspection of such a large surface of stems, leaves, flowers and produce can be extremely labour intensive and expensive. As crops mature, the at-risk investment in terms of time, energy, labour and raw materials increases but so does the difficulty of effectively inspecting the plants for signs of infestation. More mature crops have a larger surface area, more of that area is obscured or hard to access, and older plant tissue may be more susceptible to attack.
[6] Therefore, there is a need in the art for an effective apparatus, system, and method which mitigate the problem of biological infestation. SUMMARY OF THE INVENTION
[7] The present invention relates to a self-powered apparatus, system, and method for providing automated remote detection of biological infestation, particularly early detection.
[8] Broadly stated, in a first aspect, the invention comprises an apparatus for detecting biological infestation comprising: a frame comprising a first side section, a second side section, and a middle section therebetween; a pest-trapping element coupled to the first side section and comprising an attractant to trap pests; an electronic support coupled to the second side section and having an imaging device mounted thereon and facing the attractant; a power source operatively connected to the imaging device; and a controller operatively connected to the imaging device and the power source.
[9] In a second aspect, the invention comprises a system for detecting biological infestation comprising: at least one pest detection apparatus comprising a pest-trapping element to trap at least one pest, an imaging device to image the at least one pest, and a communication unit configured to communicate across a communication network; at least one network access point; and a local server operatively connected to the at least one network access point.
[10] In a third aspect, the invention comprises a method for detecting biological infestation using a pest detection apparatus comprising an imaging device, a controller, and at least one power source, the method comprising: trapping the at least one pest in the pest detection apparatus; enabling power to the imaging device from the at least one power source; and capturing at least one image of the at least one pest via the imaging device.
[1 1] In the various embodiments, the apparatus generally comprises an imaging device in the form of a self-powered camera probe capable of imaging at least one pest trapped on the pest-trapping element or present on a plant, and wirelessly communicating with a back-end comprising standard wireless networking and server infrastructure hosting custom image analysis software.
[12] In the various embodiments, the apparatus generally includes a controller. In the various embodiments, the apparatus may be powered by a power source selected from one or more photovoltaic cells, microwave antenna, or a primary battery that charges an energy storage device such as a supercapacitor or rechargeable secondary battery, or by direct electrical connections. The activity of the apparatus is periodically triggered by a timer device.
[13] In the various embodiments, the apparatus includes a printed circuit board supporting and electrically connecting all the electronic components except the photovoltaic cells and the pest-trapping element. The imaging device and a light source to illuminate the pest-trapping element are oriented towards the pest-trapping element. Proper orientation of the imaging device and pest-trapping element may be assured by tension wires.
[14] In operation, the energy harvested from the power source accumulates in the power storage device. A very low power timer device continuously operates,“waking up” the controller at regular intervals. On wake up, the controller illuminates the pest trapping element, captures an image of the pest-trapping element which may contain pests thereon, and wirelessly transmits the image to server infrastructure. Once at the server, the image is processed and analysed for content. If the system determines that a new feature of interest (typically a trapped pest) has been found, it records the possible infestation in a central database and transmits a request for prompt human intervention if required.
[15] In the various embodiments, each apparatus has a unique serial number for identification, so a pest warning report can be associated with its originating probe. By analysing various properties of measured radio signals reported from multiple wireless base stations at known positions within the building, automatic location of each apparatus in all three dimensions is possible, facilitating this process.
[16] The system is configured such that multiple apparatuses may be deployed in a growing facility, allowing high quality coverage of the crop during its entire life cycle.
[17] Additional aspects and advantages of the present invention will be apparent in view of the description, which follows. It should be understood, however, that the detailed description and the specific examples, while indicating preferred embodiments of the invention, are given by way of illustration only, since various changes and modifications within the scope of the invention will become apparent to those skilled in the art from this detailed description. BRIEF DESCRIPTION OF THE DRAWINGS
[18] Some embodiments of the present invention are illustrated as an example and are not limited by the figures of the accompanying drawings, in which like references may indicate similar elements and in which:
[19] FIG 1 is a side view of one embodiment of an apparatus of the present invention.
[20] FIG 2 is a top view of the apparatus of FIG 1.
[21] FIG 3 is a front end view of the apparatus of FIG 1.
[22] FIG 4A is a perspective view of one embodiment of an apparatus comprising a wire-based frame.
[23] FIG 4B is a perspective view of one embodiment of an apparatus comprising a modified wire-based frame for attaching a pest-trapping element using adhesive tape.
[24] FIG 5A is a side view of one embodiment of an apparatus of the present invention.
[25] FIG 5B is a top view of the apparatus of FIG. 5 A.
[26] FIG 5C is a rear end view of the apparatus of FIG 5 A.
[27] FIG 6 is an electrical schematic of one embodiment of an apparatus.
[28] FIG 7 shows a system including one embodiment of an apparatus in wireless communication with multiple wireless access points operably connected to downstream infrastructure.
DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS
[29] The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used herein, the term "and/or" includes any and all combinations of one or more of the associated listed items. As used herein, the singular forms "a," "an," and "the" are intended to include the plural forms as well as the singular forms, unless the context clearly indicates otherwise. It will be further understood that the terms "comprises" and/or "comprising," when used in this specification, specify the presence of stated features, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, steps, operations, elements, components, and/or groups thereof.
[30] Unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one having ordinary skill in the art to which this invention belongs. It will be further understood that terms, such as those defined in commonly used dictionaries, should be interpreted as having a meaning that is consistent with their meaning in the context of the relevant art and the present disclosure and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein.
[31] In describing particular embodiments, it will be understood that a number of techniques and steps are disclosed. Each of these has individual benefit and each can also be used in conjunction with one or more, or in some cases all, of the other disclosed techniques. Accordingly, for the sake of clarity, this description will refrain from repeating every possible combination of the individual steps in an unnecessary fashion. Nevertheless, the specification and claims should be read with the understanding that such combinations are entirely within the scope of the present disclosure.
[32] The present disclosure is to be considered as an exemplification of the invention, and is not intended to limit the invention to the specific embodiments illustrated by the figures or description below.
[33] The present invention relates to a self-powered apparatus, system, and method for providing automated remote detection of biological infestation. As used herein, the term “biological infestation” broadly refers to the presence of an organism regarded as a pest which may attack, damage, and/or consume one or more plants cultivated in indoor or outdoor horticultural and agricultural facilities or areas. As used herein, the term“pest” broadly refers to insects (for example, wireworms, cutworms, thrips, flea beetles, armyworms, aphids, com borers, moths, flies, mealybugs, etc.), parasites (for example, protozoa, helminths, arthropods, etc.), pathogens (for example, fungi including molds, bacteria, viruses, etc.), and vermin (for example, rats, mice, etc.).
[34] In a first aspect, the present invention comprises an apparatus for detecting biological infestation. The apparatus generally comprises: a frame comprising a first side section, a second side section, and a middle section therebetween; a pest-trapping element coupled to the first side section and comprising an attractant to trap pests; an electronic support coupled to the second side section and having an imaging device mounted thereon and facing the attractant; a power source operatively connected to the imaging device; and a controller operatively connected to the imaging device and the power source.
[35] In a second aspect, the present invention comprises a system for detecting biological infestation. The system generally comprises: at least one pest detection apparatus comprising a pest-trapping element to trap at least one pest, an imaging device to image the at least one pest, and a communication unit configured to communicate across a communication network; at least one network access point; and a local server operatively connected to the at least one network access point.
[36] In a third aspect, the present invention comprises a method for detecting biological infestation using a pest detection apparatus comprising an imaging device, a controller, and at least one power source. The method generally comprises: trapping the at least one pest in the pest detection apparatus; enabling power to the imaging device from the at least one power source; and capturing at least one image of the at least one pest via the imaging device.
[37] The invention may be sensitive, accurate, lightweight, and cost-effectively deployed to provide automated detection of pests across a large physical area, particularly early detection. Early detection and identification of pests, their eggs, or pest-induced damage may be a valuable line of defence against catastrophic crop loss.
[38] The present invention will now be described having reference to the accompanying figures.
[39] In a first embodiment shown generally in FIGS. 1-3, the apparatus 16 includes a printed circuit board (hereinafter“PCB”) 1, a frame 2, a power source in the form of one or more photovoltaic (hereinafter“PV”) cells 3, a pest-trapping element 4, a power storage device 7, an imaging device 8, a light source 9, and a controller 10.
[40] The PCB 1 supports and electrically connects all electronic components of the apparatus 16. Methods of manufacturing a PCB are well-known in the art and will not be described in detail. The electronic components of the apparatus 16 are generally soldered onto the PCB 1 to mechanically fasten and electrically connect them to the PCB 1. In the various embodiments, all electronic components of the apparatus 16 are soldered onto the PCB 1, with the exception of the PV cells 3 which are supported by the frame 2 and electrically connected to the PCB 1 by wires. In the various embodiments, the PV cells 3 are attached to the base of the frame 2. In the various embodiments, the PV cells 3 are attached to the rear of the frame 2, facing away from the PCB 1 and the imaging device 8. In the various embodiments, the PCB 1 is a multilayer PCB. In the various embodiments, the multilayer PCB 1 has a width of about 20 mm, a height of about 30 mm, and a thickness of about 0.5 mm. In the various embodiments, the PCB 1 supports the power storage device 7, imaging device 8, light source 9, and controller 10, all of which will be further described.
[41] In the various embodiments, the PCB 1 may be protected against harsh environments, moisture, electrical contact with surroundings, damage, contamination, and the like by being enclosed in a shell formed of a suitable material such as plastic or metal; encapsulated in conformal coatings commonly used in industrial applications to avoid explosion hazards from sparks and water intrusion; or immersed in potting compounds that effectively seal the apparatus 16 in a block of resin, while making provision for the imaging device 8, light source 9, and other components that may need to remain exposed for operation.
[42] In the various embodiments, the power source may be selected from one or more PV cells 3, microwave antenna, or a primary battery that charges the power storage device 7 (for example, a supercapacitor or rechargeable secondary battery) or by direct electrical connections.
[43] In the various embodiments, the imaging device 8 comprises an integrated camera device comprising a complementary metal oxide semiconductor (CMOS) or charge- coupled device (CCD) image sensor and associated optics. In the various embodiments, the imaging device 8 comprises a CMOS or CCD image sensor paired with discrete optics. In the various embodiments, the imaging device 8 may be protected from moisture by including an anti-bead coating on the lens of the imaging device 8. The coating may mitigate image degradation due to humidity-induced condensation on the lens.
[44] In the various embodiments, the light source 9 comprises a light emitting diode (LED) which illuminates the pest-trapping element 4 when activated by the controller 10.
[45] In the various embodiments, the controller 10 comprises a System on a Chip (hereinafter“SOC”). The SOC 10 comprises a microprocessor complex equipped with volatile and non-volatile storage, wireless communication, an interface to the imaging device 8, and the ability to control the light source 9 to illuminate the pest-trapping element 4. In the various embodiments, the microprocessor complex comprises a field programmable gate array (FPGA) implementing SOC functions, and may be implemented using several integrated circuits to separately provide processor, memory, imaging device interface and network interface functions. [46] In the various embodiments, an integral electrical heater (for example, a resistor) may be activated automatically or under external command to encourage moisture to evaporate from the imaging device 8 and/or other sensors 21.
[47] In the various embodiments, the apparatus 16 may include one or more sensors 21 to detect one or more environmental parameters including, but not limited to, temperature, humidity, carbon dioxide or other gases, ambient light, airflow, and the like. Such sensors 21 may augment the function of the imaging device 8. The SOC 10 not only configures the sensors 21 but also obtains readings from the sensors 21.
[48] In the various embodiments, the light source 9 may be in the form of a LED capable of narrowband illumination to energize bio-fluorescence effects in a pest. In the various embodiments, the imaging device 8 may include one or more narrowband filters for capturing narrowband signatures and such stimulated bio-fluorescence effects.
[49] In the various embodiments, the frame 2 supports and interconnects the PCB 1, the PV cells 3, and the pest-trapping element 4. In the various embodiments, the frame 2 comprises a first side section, a second side section, and a middle section therebetween. The pest-trapping element 4 is coupled to the first side section, while the PCB 1 is coupled to the second side section. The frame 2 may be constructed from any suitable material or combination of materials including, but not limited to, aluminum, plastic, wire, or other appropriate materials known to those skilled in the art.
[50] In the various embodiments, the frame 2 may be constructed from aluminum in the form of a sheet which may be stamped with ridges and folds to increase rigidity. The frame 2 may be attached to the PCB 1 using suitable attachment means including, but not limited to, screws, adhesive tape, or glue. The frame 2 may be attached to the PV cells 3 using suitable attachment means including, but not limited to, adhesive tape or glue. The frame 2 may be attached to the pest-trapping element 4 using bendable tabs or the adhesive of the pest-trapping element 4.
[51] In the various embodiments, the frame 2 may be constructed from plastic molded into the shape of the frame 2. The PCB 1, PV cells 3, and pest-trapping element 4 may be attached to the plastic frame using the same attachment means as described above for use with the aluminum frame, or may be clipped into place using slots and tabs pre formed within the plastic frame.
[52] In the various embodiments wherein the frame 2 is formed of aluminum or plastic, a connector interconnects the first side section and second side section to stabilize the frame 2. In the various embodiments, the connector comprises one or more tension wires 6. The tension wire 6 has a first end coupled to the PCB 1, and a second end coupled to the second side section of the frame 2. As can be seen in FIG 3, the tension wires 6 connect the top two comers of the PCB 1 with the top two comers of the frame 2 that supports the pest-trapping element 4. The tension wires 6 may be in the form of relatively thin filaments which are in tension when installed. The tension wires 6 act to confer stiffness and to align the imaging device 8 and the frame 2 in a parallel orientation, thereby optimally positioning the imaging device 8 and the pest-trapping element 4 for imaging pest while avoiding focusing problems and trapezoidal image distortion.
[53] In the various embodiments, the tension wires 6 may also serve as wireless communication antennae in order to improve wireless communication efficiency (for example, data rate, range or energy consumption of the radios).
[54] In the various embodiments as shown in FIGS. 4A-B, the frame 2 may be constructed of one or more segments of wire 11 that are soldered onto or attached directly to the PCB 1. The PV cells 3 may be attached to the top of the apparatus 16 and serve to stiffen and align the imaging device 8 and the frame 2 in a parallel orientation, thereby optimally positioning the imaging device 8 and the pest-trapping element 4 for imaging pests. Suitable materials for the wire 11 may include, but are not limited to, stainless steel and the like.
[55] In the various embodiments as shown in FIG. 4A, the pest-trapping element 4 may be attached to the wire 11 using adhesive tape positioned along each vertical side.
[56] In the various embodiments as shown in FIG 4B, the frame 2 comprises segments of wire 11 oriented vertically and angled, allowing the rear surface of the pest-trapping element 4 to be attached to the wire 11 using adhesive tape 12. In the various embodiments, the pest-trapping element 4 may comprise a relatively stiff card-like material defining curved slots for engaging the wire 11, thereby allowing the wire 11 to secure the pest-trapping element 4 in position.
[57] In the various embodiments as shown in FIGS. 4A-B, the frame 2 constructed of the wire 11 could be configured to clip under compression into holes and slots defined by the PCB 1, permitting assembly to the PCB 1 without requiring permanent attachment means such as, for example, solder, glue, or adhesive tape. [58] In the various embodiments as shown in FIGS. 5A-C, spring steel wires 22 having tensile strength may be used to maintain the imaging device 8 and the pest-trapping element 4 at a controlled distance and under tension during assembly, and facilitating disassembly without tools for flat storage and shipping in an envelope. In the prototype shown in FIGS. 5A-C, the PV cells 3 and power storage device 7 are not shown for clarity, but may be attached to the rear of the frame 2, facing away from the PCB 1 and the imaging device 8.
[59] With reference to FIGS. 1-3, the pest-trapping element 4 may comprise one or more attractants suitable for trapping pests. Non-limiting examples of attractants to lure and catch pests 5 include trap paper having an adhesive surface for capturing pests 5 which inadvertently contact the adhesive surface through flying or walking; chemical attractants (for example, pheromones, kairomones); colours or graphical patterns; or substrates impregnated or coated with growth medium to enable the detection of pathogens including, but not limited to, fungi including molds, bacteria, and viruses, of which colonies may grow sufficiently large enough to be imaged by the imaging device 8
[60] In certain operations (particularly indoor greenhouses), non-pest organisms performing useful functions such as pollination (for example, bees and bumblebees) or preying upon undesirable pests (for example, ladybugs) may be deliberately introduced. Such non-pest organisms may be significantly larger in size than the pests 5 for which the pest-trapping element 4 is intended. Deterrents may be used to prevent useful non-pest organisms from being trapped by the pest-trapping element 4. In the various embodiments, a mesh screen having a mesh size selected to exclude non-pest organisms may be positioned proximate the attractant of the pest-trapping element 4 in order to avoid trapping any non-pest organisms. The mesh screen may be formed of suitable materials including, but not limited to, wire or plastic.
[61] In the various embodiments, the pest-trapping element 4 may be removable to allow the imaging device 8 to aim directly at plants or portions thereof, thereby enabling sampling and determination of the presence of any pest directly on the plants or portions thereof, and/or plant status such as, for example, the quantitative growth and maturation metrics.
[62] Installation of the apparatus 16 may be temporary or permanent. In the various embodiments, the apparatus 16 may be clipped or attached using suitable fastening means to either the plants being monitored or fixed structures (for example, pots, planters, boxes, beds, grow bags, trays, saucers, stakes, supports, cages, trellises, railing, fencing, etc.) proximate to the plants being monitored. Non-limiting fastening means may include adhesives (for example, tape, glue, etc.), wire, string, clips, staples, and the like. In the various embodiments, the apparatus 16 may be mounted on a grid or framework to provide systematic coverage of an area under surveillance for biological infestation, where the apparatus 16 is powered and networked directly by fixed wire infrastructure.
[63] The apparatus 16 may be configured to be installed for the duration of a plant’s life cycle which may be lengthy. Over many months of continuous operation, the pest trapping element 4 may become coated with pests or contaminated with obscuring material (for example, dust, soil, dirt) such that generation of meaningful data becomes impaired. In the various embodiments, the system may be configured to identify and locate any pest-trapping element 4 requiring replacement or cleaning based on radio telemetry, and subsequently transmit a request for human assistance in replacing or cleaning the pest-trapping element 4. Various factors may trigger the need for replacement or cleaning of the pest-trapping element 4 including, but not limited to, the type, size, number, or density of trapped pests, or presence of contaminants.
[64] With reference to FIG. 6, the principle of operation from an electrical perspective is described. To function, the apparatus 16 requires electrical energy which can be harvested from the PV cells 3; however, the PV cells 3 may not produce sufficient instantaneous power to operate the controller 10 and associated peripherals under all light conditions. In one embodiment, the controller 10 comprises a SOC. When installed under the growth canopy or when operating during times of darkness (when pests may be most active), there may be insufficient direct power. The PV cells 3 may instead produce energy for the power storage device 7 which charges up and has the power delivery capacity to operate the apparatus 16 in short bursts. Even under low light conditions, the
PV cells 3 are able to make progress charging the power storage device 7 when it is used only infrequently and periodically. In the various embodiments, the power storage device
7 is built around supercapacitors. Supercapacitors may tolerate virtually unlimited numbers of charge/discharge cycles without suffering significant capacity, leakage or internal impedance degradation. Other various embodiments may select rechargeable batteries such as lithium polymer or lithium-ion batteries. Such batteries have price, volumetric energy and volumetric power density advantages over supercapacitors; however, they are more volatile and less durable. During the longest period of darkness, the apparatus 16 may be able to execute a minimum number of bursts to meet plant surveillance requirements. This requirement informs the energy storage capacity and also the self-discharge rate of the apparatus 16 while it is waiting between activity bursts.
[65] An energy management circuit 13 ensuring positive charging from the PV cells 3 and minimisation of leakage paths ensures the power storage device 7 operates as efficiently as possible. When the apparatus 16 is idling between activity bursts, it is able to accumulate electrical energy. During these intervals, the power consumption of the apparatus 16 may be as low as possible. For this reason during these times, power is electrically isolated from the main power draws (the SOC 10, imaging device 8, power source 9, radio/WiFi antenna 15) using a power transistor and only a dedicated timer device 14 is allowed to run. The timer device 14 is configured to wait for a specified period of time measured in minutes or even hours, and then to trigger a wake up of the SOC 10 to initiate an activity burst.
[66] An activity burst should be executed as efficiently as possible to minimise the drain on the energy storage device 7. In various embodiments, each burst comprises the following steps:
[67] 1. Timer device 14 enables power to the SOC 10 and associated peripherals and triggers the SOC 10 to boot from internal non-volatile storage - typically flash memory.
[68] 2. SOC 10 boots into its Real Time Operating System (RTOS) and loads its application executable.
[69] 3. The application reads a wake counter from non-volatile storage, increments it and writes it back to non-volatile storage. If the counter is still below a fixed threshold, the apparatus 16 decides this is not the time to wake up and jumps directly to step 10 below. However if the counter has reached the threshold, then image capture and transmission occurs. This mechanism is designed to allow finer control over the effective wake up interval. For example, the wakeup timer may be configured by a resistor value to wake up the SOC 10 every 10 minutes which is likely too frequent since it would drain the power storage device 7 too quickly. By using the counter mechanism longer, effective intervals can be implemented with 10 minute granularity with only a slight energy budget penalty.
[70] 4. A TCP/IP or UDP session is opened with the wireless network access point it was associated with when first deployed.
[71] 5. The imaging device 8 is initialised for image capture. [72] 6. A series of frames is captured with ramping LED illumination durations until a correctly exposed image is received. This approach may be necessary because the ambient illumination conditions will vary dramatically from full sunlight in a greenhouse during the day to complete darkness during the night or certain phases of crop maturation which call for darkness.
[73] 7. The optimally exposed image is optionally compressed and then transmitted to the server infrastructure over the wireless network.
[74] 8. Metadata such as the unique ID of the apparatus 16 and other readings that may be available are appended to the transmitted data package along with the image.
[75] 9. The SOC 10 resets its wake counter in non-volatile memory to zero.
[76] 10 The SOC 10 initiates a shutdown which causes all power to be removed from the SOC 10 subsystem until the next wake up event.
[77] Each activity burst lasts a few seconds and therefore consumes a minimal amount of energy. Due to the time and energy constraints, the apparatus 16 may be limited to data capture and transmission - all processing, archival and analysis may occur within much faster computer systems downstream of the apparatus 16.
[78] With reference to FIG. 7, an apparatus 16 is within wireless communication range of several wireless access points 17(i), 17(H) & 17(iii). The access points 17(i-iii) are connected using wired network links to a network switch/router 18. The switch 18 also connects a local server 19 and provides a link 20 to remote data centres across the Internet or dedicated circuits.
[79] When the apparatus 16 is first deployed and activated, it examines the access points it can detect and ranks them in order of signal strength, identifying an affinity to its preferred access point which is generally the one located closest to it. This information is stored in the probe’s non-volatile memory so it can automatically connect to it during an activity burst.
[80] When the apparatus 16 sends broadcast signals to all access points 17(i-iii), each access point 17(i-iii) can measure the signal strength. Collectively, the access points 17(i-iii) can estimate the physical location of each particular apparatus 16 as identified by a unique ID or even the MAC address embedded in the broadcast packets.
[81] Since signal strength scales inversely with distance squared between two communicating nodes, the access points 17(i-iii) can model a volumetric region in which each apparatus 16 resides. Various factors such as signal attenuation due to obscuring objects, reflections, and anisotropic antenna characteristics will distort this estimate so a heuristic algorithm complete with the ability to discard outlier readings that are inconsistent with near consensus among large populations of access points 17(i-iii) is suggested.
[82] The more access points 17(i-iii) that each apparatus 16 can reach with radio signals, the more accurate the location fix will be.
[83] Possible alternative methods for establishing apparatus 16 location fixes include radio flight time measurements and direct optical detection of strobed lights from the apparatus 16 recovering information regarding the position of the apparatus 16 photogrammetrically.
[84] Local analysis of the images transmitted by populations of apparatus 16 is performed in the local server(s) 19 and/or by servers in remote data centres. Local servers 19 collect data from the access points 17(i-iii) and decide if the images reported by each apparatus 16 show significant differences from the previous image reported by that apparatus 16, after normalising for global image changes due to varying illumination levels. If the apparatus 16 may have new data to report, the image and associated metadata are in turn transmitted to a remote data centre for detailed analysis. Such analysis may include conventional image processing techniques for normalisation and feature enhancement, as well as pattern recognition algorithms designed or trained to identify pests 5 caught in the pest-trapping element 4. This information may simply be archived or may also trigger alarms that would result in further investigations by the operators of the facility to determine if intervention may be required.
[85] In the various embodiments, a mesh topology may be used wherein nodes communicate in a peer to peer fashion, forwarding data across numerous nodes, rather than all directly beaming data to individual WiFi access points.
[86] In the various embodiments, fixed installations may be contemplated where the same apparatuses 16 are wired into arrays for systematic coverage of large areas.
[87] In the various embodiments, mesh radio networks and/or cellular network gateways or direct connection at the sensor node level may be used for outdoor operations. Outdoor applications imply longer distances for communication and harsher operating environments. [88] As will be apparent to those skilled in the art, various modifications, adaptations and variations of the foregoing specific disclosure can be made without departing from the scope of the invention claimed herein.

Claims

CLAIMS The embodiments of the invention in which an exclusive property or privilege is claimed are defined as follows:
1. An apparatus for detecting biological infestation comprising:
a frame comprising a first side section, a second side section, and a middle section therebetween;
a pest-trapping element coupled to the first side section and comprising an attractant to trap pests;
an electronic support coupled to the second side section and having an imaging device mounted thereon and facing the attractant;
a power source operatively connected to the imaging device; and
a controller operatively connected to the imaging device and the power source.
2. The apparatus of claim 1, further comprising at least one connector interconnecting the first side section and the second side section.
3. The apparatus of claim 2, wherein the at least one connector comprises at least one tension wire.
4. The apparatus of claim 3, wherein the at least one tension wire has a first end and a second end, the first end coupled to the electronic support and the second end coupled to the second side section of the frame.
5. The apparatus of any one of claims 1 to 4, wherein the power source comprises at least one photovoltaic cell.
6. The apparatus of claim 5, wherein the photovoltaic cell is coupled to the middle section of the frame.
7. The apparatus of claim 5, wherein the photovoltaic cell has a first end and a second end, the first end coupled to the electronic support and the second end coupled to the second side section of the frame.
8. The apparatus of any one of claims 1 to 7, further comprising a communication unit configured to communicate over a communications network, and operatively connected to the imaging device.
9. The apparatus of claim 8, wherein at least a portion of the frame acts as an antenna for the communication unit.
10. The apparatus of claim 9, wherein the frame comprises at least one metal wire or at least one metal sheet.
11. The apparatus of any one of claims 1 to 10, wherein the at least one power source further comprises a power storage device.
12. The apparatus of any one of claims 1 to 11, further comprising a power control mechanism operatively connected to the controller and the at least one power source.
13. The apparatus of claim 12, wherein the power control mechanism comprises an electrical switch.
14. The apparatus of claim 13, further comprising a timer operatively connected to the electrical switch responsive to an output of the timer.
15. The apparatus of claim 1, further comprising one or more sensors for detecting one or more environmental parameters.
16. The apparatus of any one of claims 1 to 15, wherein the imaging device further comprises a light source positioned to illuminate the pest-trapping element.
17. The apparatus of any one of claims 1 to 16, further comprising a mesh screen having a mesh size selected to exclude at least one non-pest organism and positioned proximate the attractant of the pest-trapping element.
18. A system for detecting biological infestation comprising:
at least one pest detection apparatus comprising a pest-trapping element to trap at least one pest, an imaging device to image the at least one pest, and a communication unit configured to communicate across a communication network;
at least one network access point; and
a local server operatively connected to the at least one network access point.
19. The system of claim 18, wherein the communication unit of the at least one pest detection apparatus is configured to transmit a first telemetry signal via the communication network to the at least one network access point.
20. The system of claim 18 or 19, wherein the at least one network access point is configured to transmit a second telemetry signal via the communication network to the communication unit of the at least one pest detection apparatus.
21. The system of any one of claims 18 to 20, wherein the communication unit of the pest detection unit is configured to transmit at least one image of the at least one pest to the local server via the at least one network access point.
22. A method for detecting biological infestation using a pest detection apparatus comprising an imaging device, a controller, and at least one power source, the method comprising:
trapping the at least one pest in the pest detection apparatus; enabling power to the imaging device from the at least one power source;
capturing at least one image of the at least one pest via the imaging device.
23. The method of claim 22, further comprising disabling power to the imaging device after collecting the at least one image.
24. The method of claim 22 or 23, wherein the pest detection apparatus further comprises a timer and wherein enabling power to the imaging device comprises timing a pre-determined time interval via the timer and enabling power at the end of the pre determined time interval.
25. The method of claim 24, wherein enabling power to the imaging device comprises enabling power when a wake counter reaches a pre-determined threshold.
26. The method of any one of claims 22 to 25, wherein the pest detection apparatus further comprises a light source and wherein capturing the at least one image further comprises illuminating the at least one pest.
27. The method of claim 26, wherein the at least one image comprises a series of images, each image in the series being captured at a different illumination level from the light source.
28. The method of any one of claims 22 to 27, wherein the pest detection apparatus further comprises a communication unit configured to communicate over a communication network and wherein enabling power to the imaging device further comprises enabling power to the communication unit.
29. The method of claim 28, further comprising transmitting the at least one image to a local server via the communication network.
30. The method of claim 28 or 29, further comprising transmitting at least one first telemetry signal to at least one network access point via the communication network.
31. The method of claim 30, further comprising receiving at least one second telemetry signal from the at least one network access point via the communication network.
32. The method of claim 30 or 31, further comprising determining an estimated location of the pest detection apparatus based on at least one of the first and second telemetry signals.
PCT/CA2019/051497 2018-10-22 2019-10-22 Self-powered apparatus, system and method for automated remote detection of biological infestation WO2020082175A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CA3021755 2018-10-22
CA3021755A CA3021755A1 (en) 2018-10-22 2018-10-22 Self-powered remote camera probes for automated horticultural pest detection

Publications (1)

Publication Number Publication Date
WO2020082175A1 true WO2020082175A1 (en) 2020-04-30

Family

ID=70329740

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CA2019/051497 WO2020082175A1 (en) 2018-10-22 2019-10-22 Self-powered apparatus, system and method for automated remote detection of biological infestation

Country Status (2)

Country Link
CA (1) CA3021755A1 (en)
WO (1) WO2020082175A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113016666A (en) * 2021-03-11 2021-06-25 江西理工大学 Bee protection device, beehive entrance, beehive and bee protection method
WO2023129030A3 (en) * 2021-12-29 2023-08-17 Cankaya Universitesi Precision agriculture kit

Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2149301A1 (en) * 2008-07-31 2010-02-03 Cropwatch B.V. Automated determining of the presence of insects on a catch plate
WO2012054397A1 (en) * 2010-10-17 2012-04-26 Purdue Research Foundation Automatic monitoring of insect populations
US20130293710A1 (en) * 2010-10-29 2013-11-07 Commonwealth Scientific And Industrial Research Organisation Real-time insect monitoring device
JP2013236586A (en) * 2012-05-15 2013-11-28 Ikari Shodoku Kk Insect capturing device, method for manufacturing insect capturing device, and method for monitoring insect
US20140279600A1 (en) * 2013-03-15 2014-09-18 Mitchell Barry Chait Automated monitoring of pest traps in a distributed work environment
CN104381231A (en) * 2014-11-06 2015-03-04 浙江大学 Image-based field insect pest situation monitoring device
WO2015185063A1 (en) * 2014-06-03 2015-12-10 Wisecon A/S Pest control device with communication means
CN105660565A (en) * 2016-04-08 2016-06-15 济宁市慧胜信息技术有限责任公司 Insect pest trapping and counting device and insect pest quantity recognition method
US20160238737A1 (en) * 2015-02-13 2016-08-18 Delta Five, Llc Automated Insect Monitoring System
CN205756703U (en) * 2016-06-28 2016-12-07 济南祥辰科技有限公司 A kind of target pest monitors preventing mean automatically
US20170273290A1 (en) * 2016-03-22 2017-09-28 Matthew Jay Remote insect monitoring systems and methods
WO2018134550A1 (en) * 2017-01-19 2018-07-26 Killgerm Group Limited Insect trap and method

Patent Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2149301A1 (en) * 2008-07-31 2010-02-03 Cropwatch B.V. Automated determining of the presence of insects on a catch plate
WO2012054397A1 (en) * 2010-10-17 2012-04-26 Purdue Research Foundation Automatic monitoring of insect populations
US20130293710A1 (en) * 2010-10-29 2013-11-07 Commonwealth Scientific And Industrial Research Organisation Real-time insect monitoring device
JP2013236586A (en) * 2012-05-15 2013-11-28 Ikari Shodoku Kk Insect capturing device, method for manufacturing insect capturing device, and method for monitoring insect
US20140279600A1 (en) * 2013-03-15 2014-09-18 Mitchell Barry Chait Automated monitoring of pest traps in a distributed work environment
WO2015185063A1 (en) * 2014-06-03 2015-12-10 Wisecon A/S Pest control device with communication means
CN104381231A (en) * 2014-11-06 2015-03-04 浙江大学 Image-based field insect pest situation monitoring device
US20160238737A1 (en) * 2015-02-13 2016-08-18 Delta Five, Llc Automated Insect Monitoring System
US20170273290A1 (en) * 2016-03-22 2017-09-28 Matthew Jay Remote insect monitoring systems and methods
CN105660565A (en) * 2016-04-08 2016-06-15 济宁市慧胜信息技术有限责任公司 Insect pest trapping and counting device and insect pest quantity recognition method
CN205756703U (en) * 2016-06-28 2016-12-07 济南祥辰科技有限公司 A kind of target pest monitors preventing mean automatically
WO2018134550A1 (en) * 2017-01-19 2018-07-26 Killgerm Group Limited Insect trap and method

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113016666A (en) * 2021-03-11 2021-06-25 江西理工大学 Bee protection device, beehive entrance, beehive and bee protection method
CN113016666B (en) * 2021-03-11 2022-11-01 江西理工大学 Bee protection device, beehive entrance, beehive and bee protection method
WO2023129030A3 (en) * 2021-12-29 2023-08-17 Cankaya Universitesi Precision agriculture kit

Also Published As

Publication number Publication date
CA3021755A1 (en) 2020-04-22

Similar Documents

Publication Publication Date Title
US11659826B2 (en) Detection of arthropods
ES2805248T3 (en) Automatic monitoring of insect populations
JP4862117B2 (en) Electric shock pulse measurement system using field server
US20150351336A1 (en) Monitoring and Control Systems for the Agricultural Industry
KR20100054331A (en) It pheromone trap and remote monitoring system using the same
WO2008063751A2 (en) Apparatus and systems for using semiochemical compositions for insect pest control
CN116391690A (en) Intelligent agricultural planting monitoring system based on big data of Internet of things
KR102276944B1 (en) A System for Growth Control of Crops and Disease and Insect Pest Control of Crops
WO2020082175A1 (en) Self-powered apparatus, system and method for automated remote detection of biological infestation
Jeaunita et al. An automated greenhouse system using agricultural Internet of Things for better crop yield
CN206057612U (en) A kind of weather monitoring based on big-dipper satellite and pest and disease damage early-warning and predicting system
CN110547271A (en) High-altitude trapping and controlling device for killing pests
CN210929277U (en) High-altitude trapping and controlling device for killing pests
CN215454853U (en) Portable insect trapping and classifying counting device
CN210181653U (en) Artificial Intelligence (AI) bee keeping system based on cloud computing
CN218331550U (en) Wisdom agricultural plant diseases and insect pests monitoring and early warning device
EP3772277B1 (en) Device and process for massive capture of olive flies - electrocutor trap
CN208446429U (en) A kind of mosquito matchmaker monitor
WO2022000098A1 (en) Method and system for monitoring and controlling the presence of at least one type of insect in agricultural crops
RO132959A0 (en) Multifunctional iot () device for monitoring crops using adaptive intelligence
CN220936390U (en) Plant diseases and insect pests early warning device based on meteorological monitoring
CN108719234A (en) A kind of reading intelligent agriculture insect-killing device
CN209436075U (en) A kind of intelligence yellow-fever mosquito monitor
Hirafuji et al. Real-time insect monitoring system by using Field Server
CN215453129U (en) Agricultural Internet of things system

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19874883

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19874883

Country of ref document: EP

Kind code of ref document: A1