WO2020006236A1 - Augmented reality for agricultural use - Google Patents

Augmented reality for agricultural use Download PDF

Info

Publication number
WO2020006236A1
WO2020006236A1 PCT/US2019/039515 US2019039515W WO2020006236A1 WO 2020006236 A1 WO2020006236 A1 WO 2020006236A1 US 2019039515 W US2019039515 W US 2019039515W WO 2020006236 A1 WO2020006236 A1 WO 2020006236A1
Authority
WO
WIPO (PCT)
Prior art keywords
agricultural product
augmented reality
video
plant
fungicides
Prior art date
Application number
PCT/US2019/039515
Other languages
French (fr)
Inventor
John C. RABBY
Original Assignee
Rabby John C
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Rabby John C filed Critical Rabby John C
Publication of WO2020006236A1 publication Critical patent/WO2020006236A1/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics
    • G06T19/006Mixed reality

Definitions

  • the invention is drawn to methods and systems for using augmented reality for agricultural products.
  • the methods and systems can provide instructions regarding the preparation and/or application of an agricultural product.
  • the methods and systems can also determine an area of coverage of the agricultural product and diagnose agricultural ailments and determine corrective action.
  • Agricultural products for example herbicides, pesticides, and fertilizers, can require expertise and knowledge to use properly.
  • the agricultural product may require mixing with a solvent or carrier prior to being applied onto plants or an area of cultivation.
  • following instructions in the preparation and application of the agricultural product may be critical in ensuring the effectiveness of such treatment.
  • an agricultural professional may want to diagnose an unhealthy and potentially diseased or infected crop.
  • a proper product for treatment for example, an insecticide, or fungicide.
  • Figure l is a block diagram illustrating a device according to one embodiment.
  • Figure 2 is an illustration of a device and augmented reality video according to one embodiment.
  • Figure 3 is an illustration of a device and augmented reality video according to one embodiment.
  • Figure 4 is a flow diagram of a method according to one embodiment.
  • a method, implemented by a processor, for providing instructions in augmented reality for agricultural products comprises: receiving video captured by a camera; detecting whether an agricultural product is present in the captured video; based on a positive detection of the agricultural product, modifying the captured video to include an instructional animation, resulting in an augmented reality video; and displaying the augmented reality video on a display screen.
  • a method, implemented by a processor, for showing an area of coverage of an agricultural product in augmented reality comprises: receiving video captured by a camera; detecting and characterizing a surface area of an area of cultivation in the captured video;
  • Such a method comprises: receiving video captured by a camera; detecting a plant in the captured video; characterizing the type of plant in the video; determining whether the plant has one or more ailments; identifying an agricultural product for treatment of the plant based on the one or more determined ailments; generating an animation including the agricultural product; modifying the captured video to include the generated animation, resulting in an augmented reality video; and displaying the augmented reality video on a display screen.
  • a system or computer program product for viewing augmented reality for an agricultural product on a computing device comprising instructions for execution by a processing circuit for performing any of the presently disclosed methods.
  • a mobile device for viewing augmented reality for an agricultural product is provided.
  • the mobile device comprises a non-transitory machine readable storage medium having stored therein instructions that, when executed by a processor, perform any of the presently disclosed methods.
  • the instructions are stored in memory on a networked server, and are retrieved through the network by the mobile device and loaded into the non-transitory machine readable storage medium, to be executed by the processor.
  • the systems and methods comprise the use of augmented reality to provide information regarding an agricultural product.
  • Augmented reality or an augmented reality video describes a video displayed in real-time that shows a captured video altered by an animation and/or audio track.
  • the augmented reality video maintains original artifacts of the captured environment, but contains additional artifacts, for example, animations and audio tracks added to and modifying the original captured video.
  • a video describes a series of images in a sequence, for example, a sequence of images captured by a camera, such as one in a mobile device.
  • the presently disclosed methods can be implemented by a mobile device comprising a camera.
  • a mobile device describes a processor based electronic device that includes an input/output (I/O) module, for example, a touch-screen display.
  • I/O input/output
  • Mobile devices can include audio input and output and a communication unit, for example, a wireless 4G transceiver, Wi-Fi, and other equivalent communication technologies now known or later developed.
  • Mobile devices include phones, tablets, and watches.
  • the video captured by the camera is in real-time.
  • Real-time refers to processing a video stream while the video is being captured by the camera, with minimal delay (for example, notwithstanding buffering and processing delays).
  • the augmented reality comprises animations that are added to the real-time captured video.
  • Animation describes a rendering of moving or still artifacts (for example, depictions of an agricultural product, being mixed with a solvent, with an accompanying audio track describing formulation ratios, preparation steps, temperatures, etc).
  • Other examples can include an animation of a logo or mascot found on packaging (for example, a logo of a wolf) brought to life and giving verbal instructions relating to the usage of a
  • Animations can include audio and visual artifacts generated by the processor in real-time or stored in memory on the device or on a network that are retrieved by the processor to generate animations.
  • whole animations can be stored in memory capable of being retrieved and used by the processor.
  • a processor describes logic circuitry that responds to and processes instructions that drive an electronic device, for example, a desktop computer or mobile device (e.g., a mobile phone with touchscreen display or a tablet). It should be understood that a processor can be more than one processor acting in a coordinated effort to respond to and process machine instructions.
  • a device 100 for providing augmented reality information for agricultural products can include one or more cameras 140, configured to capture images and video.
  • the camera can communicate to the processor 150 a video stream 142 (or stream of images) in real-time.
  • Camera 140 can be a 2D camera, for example, a standard video camera or a standard digital video camera. Alternatively or additionally, the camera can be a 3D camera with depth sensing, for example, infrared, laser projection, multiple lenses (range imaging or stereo camera) or combinations thereof.
  • the device can include memory and/or one or more database(s) 152 that can contain one or more markers, for example, two dimensional planar patterns.
  • the markers can be high contrast, for example, bi-tonal, for improved detection.
  • Such markers can be used, for example, in fiducial marker systems of the device.
  • Fiducial marker systems consist of markers that are mounted in the environment and automatically detected in camera images by the processor, using known detection algorithm, as described further below.
  • the database can include one or more references of logo or text-based markers, also capable of being detected by the processor.
  • the database can also include 2D and 3D models of agricultural products and packaging.
  • the models can be used for object detection (for example, through computer vision and comparing and matching objects in captured video) and/or generation of animations that may include the models, rendered over captured video, resulting in augmented reality video.
  • the device memory can store GPS location or use patterns (based on year, time of day, and more).
  • the processor can also include a computer vision module 156, configured to perform scene reconstruction, event detection, video tracking, object recognition, 3D pose estimation, learning, indexing, motion estimation, image restoration, and other known computer vision techniques based on the captured video 142.
  • a computer vision module 156 configured to perform scene reconstruction, event detection, video tracking, object recognition, 3D pose estimation, learning, indexing, motion estimation, image restoration, and other known computer vision techniques based on the captured video 142.
  • the processor can apply the computer vision techniques described above to analyze the captured video and identify objects such as agricultural products and packaging, plants and an area of cultivation, and orientations and positions of such, in a field.
  • the processor can be configured to process the captured video to determine whether an agricultural product (for example, a powder in a recognized package) is present in the captured video.
  • an agricultural product for example, a powder in a recognized package
  • determination of an agricultural product in the captured video can be made based on image or object recognition, and/or other techniques capable of being implemented by one skilled in the art of computer vision, to detect the agricultural product.
  • the processor can identify and/or track one or more markers described above with a marker recognizer 154.
  • the processor can determine whether an indicator is present using marker detection methods, including, for example, edge detection and line detection, to determine the presence of a marker, and the surface orientation of which the marker is laying.
  • the processor can continuously track the marker as it moves in the captured video.
  • the marker can be a two-dimensional planar pattern (for example, a QR code), a bi-tonal marker, a text- based marker, a logo, or combinations thereof.
  • the processor can generate an augmented reality video 132 by rendering an animation to be included in the captured video (for example, overlaid on the captured video).
  • the processor can be configured to render animations based on corresponding cues/indications (e.g., different markers or objects detected in captured video). For example, depending on the detected marker or agricultural product, the processor can select and render a corresponding animation based on a lookup table or other known data structure (e.g., a dictionary, array, or a database).
  • the processor can display the augmented reality video 132 for example, on one or more displays 130.
  • the display can be, for example, an LCD, OLED, or other comparable display technology now known or later developed.
  • the display can be integrated into the device (for example, a touch-screen display on a mobile device), such that an agricultural professional can advantageously use the device to generate augmented reality instructions while being in the field.
  • the processor can communicate to servers 104 through a network 102. From the network, the processor can retrieve and transmit information such as, for example, 2D markers, 3D models, actionable voice commands, the instructional animations or updates thereto.
  • the processor can also communicate to a server on a network a GPS location or use patterns (based on year, time of day, and more).
  • the processor or device can download, from a server on the network, a computer program (for example, a mobile app) and install the program into memory of the device and register, if necessary, the application with an operating system of the device, so that the program is capable of being executed by the device and/or by the operating system of the device.
  • the processor can communicate with the network through communications 160, which can include, for example, Wi-Fi, 3G, 4G, GSM, or equivalent communication technologies now known or later developed.
  • the animation can include a visual instruction of how to prepare the agricultural product detected in the captured video.
  • the augmented reality video 232 can show mixing an agricultural product (e.g., a powder or liquid agricultural product) 233 with a solvent or carrier (e.g., water) 234.
  • the processor can generate or play a previously generated audio track 211 from speakers 210 simultaneously with the animation.
  • the audio track can describe instructions that accompany the animation, for example, the ratio of the agricultural product to solvent/carrier.
  • the animation can include, for example, a visual instruction of applying the agricultural product as a seed coating, directly to soil or an area of cultivation, or to a plant, including dosage rates, formulations, temperature conditions, or other restrictions and steps.
  • an accompanying audio track can be played by the processor through the speakers.
  • the audio track can relate to the instructions shown in the animation.
  • the audio track of the animation can narrate the same instructions visually shown in the animation.
  • the presently disclosed methods further comprise determining a language of an audio track of the animation. In some of these embodiments, this step comprises determining a stored language preference of a device, for example, in device memory, and setting the language of the audio track to the stored language.
  • the animated instructions can visually show and describe (via audio), preparation and application steps, restrictions, labeled uses, active ingredients, dose rates, additives, and formulations. In this manner, agricultural professionals in the field will be instructed on the proper method or methods of preparation and/or application of the product, based on the augmented reality video.
  • methods, implemented by a processor, for providing instructions in augmented reality for agricultural products comprise receiving video captured by a camera, detecting whether an agricultural product is present in the captured video, and based on a positive detection of the agricultural product, modifying the captured video to include an instructional animation, resulting in an augmented reality video, and then displaying the augmented reality video on a display screen.
  • a method 400 is shown in Figure 4, for providing instructions in augmented reality for agricultural products.
  • the method can include: 410 receiving video captured by a camera, 420 detecting whether an agricultural product is present in the captured video, 430 modifying the captured video to include an instructional animation, and 440 displaying the augmented reality video on a display screen.
  • the methods, described herein, can be performed, by a processor of a mobile device, as described herein. Additionally, it is to be understood that the components of the device 100 and the processor 150 are shown separately for illustrative purposes but can, in some cases, have combined functionality.
  • the processor can indicate, in the augmented reality video, a potential coverage area of a particular amount of the agricultural product, for example, the amount present in the package that was detected by the device through the captured video.
  • a user can point the camera of the device 300 to an area of cultivation 30.
  • the processor can detect and characterize the surface area of the area of cultivation, compute the area of coverage of the agricultural product, and then project the area of coverage 333 onto the image or video of the area of cultivation.
  • the area of coverage 333 can be indicated, for example, by rendering an outline of the area on the augmented reality video, or by adjusting the opacity, color, brightness, or other visual attribute of the area of coverage, to distinguish it from the surrounding area.
  • An audio track of 311 can describe the area of coverage in, for example, "50 square yards per 15lb package of product" through speaker(s) 310.
  • the area of coverage can be computed based on a detected amount of the agricultural product found in the captured video, for example, based on the detected packaging or on a detected marker.
  • the amount of agricultural product can be input by the user, for example, through voice commands or through a keypad on the device.
  • the processor can then reference a database to determine the area of coverage based on the product type and the amount of the product.
  • methods, implemented by a processor, for showing an area of coverage of an agricultural product in augmented reality comprise receiving video captured by a camera, detecting and characterizing a surface area of an area of cultivation in the captured video, computing an area of coverage of an agricultural product, projecting the area of coverage onto the video of the area of cultivation, resulting in an augmented reality video, and displaying the augmented reality video on a display screen.
  • an“area of cultivation” comprises any region in which one desires to grow a plant.
  • Such areas of cultivations include, but are not limited to, a field in which a plant is cultivated (such as a crop field, a sod field, a tree field, a managed forest, a field for culturing fruits and vegetables, etc.), a greenhouse, a growth chamber, etc.
  • the processor can receive captured video of a plant. Based on the captured video of the plant, the processor can determine whether the plant in the captured video is unhealthy and/or infected by insects, fungi, or other pests. In one embodiment, the processor can use, for example, computer vision, in connection with trained neural networks, for example, trained deep neural networks or convolutional neural networks, to make the determination.
  • the trained neural networks can be trained with images of plants afflicted with various pests or other plant ailments. Thus, the trained neural networks can diagnose the plant in the captured video by comparing it to the images that the neural network has been trained through.
  • the trained neural networks can be located in the device's database or memory, or on external servers accessible through the network. Based on the diagnosis of the plant, the processor can then prescribe an agricultural product and plan to treat the infected plant, through an audio track and/or through a message/animation displayed on the screen.
  • methods, implemented by a processor, for diagnosing and providing a plan for treatment of a plant comprise receiving video captured by a camera, detecting a plant in the captured video, characterizing the type of plant in the video, determining whether the plant has one or more ailments, identifying an agricultural product and treatment for the plant based on the one or more determined ailments, generating an animation including the agricultural product, modifying the captured video to include the generated animation, resulting in an augmented reality video, and displaying the augmented reality video on a display.
  • a user interface 270 can include selectable options. For example, a replay button, when pressed, can replay an animation and accompanying audio track. In response to the "seed coating" button press, the processor can generate animated seed coating instructions with accompanying audio track.
  • the processor can generate spraying instructions with accompanying audio track. If the user wishes to compute the area of coverage, the user can press the "coverage” button. The processor can, based on the coverage request, detect and characterize the surface area of a field shown in the camera (as described above). The user can then pan to an area of cultivation of interest, as described above. In this manner, the agricultural professional can select different preparation and application options to receive instructions for, replay the instructions, and determine the area of coverage, with the device.
  • the processor can include a voice-based audio command interface.
  • the processor can receive an audio stream through a microphone 120 and use known speech detection and natural language processing modules 158 (for example, known application programming interfaces (APIs) and libraries), capable of detecting actionable voice commands in the audio stream.
  • the processor can then determine a course of action, for example, replaying an animation or generating an animation for a particular preparation and/or application (for example, mixing a formulation of the agricultural product, coating a seed, or applying the product to an area of cultivation), based on the detected actionable voice command.
  • known speech detection and natural language processing modules 158 for example, known application programming interfaces (APIs) and libraries
  • APIs application programming interfaces
  • the processor can then determine a course of action, for example, replaying an animation or generating an animation for a particular preparation and/or application (for example, mixing a formulation of the agricultural product, coating a seed, or applying the product to an area of cultivation), based on the detected actionable voice command.
  • a computer program product comprising instructions that embody the methods described herein, for viewing augmented reality for an agricultural product on a computing device.
  • the computer program product is designed to run on a mobile device (i.e., a mobile application or“app”).
  • a mobile app can be designed to function with certain mobile operating systems, such as Apple iOS, Google Android, Samsung’s Bada, Research in Motion’s BlackBerry OS, and Microsoft’s Windows Mobile.
  • the methods provided herein further comprise a step of downloading and installing the mobile app on a mobile device prior to use thereof.
  • the packaging of the agricultural product provides instructions for downloading such a mobile app (e.g., where the mobile app can be found, such as an app store).
  • the instructions for downloading and installing the mobile app are provided in multiple languages on the agricultural product packaging.
  • a mobile device for viewing augmented reality for an agricultural product comprises a non-transitory machine readable storage medium having stored therein instructions that, when executed by a processor, perform any of the presently disclosed methods.
  • the instructions are stored in memory on a networked server, and are retrieved through the network by the mobile device and loaded into the non-transitory machine readable storage medium, to be executed by the processor.
  • an“agricultural product” is any product that can be applied to a plant or area of cultivation in order to control a plant pest or unwanted vegetation in an area of cultivation (e.g., weed) or improve at least one agronomic trait of interest of a plant.
  • the agricultural product can be naturally-occurring or synthetic, a biologic (i.e., a preparation made from living organisms or their products) or a chemical.
  • the biologic can be purified from nature, recombinantly produced, or a transgenic organism.
  • the agricultural product is a microorganism, such as bacteria, that controls a plant pest or unwanted vegetation or improves at least one agronomic trait of interest of a plant.
  • the agricultural product is the Pseudomonas chlororaphis strain deposited at National Center for Agricultural Utilization Research Agricultural Research Service, U.S. Department of Agriculture, 1815 North University Street, Peoria, Illinois 61604 U.S. A. on January 31, 2014 and assigned NRRL No. B-50897 (see, for example, U.S. Pat. No. 9,795,144, which is herein incorporated by reference in its entirety).
  • Agronomic traits of interest include any trait that improves plant health or commercial value.
  • Non-limiting examples of agronomic traits of interest including increase in biomass, increase in drought tolerance, thermal tolerance, herbicide tolerance, drought resistance, pest resistance (e.g., nematode resistance, insect resistance, fungus resistance, virus resistance, bacteria resistance), male sterility, cold tolerance, salt tolerance, increased yield, enhanced nutrient use efficiency, increased nitrogen use efficiency, increased tolerance to nitrogen stress, increased fermentable carbohydrate content, reduced lignin content, increased antioxidant content, enhanced water use efficiency, increased vigor, increased germination efficiency, earlier or increased flowering, increased biomass, altered root-to-shoot biomass ratio, enhanced soil water retention, or a combination thereof.
  • the agronomic trait of interest includes an altered oil content, altered protein content, altered seed carbohydrate composition, altered seed oil composition, and altered seed protein composition, chemical tolerance, cold tolerance, delayed senescence, disease resistance, drought tolerance, ear weight, growth improvement, health enhancement, heat tolerance, herbicide tolerance, herbivore resistance, improved nitrogen fixation, improved nitrogen utilization, improved root architecture, improved water use efficiency, increased biomass, increased root length, increased seed weight, increased shoot length, increased yield, increased yield under water- limited conditions, kernel mass, kernel moisture content, metal tolerance, number of ears, number of kernels per ear, number of pods, nutrition enhancement, photosynthetic capability improvement, salinity tolerance, stay-green, vigor improvement, increased dry weight of mature seeds, increased fresh weight of mature seeds, increased number of mature seeds per plant, increased chlorophyll content, increased number of pods per plant, increased length of pods per plant, reduced number of wilted leaves per plant, reduced number of severely wilted leaves per plant, and increased number of non-wilted leaves
  • the agronomic trait of interest that is improved by the agricultural product is improved plant health.
  • improved plant health is meant increased growth and/or yield of a plant, increased stress tolerance and/or decreased herbicide resistance, to name a few.
  • Increased stress tolerance refers to an increase in the ability of a plant to decrease or prevent symptoms associated with one or more stresses.
  • the stress can be a biotic stress that occurs as a result of damage done to plants by other living organisms such as a pest (for example, bacteria, viruses, fungi, parasites, insects, nematodes, weeds, cultivated or native plants).
  • the stress can also be an abiotic stress such as extreme temperatures (high or low), high winds, drought, salinity, chemical toxicity, oxidative stress, flood, tornadoes, wildfires, radiation and exposure to heavy metals.
  • the agricultural product used in the presently disclosed systems and methods can be useful for any plant species susceptible to a plant pest or at risk of developing a plant disease or damage caused by a plant pest.
  • the agricultural product is an herbicide, pesticide, or a fertilizer.
  • an herbicide controls unwanted vegetation (e.g., weeds) in an area of cultivation.
  • a pesticide controls plant pests or protects a plant from a plant pest.
  • the term “controlling” unwanted vegetation or a plant pest refers to one or more of inhibiting or reducing the growth, feeding, fecundity, reproduction and/or proliferation of unwanted vegetation or a plant pest or killing (e.g., causing the moribidity or mortality, or reduced fecundity) of unwanted vegetation or a plant pest.
  • a fertilizer is any natural or synthetic material that can be applied to soil or to plant tissues to supply one or more plant nutrients essential to the growth of plants.
  • Non-limiting examples of fertilizers that can be used in the presently disclosed systems and methods include those that deliver nitrogen, phosphorous, potassium, calcium, magnesium, sulfur, copper, iron, manganese, molybdenum, zinc, boron, silicon, cobalt, and/or vanadium.
  • the fertilizer can be organic or synthetic.
  • the agricultural product is a pesticide that targets one or more plant pests.
  • pests includes but is not limited to, insects, fungi, bacteria, nematodes, viruses or viroids, protozoan pathogens, and the like.
  • the agricultural product is a pesticide that targets one or more insect or insect pests.
  • insects or“insect pests” as used herein refers to insects and other similar pests such as, for example, those of the order Coleoptera including, but not limited to Agriotes spp., Anthonomus spp., Atomaria linearis, Chaetocnema tibialis, Cosmopolites spp., Curculio spp., Dermestes spp., Epilachna spp., Eremnus spp., Leptinotarsa decemlineata, Lissorhoptrus spp., Melolontha spp., Orycaephilus spp.,
  • Coleoptera insects include, but are not limited to weevils from the families
  • Curculionidae e.g., sweetpotato weevil ( Cylas formicarius
  • insect pests include Coleoptera pests of the corn rootworm complex: Western corn rootworm, Diabrotica virgifera virgifera ; northern com rootworm, I) barbery Southern com rootworm or spotted cucumber beetle, Diabrotica undecimpunctata howardy and the Mexican com rootworm, D. virgifera zeae.
  • the insect pest is Western com rootworm, Diabrotica virgifera virgifera.
  • the agricultural products can also be used against Hemiptera such as Lygus hesperus , Lygus lineolaris , Lygus pratensis , Lygus rugulipennis Popp , Lygus pabulinus , Calocoris norvegicus , Orthops compestris , Plesiocoris rugicollis , Cyrtopeltis modestus , Cyrtopeltis notatus ,
  • Hemiptera such as Lygus hesperus , Lygus lineolaris , Lygus pratensis , Lygus rugulipennis Popp , Lygus pabulinus , Calocoris norvegicus , Orthops compestris , Plesiocoris rugicollis , Cyrtopeltis modestus , Cyrtopeltis notatus ,
  • Insect pests of interest also include Araecerus fasciculatus , coffee bean weevil;
  • Insect pests that can be controlled with the agricultural products used in the systems and methods disclosed herein further include insects of the order Lepidoptera, e.g. Achoroia grisella , Acleris glover ana, Acleris van ana, Adoxophyes or ana, Agrotis ipsilon, Alabama argillacea, Alsophila pometaria, Amyelois transitella, Anagasta kuehniella, Anarsia lineatella, Anisota senatoria, Antheraea pernyi, Anticar sia gemmatalis, Archips sp., Argyrotaenia sp., Athetis mindara, Bombyx mori, Bucculatrix thurberiella, Cadra cautella, Choristoneura sp., Cochylls hospes, Colias eurytheme, Corcyra cephalonica, Cydia latiferreanus, Cydia pomonella, Datana
  • Insect pests also include insects selected from the orders Diptera, Hymenoptera,
  • Insect pests that can be controlled using methods and systems of the present invention can further include those of the order Acari including, but not limited to, mites and ticks.
  • Coleoptera pests or Coleopteran pests include Western corn rootworm, Colorado potato beetle, and/or sweet potato weevil.
  • Insect pests that can be targeted by the agricultural products used in the presently disclosed methods and systems for the major crops include, but are not limited to: Maize: Ostrinia nubilalis , European com borer; Agrotis ipsilon , black cutworm; Helicoverpa zeae , com earworm; Spodoptera frugiperda , fall armyworm; Diatraea grandiose I la, southwestern com borer; Elasmopalpus lignosellus , lesser cornstalk borer; Diatraea saccharalis , surgarcane borer; western corn rootworm, e.g., Diabrotica virgifera virgifera, northern corn rootworm, e.g., Diabrotica longicornis barberi ; southern com rootworm, e.g., Diabrotica undecimpunctata howardi ; Melanotus spp., wireworms; Cyclocephala borealis , northern
  • Rhopalosiphum maidis corn leaf aphid; Sipha flava, yellow sugarcane aphid; chinch bug, e.g., Blissus leucopterus leucopterus ; Contarinia sorghicola, sorghum midge; Tetranychus
  • Melanoplus femurrubrum redlegged grasshopper
  • Melanoplus differentialis differential grasshopper
  • Thrips tabaci onion thrips
  • Frankliniella fusca tobacco thrips
  • Tetranychus cinnabarinus carmine spider mite
  • Tetranychus urticae two-spotted spider mite
  • Rice Diatraea saccharalis , sugarcane borer; Spodoptera frugiperda , fall armyworm; Helicoverpa zea , com earworm; Colaspis brunnea , grape colaspis; Lissorhoptrus oryzophilus , rice water weevil;
  • insects encompasses eggs, larvae, juvenile and mature forms of insects. Insects can be targeted at any stage of development. For example, insects can be targeted after the first instar, during the second instar, third instar, fourth instar, fifth instar, or any other developmental or adult growth stage. As used herein, the term“instar” is used to denote the developmental stage of the larval or nymphal forms of insects.
  • Nematodes include parasitic nematodes such as root-knot, cyst, and lesion nematodes, including of the species Meloidogyne such as the Southern Root-Knot nematode ( Meloidogyne incognita ), Javanese Root-Knot nematode ( Meloidogyne javanica ), Northern Root-Knot Nematode ( Meloidogyne hapla ) and Peanut Root-Knot Nematode
  • nematodes of the species Ditylenchus such as Ditylenchus destructor and Ditylenchus dipsaci
  • nematodes of the species Pratylenchus such as the Cob Root-Lesion Nematode ⁇ Pratylenchus penetrans), Chrysanthemum Root-Lesion Nematode ⁇ Pratylenchus fallax
  • Ditylenchus such as Ditylenchus destructor and Ditylenchus dipsaci
  • Pratylenchus such as the Cob Root-Lesion Nematode ⁇ Pratylenchus penetrans), Chrysanthemum Root-Lesion Nematode ⁇ Pratylenchus fallax
  • Nematodes of the species Globodera such as Globodera rostochiensis and Globodera pallida
  • Nematodes of the species Heterodera such as Heterodera glycines (soybean cyst nematode); Heterodera schachtii (beet cyst nematode); Heterodera avenae (cereal cyst nematode); Nematodes of the species Aphelenchoides such as the Rice White-tip Nematode ⁇ Aphelenchoides besseyi), Aphelenchoides ritzemabosi and Aphelenchoides fragariae ; Nematodes of the species Aphelenchus such as Aphelenchus avenae, Nematodes of the species Radopholus, such as
  • Lesion nematodes include Pratylenchus spp.
  • the term "nematode” encompasses eggs, larvae, juvenile and mature forms of nematodes.
  • a fungal pest can be, but is not limited to, a fungus selected from the group consisting of Botrytis spp., Botrytis cinerea, Cersospora spp, Cercospora sojina, Cercospora beticola, Alternaria spp., Alternaria solani, Rhizoctonia spp., Rhizoctonia solani, Blumeria graminis f. sp.
  • Tritici Erysiphe necator, Podosphaera xanthii, Golovinomyces cichoracearum, Erysiphe lager stroemiae, Sphaerotheca pannosa, Colletotrichum cereale,
  • gloeosporiodes Discula fraxinea, Mycosphaerella spp., Phomopsis spp., Plasmopara viticola, Pseudoperonospora cubensis, Peronospora belbahrii, Bremia lactucae, Peronospora lamii, Plasmopara obduscens, Pythium spp., Pythium cryptoirregulare, Pythium aphanidermatum, Pythium irregulare, Pythium sylvaticum, Pythium myriotylum, Pythium ultimum, Phytophthora spp., Phytophthora capsici, Phytophthora nicotianae, Phytophthora inf e stans, Phytophthora tropicalis, Phytophthora sojae, Fusarium spp., Fusarium graminearum, Fusarium sol
  • the fungal pest is selected from the group consisting of Botrytis cinerea, Cercospora sojina, Alternaria solani, Rhizoctonia solani, Erysiphe necator, Podosphaera xanthii, Colletotrichum cereal, Plasmopara viticola, Peronospora belbahrii, Pythium
  • the fungal pathogen is Phakopsora sp., including Phakopsora pachyrhizi and/or Phakopsora meibomiae .
  • Examples of fungal plant conditions and diseases caused by fungal pests that can be treated using the methods and systems provided herein include, but are not limited to, Asian Soybean Rust (ASR), gray mold, leaf spot, Frogeye Leaf Spot, Early Blight, Damping off complex, Brown Patch, black scurf, root rot, belly rot, sheath blight, Powdery Mildew, Anthracnose leaf spot, Downy Mildew, Pythium Blight, Late Blight, Fusarium Head Blight, sudden death syndrome (SDS), Fusarium Wilt, Com Stalk Rot, Brown Rust, Black Rust, Yellow Rust, Wheat Rust, Rust, Apple Scab, Verticillium Wilt, Fire Blight, and Brown Rot.
  • ASR Asian Soybean Rust
  • the agricultural product used in the systems and methods provided herein controls one or more nematode pests.
  • the agricultural product can control or treat root knot nematodes, ( Meloidogyne spp.).
  • Plant parasitic nematodes may attack the roots, stem, foliage and flowers of plants. All plant parasitic nematodes have piercing mouthparts called stylets. The presence of a stylet is the key diagnostic sign differentiating plant parasitic nematodes from all other types of nematodes.
  • Typical root symptoms indicating nematode attack are root knots or galls, root lesions, excessive root branching, injured root tips and stunted root systems.
  • Symptoms on the above-ground plant parts indicating root infection are a slow decline of the entire plant, wilting even with ample soil moisture, foliage yellowing and fewer and smaller leaves. These are, in fact, the symptoms that would appear in plants deprived of a properly functioning root system. Bulb and stem nematodes produce stem swellings and shortened internodes. Bud and leaf nematodes distort and kill bud and leaf tissue. In some cases, such as with SCN, yield loss may take place with no visible symptoms.
  • Herbicides that can be used in the various methods and systems disclosed herein include glyphosate, ACCase inhibitors (Arloxyphenoxy propionate (FOPS)); ALS inhibitors (Sulfonylurea (SU)), Imidazonlinone (IMI), Pyrimidines (PM)); microtubule protein inhibitor (Dinitroaniline
  • DNA DNA
  • synthetic auxins Phenoxy (P)
  • Benzoic Acid BA
  • Carboxylic acid CA
  • Photosystem II inhibitor Triazine (TZ)
  • Triazinone TN
  • Nitriles NT
  • Benzothiadiazinones BZ
  • Ureas US
  • EPSP Synthase inhibitor glycines (GC)
  • Glutamine Synthesis inhibitor Phosphinic Acid (PA)
  • DOXP synthase inhibitor Isoxazolidinone (IA)
  • HPPD inhibitor Pyrazole (PA)
  • Triketone TE
  • PPO inhibitors Diphenylether (DE), N-phenylphthalimide (NP) (Ary triazinone (AT)
  • DE Diphenylether
  • NP N-phenylphthalimide
  • AT ry triazinone
  • VLFA inhibitors chloroacetamide (CA)
  • Oxyacetamide (OA) Oxyacetamide
  • Pesticides that can be used in the various methods and systems disclosed herein include imidacloprid clothianidin, arylpyrazole compounds (W02007103076); organophosphates, phenyl pyrazole, pyrethoids caramoyloximes, pyrazoles, amidines, halogenated hydrocarbons, carbamates and derivatives thereof, terbufos, chloropyrifos, fipronil, chlorethoxyfos, telfuthrin, carbofuran, imidacloprid, tebupirimfos (U.S. Patent No. 5,849,320).
  • Insecticides that can be used used in the various methods and systems disclosed herein include imidacloprid, beta-cyfluthrin, cyantraniliprole, diazinon, lambda-cyhalothrin, methiocarb, pymetrozine, pyrifluquinazon, spinetoram, spirotetramat, thiodicarb, and Ti-435, carbamates, sodium channel modulators/voltage dependent sodium channel blockers, pyrethroids such as DDT, oxadiazines such as indoxacarb, acetylcholine-receptor agonists/antagonists, acetylcholine- receptor-modulators, nicotine, bensultap, cartap, chloronicotyinyls such as acetamiprid, bifenthrin, clothianidin, dinotefuran, imidac loprid, nitenpyram, nithiazine, thiacloprid
  • Nematicides that can be used in the various methods and systems disclosed herein include, but are not limited to, acibenzolar-S-methyl, an avermectin (e.g., abamectin), carbamate
  • nematicides e.g., aldicarb, thiadicarb, carbofuran, carbosulfan, oxamyl, aldoxycarb, ethoprop, methomyl, benomyl, alanycarb
  • organophosphorus nematicides e.g., phenamiphos (fenamiphos), fensulfothion, terbufos, fosthiazate, dimethoate, phosphocarb, dichlofenthion, isamidofos, fosthietan, isazofos ethoprophos, cadusafos, terbufos, chlorpyrifos, dichlofenthion, heterophos, isamidofos, mecarphon, phorate, thionazin, triazophos, diamidafos, fosthietan, phosphamidon), and certain fungicides, such as capt
  • Fungicides that can be used in the various methods and systems disclosed herein include aliphatic nitrogen fungicides (butylamine, cymoxanil, dodicin, dodine, guazatine, iminoctadine); amide fungicides (benzovindiflupyr, carpropamid, chloraniformethan, cyflufenamid, diclocymet, diclocymet, dimoxystrobin, fenaminstrobin, fenoxanil, flumetover, furametpyr, isofetamid, isopyrazam, mandestrobin, mandipropamid, metominostrobin, orysastrobin, penthiopyrad, prochloraz, quinazamid, silthiofam, triforine); acylamino acid fungicides (benalaxyl, benalaxyl-M, furalaxyl, metalaxyl, metalaxyl-M, pefur
  • antibiotic fungicides aureofungin, blasticidin-S, cycloheximide, griseofulvin, kasugamycin, moroxydine, natamycin, polyoxins, polyoxorim, streptomycin, validamycin
  • strobilurin fungicides fluoxastrobin, mandestrobin
  • methoxyacrylate strobilurin fungicides azoxystrobin, bifujunzhi, coumoxystrobin, enoxastrobin, flufenoxystrobin, jiaxiangjunzhi, picoxystrobin, pyraoxystrobin
  • methoxycarbanilate strobilurin fungicides pyraclostrobin, pyrametostrobin, triclopyricarb
  • methoxyiminoacetamide strobilurin fungicides (dimoxystrobin, fenaminstrobin, metominostrobin, orysastrobin); methoxyiminoacetate strobilurin fungicides (kresoxim-methyl, trifloxystrobin); aromatic fungicides (biphenyl, chlorodinitronaphthalenes, chloroneb, chlorothalonil, cresol, dicloran, fenjuntong, hexachlorobenzene, pentachlorophenol, quintozene, sodium
  • conazole fungicides triazoles
  • polysulfide fungicides barium polysulfide, calcium polysulfide, potassium polysulfide, sodium polysulfide
  • pyrazole fungicides benzovindiflupyr, bixafen, fenpyrazamine, fluxapyroxad, furametpyr, isopyrazam, oxathiapiprolin, penflufen, penthiopyrad, pyraclostrobin, pyrametostrobin, pyraoxystrobin, rabenzazole, sedaxane
  • pyridine fungicides (boscalid, buthiobate, dipyrithione, fluazinam, fluopicolide, fluopyram, parinol, picarbutrazox, pyribencarb, pyridinitril, pyrifenox, pyrisoxazole, pyroxychlor, pyroxyfur, triclopyricarb); pyrimidine fung
  • anilinopyrimidine fungicides cyprodinil, mepanipyrim, pyrimethanil
  • pyrrole fungicides cyprodinil, mepanipyrim, pyrimethanil
  • fungicides dimetachlone, fenpiclonil, fludioxonil, fluoroimide
  • quaternary ammonium fungicides berberine, sanguinarine
  • quinoline fungicides ethoxyquin, halacrinate, 8-hydroxyquinoline sulfate, quinacetol, quinoxyfen, tebufloquin
  • quinone fungicides chloranil, dichlone, dithianon
  • quinoxaline fungicides chinomethionat, chlorquinox, thioquinox
  • thiazole fungicides ethaboxam, isotianil, metsulfovax, octhilinone, oxathiapiprolin, thiabendazole, thifluzamide
  • thiazolidine fungicides flutianil, thiadifluor
  • thiocarbamate fungicides metalhasulfocarb, prothiocarb
  • thiophene fungicides ethaboxam, isofetamid, silthiofam
  • triazine fungicides anilazine
  • triazole fungicides amisulbrom, bitertanol, fluotrimazole, triazbutil
  • conazole fungicides triazoles
  • the agricultural product can be formulated as a cell paste, wettable powder, a cell pellet, dusts, granules, spray-dried formulation, freeze-dried formulation, a slurry, a dry powder, aqueous or oil based liquid products, and the like.
  • Such formulations can comprise an active ingredient in addition to carriers and other agents.
  • the formulations preferably comprise between 0.00000001 % and 98% by weight of active compound or, with particular preference, between 0.01 % and 95% by weight of active compound, more preferably between 0.5% and 90% by weight of active compound, based on the weight of the formulation.
  • the active compound content of the application forms prepared from the formulations may vary within wide ranges.
  • the active compound concentration of the application forms may be situated typically between 0.00000001 % and 95% by weight of active compound, preferably between 0.00001 % and 1 % by weight, based on the weight of the application form.
  • Application takes place in a customary manner adapted to the application forms.
  • the agricultural product formulation or application form can comprise at least one or more of an extender, a solvent, spontaneity promoter, carrier, emulsifier, dispersant, frost protectant, thickener, and/or adjuvant.
  • the extender, solvent, spontaneity promoter, carrier, emulsifier, dispersant, frost protectant, thickener, and/or adjuvant is a non-natural or synthetic extender, a solvent, spontaneity promoters, carriers, emulsifiers, dispersants, frost protectants, thickeners, and/or adjuvants.
  • the agricultural product formulation or application form comprises at least one or more natural extender, a solvent, spontaneity promoter, carrier, emulsifier, dispersant, frost protectant, thickener, and/or adjuvant.
  • Examples of typical formulations or application forms include water-soluble liquids (SL), emulsifiable concentrates (EC), emulsions in water (EW), suspension concentrates (SC, SE, FS, OD), water-dispersible granules (WG), granules (GR) and capsule concentrates (CS); WG; GR; these and other possible types of formulation are described, for example, by Crop Life International and in Pesticide Specifications, Manual on development and use of FAO and WHO specifications for pesticides, FAO Plant Production and Protection Papers - 173, prepared by the FAO/WHO Joint Meeting on Pesticide Specifications, 2004, ISBN: 9251048576.
  • the formulations or application forms of the various agricultural products can comprise, but are not limited to, auxiliaries, such as extenders, solvents, spontaneity promoters, carriers, emulsifiers, dispersants, frost protectants, biocides, solid carriers, surfactants, thickeners and/or other auxiliaries, such as adjuvants.
  • auxiliaries such as extenders, solvents, spontaneity promoters, carriers, emulsifiers, dispersants, frost protectants, biocides, solid carriers, surfactants, thickeners and/or other auxiliaries, such as adjuvants.
  • An adjuvant in this context is a component which enhances the biological effect of the formulation, without the component itself having a biological effect.
  • adjuvants are agents which promote the retention, spreading, attachment to the leaf surface, or penetration.
  • Non-limiting extenders are, for example, water, polar and nonpolar organic chemical liquids, for example from the classes of the aromatic and non-aromatic hydrocarbons (such as paraffins, alkyl benzenes, alkylnaphthalenes, chlorobenzenes), the alcohols and polyols (which, if appropriate, may also be substituted, etherified and/or esterified), the ketones (such as acetone, cyclohexanone), esters (including fats and oils) and (poly)ethers, the unsubstituted and substituted amines, amides, lactams (such as N-alkylpyrrolidones) and lactones, the sulphones and sulphoxides (such as dimethyl sulphoxide).
  • the extender used is water, it is also possible to employ, for example, organic solvents as auxiliary solvents.
  • organic solvents are:
  • aromatics such as xylene, toluene or alkylnaphthalenes, chlorinated aromatics and chlorinated aliphatic hydrocarbons such as chlorobenzenes, chloroethylenes or methylene chloride, aliphatic hydrocarbons such as cyclohexane or paraffins, for example petroleum fractions, mineral and vegetable oils, alcohols such as butanol or glycol and also their ethers and esters, ketones such as acetone, methyl ethyl ketone, methyl isobutyl ketone or cyclohexanone, strongly polar solvents such as dimethylformamide and dimethyl sulphoxide, and also water. In principle it is possible to use any suitable solvent.
  • Non-limiting solvents are, for example, aromatic hydrocarbons, such as xylene, toluene or alkylnaphthalenes, for example, chlorinated aromatic or aliphatic hydrocarbons, such as chlorobenzene, chloroethylene or methylene chloride, for example, aliphatic hydrocarbons, such as cyclohexane, for example, paraffins, petroleum fractions, mineral and vegetable oils, alcohols, such as methanol, ethanol, isopropanol, butanol or glycol, for example, and also their ethers and esters, ketones such as acetone, methyl ethyl ketone, methyl isobutyl ketone or cyclohexanone, for example, strongly polar solvents, such as dimethyl sulphoxide, and water.
  • aromatic hydrocarbons such as xylene, toluene or alkylnaphthalenes
  • chlorinated aromatic or aliphatic hydrocarbons such as chlor
  • Non-limiting examples of suitable carriers include, for example, ammonium salts and ground natural minerals such as kaolins, clays, talc, chalk, quartz, attapulgite, montmorillonite or diatomaceous earth, and ground synthetic minerals, such as finely divided silica, alumina and natural or synthetic silicates, resins, waxes and/or solid fertilizers. Mixtures of such carriers may likewise be used.
  • ground natural minerals such as kaolins, clays, talc, chalk, quartz, attapulgite, montmorillonite or diatomaceous earth
  • ground synthetic minerals such as finely divided silica, alumina and natural or synthetic silicates, resins, waxes and/or solid fertilizers. Mixtures of such carriers may likewise be used.
  • Carriers suitable for granules include the following: for example, crushed and fractionated natural minerals such as calcite, marble, pumice, sepiolite, dolomite, and also synthetic granules of inorganic and organic meals, and also granules of organic material such as sawdust, paper, coconut shells, maize cobs, and tobacco stalks.
  • Liquefied gaseous extenders or solvents may also be used.
  • extenders or carriers which at standard temperature and under standard pressure are gaseous, examples being aerosol propellants, such as halogenated hydrocarbons, and also butane, propane, nitrogen and carbon dioxide.
  • aerosol propellants such as halogenated hydrocarbons, and also butane, propane, nitrogen and carbon dioxide.
  • emulsifiers and/or foam-formers, dispersants or wetting agents having ionic or nonionic properties, or mixtures of these surface-active substances are salts of polyacrylic acid, salts of lignosulphonic acid, salts of phenolsulphonic acid or
  • naphthalenesulphonic acid polycondensates of ethylene oxide with fatty alcohols or with fatty acids or with fatty amines, with substituted phenols (preferably alkylphenols or arylphenols), salts of sulphosuccinic esters, taurine derivatives (preferably alkylta urates), phosphoric esters of polyethoxylated alcohols or phenols, fatty acid esters of polyols, and derivatives of the compounds containing sulphates, sulphonates and phosphates, examples being alkylaryl polyglycol ethers, alkyl sulphonates, alkyl sulphates, aryl sulphonates, protein hydrolysates, lignin-sulphite waste liquors and methylcellulose.
  • the presence of a surface-active substance is advantageous if one of the active compounds and/or one of the inert carriers is not soluble in water and if application takes place in water.
  • auxiliaries that may be present in the formulations and in the application forms derived from them include colorants such as inorganic pigments, examples being iron oxide, titanium oxide, Prussian Blue, and organic dyes, such as alizarin dyes, azo dyes and metal phthalocyanine dyes, and nutrients and trace nutrients, such as salts of iron, manganese, boron, copper, cobalt, molybdenum, and zinc.
  • colorants such as inorganic pigments, examples being iron oxide, titanium oxide, Prussian Blue, and organic dyes, such as alizarin dyes, azo dyes and metal phthalocyanine dyes, and nutrients and trace nutrients, such as salts of iron, manganese, boron, copper, cobalt, molybdenum, and zinc.
  • Stabilizers such as low-temperature stabilizers, preservatives, antioxidants, light stabilizers or other agents which improve chemical and/or physical stability may also be present. Additionally present may be foam-formers or defoamers.
  • formulations and application forms derived from them may also comprise, as additional auxiliaries, stickers such as carboxymethylcellulose, natural and synthetic polymers in powder, granule or latex form, such as gum arabic, polyvinyl alcohol, polyvinyl acetate, and also natural phospholipids, such as cephalins and lecithins, and synthetic phospholipids.
  • additional auxiliaries include mineral and vegetable oils.
  • auxiliaries present in the formulations and the application forms derived from them.
  • additives include fragrances, protective colloids, binders, adhesives, thickeners, thixotropic substances, penetrants, retention promoters, stabilizers, sequestrants, complexing agents, humectants and spreaders.
  • the active compounds may be combined with any solid or liquid additive commonly used for formulation purposes.
  • Suitable retention promoters include all those substances which reduce the dynamic surface tension, such as dioctyl sulphosuccinate, or increase the viscoelasticity, such as hydroxypropylguar polymers, for example.
  • Suitable penetrants in the present context include all those substances which are typically used in order to enhance the penetration of active agrochemical compounds into plants.
  • Penetrants in this context are defined in that, from the (generally aqueous) application liquor and/or from the spray coating, they are able to penetrate the cuticle of the plant and thereby increase the mobility of the active compounds in the cuticle. This property can be determined using the method described in the literature (Baur et ah, 1997, Pesticide Science 51 : 131-152).
  • Examples include alcohol alkoxylates such as coconut fatty ethoxylate (10) or isotridecyl ethoxylate (12), fatty acid esters such as rapeseed or soybean oil methyl esters, fatty amine alkoxylates such as tallowamine ethoxylate (15), or ammonium and/or phosphonium salts such as ammonium sulphate or diammonium hydrogen phosphate, for example.
  • alcohol alkoxylates such as coconut fatty ethoxylate (10) or isotridecyl ethoxylate (12)
  • fatty acid esters such as rapeseed or soybean oil methyl esters
  • fatty amine alkoxylates such as tallowamine ethoxylate (15)
  • ammonium and/or phosphonium salts such as ammonium sulphate or diammonium hydrogen phosphate, for example.
  • Non-limiting examples of compounds and systems that can be added to the formulation or application form include but are not limited to, Acetyl tributyl citrate [Citric acid, 2-(acetyloxy)-, tributyl ester]; Agar; Almond hulls; Almond shells; alpha-Cyclodextrin; Aluminatesilicate;
  • Aluminum magnesium silicate [Silicic acid, aluminum magnesium salt]; Aluminum potassium sodium silicate [Silicic acid, aluminum potassium sodium salt]; Aluminum silicate; Aluminum sodium silicate [Silicic acid, aluminum sodium salt]; Aluminum sodium silicate (1 :1: l)[Silicic acid (H4Si04), aluminum sodium salt (1 : 1 : 1)]; Ammonium benzoate [Benzoic acid, ammonium salt]; Ammonium stearate [Octadecanoic acid, ammonium salt]; Amylopectin, acid-hydrolyzed, 1- octenylbutanedioate; Amylopectin, hydrogen l-octadecenylbutanedioate; Animal glue; Ascorbyl palmitate; Attapulgite-type clay; Beeswax; Bentonite; Bentonite, sodian; beta-Cyclodextrin; Bone meal; Bran; Bread crumbs; (+)-Butyl lactate;
  • Glycerin [l,2,3-Propanetriol]; Glycerol monooleate [9-Octadecenoic acid (Z)-, 2,3-dihydroxypropyl ester]; Glyceryl dicaprylate [Octanoic acid, diester with l,2,3-propanetriol]; Glyceryl dimyristate [Tetradecanoic acid, diester with 1,2,3- propanetriol]; Glyceryl dioleate [9-Octadecenoic acid (9Z)-, diester with l,2,3-propanetriol];
  • Glyceryl distearate Glyceryl monomyristate [Tetradecanoic acid, monoester with 1,2,3- propanetriol]; Glyceryl monooctanoate [Octanoic acid, monoester with l,2,3-propanetriol];
  • Glyceryl monooleate [9-Octadecenoic acid (9Z)-, monoester with 1,2, 3 -propanetriol]; Glyceryl monostearate [Octadecanoic acid, monoester with l,2,3-propanetriol]; Glyceryl stearate
  • Hydrogenated rapeseed oil Hydrogenated soybean oil; Hydroxyethyl cellulose [Cellulose, 2- hydroxy ethyl ether]; Hydroxypropyl cellulose [Cellulose, 2-hydroxypropyl ether]; Hydroxypropyl methyl cellulose [Cellulose, 2-hydroxypropyl methyl ether]; Iron magnesium oxide (Fe 2 Mg0 4 );
  • Magnesium carbonate [Carbonic acid, magnesium salt (1 : 1); Magnesium benzoate; Magnesium oxide; Magnesium oxide silicate (Mg 3 0(Si 2 0 5 ) 2 ), monohydrate; Magnesium silicate; Magnesium silicate hydrate; Magnesium silicon oxide (Mg 2 Si 3 0 8 ); Magnesium stearate [Octadecanoic acid, magnesium salt]; Magnesium sulfate; Magnesium sulfate heptahydrate; Malic acid; Malt extract; Malt flavor; Maltodextrin; Methylcellulose [Cellulose, methyl ether]; Mica; Mica-group minerals; Milk; N/A Millet seed; Mineral oil (U.S.P.); l-Monolaurin [Dodecanoic acid, 2,3-dihydroxypropyl ester]; l-Monomyristin [Tetradecanoic acid, 2,
  • Pigment Blue 29 ; Urea; Vanillia; Vermiculite; Vinegar (maximum 8% acetic acid in solution); Vitamin C [L-Ascorbic acid]; Vitamin; Walnut flour; Walnut shells; Wheat; Wheat flour; Wheat germ oil; Whey; White mineral oil (petroleum); Wintergreen oil; Wollastonite (Ca(Si03)); Wool; Xanthan gum; Yeast; Zeolites (excluding erionite (CAS Reg. No. 66733-21-9)); Zeolites, NaA; Zinc iron oxide; Zinc oxide (ZnO); and Zinc stearate [Octadecanoic acid, zinc salt]
  • the systems and methods can comprise instructions for applying an agricultural product via augmented reality.
  • the instructions can provide information for applying the agricultural product in any manner that allows for controlling a plant pest or unwanted vegetation or for improving an agronomic trait of interest of a plant.
  • the presently disclosed systems and methods use augmented reality video to provide instructions for applying the prepared agricultural product to an area of cultivation (for example, via spraying or mixing with soil in an area of cultivation).
  • the augmented reality video provides instructions for applying the prepared agricultural product to the foliage of plants, to the soil, or to a seed (for example, seed coating).
  • the instructions can comprise application of the agricultural product to a plant propagule (e.g., seed, slip, stem cutting, com etc.).
  • the instructions can be for application of the agricultural product to the plant tissue (including fruit) before or after harvest.
  • the instructions via augmented reality can provide information regarding the rate of application of the agricultural product, which may vary according to the pest or weed being targeted, the crop to be protected, the efficacy of the agricultural product, the severity of the disease, the climate conditions, the agronomic trait of interest to improve, and the like.
  • the augmented reality instructions can advise the agricultural professional to apply a single application of the agricultural product to a plant, plant part, or area of cultivation or multiple applications of the agricultural product to a plant, plant part, or area of cultivation.
  • any plant species of interest can be treated with agricultural products using the presently disclosed systems and methods.
  • the term plant includes plant cells, plant protoplasts, plant cell tissue cultures from which plants can be regenerated, plant calli, plant clumps, and plant cells that are intact in plants or parts of plants such as embryos, pollen, ovules, seeds, leaves, flowers, branches, fruit, kernels, ears, cobs, husks, stalks, roots, root tips, anthers, and the like.
  • Grain is intended to mean the mature seed produced by commercial growers for purposes other than growing or reproducing the species.
  • plant species of interest include, but are not limited to, com (Zea mays), Brassica sp. (e.g., B. napus, B. rapa, B.juncea ), particularly those Brassica species useful as sources of seed oil, alfalfa ( Medicago sativa ), rice ( Oryza sativa ), rye ( Secale cereale), sorghum ⁇ Sorghum bicolor, Sorghum vulgare), millet (e.g., pearl millet ⁇ Pennisetum glaucum ), proso millet ⁇ Panicum miliaceum), foxtail millet ( Setaria italica), finger millet ⁇ Eleusine coracana) ), sunflower ⁇ Helianthus annuus), safflower ⁇ Carthamus tinctorius), wheat ⁇ Triticum aestivum), soybean ( Glycine max), tobacco
  • Vegetables include tomatoes ⁇ Lycopersicon esculentum), lettuce (e.g., Lactuca sativa), green beans ⁇ Phaseolus vulgaris), lima beans ⁇ Phaseolus limensis), peas ⁇ Lathyrus spp.), and members of the genus Cucumis such as cucumber (C. sativus), cantaloupe (C. cantalupensis), and musk melon (C. meld).
  • lettuce e.g., Lactuca sativa
  • green beans ⁇ Phaseolus vulgaris
  • lima beans ⁇ Phaseolus limensis lima beans ⁇ Phaseolus limensis
  • members of the genus Cucumis such as cucumber (C. sativus), cantaloupe (C. cantalupensis), and musk melon (C. meld).
  • Ornamentals include azalea ⁇ Rhododendron spp.), hydrangea ( Macrophylla hydrangea), hibiscus ⁇ Hibiscus rosasanensis), roses ⁇ Rosa spp.), tulips ⁇ Tulipa spp.), daffodils ⁇ Narcissus spp.), petunias ⁇ Petunia hybridd), carnation ⁇ Dianthus caryophyllus), poinsettia ⁇ Euphorbia pulcherrima), and chrysanthemum.
  • Conifers that may be employed in practicing the present invention include, for example, pines such as loblolly pine (Pinus taeda ), slash pine (Pinus elliotii ), ponderosa pine ( Pinus ponderosa ), lodgepole pine ⁇ Pinus contorta ), and Monterey pine ⁇ Pinus radiata ); Douglas-fir ⁇ Pseudotsuga menziesii ); Western hemlock ⁇ Tsuga canadensis ); Sitka spruce ⁇ Picea glauca); redwood ⁇ Sequoia sempervirens ); true firs such as silver fir ⁇ Abies amabilis) and balsam fir ⁇ Abies balsamea); and cedars such as Western red cedar ⁇ Thuja plicata ) and Alaska yellow-cedar ⁇ Chamaecyparis nootkatensis).
  • pines such as loblolly
  • plants of the present invention are crop plants (for example, com, alfalfa, sunflower, Brassica , soybean, cotton, safflower, peanut, sorghum, wheat, millet, tobacco, etc.).
  • com and soybean plants are optimal, and in yet other embodiments com plants are optimal.
  • plants of interest include grain plants that provide seeds of interest, oil-seed plants, and leguminous plants.
  • Seeds of interest include grain seeds, such as corn, wheat, barley, rice, sorghum, rye, etc.
  • Oil-seed plants include cotton, soybean, safflower, sunflower, Brassica , maize, alfalfa, palm, coconut, etc.
  • Leguminous plants include beans, peas, and dry pulses. Beans include guar, locust bean, fenugreek, soybean, garden beans, cowpea, mungbean, lima bean, fava bean, lentils, chickpea, etc.
  • a method, implemented by a processor, for providing instructions in augmented reality for agricultural products comprising:
  • detecting whether an agricultural product is present includes employing edge detection and/or line detection algorithms, to determine the presence of a marker on the agricultural product.
  • product branding cues comprise logos, words, images, a packaging shape, colors, or combinations thereof
  • determining the language includes determining a stored language preference of a device and setting the language of the audio track to the stored language.
  • responding to user input comprises rendering an additional animation or modifying a playback of a currently playing animation.
  • responding to the voice commands comprises rendering an additional animation or modifying a playback of a currently playing animation.
  • responding to user input comprises rendering an additional animation or modifying a playback of a currently playing animation.
  • responding to user input comprises rendering an additional animation or modifying a playback of a currently playing animation.
  • responding to the voice commands comprises rendering an additional animation or modifying a playback of a currently playing animation.
  • a computer program product for viewing augmented reality for an agricultural product on a computing device comprising instructions for execution by a processing circuit of the computing device for performing a method of any one of embodiments 1- 39.
  • a mobile device for viewing augmented reality for an agricultural product comprising a non-transitory machine readable storage medium having stored therein instructions that, when executed by a processor, perform a method of any one of embodiments 1-39.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Catching Or Destruction (AREA)

Abstract

Systems and methods for providing instructions in augmented reality for agricultural products are provided. Such methods can include receiving video captured by a camera, detecting whether an agricultural product is present in the captured video and modifying the captured video to include an instructional animation, resulting in an augmented reality video. The augmented reality video can be displayed on a display screen.

Description

AUGMENTED REALITY FOR AGRICULTURAL USE
FIELD OF THE INVENTION
The invention is drawn to methods and systems for using augmented reality for agricultural products. The methods and systems can provide instructions regarding the preparation and/or application of an agricultural product. The methods and systems can also determine an area of coverage of the agricultural product and diagnose agricultural ailments and determine corrective action.
BACKGROUND
Agricultural products, for example herbicides, pesticides, and fertilizers, can require expertise and knowledge to use properly. In some cases, the agricultural product may require mixing with a solvent or carrier prior to being applied onto plants or an area of cultivation. Thus, following instructions in the preparation and application of the agricultural product may be critical in ensuring the effectiveness of such treatment.
In the field, however, many issues can complicate the use of agricultural products. There is a limit to the number of instructions to include with packaging (typically a combination of text and pictures), before the instructions become illegible or bury the user in details. Furthermore, agricultural professionals may speak a variety of languages. Therefore, there is a need to provide dynamic instructions in a variety of languages.
Although many products may describe how much coverage (in area) that a package can provide (for example, 50 square yards), it is often difficult to visualize how much coverage can be achieved, especially if an agricultural professional does not know the exact area of the crop field. Therefore, there is a need to provide an agricultural professional with a visual indication of how much coverage can be achieved with the amount of agricultural product contained in a package (or another known amount).
In some cases, an agricultural professional may want to diagnose an unhealthy and potentially diseased or infected crop. Thus, there is also a need to diagnose unhealthy crops and determine a proper product for treatment (for example, an insecticide, or fungicide).
BRIEF DESCRIPTION OF THE DRAWINGS
Embodiments of the disclosure are illustrated by way of example and not limitation in the figures of the accompanying drawings in which like references indicate similar elements.
Figure l is a block diagram illustrating a device according to one embodiment.
Figure 2 is an illustration of a device and augmented reality video according to one embodiment.
Figure 3 is an illustration of a device and augmented reality video according to one embodiment.
Figure 4 is a flow diagram of a method according to one embodiment.
SUMMARY
Methods and systems for using augmented reality for agricultural products are provided herein. Generally, a method, implemented by a processor, for providing instructions in augmented reality for agricultural products, comprises: receiving video captured by a camera; detecting whether an agricultural product is present in the captured video; based on a positive detection of the agricultural product, modifying the captured video to include an instructional animation, resulting in an augmented reality video; and displaying the augmented reality video on a display screen.
In another aspect, a method, implemented by a processor, for showing an area of coverage of an agricultural product in augmented reality, comprises: receiving video captured by a camera; detecting and characterizing a surface area of an area of cultivation in the captured video;
computing an area of coverage of an agricultural product; and projecting the area of coverage onto the video of the area of cultivation, resulting in an augmented reality video; and displaying the augmented reality video on a display screen.
Also provided herein are methods for diagnosing a plant and providing a plan for treatment of the plant using a processor. In some embodiments, such a method comprises: receiving video captured by a camera; detecting a plant in the captured video; characterizing the type of plant in the video; determining whether the plant has one or more ailments; identifying an agricultural product for treatment of the plant based on the one or more determined ailments; generating an animation including the agricultural product; modifying the captured video to include the generated animation, resulting in an augmented reality video; and displaying the augmented reality video on a display screen.
Systems (e.g., machines and articles of manufacture) for performing the presently disclosed methods are also provided. For example, a system or computer program product for viewing augmented reality for an agricultural product on a computing device is provided, wherein the computer program product comprises instructions for execution by a processing circuit for performing any of the presently disclosed methods. A mobile device for viewing augmented reality for an agricultural product is provided. The mobile device comprises a non-transitory machine readable storage medium having stored therein instructions that, when executed by a processor, perform any of the presently disclosed methods. In some embodiments, the instructions are stored in memory on a networked server, and are retrieved through the network by the mobile device and loaded into the non-transitory machine readable storage medium, to be executed by the processor.
DETAILED DESCRIPTION
The present inventions now will be described more fully hereinafter with reference to the accompanying drawings, in which some, but not all embodiments of the inventions are shown.
Indeed, these inventions may be embodied in many different forms and should not be construed as limited to the embodiments set forth herein; rather, these embodiments are provided so that this disclosure will satisfy applicable legal requirements. Like numbers refer to like elements throughout.
Many modifications and other embodiments of the inventions set forth herein will come to mind to one skilled in the art to which these inventions pertain having the benefit of the teachings presented in the foregoing descriptions and the associated drawings. Therefore, it is to be understood that the inventions are not to be limited to the specific embodiments disclosed and that modifications and other embodiments are intended to be included within the scope of the appended claims. Although specific terms are employed herein, they are used in a generic and descriptive sense only and not for purposes of limitation.
7. _ Augmented Reality and Devices for Viewing the Same
The systems and methods comprise the use of augmented reality to provide information regarding an agricultural product. Augmented reality or an augmented reality video, as used herein, describes a video displayed in real-time that shows a captured video altered by an animation and/or audio track. The augmented reality video maintains original artifacts of the captured environment, but contains additional artifacts, for example, animations and audio tracks added to and modifying the original captured video.
A video, as used herein, describes a series of images in a sequence, for example, a sequence of images captured by a camera, such as one in a mobile device. Thus, in some embodiments, the presently disclosed methods can be implemented by a mobile device comprising a camera. A mobile device, as used herein, describes a processor based electronic device that includes an input/output (I/O) module, for example, a touch-screen display. Mobile devices can include audio input and output and a communication unit, for example, a wireless 4G transceiver, Wi-Fi, and other equivalent communication technologies now known or later developed. Mobile devices include phones, tablets, and watches.
The video captured by the camera is in real-time. Real-time, as used herein, refers to processing a video stream while the video is being captured by the camera, with minimal delay (for example, notwithstanding buffering and processing delays).
In some embodiments, the augmented reality comprises animations that are added to the real-time captured video. Animation, as used herein, describes a rendering of moving or still artifacts (for example, depictions of an agricultural product, being mixed with a solvent, with an accompanying audio track describing formulation ratios, preparation steps, temperatures, etc). Other examples can include an animation of a logo or mascot found on packaging (for example, a logo of a wolf) brought to life and giving verbal instructions relating to the usage of a
corresponding agricultural product. Another animation can include an animated nozzle shown spraying plants with a mixture of the agricultural product. Another animation can show steps of applying the agricultural product to soil or coating seeds with the agricultural product. Animations can include audio and visual artifacts generated by the processor in real-time or stored in memory on the device or on a network that are retrieved by the processor to generate animations.
Alternatively or additionally, whole animations (audio and visual artifacts) can be stored in memory capable of being retrieved and used by the processor.
A processor, as used herein, describes logic circuitry that responds to and processes instructions that drive an electronic device, for example, a desktop computer or mobile device (e.g., a mobile phone with touchscreen display or a tablet). It should be understood that a processor can be more than one processor acting in a coordinated effort to respond to and process machine instructions.
A. Camera
Referring now to Figure 1, in one embodiment, a device 100 for providing augmented reality information for agricultural products can include one or more cameras 140, configured to capture images and video. The camera can communicate to the processor 150 a video stream 142 (or stream of images) in real-time.
Camera 140 can be a 2D camera, for example, a standard video camera or a standard digital video camera. Alternatively or additionally, the camera can be a 3D camera with depth sensing, for example, infrared, laser projection, multiple lenses (range imaging or stereo camera) or combinations thereof.
B. Database and Memory
The device can include memory and/or one or more database(s) 152 that can contain one or more markers, for example, two dimensional planar patterns. The markers can be high contrast, for example, bi-tonal, for improved detection. Such markers can be used, for example, in fiducial marker systems of the device. Fiducial marker systems consist of markers that are mounted in the environment and automatically detected in camera images by the processor, using known detection algorithm, as described further below.
Alternatively or additionally, the database can include one or more references of logo or text-based markers, also capable of being detected by the processor. The database can also include 2D and 3D models of agricultural products and packaging. The models can be used for object detection (for example, through computer vision and comparing and matching objects in captured video) and/or generation of animations that may include the models, rendered over captured video, resulting in augmented reality video.
In some embodiments, the device memory can store GPS location or use patterns (based on year, time of day, and more).
C. Computer Vision and Marker Detection
The processor can also include a computer vision module 156, configured to perform scene reconstruction, event detection, video tracking, object recognition, 3D pose estimation, learning, indexing, motion estimation, image restoration, and other known computer vision techniques based on the captured video 142.
The processor can apply the computer vision techniques described above to analyze the captured video and identify objects such as agricultural products and packaging, plants and an area of cultivation, and orientations and positions of such, in a field. In this manner, the processor can be configured to process the captured video to determine whether an agricultural product (for example, a powder in a recognized package) is present in the captured video. In other words, the
determination of an agricultural product in the captured video can be made based on image or object recognition, and/or other techniques capable of being implemented by one skilled in the art of computer vision, to detect the agricultural product.
Alternatively, or additionally, the processor can identify and/or track one or more markers described above with a marker recognizer 154. The processor can determine whether an indicator is present using marker detection methods, including, for example, edge detection and line detection, to determine the presence of a marker, and the surface orientation of which the marker is laying. Similarly, the processor can continuously track the marker as it moves in the captured video. The marker can be a two-dimensional planar pattern (for example, a QR code), a bi-tonal marker, a text- based marker, a logo, or combinations thereof.
I). Augmented Reality Video and Display
Based on the detection of an agricultural product and/or of a marker in the captured video, the processor can generate an augmented reality video 132 by rendering an animation to be included in the captured video (for example, overlaid on the captured video). The processor can be configured to render animations based on corresponding cues/indications (e.g., different markers or objects detected in captured video). For example, depending on the detected marker or agricultural product, the processor can select and render a corresponding animation based on a lookup table or other known data structure (e.g., a dictionary, array, or a database).
The processor can display the augmented reality video 132 for example, on one or more displays 130. The display can be, for example, an LCD, OLED, or other comparable display technology now known or later developed. The display can be integrated into the device (for example, a touch-screen display on a mobile device), such that an agricultural professional can advantageously use the device to generate augmented reality instructions while being in the field.
E. Communications
The processor can communicate to servers 104 through a network 102. From the network, the processor can retrieve and transmit information such as, for example, 2D markers, 3D models, actionable voice commands, the instructional animations or updates thereto. The processor can also communicate to a server on a network a GPS location or use patterns (based on year, time of day, and more). The processor or device can download, from a server on the network, a computer program (for example, a mobile app) and install the program into memory of the device and register, if necessary, the application with an operating system of the device, so that the program is capable of being executed by the device and/or by the operating system of the device. The processor can communicate with the network through communications 160, which can include, for example, Wi-Fi, 3G, 4G, GSM, or equivalent communication technologies now known or later developed.
F. Instructional Animations
Referring now to Figure 2, the animation can include a visual instruction of how to prepare the agricultural product detected in the captured video. For example, the augmented reality video 232 can show mixing an agricultural product (e.g., a powder or liquid agricultural product) 233 with a solvent or carrier (e.g., water) 234. The processor can generate or play a previously generated audio track 211 from speakers 210 simultaneously with the animation. The audio track can describe instructions that accompany the animation, for example, the ratio of the agricultural product to solvent/carrier.
Similar to that shown in Figure 2, the animation can include, for example, a visual instruction of applying the agricultural product as a seed coating, directly to soil or an area of cultivation, or to a plant, including dosage rates, formulations, temperature conditions, or other restrictions and steps. As described above, an accompanying audio track can be played by the processor through the speakers. The audio track can relate to the instructions shown in the animation. For example, the audio track of the animation can narrate the same instructions visually shown in the animation.
In some embodiments, the presently disclosed methods further comprise determining a language of an audio track of the animation. In some of these embodiments, this step comprises determining a stored language preference of a device, for example, in device memory, and setting the language of the audio track to the stored language.
Thus, the animated instructions can visually show and describe (via audio), preparation and application steps, restrictions, labeled uses, active ingredients, dose rates, additives, and formulations. In this manner, agricultural professionals in the field will be instructed on the proper method or methods of preparation and/or application of the product, based on the augmented reality video.
In some embodiments, methods, implemented by a processor, for providing instructions in augmented reality for agricultural products comprise receiving video captured by a camera, detecting whether an agricultural product is present in the captured video, and based on a positive detection of the agricultural product, modifying the captured video to include an instructional animation, resulting in an augmented reality video, and then displaying the augmented reality video on a display screen.
In one embodiment, a method 400 is shown in Figure 4, for providing instructions in augmented reality for agricultural products. The method can include: 410 receiving video captured by a camera, 420 detecting whether an agricultural product is present in the captured video, 430 modifying the captured video to include an instructional animation, and 440 displaying the augmented reality video on a display screen.
The methods, described herein, can be performed, by a processor of a mobile device, as described herein. Additionally, it is to be understood that the components of the device 100 and the processor 150 are shown separately for illustrative purposes but can, in some cases, have combined functionality.
G. Area of Coverage Animations
Alternatively or additionally, the processor can indicate, in the augmented reality video, a potential coverage area of a particular amount of the agricultural product, for example, the amount present in the package that was detected by the device through the captured video. For example, referring now to Figure 3, a user can point the camera of the device 300 to an area of cultivation 30. The processor can detect and characterize the surface area of the area of cultivation, compute the area of coverage of the agricultural product, and then project the area of coverage 333 onto the image or video of the area of cultivation. The area of coverage 333 can be indicated, for example, by rendering an outline of the area on the augmented reality video, or by adjusting the opacity, color, brightness, or other visual attribute of the area of coverage, to distinguish it from the surrounding area. An audio track of 311 can describe the area of coverage in, for example, "50 square yards per 15lb package of product" through speaker(s) 310.
The area of coverage can be computed based on a detected amount of the agricultural product found in the captured video, for example, based on the detected packaging or on a detected marker. Alternatively or additionally, the amount of agricultural product can be input by the user, for example, through voice commands or through a keypad on the device. The processor can then reference a database to determine the area of coverage based on the product type and the amount of the product.
In some embodiments, methods, implemented by a processor, for showing an area of coverage of an agricultural product in augmented reality comprise receiving video captured by a camera, detecting and characterizing a surface area of an area of cultivation in the captured video, computing an area of coverage of an agricultural product, projecting the area of coverage onto the video of the area of cultivation, resulting in an augmented reality video, and displaying the augmented reality video on a display screen.
As used herein, an“area of cultivation” comprises any region in which one desires to grow a plant. Such areas of cultivations include, but are not limited to, a field in which a plant is cultivated (such as a crop field, a sod field, a tree field, a managed forest, a field for culturing fruits and vegetables, etc.), a greenhouse, a growth chamber, etc.
H. Diagnosing and Treating Plant A ilments
Additionally or alternatively, the processor can receive captured video of a plant. Based on the captured video of the plant, the processor can determine whether the plant in the captured video is unhealthy and/or infected by insects, fungi, or other pests. In one embodiment, the processor can use, for example, computer vision, in connection with trained neural networks, for example, trained deep neural networks or convolutional neural networks, to make the determination. The trained neural networks can be trained with images of plants afflicted with various pests or other plant ailments. Thus, the trained neural networks can diagnose the plant in the captured video by comparing it to the images that the neural network has been trained through. The trained neural networks can be located in the device's database or memory, or on external servers accessible through the network. Based on the diagnosis of the plant, the processor can then prescribe an agricultural product and plan to treat the infected plant, through an audio track and/or through a message/animation displayed on the screen.
In some embodiments, methods, implemented by a processor, for diagnosing and providing a plan for treatment of a plant comprise receiving video captured by a camera, detecting a plant in the captured video, characterizing the type of plant in the video, determining whether the plant has one or more ailments, identifying an agricultural product and treatment for the plant based on the one or more determined ailments, generating an animation including the agricultural product, modifying the captured video to include the generated animation, resulting in an augmented reality video, and displaying the augmented reality video on a display.
L _ User Interface
Alternatively or additionally to the animation, the processor can generate a user interface and overlay the user interface over the captured video. Referring now to Figure 2, a user interface 270 can include selectable options. For example, a replay button, when pressed, can replay an animation and accompanying audio track. In response to the "seed coating" button press, the processor can generate animated seed coating instructions with accompanying audio track.
Similarly, in response to "spraying", the processor can generate spraying instructions with accompanying audio track. If the user wishes to compute the area of coverage, the user can press the "coverage" button. The processor can, based on the coverage request, detect and characterize the surface area of a field shown in the camera (as described above). The user can then pan to an area of cultivation of interest, as described above. In this manner, the agricultural professional can select different preparation and application options to receive instructions for, replay the instructions, and determine the area of coverage, with the device.
Alternatively or additionally, the processor can include a voice-based audio command interface. Referring back to Figure 1, the processor can receive an audio stream through a microphone 120 and use known speech detection and natural language processing modules 158 (for example, known application programming interfaces (APIs) and libraries), capable of detecting actionable voice commands in the audio stream. The processor can then determine a course of action, for example, replaying an animation or generating an animation for a particular preparation and/or application (for example, mixing a formulation of the agricultural product, coating a seed, or applying the product to an area of cultivation), based on the detected actionable voice command.
J _ Systems for Viewing Augmented Reality
A computer program product, comprising instructions that embody the methods described herein, for viewing augmented reality for an agricultural product on a computing device is provided. In some embodiments, the computer program product is designed to run on a mobile device (i.e., a mobile application or“app”). Such a mobile app can be designed to function with certain mobile operating systems, such as Apple iOS, Google Android, Samsung’s Bada, Research in Motion’s BlackBerry OS, and Microsoft’s Windows Mobile. In those embodiments wherein the computer program product is a mobile app, the methods provided herein further comprise a step of downloading and installing the mobile app on a mobile device prior to use thereof. In some of these embodiments, the packaging of the agricultural product provides instructions for downloading such a mobile app (e.g., where the mobile app can be found, such as an app store). In certain embodiments, the instructions for downloading and installing the mobile app are provided in multiple languages on the agricultural product packaging.
A mobile device for viewing augmented reality for an agricultural product is provided. The mobile device comprises a non-transitory machine readable storage medium having stored therein instructions that, when executed by a processor, perform any of the presently disclosed methods. In some embodiments, the instructions are stored in memory on a networked server, and are retrieved through the network by the mobile device and loaded into the non-transitory machine readable storage medium, to be executed by the processor.
Figure imgf000012_0001
As used herein, an“agricultural product” is any product that can be applied to a plant or area of cultivation in order to control a plant pest or unwanted vegetation in an area of cultivation (e.g., weed) or improve at least one agronomic trait of interest of a plant.
A. _ Types of Agricultural Products
The agricultural product can be naturally-occurring or synthetic, a biologic (i.e., a preparation made from living organisms or their products) or a chemical. In those embodiments wherein the agricultural product is a biologic, the biologic can be purified from nature, recombinantly produced, or a transgenic organism. In some embodiments, the agricultural product is a microorganism, such as bacteria, that controls a plant pest or unwanted vegetation or improves at least one agronomic trait of interest of a plant. In certain embodiments, the agricultural product is the Pseudomonas chlororaphis strain deposited at National Center for Agricultural Utilization Research Agricultural Research Service, U.S. Department of Agriculture, 1815 North University Street, Peoria, Illinois 61604 U.S. A. on January 31, 2014 and assigned NRRL No. B-50897 (see, for example, U.S. Pat. No. 9,795,144, which is herein incorporated by reference in its entirety).
Agronomic traits of interest include any trait that improves plant health or commercial value. Non-limiting examples of agronomic traits of interest including increase in biomass, increase in drought tolerance, thermal tolerance, herbicide tolerance, drought resistance, pest resistance (e.g., nematode resistance, insect resistance, fungus resistance, virus resistance, bacteria resistance), male sterility, cold tolerance, salt tolerance, increased yield, enhanced nutrient use efficiency, increased nitrogen use efficiency, increased tolerance to nitrogen stress, increased fermentable carbohydrate content, reduced lignin content, increased antioxidant content, enhanced water use efficiency, increased vigor, increased germination efficiency, earlier or increased flowering, increased biomass, altered root-to-shoot biomass ratio, enhanced soil water retention, or a combination thereof. In other instances, the agronomic trait of interest includes an altered oil content, altered protein content, altered seed carbohydrate composition, altered seed oil composition, and altered seed protein composition, chemical tolerance, cold tolerance, delayed senescence, disease resistance, drought tolerance, ear weight, growth improvement, health enhancement, heat tolerance, herbicide tolerance, herbivore resistance, improved nitrogen fixation, improved nitrogen utilization, improved root architecture, improved water use efficiency, increased biomass, increased root length, increased seed weight, increased shoot length, increased yield, increased yield under water- limited conditions, kernel mass, kernel moisture content, metal tolerance, number of ears, number of kernels per ear, number of pods, nutrition enhancement, photosynthetic capability improvement, salinity tolerance, stay-green, vigor improvement, increased dry weight of mature seeds, increased fresh weight of mature seeds, increased number of mature seeds per plant, increased chlorophyll content, increased number of pods per plant, increased length of pods per plant, reduced number of wilted leaves per plant, reduced number of severely wilted leaves per plant, and increased number of non-wilted leaves per plant, a detectable modulation in the level of a metabolite, a detectable modulation in the level of a transcript, or a detectable modulation in the proteome relative to a reference plant. In particular embodiments, the agronomic trait of interest that is improved by the agricultural product is improved plant health. By“improved plant health” is meant increased growth and/or yield of a plant, increased stress tolerance and/or decreased herbicide resistance, to name a few. Increased stress tolerance refers to an increase in the ability of a plant to decrease or prevent symptoms associated with one or more stresses. The stress can be a biotic stress that occurs as a result of damage done to plants by other living organisms such as a pest (for example, bacteria, viruses, fungi, parasites, insects, nematodes, weeds, cultivated or native plants). The stress can also be an abiotic stress such as extreme temperatures (high or low), high winds, drought, salinity, chemical toxicity, oxidative stress, flood, tornadoes, wildfires, radiation and exposure to heavy metals.
In one non-limiting embodiment, the agricultural product used in the presently disclosed systems and methods can be useful for any plant species susceptible to a plant pest or at risk of developing a plant disease or damage caused by a plant pest.
In some embodiments, the agricultural product is an herbicide, pesticide, or a fertilizer. As used herein, an herbicide controls unwanted vegetation (e.g., weeds) in an area of cultivation. As used herein, a pesticide controls plant pests or protects a plant from a plant pest. The term “controlling” unwanted vegetation or a plant pest refers to one or more of inhibiting or reducing the growth, feeding, fecundity, reproduction and/or proliferation of unwanted vegetation or a plant pest or killing (e.g., causing the moribidity or mortality, or reduced fecundity) of unwanted vegetation or a plant pest.
As used herein, a fertilizer is any natural or synthetic material that can be applied to soil or to plant tissues to supply one or more plant nutrients essential to the growth of plants. Non-limiting examples of fertilizers that can be used in the presently disclosed systems and methods include those that deliver nitrogen, phosphorous, potassium, calcium, magnesium, sulfur, copper, iron, manganese, molybdenum, zinc, boron, silicon, cobalt, and/or vanadium. The fertilizer can be organic or synthetic.
In specific embodiments, the agricultural product is a pesticide that targets one or more plant pests. The term“pests” includes but is not limited to, insects, fungi, bacteria, nematodes, viruses or viroids, protozoan pathogens, and the like. In specific embodiments, the agricultural product is a pesticide that targets one or more insect or insect pests. The term "insects" or“insect pests” as used herein refers to insects and other similar pests such as, for example, those of the order Coleoptera including, but not limited to Agriotes spp., Anthonomus spp., Atomaria linearis, Chaetocnema tibialis, Cosmopolites spp., Curculio spp., Dermestes spp., Epilachna spp., Eremnus spp., Leptinotarsa decemlineata, Lissorhoptrus spp., Melolontha spp., Orycaephilus spp.,
Otiorhynchus spp., Phlyctinus spp., Popillia spp., Psylliodes spp., Rhizopertha spp., Scarabeidae, Sitophilus spp., Sitotroga spp., Tenebrio spp., Tribolium spp. and Trogoderma spp. In specific embodiments, Coleoptera insects include, but are not limited to weevils from the families
Anthribidae, Bruchidae, and Curculionidae (e.g., sweetpotato weevil ( Cylas formicarius
(Fabricius)), boll weevil ( Anthonomus grandis Boheman), rice water weevil (. Lissorhoptrus oryzophilus Kuschel), rice weevil {Sitophilus oryzae L.)); flea beetles, cucumber beetles, rootworms, leaf beetles, potato beetles, and leafminers in the family Chrysomelidae (e.g., Colorado potato beetle {Leptinotarsa decemlineata Say), western com rootworm {Diabrotica virgifera virgifera LeConte)); chafers and other beetles from the family Scaribaeidae (e.g., Japanese beetle {Popillia japonica Newman) and European chafer {Rhizotrogus majalis Razoumowsky));
wireworms from the family Elateridae and bark beetles from the family Scolytidae.
As disclosed herein, insect pests include Coleoptera pests of the corn rootworm complex: Western corn rootworm, Diabrotica virgifera virgifera ; northern com rootworm, I) barbery Southern com rootworm or spotted cucumber beetle, Diabrotica undecimpunctata howardy and the Mexican com rootworm, D. virgifera zeae. In specific embodiments, the insect pest is Western com rootworm, Diabrotica virgifera virgifera.
The agricultural products can also be used against Hemiptera such as Lygus hesperus , Lygus lineolaris , Lygus pratensis , Lygus rugulipennis Popp , Lygus pabulinus , Calocoris norvegicus , Orthops compestris , Plesiocoris rugicollis , Cyrtopeltis modestus , Cyrtopeltis notatus ,
Spanagonicus albofasciatus , Diaphnocoris chlorinonis , Labopidicola allii , Pseudatomoscelis seriatus , Adelphocoris rapidus , Poecilocapsus lineatus , Blissus leucopterus , Nysius ericae , Nysius raphanus , Euschistus servus, Nezara viridula , Eurygaster, Coreidae, Pyrrhocoridae, Tinidae, Blostomatidae, Reduviidae, Cimicidae; Aleurocanthus woglumi , citrus blackfly; Aleyrodes proletella , cabbage whitefly; Bemisia argentifolii , silverleaf whitefly; Trialeurodes vaporariorum , greenhouse whitefly, and Bemisia tabaci , sweet potato whitefly.
Insect pests of interest also include Araecerus fasciculatus , coffee bean weevil;
Acanthoscelides obtectus , bean weevil; Bruchus rufmanus , broadbean weevil; Bruchus pisorum , pea weevil; Zabrotes subfasciatus , Mexican bean weevil; Diabrotica balteata , banded cucumber beetle; Cerotoma trifurcata , bean leaf beetle; Diabrotica virgifera , Mexican corn rootworm; Epitrix cucumeris , potato flea beetle; Chaetocnema confmis , sweet potato flea beetle; Hypera postica , alfalfa weevil; Anthonomus quadrigibbus , apple curculio; Sternechus paludatus , bean stalk weevil; Hypera brunnipennis , Egyptian alfalfa weevil; Sitophilus granaries , granary weevil; Craponius inaequalis , grape curculio; Sitophilus zeamais , maize weevil; Conotrachelus nenuphar , plum curculio; Euscepes postfaciatus , West Indian sweet potato weevil; Maladera castanea , Asiatic garden beetle; Rhizotrogus majalis , European chafer; Macrodactylus suhspinosus , rose chafer; Tribolium confusum , confused flour beetle; Tenebrio obscurus , dark mealworm; Tribolium castaneum , red flour beetle; Tenebrio molitor , yellow mealworm and the family Drosophilidae including Drosophila suzukii , spotted wing drosophila.
Insect pests that can be controlled with the agricultural products used in the systems and methods disclosed herein further include insects of the order Lepidoptera, e.g. Achoroia grisella , Acleris glover ana, Acleris van ana, Adoxophyes or ana, Agrotis ipsilon, Alabama argillacea, Alsophila pometaria, Amyelois transitella, Anagasta kuehniella, Anarsia lineatella, Anisota senatoria, Antheraea pernyi, Anticar sia gemmatalis, Archips sp., Argyrotaenia sp., Athetis mindara, Bombyx mori, Bucculatrix thurberiella, Cadra cautella, Choristoneura sp., Cochylls hospes, Colias eurytheme, Corcyra cephalonica, Cydia latiferreanus, Cydia pomonella, Datana integerrima, Dendrolimus sibericus, Desmiafeneralis, Diaphania hyalinata, Diaphania nitidalis, Diatraea grandiosella, Diatraea saccharalis, Ennomos subsignaria, Eoreuma loftini, Esphestia elutella, Erannis tilaria, Estigmene acrea, Eulia salubricola, Eupocoellia ambiguella, Eupoecilia ambiguella, Euproctis chrysorrhoea, Euxoa messoria, Galleria mellonella, Grapholita molesta, Harrisina americana, Helicoverpa subflexa, Helicoverpa zea, Heliothis virescens, Hemileuca oliviae, Elomoeosoma electellum, Hyphantia cunea, Keiferia lycopersicella, Lambdina fiscellaria fiscellaria, Lambdina fiscellaria lugubrosa, Leucoma salicis, Lobesia botrana, Loxostege sticticalis, Lymantria dispar, Macalla thyrisalis, Malacosoma sp., Mamestra brassicae, Mamestra configurata, Manduca quinquemaculata, Manduca sexta, Maruca testulalis, Melanchra picta, Operophtera brumata, Orgyia sp., Ostrinia nubilalis, Paleacrita vernata, Papilio cresphontes, Pectinophora gossypiella, Phryganidia californica, Phyllonorycter blancardella, Pieris napi, Pieris rapae, Plathypena scabra, Platynota flouendana, Platynota stultana, Platyptilia carduidactyla, Plodia inter punctella, Plutella xylostella, Pontia protodice, Pseudaletia unipuncta, Pseudoplasia includens, Sabulodes aegrotata, Schizura concinna, Sitotroga cerealella, Spilonta ocellana, Spodoptera sp., Thaurnstopoea pityocampa, Tinsola bisselliella, Trichoplusia hi, Tuta absoluta, Udea rubigalis, Xylomyges curiails, and Yponomeuta padella.
Insect pests also include insects selected from the orders Diptera, Hymenoptera,
Mallophaga, Homoptera, Hemiptera, Orthroptera, Thysanoptera, Dermaptera, Isoptera, Anoplura, Siphonaptera, and Trichoptera. Insect pests that can be controlled using methods and systems of the present invention can further include those of the order Acari including, but not limited to, mites and ticks. In specific embodiments, Coleoptera pests or Coleopteran pests include Western corn rootworm, Colorado potato beetle, and/or sweet potato weevil.
Insect pests that can be targeted by the agricultural products used in the presently disclosed methods and systems for the major crops include, but are not limited to: Maize: Ostrinia nubilalis , European com borer; Agrotis ipsilon , black cutworm; Helicoverpa zeae , com earworm; Spodoptera frugiperda , fall armyworm; Diatraea grandiose I la, southwestern com borer; Elasmopalpus lignosellus , lesser cornstalk borer; Diatraea saccharalis , surgarcane borer; western corn rootworm, e.g., Diabrotica virgifera virgifera, northern corn rootworm, e.g., Diabrotica longicornis barberi ; southern com rootworm, e.g., Diabrotica undecimpunctata howardi ; Melanotus spp., wireworms; Cyclocephala borealis , northern masked chafer (white grub); Cyclocephala immaculata , southern masked chafer (white grub); Popillia japonica , Japanese beetle; Chaetocnema pulicaria , corn flea beetle; Sphenophorus maidis , maize billbug; Rhopalosiphum maidis , corn leaf aphid; Anuraphis maidiradicis , corn root aphid; Myzu persicae, green peach aphid; Nezara viridula, southern green stink bug; Blissus leucopterus leucopterus , chinch bug; Melanoplus femurrubrum , redlegged grasshopper; Melanoplus sanguinipes , migratory grasshopper; Hylemya platura , seedcorn maggot; Agromyza parvicornis , com blotch leafminer; Anaphothrips obscrurus , grass thrips; Solenopsis milesta , thief ant; Tetranychus urticae , two spotted spider mite; Sorghum: Chilo partellus , sorghum borer; Spodoptera frugiperda , fall armyworm; Helicoverpa zea , corn earworm; Elasmopalpus lignosellus , lesser cornstalk borer; Feltia subterranea , granulate cutworm; Phyllophaga crinita , white grub; Eleodes, Conoderus , and Aeolus spp., wireworms; Oulema melanopus , cereal leaf beetle; Chaetocnema pulicaria , corn flea beetle; Sphenophorus maidis , maize billbug;
Rhopalosiphum maidis ; corn leaf aphid; Sipha flava, yellow sugarcane aphid; chinch bug, e.g., Blissus leucopterus leucopterus ; Contarinia sorghicola, sorghum midge; Tetranychus
cinnabarinus , carmine spider mite; Tetranychus urticae , two-spotted spider mite; Wheat:
Pseudaletia unipunctata , armyworm; Spodoptera frugiperda , fall armyworm; Elasmopalpus lignosellus , lesser cornstalk borer; Agrotis orthogonia, pale western cutworm; Elasmopalpus lignosellus , lesser cornstalk borer; Oulema melanopus , cereal leaf beetle; Hypera punctata , clover leaf weevil; southern corn rootworm, e.g., Diabrotica undecimpunctata howardi ; Russian wheat aphid; Schizaphis graminum , greenbug; Macrosiphum avenae, English grain aphid; Melanoplus femurrubrum , redlegged grasshopper; Melanoplus differentials, differential grasshopper;
Melanoplus sanguinipes , migratory grasshopper; Mayetiola destructor , Hessian fly; Sitodiplosis mosellana , wheat midge; Meromyza americana , wheat stem maggot; Hylemya coarctata , wheat bulb fly; Frankliniella fusca , tobacco thrips; Cephus cinctus , wheat stem sawfly; Aceria tulipae , wheat curl mite; Sunflower: Cylindrocupturus adspersus, sunflower stem weevil; Smicronyx fulus , red sunflower seed weevil; Smicronyx sordidus , gray sunflower seed weevil; Suleima helianthana , sunflower bud moth; Homoeosoma electellum , sunflower moth; Zygogramma exclamationis , sunflower beetle; Bothyrus gibbosus , carrot beetle; Neolasioptera murtfeldtiana , sunflower seed midge; Cotton: Heliothis virescens, tobacco budworm; Helicoverpa zea , cotton bollworm;
Spodoptera exigua, beet armyworm; Pectinophora gossypiella, pink bollworm; boll weevil, e.g., Anthonomus grandis; Aphis gossypii , cotton aphid; Pseudatomoscelis seriatus , cotton fleahopper; Trialeurodes abutilonea , banded winged whitefly; Lygus lineolaris , tarnished plant bug;
Melanoplus femurrubrum , redlegged grasshopper; Melanoplus differentialis , differential grasshopper; Thrips tabaci , onion thrips; Frankliniella fusca , tobacco thrips; Tetranychus cinnabarinus , carmine spider mite; Tetranychus urticae , two-spotted spider mite; Rice: Diatraea saccharalis , sugarcane borer; Spodoptera frugiperda , fall armyworm; Helicoverpa zea , com earworm; Colaspis brunnea , grape colaspis; Lissorhoptrus oryzophilus , rice water weevil;
Sitophilus oryzae, rice weevil; Nephotettix nigropictus , rice leafhopper; chinch bug, e.g., Blissus leucopterus leucopterus ; Acrosternum hilare , green stink bug; Soybean: Pseudoplusia includens , soybean looper; Anticar sia gemmatalis , velvetbean caterpillar; Plathypena scabra, green cloverworm; Ostrinia nubilalis , European com borer; Agrotis ipsilon , black cutworm; Spodoptera exigua , beet armyworm; Heliothis virescens , tobacco budworm; Helicoverpa zea , cotton bollworm; Epilachna varivestis, Mexican bean beetle; Myzus persicae , green peach aphid; Empoasca fabae , potato leafhopper; Acrosternum hilare , green stink bug; Melanoplus femurrubrum , redlegged grasshopper; Melanoplus differentialis , differential grasshopper; Hylemya platura , seedcorn maggot; Sericothrips variabilis , soybean thrips; Thrips tabaci , onion thrips; Tetranychus turkestani , strawberry spider mite; Tetranychus urticae , two-spotted spider mite; Barley: Ostrinia nubilalis , European com borer; Agrotis ipsilon , black cutworm; Schizaphis graminum , greenbug; chinch bug, e.g., Blissus leucopterus leucopterus ; Acrosternum hilare , green stink bug; Euschistus servus, brown stink bug; Jylemya platura , seedcorn maggot; Mayetiola destructor , Hessian fly; Petrobia latens , brown wheat mite; Oil Seed Rape: Vrevicoryne brassicae, cabbage aphid; Phyllotreta cruciferae , crucifer flea beetle; Phyllotreta striolata , striped flea beetle; Phyllotreta nemorum , striped turnip flea beetle; Meligethes aeneus , rapeseed beetle; and the pollen beetles Meligethes rufimanus , Meligethes nigrescens, Meligethes canadianus , and Meligethes viridescens Potato:
Leptinotarsa decemlineata , Colorado potato beetle; Sweet potato: Spartocera batatas, giant sweet potato bug; Charidotella (=Metriona) bicolor, golden tortoise beetle; Cylas formicarius , sweet potato weevil; ( y/as puncticollis, sweet potato weevil; ( y/as brunneus, sweet potato weevil Naupactus (=Graphognathus) spp ., whitefringed beetles; Conoderus rudis, wireworm; Conoderus scissus, peanut wireworm; Blosyrus spp., rough sweet potato weevil; Acraea acerata, sweet potato butterfly; Agrius convolvuli, sweet potato hornworm; Spodoptera exigua, armyworm; Spodoptera eridania , armyworm; Synanthedon spp., clearwing moth; Hairiness and eriophyid mites; Euscepes postfasciatus, West Indian sweetpotato weevil; Peloropus batatae, Peloropus weevil; Omphisia anastomasalis, sweet potato stemborer, and white grubs- larvae of various species of scarabid beetles.
The term "insect" encompasses eggs, larvae, juvenile and mature forms of insects. Insects can be targeted at any stage of development. For example, insects can be targeted after the first instar, during the second instar, third instar, fourth instar, fifth instar, or any other developmental or adult growth stage. As used herein, the term“instar” is used to denote the developmental stage of the larval or nymphal forms of insects.
In some embodiments, the agricultural products used in the systems and methods provided herein control nematode plant pests. Nematodes include parasitic nematodes such as root-knot, cyst, and lesion nematodes, including of the species Meloidogyne such as the Southern Root-Knot nematode ( Meloidogyne incognita ), Javanese Root-Knot nematode ( Meloidogyne javanica ), Northern Root-Knot Nematode ( Meloidogyne hapla ) and Peanut Root-Knot Nematode
{Meloidogyne arenaria ); nematodes of the species Ditylenchus such as Ditylenchus destructor and Ditylenchus dipsaci; nematodes of the species Pratylenchus such as the Cob Root-Lesion Nematode {Pratylenchus penetrans), Chrysanthemum Root-Lesion Nematode {Pratylenchus fallax),
Pratylenchus coffeae, Pratylenchus loosi and Walnut Root-Lesion Nematode {Pratylenchus vulnus), Nematodes of the species Globodera such as Globodera rostochiensis and Globodera pallida, Nematodes of the species Heterodera such as Heterodera glycines (soybean cyst nematode); Heterodera schachtii (beet cyst nematode); Heterodera avenae (cereal cyst nematode); Nematodes of the species Aphelenchoides such as the Rice White-tip Nematode {Aphelenchoides besseyi), Aphelenchoides ritzemabosi and Aphelenchoides fragariae ; Nematodes of the species Aphelenchus such as Aphelenchus avenae, Nematodes of the species Radopholus, such as the Burrowing-Nematode {Radopholus similis ); Nematodes of the species Tylenchulus such as Tylenchulus semipenetrans, Nematodes of the species Rotylenchulus such as Rotylenchulus reniformis, Nematodes living in trees such as Bursaphelenchus xylophilus and the Red Ring
Nematode {Bursaphelenchus cocophilus) etc. and Globodera spp.; particularly members of the cyst nematodes, including, but not limited to Globodera rostochiensis and Globodera pailida (potato cyst nematodes); Spiral {Helicotylenchus spp), Burrowing {Radopholus similis), Bulb and stem (Ditylenchus dipsaci ); Reniform ( Rotylenchulus reniformis ); Dagger (Xiphinema spp.); Bud and leaf Aphelenchoides spp .); and Pine Wilt Disease Bursaphelenchus xylophilus). Lesion nematodes include Pratylenchus spp. The term "nematode" encompasses eggs, larvae, juvenile and mature forms of nematodes.
The agricultural product used in the methods and systems disclosed herein can be used to control one or more fungal pests. A fungal pest can be, but is not limited to, a fungus selected from the group consisting of Botrytis spp., Botrytis cinerea, Cersospora spp, Cercospora sojina, Cercospora beticola, Alternaria spp., Alternaria solani, Rhizoctonia spp., Rhizoctonia solani, Blumeria graminis f. sp. Tritici, Erysiphe necator, Podosphaera xanthii, Golovinomyces cichoracearum, Erysiphe lager stroemiae, Sphaerotheca pannosa, Colletotrichum cereale,
Apiognomonia errabunda, Apiognomonia veneta, Colletotrichum spp, Colletotrichum
gloeosporiodes, Discula fraxinea, Mycosphaerella spp., Phomopsis spp., Plasmopara viticola, Pseudoperonospora cubensis, Peronospora belbahrii, Bremia lactucae, Peronospora lamii, Plasmopara obduscens, Pythium spp., Pythium cryptoirregulare, Pythium aphanidermatum, Pythium irregulare, Pythium sylvaticum, Pythium myriotylum, Pythium ultimum, Phytophthora spp., Phytophthora capsici, Phytophthora nicotianae, Phytophthora inf e stans, Phytophthora tropicalis, Phytophthora sojae, Fusarium spp., Fusarium graminearum, Fusarium solani,
Fusarium oxysporum, Fusarium graminicola, Gibberella zeae, Colletotrichum graminicola, Penicillium spp. , ^Phakopsora sp., Phakopsora meibomiae, Phakopsora pachyrizi, Puccinia triticina, Puccinia recondita, Puccinia striiformis, Puccinia graminis, Puccinia spp., Sclerotium spp., Sclerotinia ssp., Venturia inaequalis, Verticillium spp, Erwinia amylovora, Monilinia spp., Monilinia fructicola, Monilinia lax, and Monilinia fructigena.
In some embodiments, the fungal pest is selected from the group consisting of Botrytis cinerea, Cercospora sojina, Alternaria solani, Rhizoctonia solani, Erysiphe necator, Podosphaera xanthii, Colletotrichum cereal, Plasmopara viticola, Peronospora belbahrii, Pythium
aphanidermatum, Pythium sylvaticum, Pythium myriotylum, Pythium ultimum, Phytophthora nicotianae, Phytophthora infestans, Phytophthora tropicalis, Phytophthora sojae, Fusarium graminearum, Fusarium solani, Phakopsora pachyrizi , and Venturia inaequalis
In further embodiments, the fungal pathogen is Phakopsora sp., including Phakopsora pachyrhizi and/or Phakopsora meibomiae .
Examples of fungal plant conditions and diseases caused by fungal pests that can be treated using the methods and systems provided herein include, but are not limited to, Asian Soybean Rust (ASR), gray mold, leaf spot, Frogeye Leaf Spot, Early Blight, Damping off complex, Brown Patch, black scurf, root rot, belly rot, sheath blight, Powdery Mildew, Anthracnose leaf spot, Downy Mildew, Pythium Blight, Late Blight, Fusarium Head Blight, sudden death syndrome (SDS), Fusarium Wilt, Com Stalk Rot, Brown Rust, Black Rust, Yellow Rust, Wheat Rust, Rust, Apple Scab, Verticillium Wilt, Fire Blight, and Brown Rot.
In specific embodiments, the agricultural product used in the systems and methods provided herein controls one or more nematode pests. For example, the agricultural product can control or treat root knot nematodes, ( Meloidogyne spp.). Plant parasitic nematodes may attack the roots, stem, foliage and flowers of plants. All plant parasitic nematodes have piercing mouthparts called stylets. The presence of a stylet is the key diagnostic sign differentiating plant parasitic nematodes from all other types of nematodes. Typical root symptoms indicating nematode attack are root knots or galls, root lesions, excessive root branching, injured root tips and stunted root systems. Symptoms on the above-ground plant parts indicating root infection are a slow decline of the entire plant, wilting even with ample soil moisture, foliage yellowing and fewer and smaller leaves. These are, in fact, the symptoms that would appear in plants deprived of a properly functioning root system. Bulb and stem nematodes produce stem swellings and shortened internodes. Bud and leaf nematodes distort and kill bud and leaf tissue. In some cases, such as with SCN, yield loss may take place with no visible symptoms.
Herbicides that can be used in the various methods and systems disclosed herein include glyphosate, ACCase inhibitors (Arloxyphenoxy propionate (FOPS)); ALS inhibitors (Sulfonylurea (SU)), Imidazonlinone (IMI), Pyrimidines (PM)); microtubule protein inhibitor (Dinitroaniline
(DNA)); synthetic auxins (Phenoxy (P)), Benzoic Acid (BA), Carboxylic acid (CA)); Photosystem II inhibitor (Triazine (TZ)), Triazinone (TN), Nitriles (NT), Benzothiadiazinones (BZ), Ureas (US)); EPSP Synthase inhibitor (glycines (GC)); Glutamine Synthesis inhibitor (Phosphinic Acid (PA)); DOXP synthase inhibitor (Isoxazolidinone (IA)); HPPD inhibitor (Pyrazole (PA)), Triketone (TE)); PPO inhibitors (Diphenylether (DE), N-phenylphthalimide (NP) (Ary triazinone (AT));
VLFA inhibitors (chloroacetamide (CA)), Oxyacetamide (OA)); Photosystem I inhibitor
(Bipyridyliums (BP)); and the like.
Pesticides that can be used in the various methods and systems disclosed herein include imidacloprid clothianidin, arylpyrazole compounds (W02007103076); organophosphates, phenyl pyrazole, pyrethoids caramoyloximes, pyrazoles, amidines, halogenated hydrocarbons, carbamates and derivatives thereof, terbufos, chloropyrifos, fipronil, chlorethoxyfos, telfuthrin, carbofuran, imidacloprid, tebupirimfos (U.S. Patent No. 5,849,320).
Insecticides that can be used used in the various methods and systems disclosed herein include imidacloprid, beta-cyfluthrin, cyantraniliprole, diazinon, lambda-cyhalothrin, methiocarb, pymetrozine, pyrifluquinazon, spinetoram, spirotetramat, thiodicarb, and Ti-435, carbamates, sodium channel modulators/voltage dependent sodium channel blockers, pyrethroids such as DDT, oxadiazines such as indoxacarb, acetylcholine-receptor agonists/antagonists, acetylcholine- receptor-modulators, nicotine, bensultap, cartap, chloronicotyinyls such as acetamiprid, bifenthrin, clothianidin, dinotefuran, imidac loprid, nitenpyram, nithiazine, thiacloprid, and thiamethoxam, spinosyns such as spinosad, cyclodiene organochlorines such as camphechlor, chlordane, endosulfan, gamma-HCH, HCH, heptachlor, lindane, methoxychlor, fiproles such as acetoprole, ethiprole, fipronil, vaniliprole, chloride-channel, 6.1 mectins such as avermectin, emamectin, emamectin-benzoate, ivermectin, and milbemycin, juvenile-hormone mimics such as diofenolan, epofenonane, fenoxycarb, hydroprene, kinoprene, methoprene, pyriproxyfen, and triprene, ecdysone agonists/disruptors, diacylhydrazine, chromafenozide, halofenozide, methoxyfenozide, tebufenozide, chitin biosynthesis inhibitors, benzoylureas such as bistrifluron, chlorfluazuron, diflubenzuron, fluazuron, fluey cl oxuron, flufenoxuron, hexaflumuron, lufenuron, novaluron, noviflumuron, penfluron, teflubenzuron, triflumuron, buprofezin, cyromazine, oxidative phosphorylation inhibitors, ATP disruptors, diafenthiuron, organotins such as azocyclotin, cyhexatin, fenbutatin-oxide, pyrroles such as chlorfenapyr, dinitrophenols such as binapacryl, dinobuton, dinocap, DNOC, site-I electron transport inhibitors, METI's such as fenazaquin, fenpyroximate, pyrimidifen, pyridaben, tebufenpyrad, tolfenpyrad, hydramethyinon, dicofol, rotenone, acequinocyl, fluacrypyrim, spirodiclofen, spiromesifen, tetramic acids, carboxamides such as flonicamid, octopaminergic agonists such as amitraz, magnesium-stimulated ATPase inhibitors such as propargite, BDCA's such as N2-[l,l-dimethyl-2-(methylsulfonyl)ethyl]-3-iodo- Nl-[2-methyl-4-[l,2,2,2— tetrafluoro-l-(trifluoromethyl)ethyl]phenyl]-l, 2-benzene, nereistoxin analogues such as thiocyclam hydrogen oxalate, and thiosultap sodium. Preferably the insecticide is one or more of chlorpyrifos and tefluthrin.
Nematicides that can be used in the various methods and systems disclosed herein include, but are not limited to, acibenzolar-S-methyl, an avermectin (e.g., abamectin), carbamate
nematicides (e.g., aldicarb, thiadicarb, carbofuran, carbosulfan, oxamyl, aldoxycarb, ethoprop, methomyl, benomyl, alanycarb), organophosphorus nematicides (e.g., phenamiphos (fenamiphos), fensulfothion, terbufos, fosthiazate, dimethoate, phosphocarb, dichlofenthion, isamidofos, fosthietan, isazofos ethoprophos, cadusafos, terbufos, chlorpyrifos, dichlofenthion, heterophos, isamidofos, mecarphon, phorate, thionazin, triazophos, diamidafos, fosthietan, phosphamidon), and certain fungicides, such as captan, thiophanate-methyl and thiabendazole. Fungicides that can be used in the various methods and systems disclosed herein include aliphatic nitrogen fungicides (butylamine, cymoxanil, dodicin, dodine, guazatine, iminoctadine); amide fungicides (benzovindiflupyr, carpropamid, chloraniformethan, cyflufenamid, diclocymet, diclocymet, dimoxystrobin, fenaminstrobin, fenoxanil, flumetover, furametpyr, isofetamid, isopyrazam, mandestrobin, mandipropamid, metominostrobin, orysastrobin, penthiopyrad, prochloraz, quinazamid, silthiofam, triforine); acylamino acid fungicides (benalaxyl, benalaxyl-M, furalaxyl, metalaxyl, metalaxyl-M, pefurazoate, valifenalate); anilide fungicides (benalaxyl, benalaxyl-M, bixafen, boscalid, carboxin, fenhexamid, fluxapyroxad, isotianil, metalaxyl, metalaxyl-M, metsulfovax, ofurace, oxadixyl, oxycarboxin, penflufen, pyracarbolid, sedaxane, thifluzamide, tiadinil, vanguard); benzanilide fungicides (benodanil, flutolanil, mebenil, mepronil, salicylanilide, tecloftalam); furanilide fungicides (fenfuram, furalaxyl, furcarbanil, methfuroxam); sulfonanilide fungicides (flusulfamide); benzamide fungicides (benzohydroxamic acid,
fluopicolide, fluopyram, tioxymid, trichlamide, zarilamid, zoxamide); furamide fungicides
(cyclafuramid, furmecyclox); phenylsulfamide fungicides (dichlofluanid, tolylfluanid); sulfonamide fungicides (amisulbrom, cyazofamid); valinamide fungicides (benthiavalicarb, iprovalicarb);
antibiotic fungicides (aureofungin, blasticidin-S, cycloheximide, griseofulvin, kasugamycin, moroxydine, natamycin, polyoxins, polyoxorim, streptomycin, validamycin); strobilurin fungicides (fluoxastrobin, mandestrobin); methoxyacrylate strobilurin fungicides (azoxystrobin, bifujunzhi, coumoxystrobin, enoxastrobin, flufenoxystrobin, jiaxiangjunzhi, picoxystrobin, pyraoxystrobin); methoxycarbanilate strobilurin fungicides (pyraclostrobin, pyrametostrobin, triclopyricarb);
methoxyiminoacetamide strobilurin fungicides (dimoxystrobin, fenaminstrobin, metominostrobin, orysastrobin); methoxyiminoacetate strobilurin fungicides (kresoxim-methyl, trifloxystrobin); aromatic fungicides (biphenyl, chlorodinitronaphthalenes, chloroneb, chlorothalonil, cresol, dicloran, fenjuntong, hexachlorobenzene, pentachlorophenol, quintozene, sodium
pentachlorophenoxide, tecnazene, trichlorotrinitrobenzenes); arsenical fungicides (asomate, urbacide); aryl phenyl ketone fungicides (metrafenone, pyriofenone); benzimidazole fungicides (albendazole, benomyl, carbendazim, chlorfenazole, cypendazole, debacarb, fuberidazole, mecarbinzid, rabenzazole, thiabendazole); benzimidazole precursor fungicides (furophanate, thiophanate, thiophanate-methyl); benzothiazole fungicides (bentaluron, benthiavalicarb, benthiazole, chlobenthiazone, probenazole); botanical fungicides (allicin, berberine, carvacrol, carvone, osthol, sanguinarine, santonin); bridged diphenyl fungicides (bithionol, dichlorophen, diphenylamine, hexachlorophene, parinol); carbamate fungicides (benthiavalicarb, furophanate, iodocarb, iprovalicarb, picarbutrazox, propamocarb, pyribencarb, thiophanate, thiophanate-methyl, tolprocarb); benzimidazolylcarbamate fungicides (albendazole, benomyl, carbendazim, cypendazole, debacarb, mecarbinzid); carbanilate fungicides (diethofencarb, pyraclostrobin, pyrametostrobin, triclopyricarb); conazole fungicides, conazole fungicides (imidazoles)
(climbazole, clotrimazole, imazalil, oxpoconazole, prochloraz, triflumizole); conazole fungicides (triazoles) (azaconazole, bromuconazole, cyproconazole, diclobutrazol, difenoconazole, diniconazole, diniconazole-M, epoxiconazole, etaconazole, fenbuconazole, fluquinconazole, flusilazole, flutriafol, furconazole, furconazole-cis, hexaconazole, imibenconazole, ipconazole, metconazole, myclobutanil, penconazole, propi conazole, prothioconazole, quinconazole, simeconazole, tebuconazole, tetraconazole, triadimefon, triadimenol, triticonazole, uniconazole, uniconazole-P); copper fungicides (acypetacs-copper, Bordeaux mixture, Burgundy mixture, Cheshunt mixture, copper acetate, copper carbonate, basic, copper hydroxide, copper naphthenate, copper oleate, copper oxychloride, copper silicate, copper sulfate, copper sulfate, basic, copper zinc chromate, cufraneb, cuprobam, cuprous oxide, mancopper, oxine-copper, saisentong, thiodiazole- copper); cyanoacrylate fungicides (benzamacril, phenamacril); dicarboximide fungicides
(famoxadone, fluoroimide); dichlorophenyl dicarboximide fungicides (chlozolinate, dichlozoline, iprodione, isovaledione, myclozolin, procymidone, vinclozolin); phthalimide fungicides (captafol, captan, ditalimfos, folpet, thiochlorfenphim); dinitrophenol fungicides (binapacryl, dinobuton, dinocap, dinocap-4, dinocap-6, meptyldinocap, dinocton, dinopenton, dinosulfon, dinoterbon, DNOC); dithiocarbamate fungicides (amobam, asomate, azithiram, carbamorph, cufraneb, cuprobam, disulfiram, ferbam, metam, nabam, tecoram, thiram, urbacide, ziram); cyclic dithiocarbamate fungicides (dazomet, etem, milneb); polymeric dithiocarbamate fungicides (mancopper, mancozeb, maneb, metiram, polycarbamate, propineb, zineb); dithiolane fungicides (isoprothiolane, saijunmao); fumigant fungicides (carbon disulfide, cyanogen, dithioether, methyl bromide, methyl iodide, sodium tetrathiocarbonate); hydrazide fungicides (benquinox, saijunmao); imidazole fungicides (cyazofamid, fenamidone, fenapanil, glyodin, iprodione, isovaledione, pefurazoate, triazoxide); conazole fungicides (imidazoles) (climbazole, clotrimazole, imazalil, oxpoconazole, prochloraz, triflumizole); inorganic fungicides (potassium azide, potassium thiocyanate, sodium azide, sulfur, see also copper fungicides, see also inorganic mercury fungicides); mercury fungicides; inorganic mercury fungicides (mercuric chloride, mercuric oxide, mercurous chloride); organomercury fungicides ((3-ethoxypropyl)mercury bromide, ethylmercury acetate, ethylmercury bromide, ethylmercury chloride, ethylmercury 2,3-dihydroxypropyl mercaptide, ethylmercury phosphate, /V-(ethylmercury)-/ oluenesulphonanilide, hydrargaphen, 2- methoxyethylmercury chloride, methylmercury benzoate, methylmercury dicyandi amide, methylmercury pentachlorophenoxide, 8-phenylmercurioxyquinoline, phenylmercuriurea, phenylmercury acetate, phenylmercury chloride, phenylmercury derivative of pyrocatechol, phenylmercury nitrate, phenylmercury salicylate, thiomersal, tolylmercury acetate); morpholine fungicides (aldimorph, benzamorf, carbamorph, dimethomorph, dodemorph, fenpropimorph, flumorph, tridemorph); organophosphorus fungicides (ampropylfos, ditalimfos, EBP, edifenphos, fosetyl, hexylthiofos, inezin, iprobenfos, izopamfos, kejunlin, phosdiphen, pyrazophos, tolclofos- methyl, triamiphos); organotin fungicides (decafentin, fentin, tributyltin oxide); oxathiin fungicides (carboxin, oxycarboxin); oxazole fungicides (chlozolinate, dichlozoline, drazoxolon, famoxadone, hymexazol, metazoxolon, myclozolin, oxadixyl, oxathiapiprolin, pyrisoxazole, vinclozolin);
polysulfide fungicides (barium polysulfide, calcium polysulfide, potassium polysulfide, sodium polysulfide); pyrazole fungicides (benzovindiflupyr, bixafen, fenpyrazamine, fluxapyroxad, furametpyr, isopyrazam, oxathiapiprolin, penflufen, penthiopyrad, pyraclostrobin, pyrametostrobin, pyraoxystrobin, rabenzazole, sedaxane); pyridine fungicides (boscalid, buthiobate, dipyrithione, fluazinam, fluopicolide, fluopyram, parinol, picarbutrazox, pyribencarb, pyridinitril, pyrifenox, pyrisoxazole, pyroxychlor, pyroxyfur, triclopyricarb); pyrimidine fungicides (bupirimate, diflumetorim, dimethirimol, ethirimol, fenarimol, ferimzone, nuarimol, triarimol);
anilinopyrimidine fungicides (cyprodinil, mepanipyrim, pyrimethanil); pyrrole fungicides
(dimetachlone, fenpiclonil, fludioxonil, fluoroimide); quaternary ammonium fungicides (berberine, sanguinarine); quinoline fungicides (ethoxyquin, halacrinate, 8-hydroxyquinoline sulfate, quinacetol, quinoxyfen, tebufloquin); quinone fungicides (chloranil, dichlone, dithianon);
quinoxaline fungicides (chinomethionat, chlorquinox, thioquinox); thiadiazole fungicides
(etridiazole, saisentong, thiodiazole-copper, zinc thiazole); thiazole fungicides (ethaboxam, isotianil, metsulfovax, octhilinone, oxathiapiprolin, thiabendazole, thifluzamide); thiazolidine fungicides (flutianil, thiadifluor); thiocarbamate fungicides (methasulfocarb, prothiocarb);
thiophene fungicides (ethaboxam, isofetamid, silthiofam); triazine fungicides (anilazine); triazole fungicides (amisulbrom, bitertanol, fluotrimazole, triazbutil); conazole fungicides (triazoles) (azaconazole, bromuconazole, cyproconazole, diclobutrazol, difenoconazole, diniconazole, diniconazole-M, epoxiconazole, etaconazole, fenbuconazole, fluquinconazole, flusilazole, flutriafol, furconazole, furconazole-cis, hexaconazole, huanjunzuo, imibenconazole, ipconazole, metconazole, myclobutanil, penconazole, propi conazole, prothioconazole, quinconazole, simeconazole, tebuconazole, tetraconazole, triadimefon, triadimenol, triticonazole, uniconazole, uniconazole-P); triazolopyrimidine fungicides (ametoctradin); urea fungicides (bentaluron, pencycuron, quinazamid); zinc fungicides (acypetacs-zinc, copper zinc chromate, cufraneb, mancozeb, metiram, polycarbamate, polyoxorim-zinc, propineb, zinc naphthenate, zinc thiazole, zinc trichlorophenoxide, zineb, ziram); unclassified fungicides (acibenzolar, acypetacs, allyl alcohol, benzalkonium chloride, bethoxazin, bromothalonil, chitosan, chloropicrin, DBCP, dehydroacetic acid, diclomezine, diethyl pyrocarbonate, ethylicin, fenaminosulf, fenitropan, fenpropidin, formaldehyde, furfural, hexachlorobutadiene, methyl isothiocyanate, nitrostyrene, nitrothal-isopropyl, OCH, pentachlorophenyl laurate, 2-phenylphenol, phthalide, piperalin, propamidine, proquinazid, pyroquilon, sodium orthophenylphenoxide, spiroxamine, sultropen, thicyofen, tricyclazole), or mefenoxam.
B. Formulations of Agricultural Products and Application Forms Prepared Therefrom
The agricultural product can be formulated as a cell paste, wettable powder, a cell pellet, dusts, granules, spray-dried formulation, freeze-dried formulation, a slurry, a dry powder, aqueous or oil based liquid products, and the like. Such formulations can comprise an active ingredient in addition to carriers and other agents.
The formulations preferably comprise between 0.00000001 % and 98% by weight of active compound or, with particular preference, between 0.01 % and 95% by weight of active compound, more preferably between 0.5% and 90% by weight of active compound, based on the weight of the formulation.
The active compound content of the application forms prepared from the formulations may vary within wide ranges. The active compound concentration of the application forms may be situated typically between 0.00000001 % and 95% by weight of active compound, preferably between 0.00001 % and 1 % by weight, based on the weight of the application form. Application takes place in a customary manner adapted to the application forms.
The agricultural product formulation or application form can comprise at least one or more of an extender, a solvent, spontaneity promoter, carrier, emulsifier, dispersant, frost protectant, thickener, and/or adjuvant. In some embodiments, the extender, solvent, spontaneity promoter, carrier, emulsifier, dispersant, frost protectant, thickener, and/or adjuvant is a non-natural or synthetic extender, a solvent, spontaneity promoters, carriers, emulsifiers, dispersants, frost protectants, thickeners, and/or adjuvants. In particular embodiments, the agricultural product formulation or application form comprises at least one or more natural extender, a solvent, spontaneity promoter, carrier, emulsifier, dispersant, frost protectant, thickener, and/or adjuvant.
Examples of typical formulations or application forms include water-soluble liquids (SL), emulsifiable concentrates (EC), emulsions in water (EW), suspension concentrates (SC, SE, FS, OD), water-dispersible granules (WG), granules (GR) and capsule concentrates (CS); WG; GR; these and other possible types of formulation are described, for example, by Crop Life International and in Pesticide Specifications, Manual on development and use of FAO and WHO specifications for pesticides, FAO Plant Production and Protection Papers - 173, prepared by the FAO/WHO Joint Meeting on Pesticide Specifications, 2004, ISBN: 9251048576.
The formulations or application forms of the various agricultural products can comprise, but are not limited to, auxiliaries, such as extenders, solvents, spontaneity promoters, carriers, emulsifiers, dispersants, frost protectants, biocides, solid carriers, surfactants, thickeners and/or other auxiliaries, such as adjuvants. An adjuvant in this context is a component which enhances the biological effect of the formulation, without the component itself having a biological effect.
Examples of adjuvants are agents which promote the retention, spreading, attachment to the leaf surface, or penetration.
Non-limiting extenders are, for example, water, polar and nonpolar organic chemical liquids, for example from the classes of the aromatic and non-aromatic hydrocarbons (such as paraffins, alkyl benzenes, alkylnaphthalenes, chlorobenzenes), the alcohols and polyols (which, if appropriate, may also be substituted, etherified and/or esterified), the ketones (such as acetone, cyclohexanone), esters (including fats and oils) and (poly)ethers, the unsubstituted and substituted amines, amides, lactams (such as N-alkylpyrrolidones) and lactones, the sulphones and sulphoxides (such as dimethyl sulphoxide). If the extender used is water, it is also possible to employ, for example, organic solvents as auxiliary solvents. Essentially, non-limiting liquid solvents are:
aromatics such as xylene, toluene or alkylnaphthalenes, chlorinated aromatics and chlorinated aliphatic hydrocarbons such as chlorobenzenes, chloroethylenes or methylene chloride, aliphatic hydrocarbons such as cyclohexane or paraffins, for example petroleum fractions, mineral and vegetable oils, alcohols such as butanol or glycol and also their ethers and esters, ketones such as acetone, methyl ethyl ketone, methyl isobutyl ketone or cyclohexanone, strongly polar solvents such as dimethylformamide and dimethyl sulphoxide, and also water. In principle it is possible to use any suitable solvent. Non-limiting solvents are, for example, aromatic hydrocarbons, such as xylene, toluene or alkylnaphthalenes, for example, chlorinated aromatic or aliphatic hydrocarbons, such as chlorobenzene, chloroethylene or methylene chloride, for example, aliphatic hydrocarbons, such as cyclohexane, for example, paraffins, petroleum fractions, mineral and vegetable oils, alcohols, such as methanol, ethanol, isopropanol, butanol or glycol, for example, and also their ethers and esters, ketones such as acetone, methyl ethyl ketone, methyl isobutyl ketone or cyclohexanone, for example, strongly polar solvents, such as dimethyl sulphoxide, and water. Non-limiting examples of suitable carriers include, for example, ammonium salts and ground natural minerals such as kaolins, clays, talc, chalk, quartz, attapulgite, montmorillonite or diatomaceous earth, and ground synthetic minerals, such as finely divided silica, alumina and natural or synthetic silicates, resins, waxes and/or solid fertilizers. Mixtures of such carriers may likewise be used. Carriers suitable for granules include the following: for example, crushed and fractionated natural minerals such as calcite, marble, pumice, sepiolite, dolomite, and also synthetic granules of inorganic and organic meals, and also granules of organic material such as sawdust, paper, coconut shells, maize cobs, and tobacco stalks.
Liquefied gaseous extenders or solvents may also be used. Non-limiting examples are those extenders or carriers which at standard temperature and under standard pressure are gaseous, examples being aerosol propellants, such as halogenated hydrocarbons, and also butane, propane, nitrogen and carbon dioxide. Examples of emulsifiers and/or foam-formers, dispersants or wetting agents having ionic or nonionic properties, or mixtures of these surface-active substances, are salts of polyacrylic acid, salts of lignosulphonic acid, salts of phenolsulphonic acid or
naphthalenesulphonic acid, polycondensates of ethylene oxide with fatty alcohols or with fatty acids or with fatty amines, with substituted phenols (preferably alkylphenols or arylphenols), salts of sulphosuccinic esters, taurine derivatives (preferably alkylta urates), phosphoric esters of polyethoxylated alcohols or phenols, fatty acid esters of polyols, and derivatives of the compounds containing sulphates, sulphonates and phosphates, examples being alkylaryl polyglycol ethers, alkyl sulphonates, alkyl sulphates, aryl sulphonates, protein hydrolysates, lignin-sulphite waste liquors and methylcellulose. The presence of a surface-active substance is advantageous if one of the active compounds and/or one of the inert carriers is not soluble in water and if application takes place in water.
Further auxiliaries that may be present in the formulations and in the application forms derived from them include colorants such as inorganic pigments, examples being iron oxide, titanium oxide, Prussian Blue, and organic dyes, such as alizarin dyes, azo dyes and metal phthalocyanine dyes, and nutrients and trace nutrients, such as salts of iron, manganese, boron, copper, cobalt, molybdenum, and zinc.
Stabilizers, such as low-temperature stabilizers, preservatives, antioxidants, light stabilizers or other agents which improve chemical and/or physical stability may also be present. Additionally present may be foam-formers or defoamers.
Furthermore, the formulations and application forms derived from them may also comprise, as additional auxiliaries, stickers such as carboxymethylcellulose, natural and synthetic polymers in powder, granule or latex form, such as gum arabic, polyvinyl alcohol, polyvinyl acetate, and also natural phospholipids, such as cephalins and lecithins, and synthetic phospholipids. Further possible auxiliaries include mineral and vegetable oils.
There may possibly be further auxiliaries present in the formulations and the application forms derived from them. Examples of such additives include fragrances, protective colloids, binders, adhesives, thickeners, thixotropic substances, penetrants, retention promoters, stabilizers, sequestrants, complexing agents, humectants and spreaders. Generally speaking, the active compounds may be combined with any solid or liquid additive commonly used for formulation purposes.
Suitable retention promoters include all those substances which reduce the dynamic surface tension, such as dioctyl sulphosuccinate, or increase the viscoelasticity, such as hydroxypropylguar polymers, for example.
Suitable penetrants in the present context include all those substances which are typically used in order to enhance the penetration of active agrochemical compounds into plants. Penetrants in this context are defined in that, from the (generally aqueous) application liquor and/or from the spray coating, they are able to penetrate the cuticle of the plant and thereby increase the mobility of the active compounds in the cuticle. This property can be determined using the method described in the literature (Baur et ah, 1997, Pesticide Science 51 : 131-152). Examples include alcohol alkoxylates such as coconut fatty ethoxylate (10) or isotridecyl ethoxylate (12), fatty acid esters such as rapeseed or soybean oil methyl esters, fatty amine alkoxylates such as tallowamine ethoxylate (15), or ammonium and/or phosphonium salts such as ammonium sulphate or diammonium hydrogen phosphate, for example.
Non-limiting examples of compounds and systems that can be added to the formulation or application form, include but are not limited to, Acetyl tributyl citrate [Citric acid, 2-(acetyloxy)-, tributyl ester]; Agar; Almond hulls; Almond shells; alpha-Cyclodextrin; Aluminatesilicate;
Aluminum magnesium silicate [Silicic acid, aluminum magnesium salt]; Aluminum potassium sodium silicate [Silicic acid, aluminum potassium sodium salt]; Aluminum silicate; Aluminum sodium silicate [Silicic acid, aluminum sodium salt]; Aluminum sodium silicate (1 :1: l)[Silicic acid (H4Si04), aluminum sodium salt (1 : 1 : 1)]; Ammonium benzoate [Benzoic acid, ammonium salt]; Ammonium stearate [Octadecanoic acid, ammonium salt]; Amylopectin, acid-hydrolyzed, 1- octenylbutanedioate; Amylopectin, hydrogen l-octadecenylbutanedioate; Animal glue; Ascorbyl palmitate; Attapulgite-type clay; Beeswax; Bentonite; Bentonite, sodian; beta-Cyclodextrin; Bone meal; Bran; Bread crumbs; (+)-Butyl lactate; [Lactic acid, n-butyl ester, (S)]; Butyl lactate [Lactic acid, n-butyl ester]; Butyl stearate [Octadecanoic acid, butyl ester]; Calcareous shale; Calcite (Ca(Co3)); Calcium acetate; Calcium acetate monohydrate [Acetic acid, calcium salt,
monohydrate]; Calcium benzoate [Benzoic acid, calcium salt]; Calcium carbonate; Calcium citrate [Citric acid, calcium salt]; Calcium octanoate; Calcium oxide silicate (Ca30(Si04)); Calcium silicate [Silicic acid, calcium salt]; Calcium stearate [Octadecanoic acid, calcium salt]; Calcium sulfate; Calcium sulfate dehydrate; Calcium sulfate hemihydrate; Canary seed; Carbon; Carbon dioxide; Carboxymethyl cellulose [Cellulose, carboxymethyl ether]; Cardboard; Carnauba wax; Carob gum [Locust bean gum]; Carrageenan; Caseins; Castor oil; Castor oil, hydrogenated; Cat food; Cellulose; Cellulose acetate; Cellulose, mixture with cellulose carboxymethyl ether, sodium salt; Cellulose, pulp; Cellulose, regenerated; Cheese; Chlorophyll a; Chlorophyll b; Citrus meal; Citric acid; Citric acid, monohydrate; Citrus pectin; Citrus pulp; Clam shells; Cocoa; Cocoa shell flour; Cocoa shells; Cod-liver oil; Coffee grounds; Cookies; Cork; Corn cobs; Cotton; Cottonseed meal; Cracked wheat; Decanoic acid, monoester with l,2,3-propanetriol; Dextrins; Diglyceryl monooleate [9-Octadecenoic acid, ester with l,2,3-propanetriol]; Diglyceryl monostearate [9- Octadecanoic acid, monoester with xybis(propanediol)]; Dilaurin [Dodecanoic acid, diester with l,2,3-propanetriol]; Dipalmitin [Hexadecanoic acid, diester with l,2,3-propanetriol]; Dipotassium citrate [Citric acid, dipotassium salt]; Disodium citrate [Citric acid, disodium salt]; Disodium sulfate decahydrate ; Diatomaceous earth (less than 1% crystalline silica); Dodecanoic acid, monoester with l,2,3-propanetriol; Dolomite; Douglas fir bark; Egg shells; Eggs; (+)-Ethyl lactate [Lactic acid, ethyl ester, (S)]; Ethyl lactate [Lactic acid, ethyl ester]; Feldspar; Fish meal; Fish oil (not conforming to 40 CFR 180.950) ; Fuller's earth; Fumaric acid; gamma-Cyclodextrin; Gelatins; Gellan gum; Glue (as depolymd. animal collagen); Glycerin [l,2,3-Propanetriol]; Glycerol monooleate [9-Octadecenoic acid (Z)-, 2,3-dihydroxypropyl ester]; Glyceryl dicaprylate [Octanoic acid, diester with l,2,3-propanetriol]; Glyceryl dimyristate [Tetradecanoic acid, diester with 1,2,3- propanetriol]; Glyceryl dioleate [9-Octadecenoic acid (9Z)-, diester with l,2,3-propanetriol];
Glyceryl distearate ; Glyceryl monomyristate [Tetradecanoic acid, monoester with 1,2,3- propanetriol]; Glyceryl monooctanoate [Octanoic acid, monoester with l,2,3-propanetriol];
Glyceryl monooleate [9-Octadecenoic acid (9Z)-, monoester with 1,2, 3 -propanetriol]; Glyceryl monostearate [Octadecanoic acid, monoester with l,2,3-propanetriol]; Glyceryl stearate
[Octadecanoic acid, ester with l,2,3-propanetriol]; Granite; Graphite; Guar gum; Gum Arabic; Gum tragacanth; Gypsum; Hematite (Fe203); Humic acid; Hydrogenated cottonseed oil;
Hydrogenated rapeseed oil; Hydrogenated soybean oil; Hydroxyethyl cellulose [Cellulose, 2- hydroxy ethyl ether]; Hydroxypropyl cellulose [Cellulose, 2-hydroxypropyl ether]; Hydroxypropyl methyl cellulose [Cellulose, 2-hydroxypropyl methyl ether]; Iron magnesium oxide (Fe2Mg04);
Iron oxide (Fe203); Iron oxide (Fe203); Iron oxide (Fe304); Iron oxide (FeO); Isopropyl alcohol [2- Propanol]; Isopropyl myristate; Kaolin; Lactose; Lactose monohydrate; Lanolin; Latex rubber; Laurie acid; Lecithins; Licorice extract; Lime (chemical) dolomitic; Limestone; Linseed oil;
Magnesium carbonate [Carbonic acid, magnesium salt (1 : 1); Magnesium benzoate; Magnesium oxide; Magnesium oxide silicate (Mg30(Si205)2), monohydrate; Magnesium silicate; Magnesium silicate hydrate; Magnesium silicon oxide (Mg2Si308); Magnesium stearate [Octadecanoic acid, magnesium salt]; Magnesium sulfate; Magnesium sulfate heptahydrate; Malic acid; Malt extract; Malt flavor; Maltodextrin; Methylcellulose [Cellulose, methyl ether]; Mica; Mica-group minerals; Milk; N/A Millet seed; Mineral oil (U.S.P.); l-Monolaurin [Dodecanoic acid, 2,3-dihydroxypropyl ester]; l-Monomyristin [Tetradecanoic acid, 2,3-dihydroxypropyl ester]; Monomyristin [Decanoic acid, diester with l,2,3-propanetriol]; Monopalmitin [Hexadecanoic acid, monoester with 1,2,3- propanetriol]; Monopotassium citrate [Citric acid, monopotassium salt; Monosodium citrate [Citric acid, monosodium salt]; Montmorillonite; Myristic acid; Nepheline syenite; Nitrogen; Nutria meat; Nylon; Octanoic acid, potassium salt; Octanoic acid, sodium salt; Oils, almond; Oils, wheat; Oleic acid; Oyster shells; Palm oil; Palm oil, hydrogenated; Palmitic acid [Hexadecanoic acid]; Paraffin wax; Peanut butter; Peanut shells; Peanuts; Peat moss; Pectin; Perlite; Perlite, expanded; Plaster of paris; Polyethylene; Polyglyceryl oleate; Polyglyceryl stearate; Potassium acetate [Acetic acid, potassium salt]; Potassium aluminum silicate, anhydrous; Potassium benzoate [Benzoic acid, potassium salt]; Potassium bicarbonate [Carbonic acid, monopotassium salt]; Potassium chloride; Potassium citrate [Citric acid, potassium salt]; Potassium humate [Humic acids, potassium salts]; Potassium myristate [Tetradecanoic acid, potassium salt]; Potassium oleate [9-Octadecenoic acid (9Z)-, potassium salt; Potassium ricinoleate [9-Octadecenoic acid, 12-hydroxy-, monopotassium salt,(9Z,l2R)-]; Potassium sorbate [Sorbic acid, potassium salt ]; Potassium stearate [Octadecanoic acid, potassium salt]; Potassium sulfate; Potassium sulfate [Sulfuric acid, monopotassium salt]; 1 ,2- Propylene carbonate [l,3-Dioxolan-2-one, 4-methyl-]; Pumice; Red cabbage color (expressed from edible red cabbage heads via a pressing process using only acidified water); Red cedar chips; Red dog flour; Rubber; Sawdust; Shale; Silica, amorphous, fumed (crystalline free); Silica, amorphous, precipated and gel; Silica (crystalline free); Silica gel; Silica gel, precipitated, crystalline-free; Silica, hydrate; Silica, vitreous; Silicic acid (H2Si03), magnesium salt (1 : 1); Soap (The water soluble sodium or potassium salts of fatty acids produced by either the saponification of fats and oils, or the neutralization of fatty acid); Soapbark [Quillaja saponin]; Soapstone; Sodium acetate [Acetic acid, sodium salt]; Sodium alginate; Sodium benzoate [Benzoic acid, sodium salt]; Sodium bicarbonate; Sodium carboxym ethyl cellulose [Cellulose, carboxymethyl ether, sodium salt];
Sodium chloride; Sodium citrate; Sodium humate [Humic acids, sodium salts]; Sodium oleate; Sodium ricinoleate [9-Octadecenoic acid, l2-hydroxy-, monosodium salt, (9Z,l2R)-]; Sodium stearate [Octadecanoic acid, sodium salt]; Sodium sulfate; Sorbitol [D-glucitol]; Soy protein; Soya lecithins [Lecithins, soya]; Soybean hulls; Soybean meal; Soybean, flour; Stearic acid
[Octadecanoic acid]; Sulfur; Syrups, hydrolyzed starch, hydrogenated; Tetragylceryl monooleate [9-Octadecenoic acid (9Z)-, monoester with tetraglycerol]; Tricalcium citrate [Citric acid, calcium salt (2:3)]; Triethyl citrate [Citric acid, triethyl ester; Tripotassium citrate [Citric acid, tripotassium salt]; Tripotassium citrate monohydrate [Citric acid, tripotassium salt, monohydrate]; Trisodium citrate [Citric acid, trisodium salt]; Trisodium citrate dehydrate [Citric acid, trisodium salt, dehydrate]; Trisodium citrate pentahydrate [Citric acid, trisodium salt, pentahydrate]; Ultramarine blue [C.I. Pigment Blue 29]; Urea; Vanillia; Vermiculite; Vinegar (maximum 8% acetic acid in solution); Vitamin C [L-Ascorbic acid]; Vitamin; Walnut flour; Walnut shells; Wheat; Wheat flour; Wheat germ oil; Whey; White mineral oil (petroleum); Wintergreen oil; Wollastonite (Ca(Si03)); Wool; Xanthan gum; Yeast; Zeolites (excluding erionite (CAS Reg. No. 66733-21-9)); Zeolites, NaA; Zinc iron oxide; Zinc oxide (ZnO); and Zinc stearate [Octadecanoic acid, zinc salt]
C. Application of Agricultural Products
The systems and methods can comprise instructions for applying an agricultural product via augmented reality. The instructions can provide information for applying the agricultural product in any manner that allows for controlling a plant pest or unwanted vegetation or for improving an agronomic trait of interest of a plant. In some embodiments, the presently disclosed systems and methods use augmented reality video to provide instructions for applying the prepared agricultural product to an area of cultivation (for example, via spraying or mixing with soil in an area of cultivation). In other embodiments, the augmented reality video provides instructions for applying the prepared agricultural product to the foliage of plants, to the soil, or to a seed (for example, seed coating). The instructions can comprise application of the agricultural product to a plant propagule (e.g., seed, slip, stem cutting, com etc.). In specific embodiments, the instructions can be for application of the agricultural product to the plant tissue (including fruit) before or after harvest.
The instructions via augmented reality can provide information regarding the rate of application of the agricultural product, which may vary according to the pest or weed being targeted, the crop to be protected, the efficacy of the agricultural product, the severity of the disease, the climate conditions, the agronomic trait of interest to improve, and the like. The augmented reality instructions can advise the agricultural professional to apply a single application of the agricultural product to a plant, plant part, or area of cultivation or multiple applications of the agricultural product to a plant, plant part, or area of cultivation.
I). Types of Plants
Any plant species of interest can be treated with agricultural products using the presently disclosed systems and methods. As used herein, the term plant includes plant cells, plant protoplasts, plant cell tissue cultures from which plants can be regenerated, plant calli, plant clumps, and plant cells that are intact in plants or parts of plants such as embryos, pollen, ovules, seeds, leaves, flowers, branches, fruit, kernels, ears, cobs, husks, stalks, roots, root tips, anthers, and the like. Grain is intended to mean the mature seed produced by commercial growers for purposes other than growing or reproducing the species.
Examples of plant species of interest include, but are not limited to, com (Zea mays), Brassica sp. (e.g., B. napus, B. rapa, B.juncea ), particularly those Brassica species useful as sources of seed oil, alfalfa ( Medicago sativa ), rice ( Oryza sativa ), rye ( Secale cereale), sorghum {Sorghum bicolor, Sorghum vulgare), millet (e.g., pearl millet {Pennisetum glaucum ), proso millet {Panicum miliaceum), foxtail millet ( Setaria italica), finger millet {Eleusine coracana) ), sunflower {Helianthus annuus), safflower {Carthamus tinctorius), wheat {Triticum aestivum), soybean ( Glycine max), tobacco
{Nicotiana tabacum), potato ( Solanum tuberosum), peanuts (Arachis hypogaea), cotton ( Gossypium barbadense, Gossypium hirsutum), sweet potato ( Ipomoea batatus), cassava (Manihot esculenta), coffee {Coffea spp.), coconut {Cocos nucifera), pineapple {Ananas comosus), citrus trees {Citrus spp.), cocoa {Theobroma cacao), tea {Camellia sinensis), banana {Musa spp.), avocado {Per sea americana), fig {Ficus casica), guava {Psidium guajava), mango ( Mangifera indica), olive {Olea europaea), papaya {Carica papaya), grape ( Vitus spp.), strawberry {Fragaria x ananassa), cherry {Prunus spp.), apple {Malus domestica), orange {Citrus x sinensis) cashew {Anacardium occidental), macadamia ( Macadamia integrifolia), almond {Prunus amygdalus), sugar beets {Beta vulgaris), sugarcane {Saccharum spp.), oats, barley, vegetables, ornamentals, and conifers.
Vegetables include tomatoes {Lycopersicon esculentum), lettuce (e.g., Lactuca sativa), green beans {Phaseolus vulgaris), lima beans {Phaseolus limensis), peas {Lathyrus spp.), and members of the genus Cucumis such as cucumber (C. sativus), cantaloupe (C. cantalupensis), and musk melon (C. meld). Ornamentals include azalea {Rhododendron spp.), hydrangea ( Macrophylla hydrangea), hibiscus {Hibiscus rosasanensis), roses {Rosa spp.), tulips {Tulipa spp.), daffodils {Narcissus spp.), petunias {Petunia hybridd), carnation {Dianthus caryophyllus), poinsettia {Euphorbia pulcherrima), and chrysanthemum. Conifers that may be employed in practicing the present invention include, for example, pines such as loblolly pine (Pinus taeda ), slash pine (Pinus elliotii ), ponderosa pine ( Pinus ponderosa ), lodgepole pine {Pinus contorta ), and Monterey pine {Pinus radiata ); Douglas-fir {Pseudotsuga menziesii ); Western hemlock {Tsuga canadensis ); Sitka spruce {Picea glauca); redwood {Sequoia sempervirens ); true firs such as silver fir {Abies amabilis) and balsam fir {Abies balsamea); and cedars such as Western red cedar {Thuja plicata ) and Alaska yellow-cedar {Chamaecyparis nootkatensis). In specific embodiments, plants of the present invention are crop plants (for example, com, alfalfa, sunflower, Brassica , soybean, cotton, safflower, peanut, sorghum, wheat, millet, tobacco, etc.). In other embodiments, com and soybean plants are optimal, and in yet other embodiments com plants are optimal.
Other plants of interest include grain plants that provide seeds of interest, oil-seed plants, and leguminous plants. Seeds of interest include grain seeds, such as corn, wheat, barley, rice, sorghum, rye, etc. Oil-seed plants include cotton, soybean, safflower, sunflower, Brassica , maize, alfalfa, palm, coconut, etc. Leguminous plants include beans, peas, and dry pulses. Beans include guar, locust bean, fenugreek, soybean, garden beans, cowpea, mungbean, lima bean, fava bean, lentils, chickpea, etc.
Non-limiting embodiments of the invention include:
1. A method, implemented by a processor, for providing instructions in augmented reality for agricultural products, comprising:
receiving video captured by a camera;
detecting whether an agricultural product is present in the captured video;
based on a positive detection of the agricultural product, modifying the captured video to include an instructional animation, resulting in an augmented reality video; and
displaying the augmented reality video on a display screen.
2. The method of embodiment 1, wherein detecting whether an agricultural product is present includes employing edge detection and/or line detection algorithms, to determine the presence of a marker on the agricultural product.
3. The method of embodiment 2, wherein the marker is a bi-tonal two-dimensional planar pattern located on a packaging surface of the agricultural product.
4. The method of embodiment 1, wherein detecting whether an agricultural product is present includes using computer-vision to recognize images and objects.
5. The method of embodiment 4, wherein said images or objects comprise product branding cues located on a packaging surface of the agricultural product.
6. The method of embodiment 5, wherein product branding cues comprise logos, words, images, a packaging shape, colors, or combinations thereof
7. The method of embodiment 1, wherein the instructional animation includes an audio track that describes how to prepare and/or apply the detected agricultural product.
8. The method of embodiment 1, wherein the instructional animation comprises animated steps of preparing an application form of said agricultural product.
9. The method of embodiment 8, wherein the instructional animation includes animated steps of mixing the agricultural product with a solvent, and an audio track that describes a proper ratio of the agricultural product to the solvent.
10. The method of embodiment 1, wherein the instructional animation comprises animated steps of coating seeds with said agricultural product.
11. The method of embodiment 1, wherein the instructional animation comprises animated steps of applying said agricultural product to an area of cultivation.
12. The method of embodiment 1, wherein the instructional animation comprises animated steps of applying said agricultural product to a plant.
13. The method of any one of embodiments 1-12, wherein the agricultural product comprises a pesticide or a fertilizer.
14. The method of any one of embodiments 1-12, wherein said agricultural product comprises an insecticide, fungicide, or herbicide.
15. The method of embodiment 13, wherein said pesticide comprises a pesticidal biologic.
16. The method of embodiment 15, wherein said pesticidal biologic comprises a fungicidal biologic.
17. The method of embodiment 16, wherein the fungicidal biologic comprises the
Pseudomonas chlororaphis strain deposited as NRRL No. B-50897.
18. The method of any one of embodiments 1-17, wherein said method further comprises determining a language of an audio track of the animation.
19. The method of embodiment 18, wherein determining the language includes determining a stored language preference of a device and setting the language of the audio track to the stored language.
20. The method of embodiment 1 wherein a GPS location or use patterns are stored on a device memory and/or communicated to a server on a network.
21. The method of any one of embodiments 1-20 further comprising: generating a user interface, rendered onto the augmented reality video or in a separate zone of the display outside of the augmented reality video; and
responding to user input received through the user interface.
22. The method of embodiment 21, wherein responding to user input comprises rendering an additional animation or modifying a playback of a currently playing animation.
23. The method of any one of embodiments 1-22, further comprising:
receiving audio data;
detecting, in the audio data, voice commands; and
responding to the voice commands.
24. The method of embodiment 23, wherein responding to the voice commands comprises rendering an additional animation or modifying a playback of a currently playing animation.
25. A method, implemented by a processor, for showing an area of coverage of an agricultural product in augmented reality, comprising:
receiving video captured by a camera;
detecting and characterizing a surface area of an area of cultivation in the captured video; computing an area of coverage of an agricultural product;
projecting the area of coverage onto the video of the area of cultivation, resulting in an augmented reality video; and
displaying the augmented reality video on a display screen.
26. The method of embodiment 25, wherein a GPS location or use patterns are stored on a device memory and/or communicated to a server on a network.
27. The method of embodiment 25 or 26 further comprising:
generating a user interface, rendered onto the augmented reality video or in a separate zone of the display outside of the augmented reality video; and
responding to user input received through the user interface.
28. The method of embodiment 27, wherein responding to user input comprises rendering an additional animation or modifying a playback of a currently playing animation.
29. The method of embodiment 27 or 28, further comprising:
receiving audio data;
detecting, in the audio data, voice commands; and
responding to the voice commands.
30. The method of embodiment 29, wherein responding to the voice commands comprises rendering an additional animation or modifying a playback of a currently playing animation. 31. A method, implemented by a processor, for diagnosing and providing a plan for treatment of a plant, comprising:
receiving video captured by a camera;
detecting a plant in the captured video;
characterizing the type of plant in the video;
determining whether the plant has one or more ailments;
identifying an agricultural product for treatment of the plant based on the one or more determined ailments;
generating an animation including the agricultural product;
modifying the captured video to include the generated animation, resulting in an augmented reality video; and
displaying the augmented reality video on a display screen.
32. The method of claim 31, wherein said ailment comprises infection and/or infestation by a plant pest.
33. The method of claim 32, wherein said plant pest comprises insects or fungus.
34. The method of any one of embodiments 31-33, wherein computer vision and one or more trained neural networks are used to detect and characterize the plant in the captured video, and determine whether the plant has one or more ailments.
35. The method of any one of embodiments 31-34, further comprising:
generating a user interface, rendered onto the augmented reality video or in a separate zone of the display outside of the augmented reality video; and
responding to user input received through the user interface.
36. The method of embodiment 35, wherein responding to user input comprises rendering an additional animation or modifying a playback of a currently playing animation.
37. The method of any one of embodiments 31-34, further comprising:
receiving audio data;
detecting, in the audio data, voice commands; and
responding to the voice commands.
38. The method of embodiment 37, wherein responding to the voice commands comprises rendering an additional animation or modifying a playback of a currently playing animation.
39. The method of any one of embodiments 1-38, wherein said method further comprises a step of installing a mobile application on a mobile device used for performing the method.
40. A computer program product for viewing augmented reality for an agricultural product on a computing device, the computer program product comprising instructions for execution by a processing circuit of the computing device for performing a method of any one of embodiments 1- 39.
41. The computer program product of embodiment 40, wherein said computer program product is a mobile application.
42. A mobile device for viewing augmented reality for an agricultural product, comprising a non-transitory machine readable storage medium having stored therein instructions that, when executed by a processor, perform a method of any one of embodiments 1-39.
43. The mobile device according to embodiment 42, wherein the instructions are stored in memory on a networked server, and are retrieved through the network by the mobile device and loaded into the non-transitory machine readable storage medium, to be executed by the processor.
All publications and patent applications mentioned in the specification are indicative of the level of skill of those skilled in the art to which this invention pertains. All publications and patent applications are herein incorporated by reference to the same extent as if each individual publication or patent application was specifically and individually indicated to be incorporated by reference.
Although the foregoing invention has been described in some detail by way of illustration and example for purposes of clarity of understanding, it will be obvious that certain changes and modifications may be practiced within the scope of the appended claims.

Claims

What is claimed is:
1. A method, implemented by a processor, for providing instructions in augmented reality for agricultural products, comprising:
receiving video captured by a camera;
detecting whether an agricultural product is present in the captured video;
based on a positive detection of the agricultural product, modifying the captured video to include an instructional animation, resulting in an augmented reality video; and displaying the augmented reality video on a display screen.
2. The method of claim 1, wherein detecting whether the agricultural product is present includes employing edge detection and/or line detection algorithms, to determine a presence of a marker on the agricultural product.
3. The method of claim 2, wherein the marker is a bi-tonal two-dimensional planar pattern located on a packaging surface of the agricultural product.
4. The method of claim 1, wherein detecting whether the agricultural product is present includes using computer-vision to recognize images and objects.
5. The method of claim 4, wherein said images or objects comprise product branding cues located on a packaging surface of the agricultural product.
6. The method of claim 5, wherein the product branding cues comprise logos, words, images, a packaging shape, colors, or combinations thereof.
7. The method of claim 1, wherein the instructional animation includes an audio track that describes how to prepare and/or apply the detected agricultural product.
8. The method of claim 1, wherein the instructional animation comprises animated steps of preparing an application form of said agricultural product.
9. The method of claim 8, wherein the instructional animation includes animated steps of mixing the agricultural product with a solvent, and an audio track that describes a proper ratio of the agricultural product to the solvent.
10. The method of claim 1, wherein the instructional animation comprises animated steps of coating seeds with said agricultural product.
11. The method of claim 1, wherein the instructional animation comprises animated steps of applying said agricultural product to an area of cultivation.
12. The method of claim 1, wherein the instructional animation comprises animated steps of applying said agricultural product to a plant.
13. The method of any one of claims 1-12, wherein the agricultural product comprises a pesticide or a fertilizer.
14. The method of any one of claims 1-12, wherein said agricultural product comprises an insecticide, fungicide, or herbicide.
15. The method of any one of claims 1-12, wherein said method further comprises determining a language of an audio track of the instructional animation.
16. The method of claim 15, wherein determining the language includes determining a stored language preference of a device and setting the language of the audio track to the stored language.
17. The method of claim 1 wherein a GPS location or use patterns are stored on a device memory or communicated to a server on a network.
18. The method of any one of claims 1-12, further comprising: generating a user interface, rendered onto the augmented reality video or in a separate zone of the display screen outside of the augmented reality video; and responding to user input received through the user interface.
19. A mobile device for viewing augmented reality for an agricultural product, comprising a non-transitory machine readable storage medium having stored therein instructions that, when executed by a processor, perform the following:
receiving video captured by a camera of the mobile device;
detecting whether an agricultural product is present in the captured video;
based on a positive detection of the agricultural product, modifying the captured video to include an instructional animation, resulting in an augmented reality video; and displaying the augmented reality video on a display screen of the mobile device.
20. The mobile device of claim 19, wherein the instructions are stored in memory on a networked server, and are retrieved through the network by the mobile device and loaded into the non-transitory machine readable storage medium of the mobile device, to be executed by the processor of the mobile device.
PCT/US2019/039515 2018-06-29 2019-06-27 Augmented reality for agricultural use WO2020006236A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201862691963P 2018-06-29 2018-06-29
US62/691,963 2018-06-29

Publications (1)

Publication Number Publication Date
WO2020006236A1 true WO2020006236A1 (en) 2020-01-02

Family

ID=67303524

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2019/039515 WO2020006236A1 (en) 2018-06-29 2019-06-27 Augmented reality for agricultural use

Country Status (1)

Country Link
WO (1) WO2020006236A1 (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5849320A (en) 1996-06-13 1998-12-15 Novartis Corporation Insecticidal seed coating
WO2007103076A1 (en) 2006-03-01 2007-09-13 Bayer Cropscience, Lp A polymer based seed coating
US20120233070A1 (en) * 2011-03-08 2012-09-13 Bank Of America Corporation Presenting offers on a mobile communication device
US20140156459A1 (en) * 2012-12-04 2014-06-05 Ebay Inc. In-store product detection system
US20140152847A1 (en) * 2012-12-03 2014-06-05 Google Inc. Product comparisons from in-store image and video captures
US9795144B2 (en) 2014-01-31 2017-10-24 AgBiome, Inc. Modified biological control agents and their uses

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5849320A (en) 1996-06-13 1998-12-15 Novartis Corporation Insecticidal seed coating
WO2007103076A1 (en) 2006-03-01 2007-09-13 Bayer Cropscience, Lp A polymer based seed coating
US20120233070A1 (en) * 2011-03-08 2012-09-13 Bank Of America Corporation Presenting offers on a mobile communication device
US20140152847A1 (en) * 2012-12-03 2014-06-05 Google Inc. Product comparisons from in-store image and video captures
US20140156459A1 (en) * 2012-12-04 2014-06-05 Ebay Inc. In-store product detection system
US9795144B2 (en) 2014-01-31 2017-10-24 AgBiome, Inc. Modified biological control agents and their uses

Non-Patent Citations (4)

* Cited by examiner, † Cited by third party
Title
"How Augmented Reality Can Bring Changes in Agriculture?", 29 July 2017 (2017-07-29), XP002793629, Retrieved from the Internet <URL:https://www.republiclab.com/augmented-reality-agriculture/> *
"Manual on development and use of FAO and WHO specifications for pesticides, FAO Plant Production and Protection Papers - 173", 2004, article "Crop Life International and in Pesticide Specifications"
BAUR ET AL., PESTICIDE SCIENCE, vol. 51, 1997, pages 131 - 152
CHEMICAL ABSTRACTS, Columbus, Ohio, US; abstract no. 66733-21-9

Similar Documents

Publication Publication Date Title
US20200221703A1 (en) Bacterial strains and their use for controlling plant disease
CN113631040B (en) Compositions and methods for controlling plant pests and improving plant health
CN113163771B (en) Compositions and methods for controlling plant pests and improving plant health
WO2019023226A1 (en) Compositions and methods for improving plant health and controlling plant disease and pests
US20200054022A1 (en) Compositions and methods for controlling plant pests and plant disease
WO2020006555A1 (en) Compositions comprising bacteria and methods for controlling plant pests and improving plant health
WO2019074813A1 (en) Compositions and methods for improving plant health and controlling plant disease and pests
US20220312774A1 (en) Compositions and methods for improving plant health and controlling plant disease
WO2020006236A1 (en) Augmented reality for agricultural use
KR102671224B1 (en) Bacterial strains and their use for controlling plant diseases
WO2019241370A1 (en) Compositions and methods for improving plant health and controlling plant disease
BR112018004081B1 (en) COMPOSITIONS COMPRISING A BACTERIAL STRAIN, METHOD FOR GROWING A PLANT SUSCEPTABLE TO A DISEASE, METHODS FOR CONTROLLING ONE OR MORE PLANT PATHOGENS, METHOD FOR TREATMENT OR PREVENTION OF A PLANT DISEASE AND USE OF SAID COMPOSITIONS FOR CONTROLLING PLANT DISEASES

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19740460

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19740460

Country of ref document: EP

Kind code of ref document: A1