CN116049472A

CN116049472A - Information-related plant maintenance method, system and storage medium

Info

Publication number: CN116049472A
Application number: CN202211364251.9A
Authority: CN
Inventors: 徐青松; 李青
Original assignee: Hangzhou Ruisheng Software Co Ltd
Current assignee: Hangzhou Ruisheng Software Co Ltd
Priority date: 2022-11-02
Filing date: 2022-11-02
Publication date: 2023-05-02
Also published as: WO2024094040A1

Abstract

The invention provides an information-associated plant maintenance method, system and storage medium, wherein the method comprises the following steps: acquiring a plant image provided by a user; acquiring species information of the plant according to a pre-trained plant species identification model; acquiring health degree and disease information of the plant according to a pre-trained plant health degree and disease identification model; acquiring species information and health degree and disease information of other maintenance plants of a user; and (5) combining species information, health degree and disease information of all plants maintained by the user, and determining and outputting maintenance reminding information.

Description

Information-related plant maintenance method, system and storage medium

Technical Field

The present invention relates to the field of computer technologies, and in particular, to a method, a system, and a storage medium for plant maintenance associated with information.

Background

With the improvement of living standard, plants are increasingly appearing in people's life. However, plants may have various conditions during growth due to the effects of various biological or non-biological factors. In this case, attention and treatment are required to be paid to the disease in time, otherwise the plant will grow poorly and even die, which affects the ornamental value of the plant and even causes economic loss. Meanwhile, part of users maintain a plurality of different kinds of plants, if the plants have infectious diseases, the other plants are affected to a certain extent, and how to relatedly maintain the different kinds of plants is a technical problem to be solved.

Disclosure of Invention

It is an object of the present disclosure to provide an information-related plant maintenance method, comprising:

acquiring a plant image provided by a user;

acquiring species information of the plant according to a pre-trained plant species identification model;

acquiring health degree and disease information of the plant according to a pre-trained plant health degree and disease identification model;

acquiring species information and health degree and disease information of other maintenance plants of a user;

and (5) combining species information, health degree and disease information of all plants maintained by the user, and determining and outputting maintenance reminding information.

In some embodiments, according to the acquired species information and health and disease information of all plants, judging whether the species has infectious disease and other species affected by the infectious disease are included, and outputting maintenance reminding information for the affected species.

In some embodiments, the maintenance reminder information includes condition protection and treatment information.

In some embodiments, the infectious disease and species related information affected thereby are pre-stored in a database.

In some embodiments, outputting the maintenance reminder for the affected species includes outputting the maintenance reminder at an interactive interface of the species having the infectious disorder and/or the other affected species.

In some embodiments, the species information and health and condition information of the other maintenance plants are obtained by means of a historical identification record of the current user or manually added by the user.

In some embodiments, the maintenance reminder is adjusted according to a current user's maintenance capability level, which is validated according to the current user's historical maintenance data.

In some embodiments, the method further comprises: and acquiring the growth place information and the time information of the plants so as to determine the season information, and adjusting the output maintenance reminding information according to the season information and the species information of the maintenance of the users.

According to another aspect of the present disclosure, there is provided an information-related plant-growing system including a processor and a memory, the memory having stored thereon a program which, when executed by the processor, implements the information-related plant-growing method as described above.

According to another aspect of the present disclosure, there is provided a storage medium having a program stored thereon, characterized in that the program, when executed, implements the plant care method of information correlation as described above.

Other features of the present disclosure and its advantages will become more apparent from the following detailed description of exemplary embodiments of the disclosure, which proceeds with reference to the accompanying drawings.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments of the disclosure and together with the description, serve to explain the principles of the disclosure.

The disclosure may be more clearly understood from the following detailed description taken in conjunction with the accompanying drawings in which:

fig. 1 is a schematic flow chart of a plant maintenance method related to information provided in an embodiment of the invention.

Fig. 2 is a schematic structural diagram of a plant maintenance system with information association according to an embodiment of the present invention.

Note that in the embodiments described below, the same reference numerals are used in common between different drawings to denote the same parts or parts having the same functions, and a repetitive description thereof may be omitted. In some cases, like numbers and letters are used to designate like items, and thus once an item is defined in one drawing, no further discussion thereof is necessary in subsequent drawings.

For ease of understanding, the positions, dimensions, ranges, etc. of the respective structures shown in the drawings and the like may not represent actual positions, dimensions, ranges, etc. Accordingly, the present disclosure is not limited to the disclosed positions, dimensions, ranges, etc. as illustrated in the accompanying drawings.

Detailed Description

Various exemplary embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings. It should be noted that: the relative arrangement of the components and steps, numerical expressions and numerical values set forth in these embodiments do not limit the scope of the present disclosure unless it is specifically stated otherwise.

The following description of at least one exemplary embodiment is merely illustrative in nature and is in no way intended to limit the disclosure, its application, or uses. That is, the structures and methods herein are shown by way of example to illustrate different embodiments of the structures and methods in this disclosure. However, those skilled in the art will appreciate that they are merely illustrative of the exemplary ways in which the disclosure may be practiced, and not exhaustive. Moreover, the figures are not necessarily to scale, some features may be exaggerated to show details of particular components.

Techniques, methods, and apparatus known to one of ordinary skill in the relevant art may not be discussed in detail, but should be considered part of the specification where appropriate.

In all examples shown and discussed herein, any specific values should be construed as merely illustrative, and not a limitation. Thus, other examples of the exemplary embodiments may have different values.

Users pay great attention to plant health, and disease control is an effective means for maintaining plant health and is an important link in the maintenance process. After disease control information of single plants is perfected, the disease control information is spread to the whole garden or maintenance of all plants owned by a user, and the user can conveniently read and use the important information and correlate the disease maintenance of all plants. Meanwhile, at proper nodes, the user is informed of diseases frequently occurring in the season corresponding to the plants and the control means which can be adopted, and the plant cultivation method can effectively help the user to cultivate the plants.

Fig. 1 is a schematic flow chart of an information-related plant maintenance method according to an embodiment of the present invention, where the method may be implemented in an application program (app) installed on an intelligent terminal, such as a mobile phone, a tablet computer, etc.

As shown in fig. 1, the method includes:

step S100: acquiring a plant image provided by a user;

step S200: acquiring species information of the plant according to a pre-trained plant species identification model;

step S300: acquiring health degree and disease information of the plant according to a pre-trained plant health degree and disease identification model;

step S400: acquiring species information and health degree and disease information of other maintenance plants of a user;

step S500: and (5) combining species information, health degree and disease information of all plants maintained by the user, and determining and outputting maintenance reminding information.

The plant image provided by the user can be obtained through a camera of an intelligent terminal such as a mobile phone, a tablet personal computer and the like, and also can be obtained by manually adding and uploading by the user.

The species identification model may be a neural network model, in particular a convolutional neural network model or a residual network model. The convolutional neural network model is a deep feed-forward neural network, and a convolutional kernel is utilized to scan the species image, so that a plurality of features to be identified in the species image are extracted, and the features to be identified of the species are identified. In addition, in the process of identifying the species image, the original species image can be directly input into the convolutional neural network model without preprocessing the species image. Compared with other recognition models, the convolutional neural network model has higher recognition accuracy and recognition efficiency.

Compared with a convolutional neural network model, the residual network model has more identical mapping layers, and can avoid the phenomenon of saturated accuracy and even reduced accuracy caused by the increase of network depth (the number of layers in the network). The identity mapping function of the identity mapping layer in the residual network model needs to satisfy: the sum of the identity mapping function and the input of the residual network model is equal to the output of the residual network model. After the identity mapping is introduced, the variation of the residual network model on the output is more obvious, so that the feature recognition accuracy and recognition efficiency of the species can be greatly improved.

In some embodiments, training the feature classification model may include:

acquiring a first sample set with a preset number of species images marked with a plurality of characteristic information;

determining a proportion of the species images from the first sample set as a first training set;

training a feature classification model by using a first training set; and

and finishing training when the first training accuracy is greater than or equal to the first preset accuracy, and obtaining the trained feature classification model.

In particular, in the first sample set, a large number of species images may be included, and each species image is correspondingly labeled with its corresponding plurality of features. Inputting the species image into a feature classification model to generate output feature information, and then adjusting related parameters in the feature classification model according to a comparison result between the output feature information and the marked feature information, namely training the feature classification model until training is finished when the first training accuracy of the feature classification model is greater than or equal to the first preset accuracy, so as to obtain a trained feature classification model. The feature classification model may also output a plurality of candidate features based on a species image, wherein each candidate feature may have its corresponding feature confidence level for further analysis screening.

Further, the feature classification model obtained through training can be tested, which specifically includes:

determining a proportion of the species images from the first set of samples as a first test set;

determining a first model accuracy of the trained feature classification model by using the first test set; and

and when the accuracy of the first model is smaller than the second preset accuracy, the first training set and/or the feature classification model are adjusted to retrain.

In general, the first test set and the species images in the first training set are not identical, so that the first test set can be used to test whether the feature classification model has a good recognition effect on the species images outside the first training set. During the testing, a first model accuracy of the feature classification model is calculated by comparing the output feature information generated from the images of the species in the first test set with the annotated feature information. In some examples, the method of calculating the first model accuracy may be the same as the method of calculating the first training accuracy. When the accuracy of the first model obtained by the test is smaller than the second preset accuracy, the recognition effect of the feature classification model is not good enough, so that the first training set can be adjusted, specifically, for example, the number of species images marked with the feature information in the first training set can be increased, or the feature classification model is adjusted, or both the feature classification model and the feature classification model are adjusted, and then the feature classification model is retrained to improve the recognition effect. In some embodiments, the second preset accuracy may be set equal to the first preset accuracy.

The plant species information is acquired according to a pre-trained plant species identification model, so that the health degree and disease information of the plant can be identified based on the plant species information in the subsequent processing, and the plant species information related to the infectious disease can be determined more accurately. In addition, the plant recognition result page which is recognized in the history of the user or the plant maintenance interface manually added by the user can also directly enter the subsequent plant health degree and disease information recognition processing flow, so that the process of recognizing the plant species again is skipped.

The principle of the plant health and disease recognition model and the training process can be referred to the description of the plant species recognition model, which is not repeated here. The species information, the health degree and the disease information of other plants maintained by the user can be obtained according to the historical identification information of the user, and the species information, the health degree and the disease information of all plants maintained by the current user can be obtained by manually adding and obtaining the species information, the health degree and the disease information of all plants maintained by the user in an interactive mode.

In some embodiments, according to the acquired species information and health and disease information of all plants, judging whether the species has infectious disease and other species affected by the infectious disease are included, and outputting maintenance reminding information for the affected species. Information about infectious disorders is pre-stored in a relational database, which may be determined by government agencies and associations in the field of plants, or by plant experts in the field, and information about the infectious disorders and species affected thereby is pre-stored in the database.

And (3) combining species information, health degree and disease information of all plants maintained by the user, and determining and outputting maintenance reminding information, wherein the maintenance reminding information comprises disease protection and treatment information, for example, when a certain plant is identified to have a certain specific infectious disease, related information for displaying disease control of other plants maintained can be related. Further, outputting maintenance reminder information for the affected species includes outputting maintenance reminder information at an interactive interface of the species having the infectious disease and/or the other affected species.

In some embodiments, certain plants maintained by the user are susceptible to the infection of red spiders, which are mites, infectious, and a virulent infectious disease, whether direct contact between the branches and leaves, or blowing or watering, can potentially blow the adults and eggs of the red spiders onto other plants, and then cross-infect, which can be counted as 110 plants. For example, according to a plant image provided by a user, a plant currently maintained by the user is identified as a rose through a plant species identification model, the rose is a species which is easy to infect red spider diseases, then according to the plant health degree and disease identification model, the rose currently maintained by the user is identified as being truly infected by the red spider diseases, the red spider is determined to be an infectious disease according to the information of an infectious disease database, meanwhile, according to the user history identification information or the information manually added to the maintained plant and species association information influenced by the red spider diseases, other associated maintained plants influenced by the red spider diseases by the current user are known to have plants such as scindapsus aureus, crabapple and jasmine, maintenance reminding information needs to be output for the plants, so that information on how to prevent and cure the red spider diseases, namely how to prevent and how to conduct early discovery and treatment schemes, such as how to isolate and medication are used, and occurrence of plant diseases is avoided or killed in a germination stage is required. In this embodiment, information on how to treat red spider diseases can be output on the maintenance page of China rose, and information on how to isolate and prevent infectious diseases of red spider, which need to be noted, can also be output on the maintenance page of plants such as scindapsus aureus, begonia, jasmine, and the like. In this way, all plants maintained by the user are associated, so that the infection path of the infectious diseases can be effectively cut off, and diseases related to other plant infection can be avoided.

In some embodiments, the maintenance reminder is adjusted according to a current user's maintenance capability level, which is validated according to the current user's historical maintenance data. For example, the prevention and treatment of red spider diseases have various modes, such as a method of watering to remove dust and increase humidity, a method of spraying pesticides, a method of cutting and isolating, a method of adding predatory mites on plants for users who do not like pesticides, a method of spraying neem oil or soapy water, and the soapy water can be prepared by soap or washing powder. The control information of different red spider diseases can be pushed according to the maintenance capability of the current user and used as maintenance reminding information to be output to the maintenance page of each associated plant.

In some embodiments, the method further comprises: and acquiring the growth place information and the time information of the plants so as to determine the season information, and adjusting the output maintenance reminding information according to the season information and the species information of the maintenance of the users. The information of the growing places of the plants, the time information associated with the plants can be directly obtained from a user in a man-machine interaction mode and/or can be obtained from images input by the user in a recognition mode through a computer vision technology. The plant growing area information is, for example, one or more of latitude and longitude, administrative division, and climate zone where the plant growing area is located. The information of the growing place of the plant can be obtained by, for example, an application program reading the positioning information of the terminal where it is located, and can be extracted from, for example, metadata of an image input by a user. For example, corresponding maintenance reminding information is pushed to the maintenance plants associated with the infectious diseases which are high in current time in a specific time period, so that the user can prevent and treat the infectious diseases in a targeted way.

The climate nodes of different growing places are different, for example, beijing into spring may be 2 weeks later than Hangzhou, and if the maintenance reminding information is not adapted according to the climate of the place of the user, the recommended time node has no operability in accuracy. For common diseases of the current plants, corresponding disease prevention and treatment prompts can be output in different seasons or time periods. The climates and seasons of different user positions are different, so that the user needs to acquire and adaptively adjust according to the positions where the user maintains plants, and different longitude and latitude areas in the same country may have different seasons and climates, and the user needs to correspondingly adjust. In addition, corresponding diseases and insect pests which are common in the season can be output according to the curing capability of the user, the curing capability is high, simple diseases can not be output, the disease control scheme can be adjusted according to the user capability, because the user with higher curing capability generally does not have particularly simple plant diseases or has very knowledge on related diseases, and the user does not need to output preventive reminders so as to achieve concise display of curing information.

Based on the same inventive concept, the present invention further provides an information-related plant maintenance system, please refer to fig. 2, fig. 2 is a schematic structural diagram of the information-related plant maintenance system provided by an embodiment of the present invention, and as shown in fig. 2, the information-related plant maintenance system includes a processor 301, a communication interface 302, a memory 303 and a communication bus 304.

The processor 301, the communication interface 302, and the memory 303 perform communication with each other through the communication bus 304.

The memory 303 is used for storing a computer program.

The processor 301 is configured to execute the program stored in the memory 303, and implement the following steps:

acquiring a plant image provided by a user;

For a specific implementation of each step of the method, reference may be made to the method embodiment shown in fig. 1, and details are not repeated herein.

In addition, other implementation manners of the plant maintenance method related to information realized by the processor 301 executing the program stored in the memory 303 are the same as those mentioned in the foregoing method embodiment, and will not be described herein again.

The communication bus 304 mentioned above for the electronic devices may be a peripheral component interconnect standard (Peripheral Component Interconnect, PCI) bus or an extended industry standard architecture (Extended Industry Standard Architecture, EISA) bus, etc. The communication bus 304 may be classified as an address bus, a data bus, a control bus, or the like. For ease of illustration, the figures are shown with only one bold line, but not with only one bus or one type of bus.

The communication interface 302 is used for communication between the electronic device and other devices described above.

The processor 301 may be a central processing unit (Central Processing Unit, CPU), but may also be other general purpose processors, digital signal processors (Digital Signal Processor, DSP), application specific integrated circuits (Application Specific Integrated Circuit, ASIC), off-the-shelf programmable gate arrays (Field-Programmable Gate Array, FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, or the like. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like, and the processor 301 is the control center of the electronic device and connects the various parts of the overall electronic device using various interfaces and lines.

The memory 303 may be used to store the computer program, and the processor 301 may implement various functions of the electronic device by running or executing the computer program stored in the memory 303 and invoking data stored in the memory 303.

The memory 303 may include non-volatile and/or volatile memory. The nonvolatile memory can include Read Only Memory (ROM), programmable ROM (PROM), electrically Programmable ROM (EPROM), electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double Data Rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous Link DRAM (SLDRAM), memory bus direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM), among others.

The present invention also proposes a readable storage medium having stored thereon a program which, when executed, can implement the steps of:

acquiring a plant image provided by a user;

The computer-readable storage media of embodiments of the present invention may take the form of any combination of one or more computer-readable media. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. The computer readable storage medium can be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples (a non-exhaustive list) of the computer-readable storage medium would include the following: an electrical connection having one or more wires, a portable computer hard disk, a hard disk, random Access Memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.

The computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, either in baseband or as part of a carrier wave. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination of the foregoing. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.

Computer program code for carrying out operations of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, smalltalk, C ++ and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computer (for example, through the Internet using an Internet service provider).

It should be noted that the apparatus and methods disclosed in the embodiments herein may be implemented in other ways. The apparatus embodiments described above are merely illustrative, for example, flow diagrams and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of apparatus, methods and computer program products according to various embodiments herein. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.

In addition, the functional modules in the embodiments herein may be integrated together to form a single part, or the modules may exist alone, or two or more modules may be integrated to form a single part.

The above description is only illustrative of the preferred embodiments of the present invention and is not intended to limit the scope of the present invention, and any changes and modifications made by those skilled in the art in light of the above disclosure are intended to fall within the scope of the appended claims.

Claims

1. An information-related plant maintenance method, comprising:

acquiring a plant image provided by a user;

acquiring health degree and disease information of the plant according to a pre-trained plant health degree and disease identification model; acquiring species information and health degree and disease information of other maintenance plants of a user;

2. The method according to claim 1, wherein determining whether the species has an infectious disease and other species affected by the infectious disease is performed based on the acquired species information and health and disease information of all plants, and a maintenance alert is output to the affected species.

3. The method of claim 2, wherein the maintenance reminder information includes condition protection and treatment information.

4. The method of claim 2, wherein the infectious disease and species related information affected thereby are pre-stored in a database.

5. The method of claim 2, wherein outputting a maintenance reminder to the affected species comprises outputting a maintenance reminder at an interactive interface of the species with the infectious disease and/or the other affected species.

6. The method of claim 1, wherein the species information and health and condition information of the other cured plants are obtained by means of a current user's history identification record or manually added by the user.

7. The method of claim 1, wherein the maintenance reminder information is adjusted based on a current user's maintenance capability level, the maintenance capability level being determined based on current user's historical maintenance data.

8. The method of information-related plant maintenance according to claim 1, further comprising: and acquiring the growth place information and the time information of the plants so as to determine the season information, and adjusting the output maintenance reminding information according to the season information and the species information of the maintenance of the users.

9. An information-related plant-growing system comprising a processor and a memory, wherein the memory has a program stored thereon, which when executed by the processor, implements the information-related plant-growing method according to any one of claims 1 to 8.

10. A storage medium having a program stored thereon, wherein the program, when executed, implements the method of plant care associated with information according to any one of claims 1 to 8.