Disclosure of Invention
The application provides a method, a system, a device, equipment and a storage medium for monitoring the food intake of a pasture, which are used for solving the problems of livestock food deprivation, residual food accumulation and the like caused by a feeding mode of timing operation.
In a first aspect, an embodiment of the present application provides a method for monitoring food intake in a pasture, including:
acquiring a forage image of a feeding channel in a pasture barn;
identifying forage information in the ingestion channel according to the forage image;
generating a forage processing notification message;
and sending the forage processing notification message.
Optionally, the generating the forage processing notification message includes:
if the forage residue in the ingestion channel is determined to be less than or equal to a first threshold value according to the forage residue information in the forage information, determining that the forage in the ingestion channel is empty, and generating a forage spreading notification message;
and if the forage residual in the ingestion channel is determined to be larger than the first threshold value and smaller than the second threshold value according to the forage residual information, judging that a small amount of forage remains in the ingestion channel, and generating a notification message of clearing the forage.
Optionally, the generating the forage processing notification message includes:
and if the forage allowance in the ingestion channel is determined to be not less than a second threshold value according to the forage allowance information in the forage information, and the flatness information of the forage is determined to indicate that the forage has poor flatness, generating a push notification message, wherein the forage information comprises the flatness information of the forage.
Optionally, the acquiring forage images of the feeding passage in the pasture barn includes:
acquiring a forage image of a feeding channel in a pasture colony house in a detection period;
after the forage in the ingestion channel is judged to be empty and before the notification message of spreading is generated, the method further comprises the following steps:
and determining the forage processing notification message generated in the last detection period as the notification message of the material clearing.
Optionally, the identifying forage information in the ingestion channel according to the forage image includes:
inputting the forage image into a deep learning convolution neural network model to obtain a labeled image which is output by the deep learning convolution neural network model and is used for labeling a forage region;
and determining forage information in the ingestion channel according to the forage area marked in the marked image.
In a second aspect, an embodiment of the present application provides a pasture ingestion monitoring system, including:
the intelligent image acquisition equipment is used for acquiring a forage image of a feeding channel in a pasture colony house, identifying forage information in the feeding channel according to the forage image and transmitting the forage information to the edge computing gateway;
the edge computing gateway is used for acquiring the forage information, generating a forage processing notification message and transmitting the forage processing notification message to a network server through a router;
the network server is used for acquiring the forage processing notification message and forwarding the forage processing notification message to the terminal;
and the terminal is used for acquiring and prompting the forage processing notification message.
Optionally, the edge computing gateway is specifically configured to:
if the forage residue in the ingestion channel is determined to be less than or equal to a first threshold value according to the forage residue information in the forage information, determining that the forage in the ingestion channel is empty, and generating a forage spreading notification message;
and if the forage residual in the ingestion channel is determined to be larger than the first threshold value and smaller than the second threshold value according to the forage residual information, judging that a small amount of forage remains in the ingestion channel, and generating a notification message of clearing the forage.
Optionally, the edge computing gateway is specifically configured to:
and if the forage allowance in the ingestion channel is determined to be not less than a second threshold value according to the forage allowance information in the forage information, and the flatness information of the forage is determined to indicate that the forage has poor flatness, generating a push notification message, wherein the forage information also comprises the flatness information of the forage.
Optionally, the intelligent image capturing device is specifically configured to:
acquiring a forage image of a feeding channel in a pasture colony house in a detection period;
the edge computing gateway is specifically configured to:
and after the forage in the ingestion channel is judged to be empty and before the notification message of spreading the forage is generated, determining the forage processing notification message generated in the last detection period as the notification message of clearing the forage.
In a third aspect, an embodiment of the present application provides a pasture ingestion monitoring device, including:
the system comprises an acquisition module, a storage module and a control module, wherein the acquisition module is used for acquiring forage images of a feeding channel in a pasture colony house;
the identification module is used for identifying forage information in the ingestion channel according to the forage image;
the processing module is used for generating a forage processing notification message;
and the notification module is used for sending the forage processing notification message.
In a fourth aspect, an embodiment of the present application provides an electronic device, including: the system comprises a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory are communicated with each other through the communication bus;
the memory for storing a computer program;
the processor is configured to execute the program stored in the memory, and implement the method for monitoring the feeding of the pasture according to the first aspect.
In a fifth aspect, an embodiment of the present application provides a computer-readable storage medium, which stores a computer program, and the computer program, when executed by a processor, implements the method for monitoring feed intake in a pasture according to the first aspect.
Compared with the prior art, the technical scheme provided by the embodiment of the application has the following advantages: the method provided by the embodiment of the application obtains the forage image of the ingestion channel in the pasture colony house, through the forage image, the forage information in the ingestion channel is identified, the forage processing notification message is further generated according to the forage information, the forage processing notification message is sent, and therefore after the forage information of the ingestion channel in the pasture colony house is obtained through monitoring, operation personnel can be timely notified to carry out operation, the problems that livestock eat is interrupted due to the fact that forage is not added in time in a timing operation mode, surplus forage is accumulated and goes bad due to the fact that the forage is not cleared up in time are avoided, and the scientificity of a livestock feeding link is guaranteed.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some embodiments of the present application, but not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
In the embodiment of the application, in order to solve the problems that the feeding mode of the timing operation causes the livestock to eat food inevitably and the surplus food is accumulated, the method for monitoring the food intake in the pasture is provided, the method can be applied to any electronic equipment, the electronic equipment can acquire the forage images of the food intake passage in the pasture in time, communication connection can be established between the electronic equipment and the image acquisition equipment, the image acquisition equipment acquires the forage images of the food intake passage and then immediately transmits the forage images to the electronic equipment, and the electronic equipment can also be intelligent image acquisition equipment. The method can also be completed by more than two electronic devices together, for example, the monitoring device collects forage images, and the processing device identifies forage information and generates corresponding forage processing notification messages. That is to say, the software program of the pasture ingestion monitoring method provided in the embodiment of the present application may be respectively deployed in different entity devices by several modules, or may be deployed in one entity device as one module.
Specifically, as shown in fig. 1, the concrete process of pasture ingestion monitoring is as follows:
step 101, obtaining a forage image of a feeding passage in a pasture barn.
In one embodiment, images of forage in the feeding path of the pasture barn can be obtained according to the detection period. Wherein, one or more forage images are collected in one detection period.
For example, the camera acquires a forage image of the ingestion pathway every 5 seconds.
The pasture barn can be a barn for arbitrarily housing livestock, such as a cattle barn.
The device can be an image acquisition device directly aligned to a feeding channel of a pasture colony house through a lens, and a forage image of the feeding channel is provided.
Here, the forage image refers to an image covering an area where the forage is present.
And 102, identifying forage information in the ingestion channel according to the forage image.
In a specific embodiment, the forage image is input into a deep learning convolution neural network model, and a marked image which is output by the deep learning convolution neural network model and is used for marking the forage region is obtained; and determining forage information in the ingestion channel according to the forage area marked in the marked image.
The training process of the deep learning convolutional neural network model is as shown in fig. 2, and is roughly as follows:
step 201, obtaining a sample image, wherein the sample image marks the forage area of the collected ingestion channel.
The sample image may be obtained by manually marking the collected sample image of the ingestion passage, for example, manually circling out a forage region from the sample image. The marked sample image is important data for artificial intelligence training, marking is required to be as accurate as possible, and the recognition accuracy of the trained model is correspondingly improved with higher accuracy.
Step 202, inputting the sample image into the original deep learning convolutional neural network model, and obtaining an identification image output by the original deep learning convolutional neural network model, wherein the identification image comprises the identified forage region.
Step 203, judging whether the identified forage area is consistent with the marked forage area, if not, executing step 204, otherwise, executing step 205;
step 204, after adjusting the parameters in the original deep learning convolutional neural network model, executing step 202;
and step 205, taking the corresponding original deep learning convolutional neural network model as a final deep learning convolutional neural network model when the original deep learning convolutional neural network model is consistent.
In the initial state original deep learning convolutional neural network model, the parameters are preset values.
It should be noted that, in the embodiment of the present application, the structure of the deep learning convolutional neural network model specifically used is not limited, and any stout region in the image can be identified. The following is merely an example of one implementation, and as shown in fig. 3, the rough training process inside the deep learning convolutional neural network model includes:
step 301, converting a sample image by a deep learning convolutional neural network model, setting a pixel value in a marked forage region in the sample image to be 1, and setting a pixel value outside the marked forage region in the sample image to be 0 to obtain an 0/1 matrix with the same size as the sample image;
step 302, carrying out convolution operation on the 0/1 matrix by a deep learning convolution neural network model to generate a new matrix, and taking the new matrix as a training diagram matrix to enhance an original signal and reduce noise;
step 303, inputting the training image matrix into a VGG network by the deep learning convolutional neural network model to obtain a feature matrix output by the VGG network;
and step 304, carrying out deconvolution operation on the feature matrix by the deep learning convolution neural network model to obtain low-level features, and forming an image matrix with the size equivalent to that of the 0/1 matrix through the low-level features, wherein the image matrix is an image containing the identified forage region.
In one embodiment, the forage information includes forage residue information.
Specifically, after a currently obtained forage image is input into a deep learning convolutional neural network model, a marked image which is output by the deep learning convolutional neural network model and is marked with a forage region is obtained, the number of pixels covered by the forage region in the marked image is obtained, a proportion value of the number of pixels covered by the forage region to the total number of pixels of the whole image is calculated, and the proportion value is used as forage residue information. It should be noted that the forage remaining amount information may also be calculated in other manners, which is only one implementation manner, for example, the forage remaining amount information may also be obtained by a ratio of the number of pixels covered by the forage area to the number of pixels covered by the ingestion channel, the ingestion channel area may be obtained by artificial intelligence recognition, and the specific principle may refer to the recognition process of the forage area.
In one embodiment, the forage information includes the forage residual information and the flatness information of the forage.
Specifically, after a currently obtained forage image is input into a deep learning convolutional neural network model, a marked image which is output by the deep learning convolutional neural network model and marks a forage region is obtained, the number of the forage regions marked in the marked image is counted, whether the number of the marked forage regions exceeds a preset value or not is judged, if yes, the flatness information of the forage indicates poor flatness, a material pushing vehicle needs to be informed to perform flattening, and if not, the flatness information of the forage indicates excellent flatness without flattening. Because the livestock is when the feed, probably raise the forage far away, lead to the livestock can't eat the forage that scatters to far away, through the roughness information that detects the forage in this embodiment to in time inform the operation personnel to level under the poor condition of roughness information indication roughness, thereby can effectively solve and give the problem.
And 103, generating a forage processing notification message according to the identified forage information.
In one embodiment, the forage processing notification message includes a material scattering notification message, a material clearing notification message, and a material pushing notification message.
The material scattering notification message is used for notifying the material scattering vehicle of scattering materials, the material cleaning notification message is used for notifying the material cleaning vehicle of cleaning materials, and the material pushing notification message is used for notifying the material pushing vehicle of leveling forage materials.
Specifically, if the forage residual amount in the ingestion channel is determined to be smaller than or equal to a first threshold value according to the forage residual amount information, the forage in the ingestion channel is judged to be empty, and a notification message of spreading is generated. And if the forage residual in the ingestion channel is determined to be larger than the first threshold value and smaller than the second threshold value according to the forage residual information, judging that a small amount of forage remains in the ingestion channel, and generating a notification message of clearing the forage. And if the forage remaining amount in the ingestion channel is determined to be not less than the second threshold value according to the forage remaining amount information, and the flatness information of the forage is determined to indicate that the forage is poor in flatness, generating a material pushing notification message.
In one embodiment, if the forage processing notification message generated in the last detection period is determined to be a notification message of material clearing, after the forage in the ingestion channel is determined to be empty in the current detection period, a notification message of material scattering is generated, so as to further avoid the situation that the material scattering notification is mistakenly sent under the condition that the forage is eaten right after the forage is used up.
And 104, sending the forage processing notification message.
In one embodiment, the forage processing notification message is sent to a network server, and the network server transmits the forage processing notification message to a corresponding mobile terminal so as to notify relevant operators to perform field operation according to the forage processing notification message.
Specifically, the material scattering notification message is sent to the network server, and the network server obtains the terminal of the material scattering operator configured corresponding to the material scattering notification message and sends the material scattering notification message to the terminal of the material scattering operator. And sending the notification message of material cleaning to a network server, acquiring the terminal of the material cleaning operator configured corresponding to the notification message of material cleaning by the network server, and sending the notification message of material cleaning to the terminal of the material cleaning operator. And sending the notification message of the material pushing to a network server, wherein the network server acquires the terminal of the material pushing operator configured corresponding to the notification message of the material pushing and sends the notification message of the material pushing to the terminal of the material pushing operator.
The terminals of the material scattering operators, the terminals of the material clearing operators and the terminals of the material pushing operators only need to be provided with corresponding application program client software (APP), and the three terminals can be the same entity or different entities as required.
In a specific embodiment, a process of generating a forage processing notification message and notifying a job is shown in fig. 4, and specifically includes:
step 401, judging whether the forage allowance in the ingestion channel is larger than a first threshold value according to the forage allowance information, if not, executing step 404, and if so, executing step 402;
step 402, judging whether the forage allowance in the ingestion channel is larger than a first threshold value and smaller than a second threshold value or not according to the forage allowance information, if so, executing step 405, otherwise, executing step 403;
step 403, judging whether the forage flatness in the ingestion channel is smaller than a preset value according to the forage flatness information, if so, executing step 406, otherwise, ending the flow;
step 404, after the spreading vehicle is informed to spread new forage, the flow is ended;
step 405, after the cleaning vehicle is informed to clean the forage, the flow is ended;
and step 406, after the pushing trolley is informed of leveling the forage, ending the flow.
The method provided by the embodiment of the application obtains the forage image of the ingestion channel in the pasture colony house, through the forage image, the forage information in the ingestion channel is identified, the forage processing notification message is further generated according to the forage information, the forage processing notification message is sent, and therefore after the forage information of the ingestion channel in the pasture colony house is obtained through monitoring, operation personnel can be timely notified to carry out operation, the problems that livestock eat is interrupted due to the fact that forage is not added in time in a timing operation mode, surplus forage is accumulated and goes bad due to the fact that the forage is not cleared up in time are avoided, and the scientificity of a livestock feeding link is guaranteed.
Based on the same concept, the embodiment of the present application provides a pasture ingestion monitoring system, as shown in fig. 5, which mainly includes an intelligent image acquisition device 501, an edge computing gateway 502, a router 503, a network server 504 and a terminal 505.
The intelligent image acquisition device 501 is used for acquiring forage images of a feeding channel in a pasture barn, identifying forage information in the feeding channel according to the forage images, and transmitting the forage information to the edge computing gateway 502.
And the edge computing gateway 502 is configured to generate a forage processing notification message according to the forage information identified by the intelligent image capturing device 501, and transmit the forage processing notification message to the network server 504 through the router 503.
The network server 504 is configured to obtain the forage processing notification message transmitted by the edge computing gateway 502, and forward the forage processing notification message to the terminal 505.
And the terminal 505 is configured to acquire and prompt the forage processing notification message sent by the network server 504.
In one embodiment, the forage processing notification message comprises a notification message of material scattering and a notification message of material clearing; the forage information includes forage residue information. The edge computing gateway 502 is specifically configured to: if the forage residue in the ingestion channel is determined to be less than or equal to a first threshold value according to the forage residue information, determining that the forage in the ingestion channel is empty, and generating a notification message of spreading; and if the forage residual in the ingestion channel is determined to be larger than the first threshold value and smaller than the second threshold value according to the forage residual information, judging that a small amount of forage remains in the ingestion channel, and generating a notification message of clearing the forage.
In a specific embodiment, the forage processing notification message further comprises a notification message of pushing material, and the forage information further comprises flatness information of forage. The edge computing gateway 502 is specifically configured to: and if the forage remaining amount in the ingestion channel is determined to be not less than the second threshold value according to the forage remaining amount information, and the flatness information of the forage is determined to indicate that the forage is poor in flatness, generating a material pushing notification message.
In a specific embodiment, the intelligent image capturing device 501 is specifically configured to: acquiring a forage image of a feeding channel in a pasture colony house in a detection period; after the edge computing gateway 502 determines that the forage processing notification message generated in the previous detection period is a notification message for clearing forage, before the notification message for scattering forage is generated after the forage in the ingestion channel is empty.
The intelligent image capturing device 501 may be an Artificial Intelligence (AI) camera, that is, a camera integrated with an Artificial Intelligence algorithm.
In one embodiment, after the terminal 505 prompts the operator through voice prompt or screen display, the operator controls the material scattering vehicle, the material cleaning vehicle or the material pushing vehicle to perform field operation.
The network server may be implemented in Software As A Service (SAAS).
The number of terminals may be one or more, and is determined according to the number of actual operators and the situation of the terminals disposed by the actual operators, and the number of terminals is not limited herein.
The system that this application embodiment provided, intelligence image acquisition equipment is through acquireing the forage image of eating passageway in the pasture colony house, through this forage image, forage information in the discernment passageway of eating, edge calculation gateway further generates forage processing notice message according to this forage information, send this forage processing notice message for network server, thereby can obtain the forage information back of eating passageway in the pasture colony house in the control, in time inform the operation personnel through network server and carry out the operation, it leads to the livestock to eat absolutely because of not in time adding the forage in the mode of regular operation to have avoided, and lead to the clout to pile up the scheduling problem that goes bad because of not in time clearing up the forage, the scientificity of livestock feeding link has been ensured.
And, through the mode of real time monitoring pasture behavior of eating, accurate master livestock (like the ox) condition of eating, command spill skip, pusher and the instant operation of clear skip, ensured the normal supply of livestock in-process fodder of eating in the pasture to the rotten problem that clout can not in time be cleared up has been solved.
Based on the same concept, the embodiment of the present application provides a device for monitoring food intake in a pasture, and the specific implementation of the device may refer to the description of the method embodiment, and repeated descriptions are omitted, as shown in fig. 6, the device mainly includes:
the acquisition module 601 is used for acquiring forage images of a feeding channel in a pasture colony house;
the identifying module 602 is configured to identify forage information in the ingestion channel according to the forage image;
a processing module 603, configured to generate a forage processing notification message according to the identified forage information;
a notification module 604, configured to send the forage processing notification message.
The embodiment of the application provides in, the forage image that the module 601 acquireed the ingestion passageway in the pasture colony house is obtained to the acquisition module, identification module 602 is through this forage image, forage information in the discernment ingestion passageway, processing module 603 further generates forage processing notice message according to this forage information, notice module 604 sends this forage processing notice message, thereby can obtain the forage information back of ingestion passageway in the pasture colony house in the control, in time inform the operation personnel to carry out the operation, it leads to the livestock to eat absolutely because of not in time adding the forage in the mode of regular operation to have avoided, and lead to the clout to pile up the scheduling problem that goes bad because of not in time clearing up the forage, the scientificity of livestock feeding link has been ensured.
Based on the same concept, an embodiment of the present application further provides an electronic device, as shown in fig. 7, the electronic device mainly includes: a processor 701, a communication interface 702, a memory 703 and a communication bus 704, wherein the processor 701, the communication interface 702 and the memory 703 are in communication with each other via the communication bus 704. The memory 703 stores a program executable by the processor 701, and the processor 701 executes the program stored in the memory 703 to implement the following steps: acquiring a forage image of a feeding channel in a pasture barn; identifying forage information in the ingestion channel according to the forage image; generating a forage processing notification message according to the identified forage information; and sending the forage processing notification message.
The communication bus 704 mentioned in the above electronic device may be a Peripheral Component Interconnect (PCI) bus, an Extended Industry Standard Architecture (EISA) bus, or the like. The communication bus 704 may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one thick line is shown in FIG. 7, but this is not intended to represent only one bus or type of bus.
The communication interface 702 is used for communication between the above-described electronic apparatus and other apparatuses.
The Memory 703 may include a Random Access Memory (RAM) or a non-volatile Memory (non-volatile Memory), such as at least one disk Memory. Alternatively, the memory may be at least one memory device located remotely from the processor 701.
The Processor 701 may be a general-purpose Processor, including a Central Processing Unit (CPU), a Network Processor (NP), and the like, and may also be a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other Programmable logic devices, discrete gates or transistor logic devices, and discrete hardware components.
In yet another embodiment of the present application, there is also provided a computer-readable storage medium having stored therein a computer program which, when run on a computer, causes the computer to execute the method for monitoring feed intake in a pasture as described in the above-mentioned embodiment.
In the above embodiments, the implementation may be wholly or partially realized by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loaded and executed on a computer, cause the processes or functions described in accordance with the embodiments of the application to occur, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored on a computer readable storage medium or transmitted from one computer readable storage medium to another, for example, from one website site, computer, server, or data center to another website site, computer, server, or data center via wire (e.g., coaxial cable, fiber optic, Digital Subscriber Line (DSL)) or wirelessly (e.g., infrared, microwave, etc.). The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device, such as a server, a data center, etc., that includes one or more of the available media. The available media may be magnetic media (e.g., floppy disks, hard disks, tapes, etc.), optical media (e.g., DVDs), or semiconductor media (e.g., solid state drives), among others.
It is noted that, in this document, relational terms such as "first" and "second," and the like, may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
The foregoing are merely exemplary embodiments of the present invention, which enable those skilled in the art to understand or practice the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.