WO2023172139A1 - Procédé de gestion d'un troupeau comprenant une pluralité d'animaux à l'aide d'un système de gestion d'animaux - Google Patents

Procédé de gestion d'un troupeau comprenant une pluralité d'animaux à l'aide d'un système de gestion d'animaux Download PDF

Info

Publication number
WO2023172139A1
WO2023172139A1 PCT/NL2023/050117 NL2023050117W WO2023172139A1 WO 2023172139 A1 WO2023172139 A1 WO 2023172139A1 NL 2023050117 W NL2023050117 W NL 2023050117W WO 2023172139 A1 WO2023172139 A1 WO 2023172139A1
Authority
WO
WIPO (PCT)
Prior art keywords
animal
data
herd
decision
status
Prior art date
Application number
PCT/NL2023/050117
Other languages
English (en)
Inventor
Robin Benjamin Niko ALY
Arnoldus Gerardus Franciscus Harbers
Original Assignee
Nedap N.V.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from NL2031635A external-priority patent/NL2031635B1/en
Application filed by Nedap N.V. filed Critical Nedap N.V.
Publication of WO2023172139A1 publication Critical patent/WO2023172139A1/fr

Links

Classifications

    • A—HUMAN NECESSITIES
    • A01—AGRICULTURE; FORESTRY; ANIMAL HUSBANDRY; HUNTING; TRAPPING; FISHING
    • A01K—ANIMAL HUSBANDRY; AVICULTURE; APICULTURE; PISCICULTURE; FISHING; REARING OR BREEDING ANIMALS, NOT OTHERWISE PROVIDED FOR; NEW BREEDS OF ANIMALS
    • A01K29/00—Other apparatus for animal husbandry
    • A01K29/005—Monitoring or measuring activity, e.g. detecting heat or mating

Definitions

  • the present invention is directed at a method of providing decision support data for making fertility management action decisions with respect to at least one animal from a herd comprising of a plurality of animals by training an autonomous learning data processing model and to a computer program product.
  • Background In order to maintain or extend production capacity of a herd of animals in a farm, a supporting reproduction program is important in order to maintain the average age sufficiently young. Regardless of whether the herd is kept for milk or meat production, the regular supply of young animals is important. Furthermore, independent of the need for young animals in the herd, a reproduction program is also important in order to uphold the milk yield of an animal. Mammals only produce milk after they have given birth.
  • dairy cows must give birth to one calf per year in order to continue producing milk.
  • goats and sheep likewise need to give birth in order to start their lactation cycle.
  • the lactation cycle can be maintained for a prolonged duration by frequent (e.g. daily) milking.
  • insemination is desired to maintain the animal in production.
  • the farmer may choose between natural insemination using a bull, or artificial insemination. The latter has advantages in terms of control over the reproduction program.
  • the planning can be challenging for a farmer.
  • Current reproduction management strategies aim at supporting farmers in their decision on which cows to inseminate.
  • decision support systems commonly are simple rule-based methods. For example, such systems may advise the farmer to perform insemination if a cow is past a first number of days in milk, and to advise against insemination if a cow is beyond a second number of days in milk.
  • Some generally available decision support systems aim at identifying superior reproduction strategies to be used on a farm, and are able to provide a general advice on a certain strategy (e.g. use a hormone protocol combined with estrous detection or start inseminating at day 80 after parturition).
  • farm efficiency is based on much more complex data such as optimizing milk yield, resource usage, and balancing workload. None of the systems or methods available provides for a total farming solution that enables to support a farmer in fertility management related decisions.
  • a method of managing a herd comprising a plurality of animals using an animal management system, by providing decision support data for making fertility management action decisions with respect to at least one animal from the herd;
  • the animal management system comprising an animal management server and one or more receivers for receiving a wireless data signal from a plurality of electronic sensor tags, wherein each electronic sensor tag is associated with one of the animals of the herd, and wherein each electronic sensor tag includes at least one sensor for providing a sensor signal indicative of an animal related parameter, for including the sensor signal in the wireless data signal
  • the method comprises: obtaining, from the animal management system, one or more decision trigger signals, wherein the decision trigger signals at least include a heat probability signal indicative of an above average probability that the at least one animal is in heat; obtaining, from the animal management system, fertility management history data for the at least one animal, the fertility management history data being indicative of at least one earlier taken fertility management action decision or indicative of a birth; obtaining a herd status indicative of a momentary status of the her
  • the term ‘fertility management action decision’ may be defined as any decision to take action or decisive action taken to manage the fertility status of an animal.
  • the term ‘fertility status’ can be defined as the physiological status of the animal with respect to its fertility, such as whether or not the cow is pregnant, or the development stages of fertility.
  • the term ‘fertility management action decision’ may thus relate to at least one of: a desired moment of insemination, a pregnancy check, a group change for the at least one animal, a decision to dry off, a decision to do not breed, or a decision to take no action with respect to the animal.
  • the invention relates to a method of training an autonomous learning data processing model, for use in a method according to any one or more of the preceding claims, for providing decision support data for making fertility management action decisions with respect to at least one animal from a herd comprising a plurality of animals, wherein the fertility management action decisions relate to at least one of: a desired moment of insemination, a pregnancy check, a group change for the at least one animal, a feed change, a decision to dry off, a decision to do not breed, or a decision to take no action with respect to the animal; wherein the autonomous learning data processing model is a reinforcement learning data processing model, and wherein the training method comprises the steps of: obtaining as first training data, from an animal management system or a user, one or more decision trigger signals, wherein the decision trigger signals at least include a heat probability signal indicative of an above average probability that the at least one animal is in heat; obtaining as second training data, from a user or from the animal management system, fertility management history data for the at
  • the training method of the present invention enables to provide an autonomous learning data processing model that allows to provide, based on input comprising decision trigger signals, decision support data for making fertility management action decisions with respect to at least one animal from a herd comprising a plurality of animals, wherein the fertility management action decisions relate to at least one of: a desired moment of insemination, a pregnancy check, a group change for the at least one animal, a feed change, a decision to dry off, a decision to do not breed, or a decision to take no action with respect to the animal.
  • These decision trigger signal at least include a heat probability signal that may be obtained from data obtainable from animal tags.
  • other decision trigger signals may additionally or alternatively be used as input to the autonomous learning data processing model.
  • the training is performed in a first phase by observing the decisions taken by a farmer for a herd. This may be the same herd as the herd containing the animals for which eventually the autonomous learning data processing model will later perform the determination of the desired moment of insemination. However, the training herd may also be a different herd.
  • the training method is performed by obtaining data from an animal management system that enables to determine a momentary herd status in order to monitor the future expected effects of the insemination decision on e.g. milk yield or available resources on the farm.
  • the training method evaluates the herd status, and calculates, for each potential fertility management action decision, a score representing a reward or penalty of the respective action decision.
  • An increase in milk yield may for example receive a positive reward, whereas any undesired results such as a cumulation of projected parturitions in a short time, or a shortage of certain resources (e.g. young animal pens, available personnel) will receive a penalty (i.e. negative reward).
  • All this data hereinabove referred to as first, second, third and fourth training data, is used as input to the training method.
  • the autonomous learning data processing model on the basis thereof, will be trained to decide which action decision to take. These action decisions include any one or more of the following: decide on a moment of insemination, decide to perform a pregnancy check, decide on a group change for the at least one animal, decide on a feed change (e.g.
  • fertility management action decision indicates the potential decisions that a farmer may take in order to manage an animals fertility and pregnancy status, such as to maintain a desired yield. The context thereof is therefore dependent on the needs of the farm.
  • the yield will be the amount of the product to be produced.
  • the term fertility management action decision thus relates to any action decisions that may be taken to keep up the production, e.g. such as to keep a cow in milk, or to produce a sufficient amount of pigs.
  • the heat probability signal is obtained from a further data processing model based on one or more sensor signals from an electronic sensor tag worn by the at least one animal of the herd.
  • trained neural networks are able to calculate and provide a heat probability value on the basis of information obtained from animal worn tags, such as neck tags, ear tags, or tail tags.
  • another data processing model e.g. a random forest model, may at its output provide a Boolean signal indicative of whether or not an animal is in heat.
  • the heat probability signal is determined based on animal status data obtained from the animal management system. This data may likewise be analyzed to determine a heat probability useable as decision trigger signal.
  • the heat probability signal is obtained as input from a user. Here, the farmer may observe an animal to be in heat and provide this data as input to the training method or autonomous learning data processing model.
  • the decision trigger data may additionally or alternatively include other data as well.
  • the one or more decision trigger signals further include one or more of a group comprising: heat history data of the at least one animal, milk yield history data of the at least one animal or the herd, age data of the at least one animal, momentary number of days that the at least one animal is in milk, pregnancy status of one or more animals of the herd.
  • the additional decision trigger signals will improve the outcome of the data processing model. Triggers may for example relate to certain combinations of the above, including an animal being in heat. For example, animals being in heat while the milk yield of the herd is decreasing.
  • the animal management data includes one or more of: resource data or herd data, wherein the resource data comprises data indicative of available resources for management of the herd and wherein the herd data comprises data indicative of characteristics of the herd, such as milk yield or herd size.
  • This data may be used in order to evaluate the herd status and calculate a score.
  • an objective may be to maximize milk yield, whereas a different objective may be to maximize milk yield for a herd size manageable with a certain amount of available resources.
  • maximizing milk yield in fact becomes optimizing milk yield given the available resources, and the status score may be penalized if a projected herd status indicates a herd size that is too large for the amount of available resources.
  • the status score is rewarded or penalized dependent on the herd status being indicative of respectively an increase or decrease in milk yield from the herd. Basically, a higher milk yield is desirable, so this may be rewarded. A lower milk yield is not desired, and may be penalized. Therefore, in some of these embodiments, the status score is rewarded or penalized proportional to the increase or decrease in milk yield or meat production. Furthermore, in other or further embodiments, the status score is penalized if the resource data or the herd status is indicative of a resource bottleneck, such as a shortage in pens for offspring, a cumulation of simultaneous parturitions, or a shortage of labor capacity.
  • a resource bottleneck such as a shortage in pens for offspring, a cumulation of simultaneous parturitions, or a shortage of labor capacity.
  • the status score is penalized if, after an insemination of the at least one animal, a pregnancy status of the at least one animal does not change. This may happen in case the moment of insemination is incorrect due to the animal being insufficiently fertile at that moment. So, the machine learning data processing model in this way will be trained to determine the moment of insemination to be optimal in terms of output.
  • the one or more decision trigger signals further include one or more of a group comprising: heat history data of the at least one animal, milk yield history data of the at least one animal or the herd, age data of the at least one animal, momentary number of days that the at least one animal is in milk, pregnancy status of one or more animals of the herd. These data may advantageously be used to obtain a more sophisticated and optimized decision on desired moment of insemination of the at least one animal.
  • the step of determining a desired moment of insemination comprises: comparing, for each of a plurality of future moments after receipt of the one or more decision trigger signals, an effect on the status score at a time after the respective moment: - in response to an insemination decision at the respective moment as a first alternative, and/or - a decision to postpone insemination at the respective moment as a second alternative.
  • the method may thereby review the impact of various alternatives on the status score, and for example determine which timing decision relating to the timing of insemination which yields the most favorable impact on the status score.
  • the machine learning data processing model may thereby improve to choose those timing decisions providing the steepest change towards a maximum status score.
  • the fertility management history data includes data indicative of a pregnancy of the at least one animal
  • the autonomous learning data processing model is trained to, upon receipt during the pregnancy of a decision triggers signal indicative of an above average probability that the at least one animal is in heat, determine the fertility management action decision to be at least one of: do nothing, perform a pregnancy check or perform an insemination.
  • the method is performed during a first training phase and a second training phase, and wherein during the second training phase the method further comprises the autonomous learning data processing model to perform a step of determining an advisable moment of insemination of the at least one animal based on the first training data by evaluating an expected herd status and an associated status score.
  • the machine learning data processing model that has already been trained during the first training phase may further be trained by applying it as a decision support system wherein a farmer eventually takes the decision on whether or not to follow the suggested decision with respect to the moment of insemination.
  • This second phase may be preceding a third training phase wherein the machine learning data processing model decides autonomously when to inseminate the at least one animal.
  • a method providing decision support data for making fertility management action decisions with respect to at least one animal from a herd comprising a plurality of animals by using an autonomous learning data processing model which is trained using a method according to any one or more of the preceding claims, wherein the fertility management action decisions include at least one of: determining a desired moment of insemination, deciding to perform a pregnancy check, deciding on a group change for the at least one animal, deciding on a feed change, a decision to dry off, a decision to do not breed, or a decision to take no action with respect to the animal; wherein the method comprises: obtaining, from an animal management system, one or more decision trigger signals, wherein the decision trigger signals at least include a heat probability signal indicative of an above average probability that the at least one animal is in heat; obtaining a herd status indicative of a momentary status of the herd, wherein the herd status is determined based on animal management data obtained from the animal management system; determining, by the autonomous
  • an autonomous learning data processing model wherein the model is a reinforcement learning data processing model, and wherein the model is trained using a method in accordance with the first aspect, for enabling the steps of: obtaining, from an animal management system, one or more decision trigger signals, wherein the decision trigger signals at least include a heat probability signal indicative of an above average probability that the at least one animal is in heat; obtaining a herd status indicative of a momentary status of the herd, wherein the herd status is determined based on animal management data obtained from the animal management system; determining, by the autonomous learning data processing model and based on the one or more decision trigger signals, decision support data for making a fertility management action decision with respect to the at least one animal from the herd, wherein the fertility management action decisions relate to at least one of: a desired moment of insemination, a pregnancy check, a group change for the at least one animal, a feed change, a decision to dry off, a decision to do not breed, or a decision to
  • a computer program product for use with an animal management system comprising a controller and a memory, wherein the computer program product comprises instructions which, when loaded into the memory and executed by the controller, cause the animal management system to carry out a method of training an autonomous learning data processing model in accordance with the first aspect.
  • Figure 1 schematically illustrates a system wherein the present invention may be applied
  • Figure 2 schematically illustrates a machine learning data processing model and (at least some phases of) a method of training thereof in accordance with an embodiment
  • Figure 3 schematically illustrates a neural network that may be used in a method of training thereof in accordance with an embodiment
  • Figure 4 schematically illustrates a machine learning data processing model in (at least some phases of) a method of training thereof by reinforced learning, in accordance with an embodiment
  • Figure 5 schematically illustrates a method in accordance with some embodiments of the invention
  • Figure 6 schematically illustrates a label for use in a system in accordance with an embodiment
  • Figure 7 shows a graph indicating how the method is applied in order to support decision making in relation to fertility management.
  • FIG. 1 schematically illustrates an animal management system 3 for managing a herd of cows 1.
  • the animal management system 3 consists of an animal management server 85 and a database 88.
  • the database 88 maybe a local or remotely accessible database or data storage facility.
  • the animal management system is based on the use of animal worn labels 21.
  • Each of the cows 1 wears a label 21 including one or more sensors from monitoring animal related data such as health data of each of the cows, a position of each of the cows 1, behavior of the cows 1, their local proximity to other facilities, and the like.
  • the labels 21 transmit a wireless signal 80 to the base stations 81 of the system 3.
  • the base stations 81 which serve to provide receivers to the system 3, receive the wireless signals and provide these to the management animal server 85 where the signals are analyzed in order to retrieve the desired data.
  • the system 3 in figure 1 is schematically illustrated to indicate some of the features of such systems, and the skilled person is aware of other animal management systems or similar animal management systems wherein the method of the present invention may be applied.
  • a label 21 is schematically illustrated in figure 6.
  • the label 21 for example may comprise a processor 22 that may be operatively connected with a memory 23, a communication unit 24 connected to an antenna 25, and one or more sensors 26.
  • the sensors 26 present in the label 21 may be of any type suitable to measure or sense body parameters in order to provide sensor signals indicative of any of: heat stress, social hierarchy, calving prediction from tags (ear/neck/tail/leg/bolus), milk yield from milk meter, milk composition (fat, protein, somatic cell score, mastitis, metabolic status, stress level) from milk analysis, lameness, low condition, feed intake from computer vision. At least some of the sensors 26 in label 21 provide sensor signals that are indicative of body parameters that enable to detect whether or not the animal 1 may be in heat, i.e. that there is an above average probability that the animal 1 is in heat. This information will be used by the system 3, as explained below, to obtain or provide a decision trigger signal for performing a method in accordance with the invention.
  • the decision trigger signal thus likewise is at least is indicative of an above average probability of the animal 1 being in heat.
  • the decision trigger signal may for example be generated by the system 3 based on the animal management data available in data storage 88 or obtained directly form the sensors 26.
  • the sensors 26, however, may provide additional sensor signals indicative of body parameters that may be used as auxiliary data for performing the method of the invention.
  • a number of cows 1 are present in the field. Their labels 21 transmit wireless signal to the base station 81, indicating their position for example. Based on the data received via base station 81, it may be determined for example which of the animals 1 has an above average probability of being in heat.
  • a milking arrangement 28 that is located in barn 5 may transmit wireless signals 80 to a based station 81 inside the barn 5, which indicate the amount of milk measured by milking meter 7 of the arrangement during milking of the cow 1’.
  • the milking arrangement 28 consists of a milking container 9 that receives milk obtained from cow 1’.
  • Cow 1’ wears a milking unit 8 with teat cups which draw milk from the cow 1’ that is received by milk meter 7, and thereafter provided to the container 9.
  • Milk meter 7 measures the amount of milk produced by the cow 1’ and transmits the wireless signal 80 to base station 81.
  • cow 1’ also wears a label 21 (not visible in figure 1)
  • another wireless signal 80 indicates the current location of cow 1’ in the barn 5.
  • This information may be applied to associate the amount of milk measured by milk meter 7 with the identified cow 1’ near the milking arrangement 28.
  • This information can be stored as animal management data in data storage 88 for animal management.
  • Other information that can be obtained from the system 3 in figure 1, for example may relate to the use status of calving pens.
  • a cow 1 with label 21 is illustrated that just has given birth to a calf 2.
  • Calf 2 in the meantime has been provided with a label 21’ that is to be worn by calves having a proper size.
  • the presence of cow 1 in the designated area of the barn 5 for calving, or its proximity to the calf 2 may indicate that the cow 1 has just given birth to the calf 2.
  • This information can be used to trigger a period that indicates the prohibition for the cow to be inseminated. For example, the cow 1 may be ignored for a while in order to recover from the birth of calf 2.
  • Other facilities may be present in the environment 10 that are manageable by the system 3.
  • the animal management server 85 that registers all this data in the data storage 88 is able to produce momentary data and history data of the herd which can be used in the method for training an autonomous learning data processing model 40 to provide decision support data of fertility management related action decisions, as will be explained below.
  • a multiphase training method for training the autonomous learning data processing model there is proposed a multiphase training method for training the autonomous learning data processing model.
  • the autonomous learning data processing model includes a decision model 45 followed by a neural network consisting of three hidden layers 57, 58 and 59.
  • any other machine learning data processing model suitable for being used in an reinforced learning environment may be applied to perform the steps of the present invention.
  • the invention is not limited to a particular neural network or other type of machine learning data processing model, and neither to a specific number of hidden layers of the neural network.
  • the system 3 including the autonomous learning data processing model 40 may be used to provide decision support data of fertility management related action decisions.
  • the system 3 with autonomous learning data processing model 40 may be used to determine a preferred or optimal moment of insemination.
  • the decision support data of fertility management related action decisions may relate to any of: a post calving check, a hormone treatment, a decision not to breed a certain animal (e.g. due to a health condition or age), a culling decision, determining a desired moment of insemination, deciding to perform a pregnancy check, a decision to perform an abortion check (i.e. a pregnancy check to confirm the potential loss of a calve), deciding on a group change for the at least one animal, deciding on a feed change (e.g.
  • the invention as claimed could relate to a system that advises on each of these actions decisions, or to only some of these action decisions or even only one of these.
  • a desired moment of insemination an embodiment is described of a system that advises on a desired moment of insemination.
  • the fertility management related action decisions in these embodiments merely include deciding on whether or not to inseminate or to determining the best moment to do so.
  • ⁇ Post-calving check Several checks in the first few days (up to 28 days) after calving to confirm that the reproductive system of the cow recovered from calving. This means check that the placenta has been completely expelled, the ovaries and uterus are back in a non-pregnant status. This requires manual labor.
  • ⁇ (Hormone) treatment Sometimes it may be needed to treat cows with hormones because they show only very weak (or no) heat signs. There are costs associated with this.
  • Insemination A decision to inseminate has been explained hereinbefore, and may be desired in order to maintain a sufficient milk production or in order to breed a desired animal for meat production.
  • Do-not-breed decision At a certain stage in lactation it is more profitable to stop inseminating a cow that is not pregnant yet and replace her with a new animal. This is a decision that in the current systems is usually based on number of days in lactation, but this is a decision that should in fact be based on expected future revenue of this cow, costs of insemination, availability of replacement animals and so on.
  • ⁇ Culling a do-not-breed animal Once a cow is marked as ‘Do Not Breed’ you have to decide when to cull her (sell her to the slaughterhouse). This depends on her future expected revenue. This is very different for a beef and a dairy cow. A beef cow can gain weight and that means a higher slaughter weight. A dairy cow still produces milk that you can sell. The optimal time of culling is a decision that can benefit from a support system.
  • Pregnancy check When to do a pregnancy check. This always require manual labor and therefore can be optimized as well.
  • ⁇ Abortion check Actually this also is a pregnancy check, but can be seen more as a confirmation of whether the cow is still pregnant or not anymore.
  • FIG. 2 schematically illustrates a training method for training a machine learning data processing model 40.
  • the machine learning data processing model 40 comprises an input side 43 and an output side 48, and the core of the data processing model 40 is formed by decision model 45.
  • Decision model 45 may for example be a mathematical algorithm, such as a mathematic regression model, but may as well be formed by for example a neural network or a random forest algorithm.
  • Controller 50 controls the training of the decision model 45.
  • the network On the output side 48, the network may have one possible output node per option (inseminate / do not inseminate).
  • the output node may provide a score representing the expected future reward or penalty (i.e.
  • a number of input parameters may be determined for use as training data for training the decision model 45.
  • a heat probability signal may be determined using the labels 21 of cows 1.
  • Other input data that may be used as first training data may for example include decision trigger signals such as heat history data that may be obtained from database 88 of the central animal management server 85 milk yield history data of the at least one animal or the herd of a present milk yield obtainable from server 85, database 88 or directly from the milking system 28, age data of the at least one animal which also may be obtained from the server 85 the momentary number of days that the animal is in milk which may be obtained directly from the animal worn labels 21 or the server 85 or the milking system 28, or a pregnancy status of one or more animals in the herd which may be obtained from the server 85, the labels 21 or a different source.
  • Second training data may also be obtained from the system 3 of figure 1 for use as input data 43 to the decision model 45.
  • the fertility management history data relates for example to data on earlier fertility management action decisions, and may for example include insemination data for the animal, or data on a performed pregnancy test, an earlier feed change.
  • the fertility management history data may also include data on the birth of offspring, such as calving data for cows.
  • Insemination data may be indicative of the decision to inseminate the animal or a moment of insemination. For example, once the moment of insemination has been planned in the system 85, this data may be obtained there from.
  • this may likewise be notified to the server 85 or be automatically detected for example by registration of a proximity of a cow 1 wearing a label 21 to a location where insemination takes place.
  • Any such data may be used as second training data to be provided as input data 43 to the decision model 45.
  • third training data may be obtained from the system 3 which is indicative of a momentary status of the herd.
  • the momentary status of the herd may for example indicate the herd size, the milk yield, a number of pregnant animals in the herd, resources data indicative of available resources from management of the herd or data such as health data of the herd.
  • the above first training data, second training data and third training data may be used in order to train a neural network, such as illustrated in figure 3 to be discussed later, in taking fertility management action decisions, for example on insemination, based these input parameters.
  • the first training data and third training data may be used as input data elements 43-1 through 43-m.
  • the second training data may be proposed as output 48, and based on this, the neurons 66 and 67 illustrated in figure 3 can be trained in order to propose the decision 48 as output on the input parameters 43-1 through 43-m.
  • the controller 50 may calculate, based on the first training data and the third training data, and in particular the animal management data, a status score for the herd status.
  • the status score indicates whether the decision 48 in the output of the decision model 45 corresponds with a favorable output on the herd status in view of the requirements set. For example, suppose the system would take an insemination decision and the insemination decision taken thereafter led to a decrease in milk yield of the herd, while sufficient resources are available for management, the result of the insemination decision is suboptimal and therefore the future reward is lowered. However, if the insemination has led to an increase in milk yield, the future reward is increased. For calculating the future reward of the individual options, the controller 50 received the input parameters 43-1 through 43-m (as indicated by arrow 52), and calculates the output values 48 (as indicated by arrow 51). The option with the highest estimated future reward is taken as the insemination decision.
  • the expected future reward calculated by controller 50 can be made more precise by adding more information, represented by neurons 66 and 67, to the decision model 45.
  • the machine learning data processing model 40 will follow the farmers decisions on insemination, and the policy being determined by the decision model 45 will be improved based on the outcomes and the calculated status score by the controller 50, by accordingly adapting the specific parameters of the neurons 66 and 67. This may be referred to as off-policy learning during the method of training.
  • the policy that is advised by the machine learning data processing model 40 may then be used to provide recommendations to a farmer on fertility management action decisions.
  • the training method in the first phase and in the second phase is largely similar, in the sense that also in the second phase the actual decision is taken by the farmer.
  • the second training data being the fertility management history data for the at least one animal is also during the second training phase provided as input by the farmer to the machine learning data processing model 40.
  • FIG 3 a neural network having three layers is schematically illustrated.
  • the input positions 43-1 to 43-n are illustrated as input neurons 43 in an input layer 55 of the neural network.
  • the first hidden layer 57 consists of a plurality of neurons 66, the number of neurons 66 in the first hidden layer 57 may be chosen as desired or deemed necessary.
  • Each neuron 66 in principle receives each of the input values x1 through xn from the input neurons 43-1 to 43-n.
  • each neuron 66 the received values from neurons 43-1 to 43-n may be multiplied with a weighing value which is in figure 3 schematically indicated as W01,i,j.
  • the value j refers to the respective neurons 66 in the first hidden layer 57.
  • Each of the neurons 66 in the first layer 57 may likewise apply an additional multiplier uj.
  • each of the neurons 66 may be assigned an activation function that may implement the non-linear character (where applicable) of the data processing model in some embodiments.
  • a bias value 61 may further be applied, which is a constant value that is added to the output of the neuron 66.
  • the output value of each neuron 66 of the first hidden layer 57 is thereafter provided to each of the neurons 67 in the second hidden layer 58.
  • these output values are for each pair of sending neurons 66 from layer 57 and receiving neurons 67 from layer 58, multiplied with a weighing value w12,j,k.
  • the value j herein again refers to the respective sending neuron 66 in the first hidden layer 57
  • the value k herein refers to the receiving neuron 67 in the second hidden layer 58.
  • the neurons 67 in the second hidden layer 58 may be biased with a value 62.
  • the output values of the neurons 67 in the second hidden layer 58 are passed on to the summation layer 59.
  • This layer on one hand contains a numerator neuron 69 and on the other hand a denominator neuron 70.
  • the summation layer 59 in fact forms a third hidden layer of the neural network.
  • the weights w 23,k,l indicatively indicate which weight the output value of which neuron 67 in the second hidden layer 58 receives for passing on this output value to the summation layer 59.
  • the value k indicates the respective neuron 67 in the second hidden layer 58
  • the output value 48 at the output 60 is obtained.
  • the output values 48 indicate the expected future reward of each option of the fertility management action decision. The option with the highest feature reward is chosen.
  • the decision model 45 may be a different type of machine learning data processing model that is suitable for being applied in a reinforced learning method.
  • the machine learning data processing model may be designed in accordance with any of the following algorithms: linear or non-linear regression, logistic regression, linear or non-linear discriminant analysis, decision trees, naive Bayes, K-nearest Neighbors, learning vector quantization, support vector machine, random forest, or deep neural network.
  • FIG 4 a third training phase or operational phase of the method of the present invention is schematically illustrated.
  • the machine learning data processing model 40 receives inputs 43 in order to calculate an output 48 using the decision model 45.
  • the output 48 is indicative of action 18, which may relate to a decision in favor of insemination or a decision not in favor of insemination of the at least animal.
  • the output 48 is indicative of action 18 may relate to a decision to perform a pregnancy test, for example after an animal that was considered to be pregnant shows signs of being in heat again.
  • the action 18 may also be indicative of any of the other action decisions mentioned herein before.
  • the machine learning data processing model 40 autonomously performs the fertility management action decisions, and therefore the result 48 triggers the action 18 to be performed on the animal or the herd: for example an insemination decision may be taken.
  • the environment is schematically illustrated by reference numeral 10, which may be an environment as illustrated in figure 1 consisting of a herd cows 1 and some facilities such as a barn 5, milking arrangement 28, feed distributor, etc.
  • the effect thereon on the environment 10 will be monitored and will provide the new input parameters for machine learning data processing model 40.
  • This is indicated by the arrows 12, 13 and 14 which respectively relates to the first training data 12 comprising the decision trigger signals, the second training data 13 comprising the insemination data to provide the machine learning data processing model 40 with information on those animals that have been inseminated or will be inseminated, and the fourth training data 14 indicative of the herd status.
  • the herd status may indicate for example the milk yield or the forecasted milk yield from the herd, the current or forecasted herd size, the availability of resources, the surplus or shortage of resources, optionally including the availability of resources over time such as the history or forecast thereof, the number of projected parturitions and the forecast thereof overtime e.g. to identify a cumulation of simultaneous parturitions that may give rise to a shortage in resources, etc.
  • the first, second and third training data 12, 13 and 14 are to be provided at the input of the decision model 45.
  • the decision model 45 will calculate a next action 18 to be performed and indicate this at its output 48. However, based on the present herd status 14, the controller 50 will also calculate a status score 15 in order to implement the reinforced learning component as feedback on the previous action taken.
  • the status score for the herd status is an evaluation score that indicates how well or badly the action 18 contributes to the objective.
  • the score may be rewarded for any developments in the herd status that correspond with the objectives within the requirements said.
  • the status score is rewarded for an increase in milk yield (if this is the objective) or an increase in herd size (if this is the objective), as long as this new result (i.e. the increased milk yield or herd size) is manageable with the present and forecasted resources for managing the herd. For example, if the milk yield increases so much that the present milk storage tank of the farm becomes too small, then the penalty for overshooting the storage capacity will be larger or more important than the reward for increasing the milk yield, so that the net score will be a penalty for this result.
  • penalties will be provided for any undesired result in view of the objective, for example a decrease in milk yield or a decrease in herd size that is counter to the objective set, or a projected shortage of resources.
  • Rewards will be provided for meeting the objectives.
  • the milk yield is increased such as optimally fill the milk storage container (e.g. for 98%) without overshooting before being emptied by a milk truck, and within the regular planned normal availability of staff on the farm (without requiring extra personnel)
  • the objective may be well met and thereby may yield a high score.
  • the magnitude of the reward or penalty may thus be based on how good or bad the developments in the herd status match the objectives and or may be dependent on the seriousness of any mismatch with the requirements.
  • FIG. 5 schematically illustrates a method 30 in accordance with an embodiment of the present invention.
  • the method 30 starts by obtaining, from the environment 10, as first training data 12, one or more design triggers which at least include a heat probability signal that indicates whether or not one or more of the animals 1 of the herd are in heat.
  • the heat probability signal may be taken from one or more animal worn labels 21 that are worn by the animals 1.
  • other information may be used as decision trigger signals, such as whether or not a cow 1 has recently calved, or whether or not there are any specific reasons why such an animal 1 must be treated differently.
  • the animal management server 85 may determine for this particular cow 1 that any signals that are indicative of heat are to be ignored for this cow because the cow 1 needs to recover from calving.
  • animal management server 85 or other systems of the farm may for example include heat history data or one or more animals indicative of when an animal has been in heat, milk yield history data of one or more animals or of the complete herd, which is indicative (for an animal) how its milk production has evolved overtime, age data for the animal, or a momentary number of days that the animal is in milk (produces sufficient milk), or a pregnancy status of the animal.
  • insemination data is obtained from the system 85 or the sensors in the environment 10. For example, a projected insemination planning for one or more animals may be obtained which indicates for which animals it is already be decided when they will be inseminated.
  • third training data may be determined.
  • the third training data may be indicative of a herd status of a momentary status of the herd.
  • the herd status may for example indicate the present or projected milk yield, or present of projected herd size, as discussed herein before.
  • Other animal management data may likewise be obtained, such as resource data for the farm, indicative of a number of calving pens, a number of present labor resources, the availability of milking systems 28, the size of the barn 5 and its capacity in terms of a number of animals that it may hold, or the evolution or forecast of any of these parameters.
  • the second training data may include any fertility management history data, i.e.
  • a status score for the herd status may be determined which is an important parameter because it implements the reinforced learning aspect of the training method.
  • the status score represents a reward or penalty for a future expected herd status and is calculated as a criterium before, by rewarding or analyzing the score dependent on whether or not the animal management data is indicative of and achievement of one or more of the objectives or indicates a development counter thereto.
  • the status score will be used by the autonomous learning data processing model to adapt its internal parameter in order to provide a better matching decision the output.
  • the first, second, third and fourth data will be used by the autonomous learning data processing model 40 in order to determine the desired moment of insemination of the at least one animal. This will enable the autonomous learning data processing model to perform a step of determining the desired moment of insemination based on future input data (i.e. input data to be received at a later moment) in order to achieve a desired status score.
  • This future input data may comprise one or more future decision trigger signals and training is performed based on the first, second, third and fourth training data.
  • the model will be enabled to process input data that will be received in the future in order to provide a fertility management action decision (i.e. any one of determining a desired moment of insemination, deciding to perform a pregnancy check, deciding on a group change for the at least one animal, deciding on a feed change (e.g. to feed concentrates or to feed standard feed), a decision to dry off, a decision to do not breed, or a decision to take no action with respect to the animal), such as to achieve a desired goals or objective (e.g. maximize milk yield, optimize costs versus yield, preventing resource shortages or capacity issues).
  • a fertility management action decision i.e. any one of determining a desired moment of insemination, deciding to perform a pregnancy check, deciding on a group change for the at least one animal, deciding on a feed change (e.g. to feed concentrates or to feed standard feed), a decision to dry off, a decision to do not breed, or a decision to take no action with respect to the
  • the system 3 is enabled to advise on any of the abovementioned fertility management action decisions.
  • the system 3 not only may receive insemination data, but any fertility management history data.
  • such fertility management history data may include data on any earlier action decisions that were taken, e.g. whether or not a pregnancy test was perform and the result thereof, whether the animal was placed in a different group of the herd, whether any dietary changes were made such as the adding of concentrates to the animal’s feed, when or whether the animal was inseminated or when the animal has given birth to offspring.
  • figure 7 shows a graph indicating the milk yield (upper part) of a particular cow and the occurrence of heat detection triggers (lower part of the graph).
  • the vertical axis of the upper graph shows the daily yield, which for example may be the milk output or the economic yield (e.g. daily profit expressed in relevant currency).
  • the horizontal axis shows the expiring of time, expressed in days.
  • the lower graph shows the presence of a decision trigger signal, i.e. a heat detection signal for the respective animal.
  • the letters I, P, G, and c are indicative of insemination, pregnancy test, group change and calving. In the example provided, the cow involved has been inseminated successfully, but during pregnancy the cow again is in heat. Upon detecting heat during pregnancy, the system 3 may take any of the following actions.
  • the system may perform a pregnancy test to ensure that the cow is still pregnant (it may have lost the calve) and dependent on the outcome the cow may again be inseminated.
  • the system may immediately decide to inseminate, without a pregnancy test. Another possible decision is to take no action at all at that moment.
  • Figure 7 shows the first alternative (pregnancy test followed by insemination).
  • a specific embodiment of the invention relates to a method of providing decision support data for determining a moment of insemination of at least one animal from a herd, wherein the herd comprises a plurality of animals.
  • the method in accordance with this embodiment uses an autonomous learning data processing model that is trained as described herein before.
  • the method comprises obtaining, from an animal management system, one or more decision trigger signals, wherein the decision trigger signals at least include a heat probability signal indicative of an above average probability that the at least one animal is in heat.
  • the trigger may be a signal from a heat detection system integrated in an animal tag, or alternatively a heat probability data obtained from an animal management server.
  • the method further includes obtaining a herd status indicative of a momentary status of the herd, wherein the herd status is determined based on animal management data obtained from the animal management system.
  • the method further includes determining, by the autonomous learning data processing model, a desired moment of insemination of the at least one animal based on the one or more decision trigger signals.
  • the method includes the monitoring of the herd status in order to determine, based on the one or more animal management data, a momentary status score for the herd status.
  • the status score represents a reward or a penalty dependent on whether or not the animal management data is indicative of a future expected achievement of one or more objectives.
  • Another criterium to include in score calculation may be to make the reward or penalty dependent on how much the result is improved or deteriorated compared to a preceding result or over a number of steps. This may lead to the steepest improvement at any time towards the optimal result.
  • the present invention has been described in terms of some specific embodiments thereof. It will be appreciated that the embodiments shown in the drawings and described herein are intended for illustrated purposes only and are not by any manner or means intended to be restrictive on the invention. It will be appreciated that the embodiments shown in the drawings and described herein are intended for illustrated purposes only and are not by any manner or means intended to be restrictive on the invention. It is believed that the operation and construction of the present invention will be apparent from the foregoing description and drawings appended thereto.

Landscapes

  • Life Sciences & Earth Sciences (AREA)
  • Environmental Sciences (AREA)
  • Biophysics (AREA)
  • Animal Husbandry (AREA)
  • Biodiversity & Conservation Biology (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

L'invention concerne un procédé de gestion d'un troupeau d'animaux à l'aide d'un système de gestion d'animaux, en fournissant des données d'assistance à la décision pour prendre des décisions d'action de gestion de fertilité. Le système de gestion d'animaux comprend un serveur et des récepteurs pour un signal de données sans fil provenant d'étiquettes électroniques à capteur. Chaque étiquette comprend un capteur fournissant un signal de capteur indiquant un paramètre associé à un animal. Le procédé consiste à : obtenir des signaux de déclenchement de décision comprenant un signal de probabilité de chaleur ; obtenir des données d'historique de gestion de fertilité indiquant une décision d'action de gestion de fertilité prise précédemment ou indiquant une naissance ; et obtenir un état de troupeau qui est déterminé sur la base de données de gestion d'animaux provenant du système. Le procédé comprend en outre la détermination d'une décision d'action de gestion de fertilité sur la base des signaux de déclenchement de décision, des données d'historique de gestion de fertilité et de l'état de troupeau. La décision d'action est déterminée à l'aide d'un modèle de traitement de données d'apprentissage autonome entraîné.
PCT/NL2023/050117 2022-03-10 2023-03-10 Procédé de gestion d'un troupeau comprenant une pluralité d'animaux à l'aide d'un système de gestion d'animaux WO2023172139A1 (fr)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
NL2031231 2022-03-10
NL2031231 2022-03-10
NL2031635 2022-04-20
NL2031635A NL2031635B1 (en) 2022-03-10 2022-04-20 Method of managing a herd comprising a plurality of animals using an animal management system.

Publications (1)

Publication Number Publication Date
WO2023172139A1 true WO2023172139A1 (fr) 2023-09-14

Family

ID=85706840

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/NL2023/050117 WO2023172139A1 (fr) 2022-03-10 2023-03-10 Procédé de gestion d'un troupeau comprenant une pluralité d'animaux à l'aide d'un système de gestion d'animaux

Country Status (1)

Country Link
WO (1) WO2023172139A1 (fr)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080128486A1 (en) * 2006-11-10 2008-06-05 Breedcare Pty Ltd. Livestock breeding and management system
US20150302241A1 (en) * 2012-12-02 2015-10-22 Agricam Ab Systems and methods for predicting the outcome of a state of a subject
EP3153095A1 (fr) * 2015-10-06 2017-04-12 N.V. Nederlandsche Apparatenfabriek NEDAP Système et procédé pour déterminer une état physiologique d'un ruminant
WO2020031050A1 (fr) * 2018-08-04 2020-02-13 Kaur Kamalpavit Système et dispositif de gestion de santé et de fertilité d'un ou de plusieurs animaux laitiers
WO2020161360A2 (fr) * 2019-02-08 2020-08-13 Agtag Limited Étiquette de capteur de mouvements de bovins
WO2021255731A1 (fr) * 2020-06-15 2021-12-23 Co-Exist Ltd Dispositifs de retenue du bétail, systèmes pour la gestion du bétail et leurs utilisations
WO2022005288A1 (fr) * 2020-07-03 2022-01-06 Nedap N.V. Procédé et système de détermination de transition de phase d'un jeune animal

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080128486A1 (en) * 2006-11-10 2008-06-05 Breedcare Pty Ltd. Livestock breeding and management system
US20150302241A1 (en) * 2012-12-02 2015-10-22 Agricam Ab Systems and methods for predicting the outcome of a state of a subject
EP3153095A1 (fr) * 2015-10-06 2017-04-12 N.V. Nederlandsche Apparatenfabriek NEDAP Système et procédé pour déterminer une état physiologique d'un ruminant
WO2020031050A1 (fr) * 2018-08-04 2020-02-13 Kaur Kamalpavit Système et dispositif de gestion de santé et de fertilité d'un ou de plusieurs animaux laitiers
WO2020161360A2 (fr) * 2019-02-08 2020-08-13 Agtag Limited Étiquette de capteur de mouvements de bovins
WO2021255731A1 (fr) * 2020-06-15 2021-12-23 Co-Exist Ltd Dispositifs de retenue du bétail, systèmes pour la gestion du bétail et leurs utilisations
WO2022005288A1 (fr) * 2020-07-03 2022-01-06 Nedap N.V. Procédé et système de détermination de transition de phase d'un jeune animal

Similar Documents

Publication Publication Date Title
Caja et al. Engineering to support wellbeing of dairy animals
Dominiak et al. Prioritizing alarms from sensor-based detection models in livestock production-A review on model performance and alarm reducing methods
Belanche et al. Optimizing management of dairy goat farms through individual animal data interpretation: A case study of smart farming in Spain
EP1230850A2 (fr) Dispositif et procédé de traite d'un animal, dispositif de surveillance d'un animal
EFSA Panel on Animal Health and Welfare (AHAW) Guidance on risk assessment for animal welfare
Sewalem et al. Relationship between type traits and longevity in Canadian Jerseys and Ayrshires using a Weibull proportional hazards model
Boersema et al. Farm health and productivity management of dairy young stock
Maltz Individual dairy cow management: achievements, obstacles and prospects
JP6902815B1 (ja) 畜産情報管理システム、畜産情報管理方法、及び畜産情報管理プログラム
Devir et al. A new dairy control and management system in the automatic milking farm: Basic concepts and components
Wolfová et al. Strategies for defining traits when calculating economic values for livestock breeding: a review
Krpálková et al. Evaluating the economic profit of reproductive performance through the integration of a dynamic programming model on a specific dairy farm.
Calamari et al. Model to evaluate welfare in dairy cow farms
NL2031635B1 (en) Method of managing a herd comprising a plurality of animals using an animal management system.
Olynk et al. Aligning incentives for contract dairy heifer growth
Hogeveen et al. Development of an integrated knowledge-based system for management support on dairy farms
Buis Development and application of a precision feeding program using electronic sow feeders and effect on gestating primiparous sow performance
WO2023172139A1 (fr) Procédé de gestion d'un troupeau comprenant une pluralité d'animaux à l'aide d'un système de gestion d'animaux
Cardoso et al. Optimal replacement and insemination policies for Holstein cattle in the southeastern region of Brazil: The effect of selling animals for production
Lazzarini et al. Productive, economic and risk assessment of grazing dairy systems with supplemented cows milked once a day
Rousing et al. Expert-based development of a generic HACCP-based risk management system to prevent critical negative energy balance in dairy herds
Vargas et al. Interactions between optimal replacement policies and feeding strategies in dairy herds
MICHALIČKOVÁ et al. Economics of dual-purpose dairy cattle under various milk pricing systems.
Frandsen Benchmarking in dairy production:“how to transform data to valuable decision support”
WO2018135993A1 (fr) Procédé et agencement de gestion de l'alimentation animale

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23712369

Country of ref document: EP

Kind code of ref document: A1