WO2023008571A1 - Système d'identification individuelle et procédé d'identification individuelle - Google Patents

Système d'identification individuelle et procédé d'identification individuelle Download PDF

Info

Publication number
WO2023008571A1
WO2023008571A1 PCT/JP2022/029346 JP2022029346W WO2023008571A1 WO 2023008571 A1 WO2023008571 A1 WO 2023008571A1 JP 2022029346 W JP2022029346 W JP 2022029346W WO 2023008571 A1 WO2023008571 A1 WO 2023008571A1
Authority
WO
WIPO (PCT)
Prior art keywords
animal
individual
feature amount
database
image
Prior art date
Application number
PCT/JP2022/029346
Other languages
English (en)
Japanese (ja)
Inventor
亮人 小泉
ティン カオ
美江 大越
Original Assignee
アニコム ホールディングス株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by アニコム ホールディングス株式会社 filed Critical アニコム ホールディングス株式会社
Priority to JP2023538647A priority Critical patent/JPWO2023008571A1/ja
Publication of WO2023008571A1 publication Critical patent/WO2023008571A1/fr

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A01—AGRICULTURE; FORESTRY; ANIMAL HUSBANDRY; HUNTING; TRAPPING; FISHING
    • A01K—ANIMAL HUSBANDRY; AVICULTURE; APICULTURE; PISCICULTURE; FISHING; REARING OR BREEDING ANIMALS, NOT OTHERWISE PROVIDED FOR; NEW BREEDS OF ANIMALS
    • A01K11/00—Marking of animals
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis

Definitions

  • the present invention relates to an individual identification system and an individual identification method, and more particularly to a system and method for identifying individual animals from facial images of animals.
  • Pet animals such as dogs, cats, and rabbits, and livestock such as cows and pigs are irreplaceable existences for humans.
  • pet animals so-called pets, are increasingly treated in the same way as humans, and there is a growing need for individual identification of pets.
  • pet-friendly stores and services are becoming more familiar, such as trimming salons for pets, pet cafes that allow pets, dog runs, and lodging facilities that allow pets to stay together.
  • a fee is collected for each individual pet, or an individual pet is registered and the service is provided while referring to the past service provision history.
  • a pet search service may be requested.
  • the pet is searched for based on the photo of the pet provided by the owner. Since it is a problem to determine the identity between the individual in the photograph and the individual suspected to be the animal to be searched, individual identification from the photograph of the pet is required.
  • Patent Document 1 discloses a network camera, a presence detection sensor that detects whether or not a wild animal photographed by the camera still exists inside a capture facility, and a smartphone that can read e-mails received from the network camera. , a tablet terminal, a user information terminal such as a personal computer, etc., and a still image of an e-mail received only once or only once from the above network camera.
  • a network camera a presence detection sensor that detects whether or not a wild animal photographed by the camera still exists inside a capture facility
  • a smartphone that can read e-mails received from the network camera.
  • a tablet terminal a user information terminal such as a personal computer, etc.
  • a still image of an e-mail received only once or only once from the above network camera Disclosed is an individual identification wild animal capture system that allows remote control of network cameras and capture equipment while viewing.
  • a user terminal has a photographing means for producing a sound of a frequency that causes a photographed object to turn around when photographing, and an animal identification information registering means transmits photograph data of a photograph photographed by the photographing means to the user terminal. and registers the received photo data in the management DB as animal identification information, and the notification means sends the animal-related information specified by matching that compares the images of the photos and calculates the similarity to the user terminal
  • An animal search system that notifies is disclosed.
  • Patent Document 3 discloses a pet individual identification system that performs individual identification of a plurality of pets. Then, another image of the pet is acquired, the feature amount is extracted from the other image, and the feature amount is compared with the stored feature amount. If the identification result is judged to be incorrect, the user is prompted to correct it. , a pet individual identification system that updates the identification result when a user's correction is obtained, and registers at least one of the another image and the feature amount extracted from the other image in association with the pet identifier. ing.
  • Patent Documents 1 and 2 do not disclose means for identifying individuals from animal images using trained models. Further, the individual identification system described in Patent Document 3 prompts the user to correct the identification result when it is determined that the identification result is incorrect, updates the identification result when the user's correction is obtained, and At least one of the feature amount extracted from the image and another image is associated with the pet identifier and registered, and is premised on correction of the identification result from the user.
  • an object of the present invention to provide an individual animal identification system and an individual identification method for animals that include means for identifying individuals using animal images in a simple manner.
  • the present invention is the following [1] to [16].
  • [1] A database storing feature values extracted from animal face images using trained models and animal individual identification information; a receiving means for receiving an input of an animal face image; a feature quantity extracting means for extracting a feature quantity from the face image input to the receiving means using the learned model; By comparing the feature amount stored in the database and the feature amount extracted by the feature amount extraction means, the facial image of the animal input to the reception means is associated with the individual identification information stored in the database. and determination means for determining whether the image is of an individual that is the same as or similar to the animal individual.
  • the individual identification system according to any one of [1] to [5], which is a feature amount obtained by averaging feature amounts extracted from a plurality of captured images.
  • a database storing feature values extracted from animal face images using trained models and animal individual identification information; reception means for receiving an input of a facial image of an animal to enter or exit; a feature quantity extracting means for extracting a feature quantity from the face image input to the receiving means using the learned model; By comparing the feature amount stored in the database and the feature amount extracted by the feature amount extraction means, the facial image of the animal input to the reception means is associated with the individual identification information stored in the database.
  • An entrance/exit management system comprising: determination means for determining whether the image is of an individual that is the same as or similar to an animal individual.
  • a database storing feature values extracted from animal face images using trained models and animal individual identification information; a receiving means for receiving an input of a face image of an animal to be examined at a veterinary hospital; a feature quantity extracting means for extracting a feature quantity from the face image input to the receiving means using the learned model; By comparing the feature amount stored in the database and the feature amount extracted by the feature amount extraction means, the facial image of the animal input to the reception means is associated with the individual identification information stored in the database.
  • a medical examination management system comprising determination means for determining whether the image is of an individual that is the same as or similar to an animal individual.
  • a database storing feature amounts and individual identification information of animals extracted from facial images of animals using trained models; a receiving means for receiving an input of a facial image of an animal that is about to be trimmed or shampooed at a pet salon; a feature quantity extracting means for extracting a feature quantity from the face image input to the receiving means using the learned model; By comparing the feature amount stored in the database and the feature amount extracted by the feature amount extraction means, the facial image of the animal input to the reception means is associated with the individual identification information stored in the database.
  • a reception management system comprising a determination means for determining whether the image is of an individual that is the same as or similar to an animal individual.
  • a database storing feature amounts and individual identification information of animals extracted from facial images of animals using trained models; receiving means for receiving an input of a facial image of an animal that is a candidate for an animal to be searched; a feature quantity extracting means for extracting a feature quantity from the face image input to the receiving means using the learned model; By comparing the feature amount stored in the database and the feature amount extracted by the feature amount extraction means, the facial image of the animal input to the reception means is associated with the individual identification information stored in the database.
  • a search management system comprising a determination means for determining whether the image is of an individual that is the same as or similar to an animal individual.
  • the individual identification system according to any one of [1] to [6], wherein the image is of an individual that is the same as or similar to an individual animal associated with individual identification information stored in a database.
  • a database storing feature values extracted from face images of young animals using trained models and individual identification information of the young animals; a receiving means for receiving an input of a facial image of an adult animal; a feature extraction unit that includes a trained model and extracts a feature from the face image input to the reception unit using the trained model; By comparing the feature amount stored in the database with the feature amount extracted by the feature amount extraction means, the face image of the adult animal input to the reception means is obtained as the individual identification information stored in the database.
  • a database storing feature amounts extracted from facial images of adult animals using trained models and individual identification information of the adult animals; a receiving means for receiving an input of a facial image of a young animal; a feature extraction unit that includes a trained model and extracts a feature from the face image input to the reception unit using the trained model; By comparing the feature amount stored in the database and the feature amount extracted by the feature amount extraction means, the face image of the young animal input to the reception means is identified as the individual identification stored in the database. and determination means for determining whether or not the image is of an individual that is the same as or similar to an individual animal related to information.
  • an individual animal identification system and an individual identification method that include means for identifying individuals using animal images in a simple manner.
  • the individual identification system and individual identification method of the present invention can be used for individual identification when entering and exiting a dog run, breeder's kennel, playground, individual identification when receiving a hotel, hospital, or pet salon, individual identification when searching for a lost child, and the like.
  • Various applications are possible.
  • FIG. 1 is a schematic configuration diagram showing one embodiment of an individual identification system of the present invention
  • FIG. 1 is a schematic configuration diagram showing one embodiment of an entrance/exit management system of the present invention
  • FIG. It is a flowchart figure showing an example of the flow of entrance/exit management by the entrance/exit management system of this invention.
  • the individual identification system of the present invention includes a database that stores feature values extracted from animal face images using a trained model and individual animal identification information, a reception means that receives an input of an animal face image, and a trained model.
  • a feature amount extracting means including a model and extracting a feature amount from the face image input to the receiving means by the learned model; a feature amount stored in the database; and a feature extracted by the feature amount extracting means.
  • a similar individual means an individual whose appearance is similar to that of the target individual.
  • the database of the present invention stores feature amounts and individual identification information of animals extracted from facial images of animals using learned models.
  • the feature amount extracted from the facial image of the animal and the individual identification information of the individual animal related to the facial image are linked and stored.
  • individual identification information include species, breed, sex, age, weight, and body length of the animal.
  • the face image of the animal itself may be stored as the individual identification information.
  • an ID number may be assigned to each animal.
  • health-related information such as the animal's hospital visit history, surgery history, and drug administration history, and information related to pet salon usage history such as trimming history, shampoo history, nail clipping history, and the like may be attached to the individual identification information.
  • the individual identification information one or more tendencies selected from the group consisting of barking tendency, aggression, activity and sociability can be stored.
  • the database may be managed in the form of a database server, managed on a cloud server, or distributed.
  • Artificial intelligence is preferable as a trained model that extracts the feature values stored in the database.
  • Artificial Intelligence is a software or system that imitates the intellectual work of the human brain on a computer. A computer program, etc., that performs and learns from experience. Artificial intelligence may be general-purpose or specialized, and may be deep neural networks, convolutional neural networks, or the like, and open software can be used. It is preferable that the trained model for extracting the feature quantity stored in the database and the trained model included in the feature quantity extraction means described later are the same trained model.
  • the feature values stored in the database are automatically updated.
  • the trained model is updated, the image stored in the database and used to extract the feature quantity is searched, and the updated trained model is used to extract the feature quantity from the image again.
  • a program to The load on the system can be suppressed by executing this program during a time period when the system operation rate is low, for example, at night.
  • the feature values stored in the database are preferably obtained by averaging feature values extracted from multiple images of the same individual. By averaging the feature amounts, blurring of the feature amounts stored in the database can be suppressed.
  • the term "shake" as used herein refers to movement of the subject such as blinking and facial expression changes at the time of image capturing, and movement due to the environment such as light and focal position. By averaging the feature amounts in this way, it becomes possible to store the unique features of the individual in the database, and the determination accuracy can be improved.
  • the database only needs to store the averaged feature amount, and it is not necessary to store the feature amount of all images. Therefore, according to the present invention, the load on the database can also be reduced.
  • Averaging in the present invention refers to a method of deriving representative feature values from feature values extracted from multiple images. Therefore, in addition to the method of calculating the arithmetic mean and the geometric mean, which are general mean values, the method of obtaining the median value and the mode value is treated as averaging in the present invention.
  • outliers may be excluded before averaging. Determination accuracy can be improved by excluding outliers. In addition, it can be tested whether it is an outlier by a known method. For example, a test statistic obtained by dividing the deviation by the unbiased standard deviation is obtained, and whether or not this value is greater than the significance point is tested.
  • a weighted average may be performed by multiplying the feature amount by a weight according to the importance of the image. Determination accuracy can be improved by weighting the image. For example, an image with a natural expression and facing the front is given a larger weight, and a sideways image with a blink is given a smaller weight.
  • the determination accuracy can be improved by changing the count number according to the importance of the image. For example, a newly uploaded image is treated as two different images, and an old image is treated as a single image.
  • the receiving means of the present invention is means for receiving input of face images of animals other than humans.
  • an image of an individual to be determined as to whether it is the same or similar to an individual stored in the database is accepted.
  • the image may be a still image or a moving image.
  • image includes both still images and moving images.
  • a face image is a moving image in which a face is shown. It is sufficient if the moving image includes a scene in which the face is shown.
  • a moving image is a set of continuous still images and can be processed in the same way as for still images. Examples of animals include mammals such as dogs, cats, rabbits and ferrets, and pets such as birds and reptiles.
  • the image reception method may be any method such as scanning, inputting and transmitting image data, importing images taken on the spot, and uploading moving images taken in real time.
  • the format of the face image is not particularly limited, but the face image is preferably a photograph of the animal's face taken from the front, and more preferably a photograph showing the animal's face enlarged as shown in FIG. Such photographs include photographs such as those of a person's driver's license. Also preferred are images used on animal health insurance cards, as in FIG.
  • the reception means of the server receives the image. Individual identification at the time of entry and exit is possible.
  • the image may be black and white, grayscale, or color. Images that do not show the entire animal's face, images whose shape has been edited with image editing software, images that include multiple animals, images that have faces so small that their eyes and ears cannot be recognized, or images that are unclear. I don't like it. As for the image, it is preferable that the image is normalized and the resolution and the like are unified.
  • the feature amount extracting means of the present invention is means for extracting a feature amount from the face image input to the receiving means by using the learned model.
  • Artificial intelligence is preferred as the trained model.
  • Artificial Intelligence is a software or system that imitates the intellectual work of the human brain on a computer. A computer program, etc., that performs and learns from experience.
  • Artificial intelligence may be general-purpose or specialized, and may be deep neural networks, convolutional neural networks, or the like, and open software can be used.
  • Deep learning is a development of machine learning, and is characterized by automatically finding feature quantities.
  • the learning method for generating trained models is not particularly limited, and publicly available software can be used.
  • DIGITS the Deep Learning GPU Training System published by NVIDIA can be used.
  • learning may be performed by a known support vector machine method (Support Vector Machine method) published in "Introduction to Support Vector Machines" (Kyoritsu Shuppan).
  • Support vector machine method Small Vector Machine method
  • a public data set such as ImageNet can be used.
  • the training data for learning is animal face images and their breeds.
  • the face image of the animal as training data may be the same as or different from the face image described in the reception method.
  • As the facial image of the animal used as training data it is preferable to use an image of the entire face including the eyes, nose, mouth, ears, and outline of the face of the animal.
  • a neural network is preferable as a trained model, and a convolutional neural network is more preferable.
  • the trained model is one that has been specifically trained with images of animal species that are targets for individual identification.
  • the trained model for extracting the feature quantity stored in the database and the trained model included in the feature quantity extraction means are the same trained model. By using the same trained model, the same number of feature values are extracted through the trained model, which facilitates the calculation of the matching rate (cosine similarity, for example).
  • An example of a trained model is EfficientNet trained using ImageNet.
  • a trained model that can be trained to classify and estimate breeds, ages, and individual identification from facial images of dogs and extract features from facial images of dogs is available. preferable.
  • the determining means of the present invention compares the feature amount stored in the database with the feature amount extracted by the feature amount extracting means so that the facial image of the animal input to the receiving means is stored in the database. It is determined whether or not the image is of an individual that is the same as or similar to the individual animal associated with the individual identification information.
  • the judging means includes software that calculates, for example, the cosine similarity between the feature quantities, and judges that the individuals are the same or that they are similar when the value is equal to or greater than a predetermined value. include.
  • the cosine similarity it is also possible to obtain a barycentric feature amount, which is the barycenter of the feature amounts registered in the database, and to use a value obtained by subtracting the barycentric feature amount from each feature amount.
  • the normalized feature amount can be used for cosine similarity calculation. Further, it may include software for searching a database for individuals having a high cosine similarity with the feature quantity extracted by the feature quantity extracting means, and selecting identical or similar individual candidates.
  • Euclidean distance can be used instead of cosine similarity as a method for determining identical or similar individuals.
  • the determining means of the present invention receives a face image of an animal as input information, it determines the breed of the animal using the learned model.
  • the output format is not particularly limited. For example, on the screen of a personal computer, an individual that is the same as or similar to the individual in the image input to the input means is displayed with the image and individual identification information to display the individual identification result. can be output. If there are a plurality of individuals with similar matching rates of feature amounts in the database, a plurality of candidates for the same individual may be presented. When a plurality of candidates are presented, individual identification (identical individual determination) and similar individual determination are performed simultaneously. Moreover, as incidental information, the certainty of the individual identification result may be output at the same time. For example, "this child is ⁇ -chan (reliability: 80%)", "this child resembles ⁇ -chan".
  • the individual identification system of the present invention may additionally have output means for receiving the determination result from the determination means and outputting the determination result.
  • the age of the individual registered in the database and the age of the individual to be determined may be significantly different.
  • similar individuals may be determined from images of puppies, taking into account growth factors of the puppies.
  • the lost individual can be searched for by using the photo of the puppy. It becomes possible to determine whether the candidate individual is the same as or similar to the individual to be searched.
  • learning is performed using images of puppies and images of growing up as trained models. It is preferred to use a ready-made model.
  • a preferred aspect of the present invention includes the following individual identification system.
  • a database storing feature values extracted from face images of young animals using trained models and individual identification information of the young animals; a receiving means for receiving an input of a facial image of an adult animal; a feature quantity extracting means for extracting a feature quantity from the face image input to the receiving means using the learned model; By comparing the feature amount stored in the database and the feature amount extracted by the feature amount extraction means, the face image of the adult animal input to the reception means is obtained as the individual identification information stored in the database. and determination means for determining whether or not the image is of an individual that is the same as or similar to the individual animal.
  • Early age is preferably 1 year or younger, more preferably 6 months or younger.
  • An adult preferably refers to an individual who is over the age of 6 months or over the age of 1 year, and specifically includes over 6 months of age, over 1 year of age, and the like.
  • judging whether the images are of the same or similar individuals means that the juvenile individuals currently registered in the database and the adult individuals input to the receiving means are the same or similar. It may be determined whether or not the individual is an individual, and it may be determined whether or not the grown-up appearance of a juvenile individual registered in the database is similar to the adult individual input to the reception means. .
  • this aspect of the individual identification system for example, when an image of an adult animal is input, it is possible to pick up individual juvenile animals that may resemble the adult animal in the future.
  • the face image and individual identification information of the individual to be sold, and the face are registered in a database, and the person who wishes to purchase the pet uploads the adult image of the individual he/she likes to the website.
  • the image of the adult individual uploaded to the website is accepted by the acceptance means of the individual identification system, the feature amount is extracted by the trained model, the feature amount is compared by the determination means, and grows into a similar individual in the future.
  • Images of juvenile individuals likely to be are picked up and presented to prospective pet purchasers. This makes it possible, for example, to purchase juvenile individuals that may become individuals similar to widowed individuals from pet shops or breeders.
  • the image of the puppy is registered in the database, and the individual identification information and the face are registered. If the feature values extracted by the trained model from the images are also registered in the database, when searching for a lost individual, a candidate individual can be found and photographed.
  • the information is received by the receiving means, the feature amount is extracted by the trained model, the feature amount is compared by the determination means, and it is determined whether or not the candidate individual is the same as or similar to the lost individual. This makes it possible to search for a lost child even if there is only a photo of the puppy.
  • Still another preferred aspect is the following individual identification system.
  • a database storing feature amounts extracted from facial images of adult animals using trained models and individual identification information of the adult animals; a receiving means for receiving an input of a facial image of a young animal; a feature quantity extracting means for extracting a feature quantity from the face image input to the receiving means using the learned model; By comparing the feature amount stored in the database and the feature amount extracted by the feature amount extraction means, the face image of the young animal input to the reception means is identified as the individual identification stored in the database. and determination means for determining whether or not the image is of an individual that is the same as or similar to an individual animal related to information.
  • Early age is preferably 1 year or younger, more preferably 6 months or younger.
  • An adult preferably refers to an individual who is over the age of 6 months or over the age of 1 year, and specifically includes over 6 months of age, over 1 year of age, and the like.
  • determining whether the images are of the same or similar individuals means that the adult individuals currently registered in the database and the juvenile individuals input to the receiving means are the same or similar. It may be determined whether or not the individual is an individual, or whether or not the adult individual registered in the database resembles the growth figure of the young individual input to the reception means. .
  • the individual identification system of this aspect for example, when an image of a juvenile animal is input, it is possible to pick up an adult animal individual that may resemble the juvenile animal when it grows up in the future. can.
  • the face of an adult individual is previously sold separately from the juvenile individual. Images, individual identification information, and features extracted from facial images by trained models are registered in a database. Then, when a person who wishes to purchase a pet animal selects an infant individual posted on the website, the face image of the infant individual is received by the acceptance means of the individual identification system, and the characteristics are determined by the trained model.
  • the amount is extracted, the feature amount is compared by the judging means, and the image of the adult individual that the selected juvenile individual may resemble in the future is picked up. This enables the prospective purchaser to have a concrete image of what kind of individual the young animal to be considered for purchase will be when it grows up in the future, by means of images of similar individuals.
  • the database 12 stores in advance facial images, feature amounts extracted from the facial images using trained models, and individual identification information for a plurality of individual animals.
  • An image including the animal's face is captured by a capturing means 16 such as a camera installed at the entrance of the area where entry/exit of the animal is desired to be managed. Then, the photographed image is input to the receiving means 15 through the network.
  • the processing calculation unit 17 uses the feature amount extraction means (learned model) 18 to extract the feature amount from the image input to the reception means 15 .
  • the processing operation unit 17 refers to the database 12, and uses the determination unit 11 to match the feature amount related to the animal face image stored in the database 12 with the feature amount obtained from the received image. Calculate the rate and determine whether or not they are the same individual. The judgment is repeated for each of the animal face images stored in the database 12, and if it is judged that they are the same individual, the face image of the animal and the individual identification information of the animal are output by the output means 14. Output on the screen of the terminal 13 .
  • the terminal 13 is, for example, a terminal installed at the entrance of an area where entry/exit of animals is desired to be managed.
  • Examples of the terminal 13 include a personal computer and a tablet terminal.
  • the terminal 13 includes a processing unit such as a CPU, a storage unit such as a hard disk, ROM or RAM, a display unit such as a liquid crystal panel, an input unit such as a mouse, keyboard, touch panel, etc., and a communication unit such as a network adapter. .
  • an image of an animal is photographed by a photographing means such as a camera, and individual identification is performed. It is also possible to use a camera to photograph the face of the target animal, and input and transmit the photograph.
  • the user takes a photograph of the face of the animal to be insured according to instructions displayed on the screen of the terminal 13 , and sends it to the reception means 15 when an appropriate photograph is taken.
  • the server is separately provided with a photographing assistance means consisting of an image determination program, and the photographing assistance means is an image of the individual, such as that the entire face of the animal is imaged, or that the animal's face is photographed from the front. It may be determined whether or not the photograph is suitable for identity determination, and the determination result may be transmitted to the user through an interface or terminal.
  • the server is configured by a computer in this embodiment, it may be any device as long as it has the functions of the present invention.
  • the server may be a server on the cloud.
  • the determination means and reception means are stored in the server and connected to the terminal via connection means such as the Internet or LAN, but the present invention is not limited to this.
  • a mode in which the means and the interface unit are stored in one server or device, or a mode in which a separate terminal is not required may be employed.
  • the storage unit 10 is composed of, for example, a ROM, a RAM, or a hard disk.
  • the storage unit 10 stores an information processing program for operating each unit of the server, and particularly stores the determination unit 11 .
  • the determination means 11 is software that calculates the matching rate of the feature amount for each image and determines whether or not the individuals are the same individual based on the matching rate value.
  • the processing calculation unit 17 executes identity determination using the determination means 11 stored in the storage unit.
  • the interface unit (communication unit) includes reception means 15 and output means 14, for example, receives a face image of an animal from a photographing means, and transmits to the terminal the determination result of identity or similarity, and the photographed individual. Output individual identification information about the same or similar individuals.
  • the entrance/exit management system of the present invention includes a database storing feature values extracted from animal facial images using a trained model and animal individual identification information, and an input of an animal's facial image entering or exiting.
  • Receiving means for receiving feature quantity extracting means for extracting a feature quantity from the face image input to the receiving means, including a trained model, feature quantity stored in the database, and the feature quantity extracting means for extracting
  • the face image of the animal input to the reception means is an image of an individual that is the same as or similar to the individual animal associated with the individual identification information stored in the database. and determination means.
  • the entrance/exit management system of the present invention can be used, for example, in pet hotels, dog runs, pet cafes, etc., where it is desired to grasp and manage the entrance and exit of animals to specific areas or rooms.
  • the database preferably stores, as individual identification information, one or more tendencies selected from the group consisting of barking tendency, aggression, activity and sociability.
  • the determining means determines that an animal about to enter or exit is an individual identical or similar to an individual having a predetermined propensity stored in the database, It is preferable to further have alert means for alerting. Alert means is not particularly limited.
  • the reception means is not limited, and for example, it is possible to receive, through the network, images captured by photography means such as a surveillance camera fixed in the room, a network camera, or a camera attached to a smartphone.
  • the database, feature quantity extraction means, determination means, and output means are the same as above.
  • FIG. 4 An example of an embodiment of the entrance/exit management system of the present invention will be described with reference to FIG. 4 using a case of a pet hotel.
  • the user of the pet hotel registers as a member on the website of the pet hotel through the terminal 13, and then registers the species, breed, name, date of birth, weight, sex, and vaccination status of the pet to be accommodated at the pet hotel.
  • the face image of the pet is registered together with the individual identification information such as.
  • the individual identification information of the registered pet is stored in the database 12 managed by the pet hotel.
  • a feature amount is extracted from the face image registered using the trained model, and stored in the database in association with the individual identification information.
  • the user makes a reservation for the pet hotel on the website through the terminal 13, and visits the pet hotel with the pet on the reserved date and time.
  • An employee of the pet hotel photographs the pet by a photographing means 16 such as a camera installed in the pet hotel.
  • the photographed image is input to the receiving means 15 through the network.
  • the processing calculation unit 17 uses the feature amount extraction means (learned model) 18 to extract the feature amount from the image input to the reception means 15 .
  • the processing operation unit 17 refers to the database 12, and uses the determination unit 11 to match the feature amount related to the face image of the pet stored in the database 12 with the feature amount obtained from the received image. Calculate the rate and determine whether or not they are the same individual.
  • the determination is repeated for each face image of the pet stored in the database 12, and when it is determined that they are the same individual, the face image of the pet and the individual identification information of the pet are output by the output means 14. Output on the screen of the hotel terminal.
  • the determination result may also be output to the terminal 13 owned by the user of the pet hotel.
  • the pet hotel employee uses the output determination result and pet individual identification information to determine that the pet trying to use the pet hotel is the same individual as the pet registered as a member. and allow the pet to enter.
  • a terminal 13 is a terminal used by a user.
  • Examples of the terminal 13 include a personal computer and a tablet terminal.
  • the terminal 13 includes a processing unit such as a CPU, a storage unit such as a hard disk, ROM or RAM, a display unit such as a liquid crystal panel, an input unit such as a mouse, keyboard, touch panel, etc., and a communication unit such as a network adapter. .
  • the user may use a smartphone camera to take a picture of the target animal's face on the spot, enter and send it.
  • the user takes a photograph of the face of the animal to be insured according to the instructions displayed on the screen of the terminal 13 and sends it to the database 12 when an appropriate photograph is taken.
  • the server is separately provided with a photographing assistance means consisting of an image determination program, and the photographing assistance means is an image of the individual, such as that the entire face of the animal is imaged, or that the animal's face is photographed from the front. It may be determined whether or not the photograph is suitable for identity/similarity determination, and the determination result may be transmitted to the user through an interface or a terminal.
  • the server is configured by a computer in this embodiment, it may be any device as long as it has the functions of the present invention.
  • the server may be a server on the cloud.
  • the storage unit 10 is composed of, for example, a ROM, a RAM, or a hard disk.
  • the storage unit 10 stores an information processing program for operating each unit of the server, and particularly stores the determination unit 11 .
  • the determination means 11 is software that calculates the matching rate of the feature amount for each image and determines whether the individuals are the same individual or similar individuals based on the matching rate value.
  • the processing calculation unit 17 uses the determination means 11 stored in the storage unit to perform identity/similarity determination.
  • the interface unit includes reception means 15 and output means 14. For example, the face image of the animal is received from the photographing means, and the determination result of identity/similarity and the identity of the photographed individual are sent to the terminal. Or output individual identification information about similar individuals.
  • the pet hotel can easily determine that the pet brought by the user is the same individual as the pet registered as a member, and the reception of the pet hotel. can be done smoothly.
  • Fig. 5 shows a flowchart of individual identification based on the embodiment of the entrance/exit management system of the present invention.
  • An employee of the pet hotel uses a photographing means to photograph the face of the pet brought by the user, and inputs it to the reception means of the server using a terminal (step S1).
  • the processing operation unit of the server compares the feature amount of the uploaded face image and the face image of the animal registered in advance in the database using the determination means, and determines whether or not they are the same individual or similar. It is determined whether or not the object is an individual (step S2).
  • the output means outputs the judgment result by displaying it on the terminal screen, etc., and presents it to the employee of the pet hotel (step S3).
  • the medical examination management system of the present invention includes a database storing feature amounts extracted from animal facial images using learned models and individual identification information of animals, and facial images of animals to be examined at a veterinary hospital.
  • Receiving means for receiving input feature quantity extracting means for extracting a feature quantity from the face image input to the receiving means, the feature quantity being stored in the database; By comparing the extracted feature amounts, it is determined whether or not the face image of the animal input to the receiving means is the image of an individual that is the same as or similar to the individual animal associated with the individual identification information stored in the database. and determination means for determining.
  • the medical examination management system of the present invention can be used, for example, when a pet insurance provider wants to know whether a pet covered by pet insurance has been examined.
  • the reception management system of the present invention includes a database storing feature values extracted from animal face images using learned models and animal individual identification information, and a face of an animal about to be trimmed or shampooed at a pet salon.
  • Receiving means for receiving an input of an image; feature quantity extracting means for extracting a feature quantity from the face image input to the receiving means, including a trained model; feature quantity stored in the database; By comparing the feature values extracted by the extracting means, it is determined whether or not the facial image of the animal input to the receiving means is the image of an individual that is the same as or similar to the individual animal associated with the individual identification information stored in the database.
  • a reception management system comprising: determination means for determining whether the facial image of the animal input to the receiving means is the image of an individual that is the same as or similar to the individual animal associated with the individual identification information stored in the database.
  • a reception management system comprising: determination means for determining whether the
  • the reception management system of the present invention can be used, for example, when a pet salon wants to know whether a pet to be serviced is a pet registered as a member and the past service provision history.
  • the management system of the present invention includes a database storing feature values extracted from animal face images using a trained model and animal individual identification information, and face images of animals that are candidates for animals to be searched.
  • a feature extraction means for extracting a feature from the face image input to the acceptance means including a trained model; a feature stored in the database; and the feature extraction By comparing the feature values extracted by the means, whether or not the face image of the animal input to the receiving means is an image of an individual that is the same as or similar to the individual animal associated with the individual identification information stored in the database. and determination means for determining the.
  • the animal management system of the present invention can be used, for example, when searching for a lost pet and wanting to check whether the found animal is the pet to be searched.
  • the individual identification method of the present invention includes a step of receiving an input of an animal face image, a feature extraction step of extracting a feature from the face image input to the receiving means using a trained model, and an animal face By comparing the feature amount extracted from the image using the trained model and the feature amount stored in a database storing the individual identification information of the animal and the feature amount extracted by the feature amount extraction means, the reception a determination step of determining whether the face image of the animal input to the means is an image of an individual that is the same as or similar to the individual animal associated with the individual identification information stored in the database.
  • the step of accepting an input of an animal's facial image is, for example, a step of accepting an input of an animal's facial image using the accepting means described above.
  • the feature quantity extraction step is a step of extracting a feature quantity from the face image input to the reception means using the learned model.
  • the trained model is the same as the trained model described in the individual identification system above.
  • the determination step the feature amount extracted from the face image of the animal using the trained model and the feature amount stored in the database storing the individual identification information of the animal, and the feature amount extracted by the feature amount extraction means. It is a step of determining whether or not the face image of the animal input to the reception means is the image of an individual that is the same as or similar to the individual animal associated with the individual identification information stored in the database. For example, it is the step of calculating the matching rate of the feature amount using the above determination means and determining whether the individuals are the same or similar.
  • Example 1 Face images of each of nine miniature dachshunds (images showing only the eyes and their surroundings. As an example, the color photographs of FIGS. 6(A) to (C). They were unified to 500 ⁇ 500 pixels.) were prepared. . Each image was input to the trained model and the feature amount was extracted. A model with ImageNet weights in EfficientNetB7 was used as a trained model. Next, a face image A of a miniature dachshund (individual to be identified; FIG. 7) for which individual identification is to be performed was prepared, and feature amounts were extracted using the above-described trained model. The same individual as the identification target individual is included in the above nine animals.
  • the cosine similarity with the feature value of the face image A is calculated, and the softmax function of the scaled cosine similarity is used so that the sum of the nine images is 100%. adjusted to As a result, it was found that the individual with the highest facial image match rate of 93% among the nine individuals was the image of the same individual as the individual to be identified.
  • Example 2 A plurality of face images similar to those in Example 1 were prepared for each of nine individuals (miniature dachshunds A to I). These images are called “database images”. Using the same trained model as in Example 1, feature amounts were extracted from each face image. Averaging (arithmetic mean) was performed on the feature amounts of multiple face images for each of the nine individuals. As shown in Table 1, the number of face images used for averaging was changed to 2, 4, 8, 16, 32, 64, and 128, and averaging was performed. rice field. In Table 1, the number of images used for averaging is "1", which is an example in which one image is used and no averaging is performed. The feature quantity obtained for each of the nine individuals is defined as the "average feature quantity".
  • the percentage of correct answers out of a total of 90 images of 9 individuals ⁇ 10 images was defined as the “correct answer rate”.
  • Table 1 shows the relationship between the number of sheets used for averaging and the accuracy rate. As is clear from Table 1, the accuracy rate can be increased by averaging the feature values.
  • Example 3 (Similar individual determination) One face image was prepared for each of 452 puppies. The puppies are 3-6 month old puppies whose breed is specified by pedigree or DNA test, and the images are 500 ⁇ 500 pixel color images showing at least the face and its surroundings. In addition, although the breed was not limited in this test, Toy Poodle, Chihuahua, Miniature Dachshund, Shiba, Pomeranian, Miniature Schnauzer, England Terrier, Shih Tzu, Papillon and French - Including bulldogs. Each image was input to the trained model and the feature amount was extracted. For EfficientNetB4, we used a model fine-tuned from a trained model with ImageNet weights. Next, one face image was prepared for each of 100 adult dogs, and the feature amount was extracted using the learned model. Puppies and adult dogs are separate individuals.

Landscapes

  • Life Sciences & Earth Sciences (AREA)
  • Environmental Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Birds (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Zoology (AREA)
  • Animal Husbandry (AREA)
  • Biodiversity & Conservation Biology (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Collating Specific Patterns (AREA)
  • Image Analysis (AREA)

Abstract

L'invention concerne un système d'identification individuelle ou un procédé d'identification individuelle pour un animal, le système comprenant un moyen qui identifie, au moyen d'un procédé simple, un individu en utilisant une image de l'animal.　Le système d'identification individuelle comprend : une base de données qui stocke des quantités de caractéristiques extraites en utilisant un modèle entraîné à partir d'images faciales d'animaux et d'éléments d'informations d'identification individuelle concernant les animaux ; un moyen de réception qui reçoit une entrée d'une image faciale d'un animal ; un moyen d'extraction de quantité de caractéristiques qui comprend le modèle entraîné et extrait des quantités de caractéristiques de l'entrée d'une image faciale au moyen de réception ; et un moyen de détermination qui, en comparant les quantités de caractéristiques stockées dans la base de données et les quantités de caractéristiques extraites par le moyen d'extraction de quantité de caractéristiques, détermine si l'image faciale de l'animal entrée dans le moyen de réception est une image d'un individu identique ou similaire à un individu animal associé aux informations d'identification individuelle stockées dans la base de données.
PCT/JP2022/029346 2021-07-30 2022-07-29 Système d'identification individuelle et procédé d'identification individuelle WO2023008571A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2023538647A JPWO2023008571A1 (fr) 2021-07-30 2022-07-29

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2021126317 2021-07-30
JP2021-126317 2021-07-30

Publications (1)

Publication Number Publication Date
WO2023008571A1 true WO2023008571A1 (fr) 2023-02-02

Family

ID=85086095

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2022/029346 WO2023008571A1 (fr) 2021-07-30 2022-07-29 Système d'identification individuelle et procédé d'identification individuelle

Country Status (2)

Country Link
JP (1) JPWO2023008571A1 (fr)
WO (1) WO2023008571A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2024202364A1 (fr) * 2023-03-27 2024-10-03 日本電気株式会社 Système de gestion de santé, procédé de transmission, et programme

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2009176208A (ja) * 2008-01-28 2009-08-06 Nec Corp 顔認証装置、システム、方法及びプログラム
JP2014027920A (ja) * 2012-06-27 2014-02-13 Microchip Japan Inc ペット等の個体の情報管理システム及びマイクロチップ
JP2014071610A (ja) * 2012-09-28 2014-04-21 Keyware Solutions Inc データ処理装置、名寄せ処理方法及びコンピュータプログラム
JP2019010004A (ja) * 2017-06-29 2019-01-24 株式会社Ｐｅｃｏ 情報処理システム及びプログラム
JP2019071894A (ja) * 2017-08-29 2019-05-16 株式会社ハチたま 動物用健康管理システム、ペットの健康管理システム、携帯端末、及び携帯端末のプログラム
JP2019200527A (ja) * 2018-05-15 2019-11-21 アイシン・コムクルーズ株式会社 情報処理装置、情報処理方法、およびプログラム
JP6817590B1 (ja) * 2020-07-27 2021-01-20 パナソニックＩｐマネジメント株式会社 撮像装置

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2009176208A (ja) * 2008-01-28 2009-08-06 Nec Corp 顔認証装置、システム、方法及びプログラム
JP2014027920A (ja) * 2012-06-27 2014-02-13 Microchip Japan Inc ペット等の個体の情報管理システム及びマイクロチップ
JP2014071610A (ja) * 2012-09-28 2014-04-21 Keyware Solutions Inc データ処理装置、名寄せ処理方法及びコンピュータプログラム
JP2019010004A (ja) * 2017-06-29 2019-01-24 株式会社Ｐｅｃｏ 情報処理システム及びプログラム
JP2019071894A (ja) * 2017-08-29 2019-05-16 株式会社ハチたま 動物用健康管理システム、ペットの健康管理システム、携帯端末、及び携帯端末のプログラム
JP2019200527A (ja) * 2018-05-15 2019-11-21 アイシン・コムクルーズ株式会社 情報処理装置、情報処理方法、およびプログラム
JP6817590B1 (ja) * 2020-07-27 2021-01-20 パナソニックＩｐマネジメント株式会社 撮像装置

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2024202364A1 (fr) * 2023-03-27 2024-10-03 日本電気株式会社 Système de gestion de santé, procédé de transmission, et programme

Also Published As

Publication number Publication date
JPWO2023008571A1 (fr) 2023-02-02

Similar Documents

Publication Publication Date Title
EP4053762A1 (fr) Système de prédiction de maladies, système de calcul de frais d'assurance, et procédé de prédiction de maladies
US10600179B2 (en) Image analysis for determining characteristics of groups of individuals
TW201539357A (zh) 家畜識別系統和方法
JP7360496B2 (ja) 判定システム
WO2023008571A1 (fr) Système d'identification individuelle et procédé d'identification individuelle
JP2017224188A (ja) 飼育動物の保険加入支援システム、飼育支援システム、及びプログラム
US20240202200A1 (en) Evaluation method
JP7360489B2 (ja) 個体識別システム及び個体識別方法
KR102303862B1 (ko) 인공지능 기반 온라인 가축 경매 장치 및 방법
US20230245243A1 (en) Insurance premium calculation system and insurance premium calculation method
JP5702619B2 (ja) ペット情報管理システム及びペット情報管理方法
JP7204859B1 (ja) 性格判定システム及び性格判定方法
JP7503041B2 (ja) 保険料算出システム及び保険料算出方法
JP2024062859A (ja) 愛玩動物の相性判定システム及び相性判定方法
JP7260922B2 (ja) 学習用データ生成装置、学習装置、行動分析装置、行動型分析装置、プログラム、及び記録媒体
Klasky et al. Milking Welfare: Bovis Sacer and the Inclusive Thanatopolitics of the Dairy Farm
Klasky Milking Welfare: Agricultural Technology and Subject Formation on the Industrial Dairy Farm
KR102409368B1 (ko) 송아지 생산 시설과 공동 구매 소비자 중개 및 손익 배분 시스템
JP7330258B2 (ja) 感情判定システム及び感情判定方法
GB2618780A (en) Health tracking method and system
JP2022184223A (ja) ペット販売価格判定システム及びペット販売価格判定方法
CN117672501A (zh) 一种基于人工智能的宠物健康初筛系统
JP2022175927A (ja) カットスタイル判定システム及びカットスタイル判定方法
CN115204966A (zh) 推荐宠物用品的方法、装置、计算机设备和存储介质
CN117892172A (zh) 一种牲畜养殖的监管方法、装置、电子设备及存储介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22849631

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2023538647

Country of ref document: JP

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 22849631

Country of ref document: EP

Kind code of ref document: A1