KR20230012432A - Method and apparatus managing biometric information for pet entity authentication - Google Patents

Abstract

An embodiment of the present invention relates to a method of managing biometric information for entity identification of a companion animal and an electronic device for performing the same. A method for managing biometric information for entity identification of a companion animal by an electronic device according to an embodiment of the present invention comprises the steps of: acquiring a plurality of companion animal images by photographing the companion animal entity, which is to be a biometric information acquisition target, at least once; identifying the biometric information of the companion animal from the plurality of companion animal images; encrypting the identified biometric information; and transmitting the encrypted biometric information to an external device connected to the electronic device. The biometric information of the companion animal can be effectively managed.

Description

Method and apparatus for managing bio information for companion animal entity identification {METHOD AND APPARATUS MANAGING BIOMETRIC INFORMATION FOR PET ENTITY AUTHENTICATION}

The present disclosure relates to a method and apparatus for managing bio-information of a companion animal. More specifically, it relates to a method and apparatus for managing bio-information for companion animal entity identification.

Recently, the number of households raising companion animals has increased rapidly, and the market for companion animals is also rapidly growing accordingly. However, as the number of companion animals rapidly increases, overall systems for managing companion animals have not yet been automated, and accordingly, there are many limitations in effectively managing companion animals.

In order to effectively manage companion animals such as companion dogs and cats, it is necessary to accurately identify each individual companion animal, and it is essential to develop technology to manage large-scale companion animal bio information for entity identification.

In particular, in order to develop services and solutions to solve various issues related to companion animals by using biometric recognition technology based on biometric information, it is required to develop database construction technology for large-scale companion animal biometric information.

Korea Patent No. 2263033

According to an embodiment, a method for managing bio information for identification of a companion animal and an electronic device performing the same may be provided.

Also, according to an embodiment, a method of determining quality conditions for companion animal images and selecting companion animal images satisfying predetermined quality conditions and an electronic device performing the same may be provided.

According to an embodiment of the present disclosure for achieving the above-described technical problem, in a method for an electronic device to manage bio information for identification of a companion animal entity, the companion animal entity as a target for obtaining the bio information is selected at least once. acquiring a plurality of companion animal images by photographing; identifying bio information of the companion animal from the plurality of companion animal images; Encrypting the identified bio-information; and transmitting the encrypted bio-information to an external device connected to the electronic device. Including, a method may be provided.

According to another embodiment for achieving the above-described technical problem, an electronic device for managing bio-information for identification of a companion animal entity, comprising: a network interface; a memory that stores one or more instructions; and at least one processor executing the one or more instructions; wherein, by executing the one or more instructions, the at least one processor obtains a plurality of companion animal images by photographing the companion animal subject to be obtained as the bio information at least once or more, and the plurality of companion animal images An electronic device may be provided that identifies bio-information of the companion animal from animals, encrypts the identified bio-information, and transmits the encrypted bio-information to an external device connected to the electronic device.

According to another embodiment for achieving the above-described technical problem, in a method for an electronic device to manage bio information for identification of a companion animal entity, by photographing a companion animal entity to be obtained as the bio information at least once. acquiring a plurality of companion animal images; identifying bio information of the companion animal from the plurality of companion animal images; Encrypting the identified bio-information; and transmitting the encrypted bio-information to an external device connected to the electronic device. A computer-readable recording medium recording a program for executing the method on a computer, including, may be provided.

According to an embodiment of the present disclosure, bio-information on a companion animal can be effectively managed.

The quality of the companion animal image may be determined, and bio information may be obtained from the companion animal image having a certain level or higher.

1 is a diagram schematically illustrating a method of managing bio information for identification of a companion animal by an electronic device according to an embodiment.
2 is a flowchart of a method for an electronic device to manage bio information for identification of a companion animal according to an embodiment.
3 is a diagram for explaining a bio-information collection environment according to an exemplary embodiment.
4 is a diagram for explaining an inscription image of a companion animal acquired through a non-contact device according to an embodiment.
5 is a flowchart of a method of managing bio-information for identification of a companion animal by an electronic device according to another embodiment.
6 is a flowchart of a method of determining, by an electronic device, whether a quality state of a companion animal image satisfies a predetermined quality condition according to an embodiment.
7 is a diagram for explaining a process of determining the quality of a companion animal image by an electronic device according to an embodiment.
8 is a block diagram of an electronic device according to an exemplary embodiment.
9 is a block diagram of an electronic device according to another embodiment.
10 is a block diagram of a server connected to an electronic device according to an embodiment.

Terms used in this specification will be briefly described, and the present disclosure will be described in detail.

The terms used in the present disclosure have been selected from general terms that are currently widely used as much as possible while considering the functions in the present disclosure, but they may vary according to the intention or precedent of a person skilled in the art, the emergence of new technologies, and the like. In addition, in a specific case, there is also a term arbitrarily selected by the applicant, and in this case, the meaning will be described in detail in the description of the invention. Therefore, terms used in the present disclosure should be defined based on the meaning of the term and the general content of the present disclosure, not simply the name of the term.

When it is said that a certain part "includes" a certain component throughout the specification, it means that it may further include other components without excluding other components unless otherwise stated. In addition, terms such as "...unit" and "module" described in the specification mean a unit that processes at least one function or operation, which may be implemented as hardware or software or a combination of hardware and software. .

Hereinafter, with reference to the accompanying drawings, embodiments of the present disclosure will be described in detail so that those skilled in the art can easily carry out the present disclosure. However, the present disclosure may be implemented in many different forms and is not limited to the embodiments described herein. And in order to clearly describe the present disclosure in the drawings, parts irrelevant to the description are omitted, and similar reference numerals are attached to similar parts throughout the specification.

1 is a diagram schematically illustrating a method of managing biometric information of a companion animal by a companion animal biometric information management system according to an embodiment.

As shown in Figures 102 and 104, the electronic device 1000 according to an embodiment of the present disclosure acquires a companion animal image 122 by photographing a companion animal in a predetermined collection environment condition, A region of interest (ROI) 124 may be identified from the acquired companion animal image, and bio information may be obtained from the identified region of interest. According to an embodiment, the electronic device 1000 may transmit bio information acquired from a companion animal image to the server 2000, and the electronic device 1000 or the server 2000 may store bio information on a large scale. Base 140 can be built.

The types of electronic devices used for companion animal object identification will be described. According to an embodiment, the electronic device 1000 may be provided as a contact type 110 and a non-contact type 120. For example, the electronic device of the non-contact type 110 includes a digital camera that generates a digital signal as a picture by using a digital memory, and a mobile camera mounted on a mobile device such as a smartphone or tablet computer. Camera) or an infrared type special camera that has many frames per second or recognizes a specific wavelength range, but is not limited thereto. Also, for example, the contact type 120 electronic device may be an optical scanner that optically captures a contact surface using an optical prism and an optical path, but is not limited thereto.

In addition, according to an embodiment, the electronic device 1000 includes an OIS system (Optical Image Stabilization) that detects the motion of the photographing device using a gyro sensor and mechanically moves a part of an optical component to change an optical path to compensate for shaking. A device for photographing a companion animal based on pan movement that rotates only the camera head inside the electronic device in the horizontal direction (left and right) and tilt movement that rotates only the camera head in the vertical direction (left and right) can be

Hereinafter, requirements required for an electronic device to acquire bio information will be described. The electronic device 1000 according to the present disclosure may include device functions of a certain level or higher to correspond to the movement of a companion animal to be acquired. For example, the electronic device 1000 of the non-contact type 120 may perform a function of adjusting a resolution above a certain level, shutter speed, sensitivity, and aperture. According to an embodiment, a certain level required for the function performed by the electronic device 1000 satisfies a level suitable for the quality status of inscription information used for entity identification when biometric information located within a specific ROI is processed into biometric identification information. It may be at the level required to do so.

In addition, according to an embodiment, the contact-type electronic device 1000 obtains an inscription image or an inscription image by directly contacting the nose region of the companion animal to the prism region, and obtains a biometric for object identification from the obtained inscription image or inscription image. When the information is obtained, a contact photographing method may be performed at a level suitable for the biometric information determined from the biometric information to be used for entity identification.

Referring to Table 1 above, minimum performance requirements required for the non-contact type electronic device 1000 for acquiring bio information according to an embodiment are illustrated. According to an embodiment, the non-contact type electronic device 1000 has a pixel count of 5 M pixels or more, a sensor size of 1/3 inch or more, an aperture of f/1.8, a resolution of 1,080 × 1,080 pixels or more, , The outdoor shutter speed tolerance range satisfies the range of 1/1000th of a second ~ 1s, the indoor shutter speed tolerance range satisfies the range of 1/500th of a second ~ 1s, and the sensitivity (ISO ) When the allowable range satisfies the range of 200 to 400, the non-contact type electronic device may identify bio information of a certain level or higher from the acquired companion animal image.

Referring to Table 2 above, minimum performance requirements required for the contact-type electronic device 1000 for bio-information acquisition according to an embodiment are illustrated. According to an embodiment, the contact-type electronic device 1000 has a CMOS image sensor having a size of 2 M pixels or more, an image resolution of 500 DPI or more, an image acquisition frame rate of 10 frames/sec, and image storage. When the format is provided in at least one of RAW, BMP, WSQ, and JPEG2000, bio information of a certain level or higher may be identified from the companion animal image obtained by the contact type electronic device.

Also, referring to Table 3 above, ROI quality requirements for a region of interest (ROI) in a companion animal image are shown. According to an embodiment, when the size of the ROI in the companion animal image acquired by the electronic device 1000 according to the present disclosure is 256 x 256 pixels or more and the ratio of bioinformation in the ROI is determined to be 60% or more, Table 3 above Bio information of a certain level or higher may be identified from the companion animal image including the ROI of a certain level.

Hereinafter, requirements for a collection target of biometric information will be described. Since the object of collection of bio information is a companion animal, data can be collected in an uncooperative environment, and if the companion animal exhibits excessive movement, the collection of bio information cannot be performed smoothly, so the condition of the companion animal can be controlled. In addition, due to the nature of companion animals, foreign substances often cover inscriptions, so an additional step of arranging the shooting area may be required, and companion animal images or image data may be collected more than once to evaluate the persistence of bio information. there is.

Hereinafter, a bio-information collection method will be described. The collection of bio information can be conducted in an environment where companion animals can maintain a stable state, and can be conducted in an environment where companion animals can be stable through assistance from guardians, companion animal managers, veterinarians, trainers, and the like. In the case of a method in which the non-contact electronic device 1000 according to an embodiment acquires a companion animal image, it may be performed in a state in which the companion animal and the photographer maintain a certain distance or more, and an indoor shooting environment in which illumination of a certain brightness or more is secured. can proceed in

Hereinafter, a bioinformation storage standard format for constructing a bioinformation database will be described. The bio information extracted from the companion animal image obtained by the electronic device 1000 is stored in the database 140 to build a bio information database. A bioinformation database for identification of a companion animal entity may be defined by dividing into basic information applied to all entities, environment and device information representing an acquisition environment of bioinformation, and specific information including individual characteristics of each entity.

Referring to Table 4 above, basic information about a companion animal that can be stored by being matched with bio information in the database 140 is shown. According to an embodiment, the basic information may include information on at least one of a country code, a region code, a registration authority, a registration date, a modification date, a modification record, or a version.

Referring to Table 5 above, device information and environment information used for photographing an object of a companion animal that can be stored by being matched with bio information in the database 140 are shown. According to an embodiment, the environment information may indicate a companion animal image or whether the companion animal image is obtained through indoor or outdoor shooting. According to an embodiment, the device information may include information about the type of device used to capture the companion animal image and the maximum resolution capability of the device.

Referring to Table 6, an example of specific information for identification of a companion animal that is stored in the database 140 is shown. According to an embodiment, the specific information may include bio information. Also, according to an embodiment, the specific information may further include at least one of file information, companion animal information, guardian information, or other information. According to an embodiment, the file information may include information on at least one of a file format, a file name, a file location, or a file size, and the bio information may include at least one of a type of bio information, raw data of bio information, or resolution of bio information. Companion animal information may include at least one of information on the birth date (BirthDate), gender (Gender), or species (BREED) of the companion animal.

According to an embodiment, the guardian information may include a guardian's unique code capable of uniquely identifying the guardian, and other information may include at least one of repetition order related to the number of times companion animal images are taken or information on other comments. can include In addition, according to an embodiment, the bio information collected by the electronic device may be compressed and stored after being encrypted in the computer of the server 2000 managed by the service provider, and the compressed information may be accessed only for research purposes. may be allowed to Hereinafter, the security management guidelines for the database for object identification, the method of separating and operating the guardian identification information and companion animal bio information data, and the guardian's personal information protection guidelines will be described in detail.

According to an embodiment, in the process of operating a database for identification of a companion animal, measures to protect personal information may be required to minimize the possibility of leakage of the personal information of the guardian and the biometric information of the companion animal. In the process of managing data related to companion animal bio information, the following guidelines can be followed to protect personal information.

For example, in order to protect guardian data from malicious attacks through access to companion animal data, guardian data may be separated from companion animal data and managed. Guardian identification information and companion animal bio information DB can be operated separately logically or physically, and according to an embodiment, a common identifier that can commonly refer to each identification information of guardian identification information and companion animal bio information is set. It can be. In addition, the following security requirements may be required in a process in which the electronic device 1000 logically or physically separates and operates guardian identification information and companion animal bio information using a common identifier.

For example, it should not be possible to extract guardian identification information or companion animal bio information with the common identifier itself. You have to be able to detect the facts. In addition, even if DB contents are modified by an operator who has an appropriate secret key during DB operation, the operator of the other DB must be able to detect this fact.

Hereinafter, the personal information protection guidelines for guardians will be described. For example, guardians must protect sensitive information about individuals. This is to protect personal information that can identify individuals, such as the guardian's name, phone number, date of birth, address code, text, voice and video. The database security manager for identification of companion animals based on biometrics must comply with the following security measures. For example, parental identification information in databases for entity identification must be properly used and pre-posted to establish policies and govern procedures, and adherence to collection restriction principles, in systems designed to ensure that parental identification information is not stored any longer than necessary. Data must be processed in relation to the purpose, and judgment is required to provide user information at no cost to the user for the recording, consent, right to access, right to correct, and objection to personally identifiable information collected. In addition, if the administrator wants to link to the subject information recorded in the parental identification information, it is generally necessary to inform the relevant user in advance in a conspicuous way and obtain specific and explicit consent before providing the information.

2 is a flowchart of a method for an electronic device to manage bio information for identification of a companion animal according to an embodiment.

In S210, the electronic device 1000 may acquire a plurality of companion animal images by photographing a companion animal subject to obtain bio information at least once. In S220, the electronic device 1000 may identify bio information of the companion animal from a plurality of companion animal images. In S230, the electronic device 1000 may encrypt the identified bio information. In S240, the electronic device 1000 may transmit the encrypted bio information to an external device connected to the electronic device.

Although not shown in FIG. 2 , according to another embodiment, the electronic device 1000 may identify a region of interest from a companion animal image and bio information from the identified region of interest. According to another embodiment, the electronic device 1000 may determine whether the quality state of the obtained companion animal image satisfies a predetermined quality condition, and may identify bio information from the companion animal image satisfying the quality condition. .

In addition, although not shown in FIG. 2 , prior to identifying the bio information, the electronic device 1000 determines at least one of the country, region, registration authority, registration date, modification date, modification record, or version related to the companion animal entity. Acquisition of basic information, acquisition of shooting environment information in which the companion animal image was captured, acquisition of device information of an electronic device used to acquire the companion animal image, and a file related to a file format for storing the bio information Information, companion animal information on at least one of the date of birth, gender or breed of the companion animal, guardian identification information on the companion animal object, and other information about at least one of the number of times or comments of the companion animal object may be further obtained. may be

Also, although not shown in FIG. 2 , when encrypting bio information in step S230 , the electronic device 1000 may encrypt basic information, environment information, device information, and other information together with the bio information. Also, although not shown in FIG. 2 , in S240, the electronic device 1000 may transmit encrypted basic information, environment information, device information, and other information together with the encrypted bio information to an external device connected to the electronic device.

According to an embodiment, the bio information acquired by the electronic device in S220 may include at least one of companion animal's nose print information, face information, or iris information. Also, according to an embodiment, in S210, the electronic device 1000 may acquire a plurality of companion animal images by photographing a companion animal object at least once under a preset environmental condition in which an illumination intensity equal to or higher than a threshold brightness is secured.

3 is a diagram for explaining a bio-information collection environment according to an exemplary embodiment.

Referring to figures 310 and 320, a process of collecting bio information in a predetermined bio information collection environment by the electronic device 1000 will be described in detail. For accurate performance test evaluation according to the present disclosure, as shown in Figures 310 and 320, in constructing a database for identification of companion animal entities, various collection environments must be considered. According to the case shown in FIG. 3 , in the case of photographing using a non-contact bio-information acquisition device, the range of change in the type of photographing location for acquiring bio-information, the light source of the photographing location, and the photographing angle of the bio-information obtaining device can be defined. can The shooting location is divided into indoor and outdoor, and the light source at the location can be installed so that the dog's bio-information can be investigated from various angles. An electronic device for obtaining bio information according to the present disclosure may be installed by adjusting the angles of the top, bottom, left, and right sides based on a point at which bio information of a companion dog to be collected can be acquired from the front.

Hereinafter, an example of estimating the quantity of bio-information collection devices for identification of companion animal entities that can be used to obtain bio-information will be described. According to an embodiment, the bioinformation obtaining device is a mobile camera supporting an Optical Image Stabilization (OIS) system and communication terminal USB 3.0 or higher to remove irregular variables of the collection environment and stably transmit and store large-scale data. may be a mounted device. Also, according to an embodiment, the number of acquisition devices required for collection may be determined as shown in Table 7 below, based on the number of conditions selected within the variation range of the collection environment.

Hereinafter, bio information collection preparation procedures for companion animal entity identification will be described. In order to establish a database for smooth object identification, the collection location can be selected in an area with a large number of companion dogs, such as a dog playground, theme park, protection center, and rabies vaccination site. In addition to areas where companion animals are concentrated, a method of operating a mobile bus dedicated to building a database can be utilized, and the bioinformation collection environment in the mobile bus can be configured identically to that of areas where companion animals are concentrated. When the establishment of the bioinformation collection environment is completed in the relevant place, information and guidelines on bioinformation collection for object identification are provided, and companion animal experts such as companion animal managers, veterinarians, and trainers are consulted in preparation for safety accidents at the collection site, such as dog bites. Safety measures must be prepared through this, and data collection can be carried out through companion animal image shooting in the presence of the expert.

Hereinafter, the process of collecting bioinformation for companion animal entity identification will be described. According to an embodiment, although not shown in FIG. 3 , the electronic device 1000 may first obtain data excluding bio information among basic information and specific information of a companion dog based on a user input to the electronic device. For example, when a companion dog and guardian visit a collection place to participate in bio information collection, the guardian fills out a consent form to provide information on necessary items for collection and inputs and stores data excluding bio information among basic and specific information of companion dog. It can be done through an electronic device.

Hereinafter, a preparation process for photographing a companion animal will be described. According to one embodiment, the companion animal is stably located at a point within 20 cm to 40 cm in front of the place where the electronic device for obtaining bio information is installed so that the guardian can fix the face of the companion animal in a comfortable state, and shooting Before starting, arrange the shooting area so that the companion animal's bio information is not covered by foreign substances.

Hereinafter, a companion animal photographing process will be described in detail. According to an embodiment, the electronic device 1000 may obtain a companion animal image by capturing a point in time when the focus of the electronic device is normally focused on the companion animal's bio information. According to an embodiment, when a plurality of electronic devices acquire bio information of a companion animal at the same time or together, the bio information may be obtained by setting a time when two or more electronic devices are normally focused as a bio information acquisition time.

Referring to Table 8 above, an example of calculating the number of times of collection of bio-information for identification of a companion animal is shown. For example, the number of bio information collection times for the same entity can be calculated based on the location, light source, and angle conditions of the collection environment, and repeated from the companion animal photographing preparation step to acquire a plurality of bio information from the same entity. It can be.

Hereinafter, a standard format for storing bioinformation data for companion animal entity identification will be described. According to an embodiment, the bio information obtained in the case shown in FIG. 3 may be stored according to the storage standard format according to Tables 9 to 11 below.

Referring to Table 9, the configuration of basic information of a database construction example for identification of a companion animal entity is shown. According to an embodiment, the bio information of the companion animal identification database may be stored by being matched with the basic information shown in Table 9 above. According to an embodiment, the basic information may include information about at least one of a country code, a region code, a registration authority, a registration date and time, a modification date and time, a revision record, and a version.

Referring to Table 10, configurations of environment and device information of an example of constructing a database for identification of a companion animal entity are shown. According to an embodiment, the bio information of the companion animal identification database may be stored by being matched with the environment information and device information shown in Table 10 above. According to an embodiment, the environment information may include photographing environment information representing indoor or outdoor photographing environment conditions, and the device information may include information about at least one of a device type and a maximum resolution of the device. According to an embodiment, the device information may include information about a type of device, either a non-contact type or a contact type.

Referring to Table 11, an example of specific information of a case of constructing a database for identification of a companion animal entity is shown. According to an embodiment, the bio information of the companion animal identification database may be included in specific information along with the information shown in Table 11 above. According to an embodiment, the specific information may include bio information. Also, according to an embodiment, the specific information may include at least one of file information, companion animal information, guardian information, or other information in addition to bio information.

According to an embodiment, the file information may include information about at least one of a file format, a file name, a file location, or a file size. According to an embodiment, the bio information may include information about at least one of a type of bio information, raw data of bio information, and resolution of bio information. According to an embodiment, companion animal information may include information about at least one of a companion animal's unique code, a companion animal's date of birth, a companion animal's gender, or a companion animal's species (BREED). According to an embodiment, the guardian information may include unique code information for uniquely identifying the guardian, and other information may further include information on the number of repetitions or other comments.

Hereinafter, the performance test of the object identification algorithm, such as the inscription of a companion animal, and the search service for lost or abandoned animals using object identification technology will be briefly described. According to an embodiment, when a database is built using the obtained bio information of a companion animal as in the case shown in FIG. 3, a technical performance test for the print recognition algorithm can be performed, and a predetermined performance test Various services based on companion animal entity identification may be provided for the database that satisfies the conditions. For example, a companion animal lost or abandoned inquiry service may be provided using a print recognition algorithm or an iris recognition algorithm verified through a biometric information database for identification of a companion animal that meets the conditions of a technical performance test.

4 is a diagram for explaining an inscription image of a companion animal acquired through a non-contact device according to an embodiment.

When the electronic device 1000 according to an embodiment is provided as a non-contact type, an inscription suitable for object identification may be obtained by photographing the companion animal while staring at the front of the electronic device. If the other inscription is blurred, obscured, or distorted, an inscription unsuitable for object identification may be obtained.

Referring to figure 410 of FIG. 4, an example of an inscription suitable for identification of a companion animal entity is shown, and referring to figure 420, an example of an inscription not suitable for identification of a companion animal entity and an example in which the inscription is blurred is shown. Also, referring to figure 430, as an example of an inscription not suitable for identification of a companion animal, an example of a case where the inscription is covered and a case where the inscription is distorted when an image is captured is shown.

In addition, although not shown in FIG. 4, when photographing is performed by contacting the inscription area to the photographing surface using a contact type electronic device, an inscription suitable for object identification may be obtained, and if only the other partial inscription is input, the non-contact type When a blurry image that does not closely adhere to the photographing unit of the type electronic device is input, an inscription (eg, a partial inscription, a blurry inscription) that is not suitable for object identification may be obtained.

5 is a flowchart of a method of managing bio-information for identification of a companion animal by an electronic device according to another embodiment.

In S610, the electronic device 1000 may acquire a plurality of companion animal images by photographing a companion animal subject to obtain bio information at least once. In S620, the electronic device 1000 determines that the quality status of the obtained plurality of companion animal images determined based on the quality evaluation factor for at least one of brightness, noise, or sharpness of the companion animal image satisfies a predetermined quality condition. You can decide whether you are satisfied or not. For example, the electronic device 1000 does not identify bio information from all acquired companion animal images, but identifies bio information only from images that satisfy a certain level of quality conditions among images acquired through photographing. You may.

In S630, the electronic device 1000 may identify bio information from some companion animal images that satisfy a quality condition among companion animal images. In S640, the electronic device 1000 may encrypt the identified bio information. In S650, the electronic device 1000 may transmit the encrypted bio information to an external device connected to the electronic device.

6 is a flowchart of a method of determining, by an electronic device, whether a quality state of a companion animal image satisfies a predetermined quality condition according to an embodiment.

In S710, the electronic device 1000 may identify regions of interest related to the companion animal object from the plurality of companion animal images. For example, the region of interest may include at least a part of the eye or nose region of the companion animal object in the companion animal image.

In S720, the electronic device 1000 may determine whether the quality states of the plurality of companion animal images satisfy a quality condition by applying a quality evaluation factor to the identified regions of interest. A detailed method of determining whether the quality state of companion animal images by the electronic device 1000 satisfies a predetermined quality condition will be described with reference to FIG. 8 to be described later.

7 is a diagram for explaining a process of determining the quality of a companion animal image by an electronic device according to an embodiment.

According to an embodiment, the electronic device 1000 may determine whether the quality states of the plurality of companion animal images 801 satisfy a quality condition. According to an embodiment, the electronic device 1000 identifies a region of interest from the plurality of companion animal images 801, and determines a corresponding region of interest based on whether or not a quality state of the identified region of interest satisfies a quality condition. It may also be determined whether the included companion animal image satisfies the quality condition.

In S802, the electronic device 1000 may perform brightness evaluation on the plurality of companion animal images 801. For example, the electronic device 1000 may determine the brightness score 802 according to the brightness value of each pixel. In S804, the electronic device 1000 may determine whether the determined brightness score satisfies a preset threshold condition.

For example, the electronic device 1000 may obtain a brightness level (0 to 255 or a specified level) for each segment (10X10, etc.) or for each pixel throughout the ROI or companion animal image, and then determine a brightness score for each region. . According to an embodiment, the brightness score may be determined as an average value, a median value, a ratio corresponding to a threshold level, and the like. According to an embodiment, a low brightness score may be measured when a brightness evaluation value is far from a preset threshold range.

According to an embodiment, when the electronic device 1000 identifies that the brightness score is smaller than the first threshold brightness score, the quality state of the companion animal image having the brightness score smaller than the first threshold brightness score does not satisfy the quality condition. can be identified as not. According to another embodiment, when the brightness score is identified as smaller than the first threshold brightness score or greater than the second threshold brightness score, the electronic device 1000 determines that the threshold condition is not satisfied, and rejects it. It may be determined that the quality state of the animal image does not satisfy the quality condition.

However, according to another embodiment, the electronic device 1000 determines brightness scores for the plurality of companion animal images 801, the determined brightness scores are equal to or greater than the first threshold brightness score, and the second threshold brightness score. If identified below, the quality status of the companion animal images may be determined to satisfy a predetermined quality condition.

Also, according to an embodiment, the electronic device 1000 may determine whether the quality state of companion animal images satisfies the quality condition by further performing noise evaluation in addition to brightness evaluation. For example, when the brightness score determined in S802 is identified to be equal to or higher than the first threshold brightness score, the electronic device 1000 determines noise values included in companion animal images identified as equal to or higher than the first threshold brightness score in step S806. Based on this, noise scores 806 of companion animal images identified with a first threshold brightness score or higher may be determined.

For example, the electronic device 1000 may determine a weight by reflecting HW information (exposure time, ISO value) and previous brightness level information. According to an embodiment, the weight may be determined in a method such as weight = (brightness score / ISO value (eg, higher may be lowered)) * exposure time (score may be lowered as the distance from the designated value is increased). The electronic device 1000 may determine noise scores for companion animal images based on the determined weight value.

According to an embodiment, the electronic device 1000 sets the noise score to the second threshold when it is determined that the noise scores included in the companion animal images that are equal to or greater than the first threshold brightness score are smaller than the second threshold noise score. A quality state of a companion animal image smaller than the noise score may be identified as not satisfying the quality condition. However, according to another embodiment, the electronic device 1000 determines that noise scores included in companion animal images determined to be equal to or greater than the first threshold brightness score are smaller than the second threshold noise score or greater than the third threshold noise score. If identified, it may be determined that the quality state of the companion animal image does not satisfy the quality condition in S808.

However, according to another embodiment, when the noise score of the companion animal image determined to satisfy the threshold condition as a result of the brightness evaluation is equal to or greater than the second threshold noise score and equal to or less than the third threshold noise score, the electronic device 1000 performs operation S808. , The quality state of the companion animal images may be determined to satisfy a predetermined quality condition.

In S810, the electronic device 1000 further performs sharpness evaluation on the companion animal images identified as meeting the threshold condition as a result of the brightness evaluation and noise evaluation, thereby determining whether the quality state of the companion animal images satisfies the quality condition. can decide whether

For example, in S810, the electronic device 1000 determines sharpness scores related to the degree of sharpness of companion animal images for which noise scores of companion animal images are determined to be equal to or greater than the second threshold noise score, and in S818, the determined sharpness score. When is determined to be less than the third threshold sharpness score, it is determined that the quality state of the companion animal image having a sharpness score smaller than the third threshold sharpness score does not satisfy the quality condition, and the determined sharpness score is the third threshold sharpness score. If it is determined as above, it may be determined that the quality state of the companion animal image determined to be above the third critical sharpness score satisfies the quality condition. According to an embodiment, the sharpness score may be determined by weighting the out-of-focus score 812 and the motion blur score 814 based on a preset weight.

According to another embodiment, the electronic device 1000 does not determine whether to evaluate sharpness based on the sharpness score determined by weighting the out-of-focus score 812 and the motion blur score 814, but evaluates brightness and noise. For the companion animal images identified as satisfying the result threshold condition, an out-of-focus score according to the out-of-focus evaluation and a motion blur score according to the motion blur evaluation are determined, respectively, and each of the out-of-focus score and the motion blur score are respectively determined. Based on whether or not a set threshold condition is satisfied, it may be determined whether or not the quality condition is satisfied.

For example, in S812, the electronic device 1000 performs out-of-focus scores (according to focus values) of companion animal images identified as meeting a threshold condition as a result of the noise evaluation (eg, the noise score is identified as equal to or higher than the second threshold noise score). 812) can be determined. For example, the electronic device 1000 ignores noise by using a filter that marks a sharp part of an image with a LOG (Laplacian of Gaussian), a Sobel filter, or a custom kernel filter, thereby ignoring noise and generating a size corresponding to the inscription valley and mountain. An out-of-focus score may be determined by detecting the sharpness of a criterion or creating a feature map that marks sharp parts of the entire image, and scoring it with an average or a ratio of areas above a threshold value.

Also, for example, the electronic device 1000 performs motion blur according to motion values of companion animal images identified as meeting a threshold condition as a result of the noise evaluation (eg, noise scores identified as being equal to or higher than the second threshold noise score) in S814. A score 814 can be determined. For example, the electronic device 1000 uses an algorithm capable of digitizing movement between frames, such as optical flow, Lucas-Kanade, Gunner Farneback, Horn-Schunck, or deep learning-based, for the entire companion animal image or ROI area. By scoring motion, a motion blur score can be determined.

In operation S818, the electronic device 1000 determines that the determined out-of-focus score is less than the fourth threshold out-of-focus score or the determined motion blur score is less than the fifth threshold motion blur score. A quality state of a companion animal image determined to be less than the fourth threshold out-of-focus score or the motion blur score to be less than the fifth threshold motion blur score may be identified as not satisfying the quality condition.

However, according to another embodiment, the electronic device 1000 determines that the out-of-focus score is greater than or equal to the fourth threshold out-of-focus score and the motion blur score is greater than or equal to the fifth threshold motion blur score. A quality state of a companion animal image for which an out score is determined to be equal to or greater than the fourth threshold out-of-focus score and the motion blur score is equal to or greater than the fifth threshold motion blur score may be identified as satisfying the quality condition. .

As described above, the electronic device 1000 performs brightness evaluation on the companion animal images or the region of interest identified in the companion animal images, and based on the brightness evaluation result, the quality state of the corresponding companion animal image is determined as bio It is possible to determine whether a certain level of quality conditions required for information acquisition are satisfied.

However, according to another embodiment, the electronic device 1000 calculates a brightness score 802, a noise score 806, an out-of-focus score 812, At least one of the motion blur scores 814 is determined, and based on whether a threshold condition for at least one of the brightness score 802, the noise score 806, the out-of-focus score 812, and the motion blur score 814 is met. , it is possible to determine whether the quality status of the corresponding companion animal images satisfies a certain level of quality condition required for biometric information acquisition.

Also, in order for the electronic device 1000 to determine the quality conditions of companion animal images, the order of image evaluation quality evaluation factors applied to companion animal images may be different. For example, the electronic device 1000 may perform brightness evaluation, noise evaluation, out-of-focus evaluation, and motion blur evaluation on companion animal images in an order different from that described in FIG. 7 .

In addition, according to an embodiment, the electronic device 1000 does not perform all of the four evaluation processes shown in FIG. 7 and satisfies the quality condition for companion animal images by performing at least one evaluation among the four evaluations. Of course, you can decide whether or not.

Also, as described above, the electronic device 1000 may perform at least one of brightness evaluation, noise evaluation, out-of-focus evaluation, or motion blur evaluation on the companion animal images themselves, but interest identified from the companion animal images. By performing at least one of brightness evaluation, noise evaluation, out-of-focus evaluation, and motion blur evaluation on the region ROI, it may be determined whether the quality state of companion animal images satisfies a predetermined quality condition.

Also, according to an embodiment, the electronic device 1000 determines an out-of-focus score and a motion blur score for the companion animal image itself, determines a sharpness score according to a weighted sum of the determined out-of-focus score and motion blur score, The quality of the companion animal image may be evaluated by applying at least one of the above-described brightness evaluation, noise evaluation, or sharpness evaluation according to the determined sharpness score to the companion animal images.

8 is a block diagram of an electronic device according to an exemplary embodiment.

9 is a block diagram of an electronic device according to another embodiment.

As shown in FIG. 8 , the electronic device 1000 may include a processor 1300, a network interface 1500, a memory 1700, and a camera module 1610. However, not all illustrated components are essential components. The electronic device 1000 may be implemented with more components than those shown, or the electronic device 1000 may be implemented with fewer components.

For example, as shown in FIG. 9 , the electronic device 1000 according to an embodiment includes a processor 1300, a memory 1700, and a camera module 1610, as well as a user input interface 1100 and an output unit 1200. ) sensing unit 1400 and an A/V input unit 1600 may be further included.

The user input interface 1100 means a means through which a user inputs a sequence for controlling the electronic device 1000 . For example, the user input interface 1100 includes a key pad, a dome switch, a touch pad (contact capacitive method, pressure resistive film method, infrared sensing method, surface ultrasonic conduction method, A spray tension measuring method, a piezo effect method, etc.), a jog wheel, a jog switch, and the like may be included, but are not limited thereto. The user input interface 1100 may receive a user's input sequence for a screen output on the display by the electronic device 1000 . Also, the user input interface 1100 may receive a user's touch input touching the display or a key input through a graphic user interface on the display.

The output unit 1200 may output an audio signal, a video signal, or a vibration signal, and the output unit 1200 may include a display unit 1210, a sound output unit 1220, and a vibration motor 1230. there is.

The display unit 1210 includes a screen for displaying and outputting information processed by the electronic device 1000 . Also, the screen may display a companion animal image obtained by the electronic device 1000 or bio information extracted from the companion animal image. Also, according to an embodiment, the display unit 1210 may display guide contents and auxiliary guide contents for a user to photograph a companion animal in real time. The audio output unit 1220 outputs audio data received from the network interface 1500 or stored in the memory 1700 (eg, audio or sound content for inducing the companion animal's attention). Also, the sound output unit 1220 outputs sound signals related to functions performed by the electronic device 1000 . The vibration motor 1230 may output a vibration signal. For example, the vibration motor 1230 may output vibration signals corresponding to outputs of functions performed by the electronic device 1000 .

The processor 1300 typically controls overall operations of the electronic device 1000 . For example, the processor 1300 executes programs stored in the memory 1700, so that the user input unit 1100, the output unit 1200, the sensing unit 1400, the network interface 1500, and the A/V input unit ( 1600) can be controlled overall. Also, the processor 1300 may perform the functions of the electronic device 1000 described in FIGS. 1 to 8 by executing programs stored in the memory 1700 .

Specifically, the processor 1300 may obtain a user's input for touching the screen of the electronic device by controlling the user input unit. According to an embodiment, the processor 1300 may control a microphone to acquire a user's voice. The processor 1300 may obtain companion animal images based on a user input, determine a quality condition for companion animal images, or obtain bio information from companion animal images satisfying a predetermined quality condition.

According to an embodiment, the processor 1300 obtains a plurality of companion animal images by capturing the companion animal subject to be obtained at least once by executing one or more instructions stored in the memory 1700, and , Bio information of the companion animal may be identified from the plurality of companion animal images, the identified bio information may be encrypted, and the encrypted bio information may be transmitted to an external device connected to the electronic device.

In addition, according to an embodiment, the processor 1300 determines a predetermined quality state for the obtained plurality of companion animal images based on a quality evaluation factor for at least one of brightness, noise, or sharpness of the companion animal image. It is determined whether a quality condition of is satisfied, and the bio information may be identified from some companion animal images that satisfy the quality condition among the companion animal images.

The sensing unit 1400 may detect a state of the electronic device 1000 or a state around the electronic device 1000 and transmit the sensed information to the processor 1300 . The sensing unit 1400 includes a magnetic sensor 1410, an acceleration sensor 1420, a temperature/humidity sensor 1430, an infrared sensor 1440, a gyroscope sensor 1450, and a position sensor. (eg, GPS) 1460, an air pressure sensor 1470, a proximity sensor 1480, and an RGB sensor (illuminance sensor) 1490, but may include at least one, but is not limited thereto. Since a person skilled in the art can intuitively infer the function of each sensor from its name, a detailed description thereof will be omitted.

The network interface 1500 may include one or more components that allow the electronic device 1000 to communicate with other devices (not shown) and the server 2000 . Another device (not shown) may be a computing device such as the electronic device 1000 or a sensing device, but is not limited thereto. For example, the network interface 1500 may include a wireless communication interface 1510, a wired communication interface 1520, and a mobile communication unit 530.

The wireless communication interface 1510 includes a short-range wireless communication unit, a Bluetooth communication unit, a near field communication unit, a WLAN (Wi-Fi) communication unit, a Zigbee communication unit, an infrared data association (IrDA) ) communication unit, WFD (Wi-Fi Direct) communication unit, etc., but is not limited thereto. The wired communication interface 1520 may connect the server 2000 or the electronic device 1000 by wire.

The mobile communication unit 1530 transmits and receives a radio signal with at least one of a base station, an external terminal, and a server on a mobile communication network. Here, the radio signal may include a voice signal, a video call signal, or various types of data according to text/multimedia message transmission/reception.

According to an embodiment, the network interface 1500 may transmit the companion animal image and bio information extracted from the companion animal image to the server under the control of the processor. Also, the network interface 1500 may receive companion animal image information and bio information from a server or other electronic device.

An audio/video (A/V) input unit 1600 is for inputting an audio signal or a video signal, and may include a camera 1610 and a microphone 1620. The camera 1610 may obtain an image frame such as a still image or a moving image through an image sensor in a video call mode or a photographing mode. An image captured through the image sensor may be processed through the processor 1300 or a separate image processing unit (not shown). For example, the camera module 1610 may acquire companion animal images a plurality of times based on a user input.

The microphone 1620 receives external sound signals and processes them into electrical voice data. For example, the microphone 1620 may receive a sound signal from an external device or a user. The microphone 1620 may receive a user's voice input. The microphone 1620 may use various noise cancellation algorithms to remove noise generated in the process of receiving an external sound signal.

The memory 1700 may store programs for processing and control of the processor 1300 and may store data input or output to the electronic device 1000 . Also, the memory 1700 may store information about a companion animal image and bio information acquired by the electronic device 1000 based on a user input.

The memory 1700 may include a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (eg SD or XD memory, etc.), RAM (RAM, Random Access Memory) SRAM (Static Random Access Memory), ROM (Read-Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM (Programmable Read-Only Memory), magnetic memory, magnetic disk , an optical disk, and at least one type of storage medium.

Programs stored in the memory 1700 may be classified into a plurality of modules according to their functions, such as a UI module 1710, a touch screen module 1720, and a notification module 1730. .

The UI module 1710 may provide a specialized UI, GUI, or the like that works with the electronic device 1000 for each application. The touch screen module 1720 may detect a user's touch gesture on the touch screen and transmit information about the touch gesture to the processor 1300 . The touch screen module 1720 according to some embodiments may recognize and analyze the touch code. The touch screen module 1720 may be configured as separate hardware including a controller.

The notification module 1730 may generate a signal for notifying occurrence of an event of the electronic device 1000 . Examples of events occurring in the electronic device 1000 include reception of a call signal, reception of a message, input of a key signal, and notification of a schedule. The notification module 1730 may output a notification signal in the form of a video signal through the display unit 1210, output a notification signal in the form of an audio signal through the sound output unit 1220, and may output a notification signal in the form of a vibration motor 1230. A notification signal may be output in the form of a vibration signal through

10 is a block diagram of a server connected to an electronic device according to an embodiment.

According to one embodiment, the server 2000 may include a network interface 2100, a database 2200 and a processor 2300. The network interface 2100 may correspond to the network interface 1500 of the electronic device 1000 shown in FIGS. 8 and 9 . For example, the network interface 2100 may obtain a companion animal image and bio information from the electronic device 1000 . In addition, according to an embodiment, the network interface 2100 includes bio information encrypted from an electronic device, basic information that can be matched with the bio information, environment information, device information and file information, companion animal information, guardian information, or other information. Specific information about at least one of them may be obtained.

According to an embodiment, the database 2200 may correspond to the memory 1700 of the electronic device 1000 shown in FIGS. 8 and 9 . For example, the database 2200 may include bio information for identification of a companion animal. In addition, according to an embodiment, the database 2200 may store buyer information extracted from companion animal images that satisfy the quality condition of a certain level or higher described above or companion animal images that satisfy the quality condition of a certain level or higher. .

The processor 2300 typically controls the overall operation of the server 2000. For example, the processor 2300 may generally control the DB 2200 and the network interface 2100 by executing programs stored in the DB 2200 of the server 2000 . In addition, the processor 2300 may perform all or part of the functions of the electronic device 1000 (for example, a device for obtaining biometric information) described above with reference to FIGS. 1 to 9 by executing programs stored in the DB 2100. .

The method according to an embodiment may be implemented in the form of program instructions that can be executed through various computer means and recorded on a computer readable medium. The computer readable medium may include program instructions, data files, data structures, etc. alone or in combination. Program commands recorded on the medium may be specially designed and configured for the present disclosure, or may be known and usable to those skilled in computer software.

In addition, a computer program device including a recording medium in which a program for performing a different method according to the above embodiment is stored may be provided. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks and magnetic tapes, optical media such as CD-ROMs and DVDs, and magnetic media such as floptical disks. - includes hardware devices specially configured to store and execute program instructions, such as magneto-optical media, and ROM, RAM, flash memory, and the like. Examples of program instructions include high-level language codes that can be executed by a computer using an interpreter, as well as machine language codes such as those produced by a compiler.

Although the embodiments of the present disclosure have been described in detail above, the scope of the present disclosure is not limited thereto, and various modifications and improvements of those skilled in the art using the basic concepts of the present disclosure defined in the following claims are also included in the present disclosure. fall within the scope of the right

Claims (12)

A method for an electronic device to manage bio information for identification of a companion animal entity,
acquiring a plurality of companion animal images by photographing a companion animal subject to which the bio information is obtained at least once;
identifying bio information of the companion animal from the plurality of companion animal images;
Encrypting the identified bio-information; and
transmitting the encrypted bio information to an external device connected to the electronic device; Including, method. The method of claim 1, wherein the method
Determining whether a quality state of the obtained plurality of companion animal images, which is determined based on a quality evaluation factor related to at least one of brightness, noise, and sharpness of the companion animal image, satisfies a predetermined quality condition; and
identifying the bio information from some of the companion animal images that satisfy the quality condition; Further comprising a method. The method of claim 2, wherein determining whether the quality condition is satisfied
identifying regions of interest related to the companion animal entity from the plurality of companion animal images; and
determining whether quality states of the plurality of companion animal images satisfy the quality condition by applying the quality evaluation factor to the identified regions of interest; Including, method. The method of claim 1, wherein the method
obtaining basic information about at least one of country, region, registration authority, registration date, modification date, modification record, or version related to the companion animal entity;
obtaining photographing environment information in which the companion animal image was photographed;
obtaining device information of an electronic device used to acquire the companion animal image; and
File information on a file format for storing the bio information, companion animal information on at least one of the date of birth, gender or breed of the companion animal, guardian identification information on the companion animal entity, and the number of times the companion animal has been photographed; obtaining other information about at least one of the comments; Further comprising a method. 5. The method of claim 4, wherein the method
encrypting the basic information, environment information, device information and other information together with the bio information; and
transmitting the encrypted basic information, environment information, device information, and other information together with the bio information to the external device; Further comprising a method. According to claim 3,
The bio information includes at least one of print information, face information, or iris information of the companion animal;
Acquiring the plurality of companion animal images
acquiring the plurality of companion animal images by photographing the companion animal object at least once under a predetermined environmental condition in which an illuminance equal to or higher than a threshold brightness is secured; Including, method. The method of claim 2, wherein determining whether the quality condition is satisfied
determining brightness scores according to brightness values of each pixel of the plurality of companion animal images; and
if it is determined that the determined brightness score is smaller than a first threshold brightness score, identifying a quality state of a companion animal image having a smaller brightness score than a first threshold brightness score as not satisfying the quality condition; Including, method. The method of claim 7, wherein determining whether the quality condition is satisfied
determining a noise score according to a noise value included in companion animal images for which the brightness score is equal to or greater than the first threshold brightness score; and
If it is determined that the determined noise score is smaller than a second threshold noise score, identifying a quality state of a companion animal image having a noise score smaller than the second threshold noise score as not satisfying the quality condition; Further comprising a method. The method of claim 8, wherein determining whether the quality condition is satisfied
determining sharpness scores related to sharpness levels of companion animal images for which the noise score is equal to or greater than the second threshold noise score; and
When it is determined that the determined sharpness score is smaller than the third critical sharpness score, the quality state of the companion animal image having the sharpness score smaller than the third critical sharpness score is identified as not satisfying the quality condition, and the determined sharpness identifying a quality state of a companion animal image whose score is greater than or equal to the third critical sharpness score as satisfying the quality condition; Including, method. The method of claim 8, wherein determining whether the quality condition is satisfied
determining out-of-focus scores according to focus values of companion animal images for which the noise score is equal to or higher than the second threshold noise score;
determining motion blur scores according to motion values of companion animal images for which the noise score is equal to or higher than the second threshold noise score;
When the determined focus out score is less than a fourth threshold focus out score or when it is determined that the determined motion blur score is less than a fifth threshold motion blur score, the focus out score is less than the fourth threshold focus out score; , identifying a quality state of the companion animal image, for which the motion blur score is determined to be smaller than the fifth threshold motion blur score, as not satisfying the quality condition;
When the focus out score is determined to be equal to or greater than the fourth threshold focus out score and the motion blur score is determined to be greater than or equal to the fifth threshold motion blur score, the focus out score is determined to be equal to or greater than the fourth threshold focus out score identifying a quality state of a companion animal image as satisfying the quality condition; Including, method. In an electronic device for managing bio information for companion animal identification,
network interface;
a memory that stores one or more instructions; and
at least one processor to execute the one or more instructions; including,
By executing the one or more instructions, the at least one processor:
Obtaining a plurality of companion animal images by photographing a companion animal subject to which the bio information is acquired at least once;
Identifying bio information of the companion animal from the plurality of companion animal images;
Encrypt the identified bio information,
An electronic device that transmits the encrypted bio-information to an external device connected to the electronic device. A method for an electronic device to manage bio information for identification of a companion animal entity,
acquiring a plurality of companion animal images by photographing a companion animal subject to which the bio information is obtained at least once;
identifying bio information of the companion animal from the plurality of companion animal images;
Encrypting the identified bio-information; and
transmitting the encrypted bio information to an external device connected to the electronic device; A computer-readable recording medium recording a program for executing a method on a computer, including a.

Images