KR102222059B1 - Object position recognition diagnostic device that outputs the object position and the diagnosis result using a diagnostic device with marker - Google Patents

Abstract

The present invention relates to an object location recognition type diagnostic device which outputs the location and diagnosis result of an object using the diagnostic device with markers, and more specifically, to an object location recognition type diagnostic device which outputs the location and diagnosis result of an object using the diagnostic device with markers, wherein a specific part of the object is diagnosed by means of the diagnostic device, and when diagnosis result information is provided to a smart location-aware diagnostic device, the smart location-aware diagnostic device accurately determines diagnosis location through the marker formed on the diagnostic device, and the precise location of the marker and the diagnosis result information acquired at the corresponding location are stored and managed, or are output on a screen.

Description

Object position recognition diagnostic device that outputs the object position and the diagnosis result using a diagnostic device with marker}

The present invention relates to an object location recognition diagnostic apparatus for outputting the location of an object and a diagnosis result using a diagnostic device on which a marker is formed, and more particularly, a diagnostic device for diagnosing a specific part of an object and using a diagnostic device to diagnose the diagnosis result information. When provided to a device, a smart location recognition diagnostic device accurately determines the diagnosis location through a marker formed on the diagnosis device, and a marker for storing and managing the exact location of the marker and the diagnosis result information obtained at that location, or outputting it on the screen. The present invention relates to an object position recognition type diagnosis apparatus that outputs an object position and a diagnosis result using a diagnosis device having a formed thereon.

As interest in skin beauty increases, many users check the condition of the skin through various routes such as skin care rooms, massage shops, and dermatology clinics, and use appropriate cosmetics or drugs to take care of the skin.

The condition of people's skin varies greatly depending on the season, and since individual variations are severe, accurate diagnosis is paramount for proper prescription.

For the diagnosis of skin conditions, specialized medical equipments are provided in dermatology clinics and clinics to enable diagnosis such as taking enlarged photographs of pores.

However, due to the increase in interest in skin beauty, the level of knowledge about the skin of users has also increased, and users want to know more about the condition of their own skin or changes in the condition of the skin.

Nevertheless, it would be very cumbersome to simply monitor the skin condition and visit the clinic on a regular basis to understand the trend of changes caused by the use of cosmetics and the like.

Therefore, there is a need to prepare a plan that allows users to simply check and diagnose their skin condition while carrying.

In addition, conventional cameras, sensors, etc. that provide comprehensive information on skin are simply photographed by an operator manually touching the skin to obtain information.

In addition, in the case of measuring the approximate condition of the skin, 2D images have been acquired and analyzed with a high-resolution camera, and in order to obtain comprehensive information on the facial skin, other sensors other than the high-resolution camera are used to use a contact-type local imaging sensor. There was a hassle of having to re-shoot.

In this case, taking a face as an example, there was an inconvenience of having to take a photograph by manually attaching a contact-type local photographing camera after separating the face from the device after photographing the skin in front of a high-resolution camera.

Meanwhile, computer vision-based methods using a camera as an interface between humans and devices have been widely used in recent years.

In particular, it may be used in fields such as entertainment computing fields such as haptic games that recognize the user's movements and reflect them in content, or fields such as computer simulations that require a user's virtual experience.

In the case of using a general visible light camera or an image acquired therefrom, its performance greatly depends on the surrounding lighting environment or background.

As a method to overcome this problem, an infrared image having a property that is relatively robust to changes in the lighting environment can be used.

In addition, a specific type of marker can be attached to an object to be tracked, and the location of the object can be tracked by detecting it.

In this case, the method of detecting an area where the amount of light reflected simply is the largest without considering the shape of the marker has a problem that precise object tracking is difficult due to the reflection intensity according to the properties of the target object.

For example, an emergency procedure may be performed in an ambulance vehicle, and accordingly, the exact location of the emergency procedure and the procedure image must be stored and managed on a black box. There was a problem that could not be mapped, so when you arrive at the hospital and proceed with the surgery, an unemployment person misses the golden time.

Accordingly, there is a need for a technique capable of confirming the exact position of the marker by constructing a new map by confining the specific area where the marker is located among a plurality of classification areas in which the entire area of a specific object is classified with a certain size.

(Registered Patent Document) Korean Registered Patent Publication No. 10-1175611

Accordingly, the present invention has been proposed in view of the problems of the prior art as described above, and an object of the present invention is to diagnose a specific part of an object by a diagnostic device and provide diagnostic result information to a smart location recognition diagnostic device. A smart location recognition diagnostic device accurately determines a diagnosis location through the formed marker, and stores and manages the exact location of the marker and diagnostic result information obtained at the corresponding location, or outputs it on the screen.

In order to achieve the problem to be solved by the present invention, an object position recognition type diagnosis apparatus for outputting an object position and a diagnosis result using a diagnostic device having a marker according to an embodiment of the present invention,
A diagnosis device 100 for providing diagnosis result information of an object to the smart location recognition type diagnosis device 300;
A marker 200 formed on the diagnosis device 100 to enable the smart location recognition type diagnosis device 300 to determine a diagnosis location;

A smart location for acquiring the diagnosis result information of the object provided by the diagnosis device 100, identifying the diagnosis location using self-imaged image information, matching the detected diagnosis location with the diagnosis result information provided by the diagnosis device, and outputting it on the screen. Recognition type diagnostic device 300; includes.

delete

delete

An object position recognition type diagnosis apparatus for outputting an object position and a diagnosis result using a diagnostic device on which a marker is formed according to the present invention,

When a specific part of the object is diagnosed by a diagnostic device and the diagnosis result information is provided to the smart location recognition diagnostic device, the location of the diagnosis is accurately determined by the smart location recognition diagnostic device through the marker formed on the diagnostic device, and the exact location of the marker and The diagnosis result information obtained at the corresponding location can be stored and managed or displayed on the screen.

For example, emergency procedures can be performed in an ambulance, and accordingly, the exact location and procedure images of the emergency procedures can be stored and managed on a black box, so that when you arrive at the hospital and perform surgery, you can check it. It will be possible.

1 is an overall configuration diagram of an object position recognition type diagnostic apparatus for outputting an object position and a diagnosis result using a diagnostic device on which a marker is formed according to an embodiment of the present invention.
2 is a block diagram of a smart location recognition diagnosis device 300 of an object location recognition diagnosis apparatus for outputting a location of an object and a diagnosis result using a diagnosis device having a marker according to an embodiment of the present invention.
FIG. 3 is an exemplary diagram of human body classification of an object location recognition type diagnosis apparatus that outputs the location of an object and a diagnosis result using a diagnostic device on which a marker is formed according to an embodiment of the present invention, and FIG. 4 is a map by classification area for each detailed region. Illustrative diagram.

The following content merely exemplifies the principles of the present invention. Therefore, those skilled in the art can implement the principles of the present invention and invent various devices included in the concept and scope of the present invention, although not clearly described or illustrated herein.

In addition, all conditional terms and examples listed in this specification are, in principle, clearly intended only for the purpose of understanding the concept of the present invention, and should be understood as not limiting to the embodiments and states specifically listed as described above. do.

An object position recognition type diagnostic apparatus for outputting an object position and a diagnosis result using a diagnostic device on which a marker is formed according to an embodiment of the present invention,
A diagnosis device 100 for providing diagnosis result information of an object to the smart location recognition type diagnosis device 300;
A marker 200 formed on the diagnosis device 100 to enable the smart location recognition type diagnosis device 300 to determine a diagnosis location;

A smart location for acquiring the diagnosis result information of the object provided by the diagnosis device 100, identifying the diagnosis location using self-imaged image information, matching the detected diagnosis location with the diagnosis result information provided by the diagnosis device, and outputting it on the screen. Recognition type diagnosis device 300; characterized in that it is configured to include.

delete

delete

In addition, the marker 200 formed on the diagnostic device 100 is characterized in that the head of the diagnostic device 100 has a special shape or a distinct color or shape.
In addition, the smart location recognition diagnostic device 300,
An object imaging unit 310 for capturing the entire situation in which the diagnostic device 100 on which the marker is formed is diagnosing an object,
A diagnostic position determination unit (which determines where the body part of the object where the marker formed in the diagnostic device is located is) using image information captured by the object imaging unit 310, and generates diagnosis position information where the marker is located among the identified body parts ( 320) and,
A map information extracting unit 330 for extracting a body region image corresponding to the body part identified by the diagnosis location determination unit 320 from the map information storage unit 340 for each region;
A map information storage unit 340 for each area that stores image information for each body area,

delete

A position recognition alignment processing unit 350 for aligning by mapping the diagnosis result information provided by the diagnosis device to the diagnosis position generated by the diagnosis position determination unit 320 on the body region image extracted by the map information extraction unit 330 It characterized in that it comprises a.

delete

delete

delete

delete

delete

delete

delete

delete

delete

In addition, the diagnosis result information of the object may include an image of the surface of the skin or an image of the inside of the skin obtained through ultrasound.

delete

Hereinafter, a detailed description will be given through an embodiment of an object position recognition type diagnosis apparatus that outputs an object position and a diagnosis result using a diagnostic device on which a marker is formed according to the present invention.

1 is an overall configuration diagram of an object position recognition type diagnosis apparatus for outputting an object position and a diagnosis result using a diagnosis device on which a marker is formed according to an exemplary embodiment of the present invention.

As shown in FIG. 1, an object position recognition type diagnosis apparatus for outputting an object location and diagnosis result using a diagnosis device having a marker formed thereon according to the present invention includes a diagnosis device 100, a marker 200, and a smart position recognition diagnosis device 300. ).

The diagnostic device 100 and the smart location recognition diagnostic device 300 exchange information related to object diagnosis with each other using wired or wireless communication.

The diagnostic result information provided by the diagnostic device 100 to the smart location recognition diagnostic device 300 may include a skin surface image of an object, an inner image of the skin such as ultrasound, skin information such as moisture, oil, and the like.

In the case of a diagnostic device that acquires an image of the skin surface, a camera is mounted, and in the case of a diagnostic device that acquires an inner image of the skin such as ultrasound, an ultrasound camera is mounted, and skin information such as moisture and oil is acquired. In the case of a diagnostic device, a moisture or oil measurement sensor is installed.

In addition, the diagnostic device does not matter whether it is a contact type or a non-contact type, and it is a size that consumers can easily carry and can be measured anytime, anywhere, and the corresponding diagnostic information can be checked in real time on a smart location recognition type diagnosis device.

At this time, a marker 200 is formed on the diagnostic device so that the diagnostic location can be determined by a smart location recognition diagnostic device, which is a special shape so that the diagnosis location can be identified using a photographed image in a smart location recognition diagnostic device. It may be a marker of or a special colored marker.
That is, the marker 200 formed on the diagnostic device 100 is characterized in that it is configured with a special shape or a distinct color or shape of the head portion of the diagnostic device 100. Therefore, it is possible to grasp the diagnosis position based on the marker.

delete

delete

delete

delete

In addition, the smart location recognition diagnostic device 300 acquires the diagnosis result information of the object provided by the diagnosis device 100, identifies the diagnosis location using self-imaged image information, and identifies the diagnosis location and the diagnosis device provided by the diagnosis device. It matches the diagnosis result information and outputs it to the screen.

In addition, the matched diagnosis location and diagnosis result information may be transmitted to a diagnosis result management cloud server configured in a remote location and stored in a separate DB so that continuous management can be performed.

2 is a block diagram of a smart location recognition diagnosis device 300 of an object location recognition diagnosis apparatus outputting a location of an object and a diagnosis result using a diagnosis device on which a marker is formed according to an embodiment of the present invention.

As shown in Figure 2, the smart location recognition type diagnostic device 300,
An object imaging unit 310 for capturing the entire situation in which the diagnostic device 100 on which the marker is formed is diagnosing an object,
A diagnostic position determination unit (which determines where the body part of the object where the marker formed in the diagnostic device is located is) using image information captured by the object imaging unit 310, and generates diagnosis position information where the marker is located among the identified body parts ( 320) and,
A map information extracting unit 330 for extracting a body region image corresponding to the body part identified by the diagnosis location determination unit 320 from the map information storage unit 340 for each region;
A map information storage unit 340 for each area that stores image information for each body area,
A position recognition alignment processing unit 350 for aligning by mapping the diagnosis result information provided by the diagnosis device to the diagnosis position generated by the diagnosis position determination unit 320 on the body region image extracted by the map information extraction unit 330 It will be configured to include.

delete

delete

delete

delete

delete

In the illustrative example of the present invention, the human body is used as an example, but the operation is not limited to the human body, and it is natural that other objects can be diagnosed.

Specifically,
The object photographing unit 310 photographs the entire situation in which the diagnostic device 100 on which the marker is formed is diagnosing the object. For example, when the object is a human body, the diagnostic device 100 is used for the head, chest, abdomen, and upper limbs. The situation of diagnosing the lower limbs, etc. is photographed, and the photographed image information is stored in a separate memory.

At this time, the diagnosis position determination unit 320 uses the image information captured by the object imaging unit 310 to determine where the body part of the object where the marker formed in the diagnosis device is located is, and among the identified body parts, the marker is located. Generate diagnostic location information. For example, the diagnosis location information may be coordinate information such as eyes, nose, and mouth on the head.
The identification of the body part of the object where the marker is located and the determination of the diagnosis position where the marker is located among the identified body parts can be identified or determined using an image processing algorithm.

For example, as shown in FIG. 3, when the position of the marker is located on the head on the image image captured by the object photographing unit 310, it is primarily determined that the body part of the object where the marker is located is the head. Then, among the head, whether the marker is located on the eye, the nose, or the mouth is secondarily identified using an image processing algorithm to generate diagnostic location information.

delete

That is, firstly, it is determined whether the position of the marker is included in any of the major category categories (eg, head, chest, abdomen, upper limb, lower limbs, etc.) (eg, judging by the head), and among them, the corresponding major category category. Among the subcategories of (for example, eyes, nose, mouth, shoulders, arms, hands, pelvis, legs, feet, etc.), which subcategory is secondly judged (for example, judged by eyes). This is determined using an image processing algorithm. Since a technique for determining where a marker is located on a human body using an image processing algorithm is a general image processing technique, a detailed description will be omitted.

delete

The map information extracting unit 330 extracts a body region image corresponding to the body part identified by the diagnosis position determining unit 320 from the map information storage unit 340 for each region.

For example, if the body part identified by the diagnosis position determination unit 320 is a head, a head image as shown in FIG. 4 is extracted from the map information storage unit 340 for each region.

The map information storage unit 340 for each area stores image information for each body area. For example, as shown in FIG. 4, the body such as head, chest, abdomen, shoulders, arms, hands, pelvis, and feet Images for each area are saved.
Thereafter, the position recognition alignment processing unit 350 maps the diagnosis result information provided by the diagnosis unit to the diagnosis position generated by the diagnosis position determination unit 320 on the body region image extracted by the map information extraction unit 330 and aligns. It will be processed.

delete

For example, the body region image extracted by the map information extracting unit 330 is the head, the diagnosis position generated by the diagnosis position determination unit 320 is the ball, and the diagnosis result information provided by the diagnosis unit is oil 85AU, moisture 67 In the case of skin information such as% or the skin surface image of the cheek region, the position recognition alignment processing unit 350 performs alignment processing to map the diagnosis result information to the cheek region on the head image.

delete

delete

delete

delete

The entire operation process of the present invention will be described with an example of face diagnosis.
When the smart location recognition diagnostic device 300 is executed, the object imaging unit 310 of the smart location recognition diagnostic device 300 captures the entire situation in which the face of the object is diagnosed using the diagnostic device 100 on which a marker is formed. do.

After making the diagnosis device 100 paired with the smart location recognition diagnosis device contact or non-contact with the cheek part of the body to be diagnosed, the diagnosis result information is generated and provided to the smart location recognition diagnosis device 300 do.

Thereafter, the diagnosis position determination unit 320 uses the image information captured by the object imaging unit 310 (eg, image information about a situation in which the cheek part of the face is diagnosed using a diagnosis device), and the marker formed in the diagnosis unit is It is determined whether the body part of the object being located is a face, and a ball part where the marker is located among the identified facial parts is generated as diagnostic location information.

delete

delete

Thereafter, the map information extracting unit 330 extracts a body region image corresponding to the face, which is a body part identified by the diagnosis position determining unit 320, from the map information storage unit 340 for each region.
Thereafter, the position recognition alignment processing unit 350 maps and stores the diagnosis result information provided by the diagnosis device to the cheek region, which is the diagnosis position generated by the diagnosis position determination unit 320, on the face image extracted by the map information extraction unit 330. do.

delete

delete

delete

delete

delete

In the above, preferred embodiments of the present invention have been illustrated and described, but the present invention is not limited to the specific embodiments described above, and is generally used in the technical field to which the present invention pertains without departing from the gist of the present invention claimed in the claims. Of course, various modifications may be implemented by a person having the knowledge of, and these modifications should not be individually understood from the technical idea or perspective of the present invention.

delete

delete

delete

delete

delete

delete

delete

delete

100: diagnostic device
200: marker
300: Smart location recognition diagnostic device

Claims (6)

In the object position recognition type diagnostic apparatus for outputting an object position and a diagnosis result using a diagnostic device on which a marker is formed,
A diagnosis device 100 for providing diagnosis result information of an object to the smart location recognition type diagnosis device 300;
A marker 200 formed on the diagnosis device 100 to enable the smart location recognition type diagnosis device 300 to determine a diagnosis location;
A smart location for acquiring the diagnosis result information of the object provided by the diagnosis device 100, identifying the diagnosis location using self-imaged image information, matching the detected diagnosis location with the diagnosis result information provided by the diagnosis device, and outputting it on the screen. Consisting, including; recognition type diagnostic device 300;

The smart location recognition diagnostic device 300,
An object imaging unit 310 for capturing the entire situation in which the diagnostic device 100 on which the marker is formed is diagnosing an object,
A diagnostic position determination unit (which determines where the body part of the object where the marker formed in the diagnostic device is located is) using image information captured by the object imaging unit 310, and generates diagnosis position information where the marker is located among the identified body parts ( 320) and,
A map information extracting unit 330 for extracting a body region image corresponding to the body part identified by the diagnosis location determination unit 320 from the map information storage unit 340 for each region;
A map information storage unit 340 for each area that stores image information for each body area,
A position recognition alignment processing unit 350 for aligning by mapping the diagnosis result information provided by the diagnosis device to the diagnosis position generated by the diagnosis position determination unit 320 on the body region image extracted by the map information extraction unit 330 An object position recognition type diagnosis apparatus for outputting a position of an object and a diagnosis result using a diagnostic device on which a marker is formed, comprising: a.
The method of claim 1,
The marker 200 formed on the diagnostic device 100,
An object position recognition type diagnosis apparatus for outputting the position of the object and the diagnosis result using a diagnosis device having a marker, characterized in that the head of the diagnosis device 100 has a special shape or a distinct color or shape.
delete delete delete The method of claim 1,
The diagnosis result information of the subject,
An object position recognition type diagnosis apparatus for outputting a position of an object and a diagnosis result using a diagnostic device including a surface image of the skin or an image of the inside of the skin.

Images