WO2022092613A1 - Hair evaluation device for hair transplant surgery - Google Patents

Abstract

The present invention relates to a hair evaluation device for hair transplant surgery, which: captures images of hair collected during hair transplant surgery and, on the basis of image information, measures the condition of hair, such as the thickness of hair and whether the surface of hair is damaged; displays the total number of hair follicles in real time or guides the location and distribution of a hair transplant within a hair transplant area; displays the number of hairs being planted in real time, thus reducing the fatigue of a surgeon during surgery; enables even a doctor with little surgical experience to smoothly perform hair transplant surgery by lowering the difficulty of surgery; and can increase the satisfaction of a hair transplant patient through planned hair transplant surgery.

Description

Hair evaluation device for hair transplant surgery

In the present invention, the hair collected during hair transplantation is photographed and the condition of the hair such as the thickness of the hair and whether the hair surface is damaged is measured based on the image information, and the total number of hair follicles is displayed in real time, or within the hair transplantation area. It guides the location and distribution of hair transplantation, displays the number of hairs being planted in real time to reduce the surgeon's fatigue during surgery, and lowers the difficulty of the operation so that even doctors with little experience in surgery can perform hair transplantation smoothly. , relates to a hair evaluation device for hair transplant surgery, which can increase the satisfaction of hair transplant patients by planning hair transplant surgery.

Hair transplantation surgery is a non-incision method in which the hair in the best condition is selectively collected from the hair transplant patient as much as the size of the hair follicle using a fine punch, trimmed around it to fit the transplantation period, and then transplanted into the frontal area, and the hair transplant patient The hair follicles are individually separated from the skin tissue removed by incision of the back of the head, and the hair follicle unit is transplanted into the transplanted part of the hair transplant patient.

As such, the total number of hairs collected by one of the non-incision method and the incision method is different for each operation, and there is a difference in the ratio of single hair, double hair, triple hair or more, so the total number of hair and single hair It is difficult for a doctor with relatively little experience to make a hair transplant surgery plan because it is necessary to determine the hair ratio information of hair, double hair, triple hair or more with the naked eye of the doctor and make a hair transplant surgery plan. There was a problem in that the success or failure of hair transplant surgery was different depending on the skill level of the surgeon.

Specifically, in the case of hair transplantation on the forehead of a hair transplant patient, hair transplantation occurs naturally when hair is planted evenly left and right according to the thickness and degree of damage of the hair. Although the number of hairs is limited, if the hair is densely planted in either part, the ratio is not constant or hair asymmetry occurs. If the part to be implanted irregularly, the bangs design was not planted as planned, and there was a problem that the satisfaction of the hair transplant patient was lowered.

[Prior art document] Republic of Korea Patent Publication No. 10-1870689 (registered on June 19, 2018)

In order to achieve the above problems, the present invention detects the number of hairs collected from the patient's affected area to determine the number of hairs in real time, detects the transplant surgery area of the hair transplant patient, and induces the location and distribution of hair transplantation within the area. , the number of hairs being planted is displayed in real time or the skin tissue collected during hair transplantation is photographed to measure the condition of the hair, such as the thickness of the hair and whether the surface of the hair is damaged, based on the image information, and the total number of hairs is displayed in real time to reduce the fatigue of the surgeon during the operation and lower the difficulty of the operation so that even doctors with little experience in surgery can perform hair transplantation smoothly. The purpose of this is to provide a hair evaluation device for hair transplant surgery that can increase the satisfaction of hair transplant patients by providing information on the number and ratio of parts and the remaining collected hair to plan hair transplant surgery and effectively form a design. there is.

In order to achieve the above object, the hair evaluation device for hair transplant surgery according to an embodiment of the present invention is fixed to one side of the patient's operating table, and the fixed height, angle, and fixed interval of the hair harvesting camera unit, the head camera unit, and the display unit are measured. The evaluation device body that adjusts and supports, and the camera shape coupled to the upper end of the evaluation device body or connected by wire or wirelessly accommodates the collected hair part of the hair transplant patient at the lower end of the camera, and takes the collected hair part 3D image A hair harvesting camera unit that measures depth information by taking a three-dimensional image of the surgical location of the hair transplant patient's head in the form of a camera coupled to one side of the upper end of the evaluation device body or connected by wire or wirelessly, and a head camera unit measuring depth information A display unit for displaying on the screen the virtual information analyzed by comparison and analysis by the smart control unit with the depth 3D image information captured by the hair-collecting camera unit and the head camera unit, and formed inside the evaluation device body, the hair-collecting camera unit, the head camera It includes a smart control unit that identifies the depth 3D image information photographed in the unit, automatically classifies the object extracted from the 3D image information based on setting data, compares and analyzes the classified information, and transmits it to the display unit.

In addition, the hair evaluation device for hair transplant surgery according to another embodiment of the present invention is fixed to one side of the patient's operating table, and supports the hair collecting hair camera unit, the head camera unit, and the fixed height, angle, and fixed interval of the display unit. The evaluation device body and the hair evaluation device body are coupled to one side of the upper end of the body or are wired or wirelessly connected to the lower end of the camera to accommodate the collected hair part of the hair transplant patient, and take a three-dimensional image of the collected hair part to obtain depth information. A camera unit for collecting hair that measures A head camera unit, a display unit that displays on the screen the virtual information compared and analyzed by the smart control unit with the depth 3D image information captured by the head camera unit and the hair collecting camera unit, and the hair collecting camera unit and the head camera unit formed inside the body of the hair evaluation device It includes a smart control unit that identifies the depth 3D image information captured in the 3D image information, automatically classifies the object extracted from the 3D image information based on the setting data, and compares and analyzes the classified information and transmits it to the display unit.

As described above, in the present invention, information on the number of hairs collected during hair transplantation is detected to determine the number of hairs each in real time, the transplant surgery area of the hair transplant patient is detected, and the number of hairs remaining per detected surgical area is detected in real time. By automatically calculating the standard density of the number of hair follicles, it guides the location and distribution of hair transplantation by evenly distributing a number of virtual images in the form of dots in the area where surgery is not performed in the transplant surgery area of a hair transplant patient. The number is displayed in real time or the skin tissue collected during a hair transplant operation is taken to measure the condition of the hair, such as the thickness of the hair and whether the hair surface is damaged, based on the image information, and the total number of hair follicles is displayed in real time. This reduces the fatigue of the surgeon during the operation and lowers the difficulty of the operation, so that even doctors with little experience in surgery can perform hair transplantation smoothly. It provides information on the number and proportion of hairs to be harvested, arranges single hair, double hair, and triple hair appropriately to plan hair transplant surgery, and effectively forms a design to increase the satisfaction of hair transplant patients.

1 is a perspective view showing the overall components of a hair evaluation device for hair transplant surgery according to the present invention;

2 is a perspective view showing a shape in which the lower end of the hair counting body of the hair evaluation device according to the present invention has a structure of a stationary body;

3 is a perspective view showing a shape in which the lower end of the hair counting body of the hair evaluation device according to the present invention has a structure of a table fixed body;

4 is a perspective view showing a shape including a head camera unit in the hair evaluation device according to the present invention;

5 shows the shape of the hair-collecting camera unit coupled to the hair counting body according to the present invention, and shows the direction in which the fixed height, angle, and fixed interval of the hair-collecting camera unit are adjusted by arrows, and the hair-collecting camera is vertical A partially enlarged view showing that the interval is partially enlarged with

6 is a perspective view showing the shape of the display unit coupled to the hair counting body according to the present invention, projecting the shape in which the smart control unit is built in;

7 is an embodiment diagram showing the shape of the display unit coupled to the hair counting body according to the present invention, and showing the direction in which the fixed height and angle of the display unit and the fixed interval are adjusted with arrows;

8 is a block diagram illustrating components of a display unit according to the present invention;

9 is a block diagram showing components of a display output unit according to the present invention;

10 is a block diagram showing the components of a patient operation state screen according to the present invention;

11A is a block diagram showing the components of the screen for collecting hair according to the first embodiment of the present invention;

11B is a block diagram showing the components of the hair collection state screen according to the second embodiment of the present invention;

12A is a block diagram illustrating components of a hair counting display unit according to a first embodiment of the present invention;

12B is a block diagram showing the components of a hair thickness display unit according to a second embodiment of the present invention;

12c is a block diagram showing the components of a hair damage display unit according to a second embodiment of the present invention;

13 is a block diagram showing the components of a smart control unit according to the present invention;

14 is a block diagram showing the components of the hair collection analysis unit according to the present invention;

15 is a block diagram showing the components of the surgical site analysis unit according to the first embodiment of the present invention;

16 is an exemplary diagram illustrating the shape of the head camera unit according to the present invention, and showing the direction in which the fixed height and angle of the head camera unit and the fixed interval are adjusted with arrows.

Prior to explaining the present invention, when there is one hair in one follicle, it is called single hair, when there are two hairs in one follicle, it is called double hair, and when there are 3 or more hairs in one follicle, it is called triple hair. .

Hereinafter, preferred embodiments according to the present invention will be described with accompanying drawings.

1 is a perspective view showing the overall components of a hair evaluation device for hair transplant surgery according to the present invention, wherein the hair evaluation device 1 includes a hair evaluation device body 100, a hair harvesting camera unit 200, It includes a display unit 300 and a smart control unit 400 . According to an embodiment of the present invention, the hair evaluation device 1 may further include a head camera unit 500 .

First, the hair evaluation device body 100 according to the present invention will be described.

The hair evaluation apparatus main body 100 serves to control and support the fixed height, angle, and fixed interval of the hair harvesting camera unit and the display unit. When the hair evaluation device 1 includes a head camera unit 500 and a surgical site analysis unit 420 to be described later, the hair evaluation device body 100 is, for example, the shape of an upright support, more specifically , around the patient in a circular rod shape, for example, may be fixed to one side of the operating table side. Otherwise, when observing only separated hair follicles, not the patient, the hair evaluation device body 100 does not need to be fixed around the patient.

The structure of the lower end of the hair evaluation device body 100 according to the present invention may be any one of a stationary body 100a and a table fixed body 100b.

Here, the stationary body 100a is formed so that the lower end of the upright circular bar has a wide surface, and is placed on the floor or table top to support the hair evaluation device body 100 in a stationary manner.

This facilitates the movement of the position of the hair evaluation device body 100 by widening the operating radius when a wide operating space is secured according to the situation of the hair transplant operating room.

Here, the table fixed main body 100b is formed so that a double-structured fixed frame at the lower end of an upright circular bar is formed to adjust the spacing in the up and down directions in a bolt fastening method, is inserted between the ends of the table, and is fixed, so that the hair evaluation device The main body 100 is supported in a fixed table manner.

This allows the hair evaluation device body 100 to be firmly fixed by fastening the hair evaluation device body 100 to one side of the operating table or operating bed when the operating space is narrow depending on the situation of the hair transplant operating room.

Next, a description will be given of the hair harvesting camera unit 200 according to the present invention.

The hair harvesting camera unit 200 has a camera shape coupled to an upper end of the hair evaluation device body or connected by wire or wirelessly, and accommodates the collected hair of the hair transplant patient at the lower end of the camera, and the collected hair part is two-dimensional. Alternatively, a three-dimensional image is taken and depth information is directly measured from the three-dimensional image, or the smart controller 400 serves to infer depth information from a two-dimensional image.

The two-dimensional image may be taken by a high-definition camera included in the hair harvesting camera unit 200 . The two-dimensional image may be usefully used mainly to evaluate the quality of hair for each individual hair follicle.

On the other hand, when the hair harvesting camera unit 200 includes a depth camera, the three-dimensional image may be taken by the depth camera. The depth camera referred to in the present disclosure includes a stereo depth camera, an infrared It may include, but is not limited to, a depth camera (IR depth camera) and a ToF camera.

The 3D image may be mainly used to determine the number of hair follicles, but may also be used to evaluate the hair quality of individual hair follicles.

The hair collection camera unit 200 may include a hair collection position adjustment unit 210 and a hair collection camera 220 .

The hair collection position adjustment unit 210 is coupled to one side of the upper side of the main body of the hair evaluation device, the hair collection is supported at the bottom, the hair measurement camera is supported on the top, and the height, distance, and angle of the hair collection camera unit are adjusted. plays a role

This sets the mounting position of the hair collected from the hair transplant patient.

Through this, the collected hair is accurately positioned in the photographing composition of the hair harvesting camera, and the collected hair is positioned so that doctors and nurses can easily take it out and use it.

The hair harvesting camera 220 is coupled to the end of the hair harvesting position adjusting unit to emit a laser, receives a signal reflected from the object, senses the distance, area, and height of the object, and then converts the object through a point on a three-dimensional surface to shape data serves to extract

This extracts the hair collected from a hair transplant patient as two-dimensional data or three-dimensional data, and delivers data information to the smart control unit.

Next, the display unit 300 according to the present invention will be described.

The display unit 300 serves to display two-dimensional image information or depth three-dimensional image information captured by the hair harvesting camera unit and virtual information analyzed and compared by the smart controller on the screen.

This may include a display position adjusting unit 310 and a display output unit 320 .

The display position adjusting unit 310 is coupled to one side of the upper surface of the hair evaluation device main body and serves to adjust the height, distance, and angle of the display screen.

This sets the mounting position of the display output unit.

Through this, the image information of the display output unit is positioned so that doctors and nurses performing hair transplantation surgery can easily check it.

The display output unit 320 includes a patient operation state screen 321 that displays image information captured by the head camera unit on the screen, and a hair collection state screen 322 that displays image information captured by the hair collecting camera unit on the screen. ) It plays a role of selectively outputting an image to the screen, or dividing each image and outputting it to the screen.

This provides image information to doctors and nurses performing hair transplantation surgery by displaying image information captured by the hair harvesting camera unit 200 and the head camera unit 500 during hair transplantation surgery.

Here, the patient operation status screen 321 detects the color of the sketch part of the patient's head before the hair transplant operation in the image taken by the head camera unit 500 to display the perimeter of the surgical area with a pen, and detects the perimeter and perimeter. Display image detection (321a) to detect and display the inner area of the surface is output, and display image detection (321a) according to the number of hairs collected from the hair transplant patient detected from the image photographed by the hair harvesting camera unit 200 A sketch image controller 321b for distributing and displaying images of hair in the form of dots according to a predetermined arrangement is formed inside the portion.

Here, the predetermined arrangement may be an arrangement in which each of the number of hairs per follicle is evenly distributed, for example, single hair, double hair, triple hair, for example, single hair is centrally distributed in the front of the hairline, and double It may be an arrangement to evenly distribute the hair and triple hair thereon, and those skilled in the art will be able to imagine various arrangements.

As described above, the surgical area in which the patient's surgery is performed is sensed through the display image detection 321a and the sketch image controller 321b, and the number of hairs collected from the patient is applied to the detected surgical area so that the doctor can determine the level of hair transplantation before surgery. Plan the plan and apply the number of remaining hair excluding the hair planted during the operation to the sketch image control unit in real time to easily determine the number of remaining hair compared to the hair transplant area, thereby reducing the fatigue of the surgeon By lowering the difficulty, even doctors with little experience in surgery can perform hair transplantation smoothly, and hair transplantation that forms an even distribution through planned hair transplantation can be achieved, and ultimately, the satisfaction of hair transplant patients can be increased.

As will be described later, schematically describing an exemplary method used in the present invention to count the number of hairs, first, a detected image is divided into follicular units, and then a pre-trained neural network or heuristic ( The heuristic) method can evaluate the number of hairs (single hair, double hair, triple hair, etc.) in individual follicular units, and an excessively detailed description thereof will be omitted because it may obscure the gist of the present invention.

In the first embodiment of the present invention, the hair collection status screen 322 includes a hair counting display unit 322a for counting the number of hairs per one follicle in the image area detected by the hair collection camera unit 200; A used hair ratio display unit 322b is formed for determining and displaying the number and ratio of hairs that are used from the number of hairs per follicle counted by the hair counting display unit and are reduced in real time.

According to an exemplary method for counting the number of hairs, using the hair ratio of the follicular unit occupying the uppermost part of the detected image and the volume of the hair follicle under the camera, The ratio can be estimated, and a statistical method can be used together in this process.

The hair counting display unit 322a may include single hair counting (322a-1), double hair counting (322a-2), triple hair counting (322a-3).

Here, the single hair counting 322a-1 counts and displays the number of single hairs having one hair in one hair follicle in the image measured by the hair collection camera unit.

Here, the double hair counting 322a-2 counts and displays the number of double hairs having two hairs in one hair follicle in the image measured by the hair collection camera unit.

Here, the triple hair counting 322a-3 counts and displays the number of triple hairs having three or more hairs in one hair follicle in the image measured by the hair collection camera unit.

The hair counting display unit 322a according to the present invention is classified into single hair counting (322a-1), double hair counting (322a-2), triple hair counting (322a-3) according to the number of hairs per collected patient's hair follicles. Thus, the number and ratio of hairs per each follicle are displayed to provide information to the doctor so that single hair, double hair, and triple hair can be distributed according to a predetermined arrangement in the hair transplantation part. For example, single hair, double hair, triple hair may be evenly distributed, but is not limited thereto.

The configuration of single hair counting (322a-1), double hair counting (322a-2), triple hair counting (322a-3) of the above-mentioned hair counting display unit 322a is only one embodiment, those of ordinary skill in the art are one Of course, the number of hairs per hair follicle can be variously classified, counted, and displayed based on the number of hairs formed in the hair follicles.

Through this, the number of hairs per hair follicle is distributed according to a predetermined arrangement in the hair transplant operation part according to the judgment of the doctor performing the hair transplant operation, and the hair transplantation is performed so that the natural hair transplantation operation is performed. It can increase the satisfaction of transplant patients.

The used hair ratio display unit 322b provides real-time information to the doctor by displaying the remaining number and ratio of single hair, double hair, and triple hair counted by the hair counting display unit 322a, respectively, used and reduced.

Through this, the number of hairs per hair follicle is distributed according to a predetermined arrangement in the surgical part according to the judgment of the doctor performing the hair transplantation operation, for example, single hair, double hair, triple hair are evenly distributed respectively to perform hair transplantation Therefore, it is possible to increase the satisfaction of hair transplant patients by allowing natural hair transplant surgery to be performed.

On the other hand, in the second embodiment of the present invention, the hair collection state screen 322 selects an image from the tip of the hair included in the detected image area to the opposite end, and measures the average thickness of the selected hair to create augmented reality. Through a predetermined length unit, for example, a hair thickness display unit 322c to express in micrometer units and; Whether or not there is hair damage that selects an image from the tip of the hair included in the detected image area to the opposite end, measures the curvature of each outer boundary of the selected hair, and extracts the outline through augmented reality to express the degree of hair damage Among the display units 322d, one display unit is selectively displayed or both display units are displayed.

Briefly describing an exemplary method used in the present invention to determine the thickness and damage of hair, the detected image is divided into units of follicles, and similarly, using a pre-learned neural network or heuristic method, It can evaluate the quality of hair thickness, damage, etc.

The hair thickness display unit 322c is, for example, a first hair thickness portion 322c-1, a second hair thickness portion 322c-2, a third hair thickness portion 322c-3, and a fourth hair thickness part 322c - 4 may be included.

Here, the first hair thickness unit 322c-1 automatically calculates the thickness of hair, which is included in the region and the average thickness of measured hair is identified as a predetermined first thickness, for example, 40 micrometers or less to determine the number of hairs and Shows the proportion of identified hair among the total number of measured hairs.

Here, the second hair thickness part 322c-2 is included in the region and the average thickness of measured hair is identified within a predetermined second thickness to a predetermined third thickness, for example, 40 to 60 micrometers. It is automatically calculated and shows the number of hairs and the proportion of identified hair among the total number of measured hairs.

Here, the third hair thickness unit 322c-3 is included in the region and the average thickness of measured hair is identified within a predetermined fourth thickness to a predetermined fifth thickness, for example, 60 to 75 micrometers. It is automatically calculated and shows the number of hairs and the proportion of identified hair among the total number of measured hairs.

Here, the fourth hair thickness unit 322c-4 automatically calculates the thickness of the hair, which is included in the region and the average thickness of measured hair is identified as a predetermined sixth thickness, for example, 75 micrometers or more, the number of hairs and Shows the proportion of identified hair among the total number of measured hairs.

Here, it will be understood that the predetermined first to sixth thicknesses may be appropriately adjusted according to gender, age, and race.

The hair thickness display unit 322c according to an embodiment of the present invention includes a first hair thickness unit 322c-1 and a second hair thickness unit 322c-2 within a thickness range set according to the sampled patient's hair detection thickness. ), the third hair thickness section 322c-3, and the fourth hair thickness section 322c-4, and display the number and ratio of hairs included in each hair thickness region to provide information to the doctor and provide hair Make sure to plant hair of a suitable thickness for the transplanted area.

More generally, the entire range to which the average thickness of hair belongs may be divided into two or more hair thickness ranges, and the hair thickness display unit 322c, for each of the hair thickness ranges, is included in the area and measured By automatically calculating the thickness of hair identified as having an average thickness of hair within each of the hair thickness ranges, the number of hairs and the proportion of identified hairs among the total number of measured hairs may be represented.

Through this, according to the judgment of the doctor performing the hair transplant surgery, hair transplantation is performed at an appropriate location of the hair transplant operation part according to the number and ratio of the thickness of the hair, thereby increasing the engraftment rate of the hair, and allowing the hair transplantation operation to be performed naturally. It can increase the satisfaction of transplant patients.

The hair damage indication unit 322d is included in the area and the cuticle layer on the surface of the hair is closely and densely arranged according to the degree of damage to the hair based on the result of measuring the outer surface and outer boundary of the photographed hair, and the degree of luster. Normal hair, which is shiny hair, and at least a portion of the cuticle layer surrounding the outer surface of the hair may include a normal hair and damaged hair detection unit for detecting damaged hair. Here, the damaged hair may be classified into one or more categories according to the degree of damage to the damaged hair.

As an embodiment, the hair damage display unit 322d includes a normal hair detection unit 322d-1, a first damaged hair detection unit 322d - 2, a second damaged hair detection unit 322d-3, and a third damaged hair detection unit. (322d-4).

Here, the normal hair detection unit 322d-1 measures the outer surface, the outer boundary, and the degree of gloss of the photographed hair included in the area to detect shiny hair with the cuticle layer on the surface of the hair closely and densely arranged. .

Here, the first damaged hair detection unit 322d - 2 measures the outer surface, the outer boundary, and the degree of luster of the photographed hair included in the area, and the cuticle layer surrounding the outer surface of the hair is damaged in the initial stage of damaged hair. detect

Here, the second damaged hair detection unit 322d-3 measures the outer surface, outer boundary, and glossy information of the measured hair included in the region, so that the cuticle damage on the outer surface of the hair is large, and the area where the cuticle is completely peeled off appears Detect damaged hair.

Here, the third damaged hair detection unit 322d-4 is included in the region and measures the outer surface, outer boundary, and glossy information of the measured hair, so that a part of the outer surface of the hair is torn or cut, and the cuticle is mostly worn out of the hair. Detect damaged hair.

The hair damage display unit 322d according to the present invention includes a normal hair detection unit 322d-1, a first damaged hair detection unit 322d-2, and a second damaged hair detection area set according to whether or not the collected patient's hair is damaged. It is classified into a damaged hair detection unit 322d-3 and a third damaged hair detection unit 322d-4, and the number and ratio of hairs included in each hair damaged area are displayed to provide information to a doctor suitable for hair transplantation. Allow the hair to be planted.

Through this, according to the judgment of the doctor performing the hair transplant surgery, healthy, undamaged hair is distributed in front of the hair transplant operation part, and in the case of severe damage, hair transplantation is performed by distributing it behind the invisible hair transplant operation part. It is possible to improve the patient's bangs line by transplanting healthy hair in a prominent frontal area, and to increase the satisfaction of hair transplant patients by allowing a natural hair transplant operation to be performed. Of course, the configuration of the hair damage display unit 322d is not limited to the first to third damaged hair detection units of the above-described examples.

Next, the smart control unit 400 according to the present invention will be described. The smart control unit 400 is a kind of computing device embedded in the body of the hair evaluation device, and may include a communication unit, a processor, etc. to perform the information processing function described in the present disclosure. The configuration of such a computing device is well known to those of ordinary skill in the art, and an excessively detailed description thereof will be omitted.

The smart control unit 400 is formed inside the body of the hair evaluation device to identify the depth 3D image information captured by the hair harvesting camera unit or infer the depth 3D image information from the 2D image information captured by the hair harvesting camera unit, , serves to automatically classify objects extracted from 3D image information based on setting data, compare and analyze the classified information, and deliver it to the display unit.

This may include a hair collection analysis unit 410 . In addition, the smart control unit may further include a surgical site analysis unit 420 .

The hair harvesting analysis unit 410 compares hair detected from the skin tissue of the hair transplant patient through the three-dimensional image information captured or inferred by the hair harvesting camera unit or hair collected from the hair transplant patient with set data. plays a role in the analysis.

The hair collection analysis unit 410 according to the first embodiment of the present invention includes a noise removal step (S411), a pre-processing step (S412), a hair image detection step (S413), a determining the number of hairs (S415), and information transfer Steps S416 are sequentially performed.

First, the noise removing step ( S411 ) serves to remove noise such as light or foreign substances unnecessarily reflected from the incised skin tissue and hair in the captured image.

Second, the pre-processing step (S412) of the collected hair serves to contrast the incised skin tissue with the hair in the captured image to make the boundary between the skin tissue and the hair clear.

Third, the hair image detection step ( S413 ) serves to detect a hair image from the pre-processed captured image.

Fourth, in the step of determining the number of hairs (S415), information on the number of each of single hair with one hair, double hair with two hairs, and triple hair with three or more hairs is identified based on one hair follicle in the detected hair image. plays a role

Fifth, the information transfer step (S416) serves to transmit the identified number of hair information to the smart control unit.

On the other hand, the hair collection analysis unit 410 according to the second embodiment of the present invention is a hair image detection step (S413), a hair damage identification step (S414), a determining the number of hairs (S415), an information delivery step (S416) Steps including the may be performed sequentially. Prior to the hair image detection step (S413), at least one of the noise removing step (S411) and the pre-processing step (S412) of the collected hair may be further performed.

First, the noise removing step ( S411 ) removes noise such as unnecessary reflected light or foreign substances from the skin tissue and hair collected from the captured image.

Second, in the pre-processing step (S412) of the collected hair, the skin tissue and the hair collected from the captured image are contrasted.

Third, the hair image detection step (S413) detects a hair image from the pre-processed captured image.

Fourth, in the hair damage identification step (S414), a part of the detected hair image area is enlarged to identify the thickness and damage of the hair and displayed in augmented reality.

Fifth, in the step of determining the number of hairs (S415), a hair image is detected, and based on one hair follicle from the detected hair, single hair with one hair, double hair with two hairs, and triple hair with three hairs, respectively Get information on the number of

Sixth, in the information transfer step (S416), information on the number of identified hairs is transmitted to the control unit.

The hair harvested hair analysis unit 410 according to the present invention is a 3D graphic geometry processing technology according to an image processing method for analyzing the hair collected from a hair transplant patient, which is a model and view conversion step, a lighting and shading step, and a projection. Various image processing techniques such as step, arrangement step, and screen mapping step can be selectively used.

The surgical site analysis unit 420 detects the surgical area image information of the hair transplant patient through the 3D image information taken from the head camera unit or the 3D image information inferred from the 2D image information, and in the collected hair analysis unit It serves to compare and analyze surgical location information using the detected hair data.

Specifically, the surgical site analysis unit 420 according to the first embodiment of the present invention sequentially performs the steps including the area measurement step (S421), the number information identification step (S424), and the information delivery step (S425). can At least one of the noise removal step S422 and the surgical area pre-processing step S423 may be further performed prior to the number information identification step (S424).

First, the area measurement step (S421) serves to detect a line contour image to be designed for the surgical part of the hair transplant patient, and measure the inner area area based on the peripheral surface of the contour image.

Second, the noise removal step ( S422 ) serves to remove noise such as reflected light or foreign substances unnecessary taken from the skin tissue and sequentially planted hair in the area measured based on the peripheral surface of the contour image.

Third, the operation area pre-processing step ( S423 ) serves to contrast the skin tissue included in the area measured based on the circumferential surface of the contour image with the hair to be sequentially planted.

Fourth, the number information identification step (S424) detects a hair image planted in the area measured based on the peripheral surface of the outline image, and a single hair in which one hair is formed based on one hair follicle among the hairs planted in the area, two It detects double hair in which hairs are formed and triple hair in which three hairs are formed, and serves to identify information on the number of hairs each planted.

Fifth, the information transfer step (S425) serves to transmit the detected number of planted hair information to the smart control unit.

The surgical site analysis unit 420 according to the first embodiment of the present invention performs a model and view transformation step, lighting and shading, which is a geometry processing technology of 3D graphics, according to an image processing method for analyzing a surgical part of a hair transplant patient. Various image processing techniques such as processing step, projection step, arrangement step, and screen mapping step can be selectively utilized.

The smart control unit 400 according to the first embodiment of the present invention has the following characteristics.

First, information on the number of hairs secured before hair transplantation is transmitted through the hair harvesting camera unit, and line contour image detection information to be designed in the surgical part of the hair transplant patient is transmitted through the head camera unit, and the surgical location area A virtual image is formed on the patient's treatment state screen by automatically distributing it in the form of dots according to the number of hairs secured in the .

Second, the display (or display format) is different, such as setting the color according to the single hair with one hair follicle, double hair with two hairs, and triple hair with three hairs based on one hair follicle in the detected hair. (differentiate), when automatically distributed in a dot form, each of the number of hairs per follicle, for example, single hair, double hair, and triple hair, is distributed according to a predetermined arrangement to form a virtual image on the patient's operation state screen.

Third, planted head area among the number of hairs planted/displayed area: By automatically calculating the standard density of hair to be planted through the ratio of the number of remaining incised hairs/unplanted head area among the displayed area, the ratio distribution information within the area according to the standard density and It provides the number of remaining hair compared to the remaining area in real time.

On the other hand, the smart control unit 400 according to the second embodiment of the present invention is the first hair thickness part, the second hair thickness part, the third hair thickness part, and the fourth hair identified based on the average thickness information in the detected hair. The display (or display format) is different, such as setting the color in the display image according to the thickness part, and a virtual image is formed with display information that is different according to the thickness of the hair, for example, color information on the surgical site of a hair transplant patient. Therefore, a hair transplant location is recommended.

More generally, when the entire range to which the average thickness of hair belongs is divided into two or more hair thickness ranges, the smart control unit 400, each of the hair thicknesses identified based on the average thickness information in the detected hair It is possible to recommend a hair transplant location by changing the display, such as setting a color in the display image according to the range, and forming a virtual image with display information such as color information according to the thickness of hair on the surgical site of a hair transplant patient.

In addition, the hair evaluation device 1 according to the present invention additionally receives a signal reflected from the surgical part of a hair transplant patient, senses the distance, area, and height of the surgical part, and extracts object shape data through a three-dimensional point. A camera unit 500 is included.

It consists of a head camera position adjustment unit 510 and a patient surgery camera 520 . The head camera unit 500 takes a two-dimensional or three-dimensional image of the treatment position of the head of a hair transplant patient and directly measures depth information from the three-dimensional image, or makes the smart controller 400 infer depth information from the two-dimensional image can do it

The head camera position adjusting unit 510 is coupled to one side of the upper side of the main body of the hair evaluation device and serves to adjust the height, distance, and angle of the patient's surgery camera to photograph the surgical part of the hair transplant patient.

This sets the position of the patient's surgical camera by adjusting the height, distance, and angle in the direction of the surgical part of the hair transplant patient.

Through this, the surgical part is accurately positioned in the photographing composition of the patient's surgery camera in response to the prone state, the lying position, or the lying direction of the hair transplant patient.

The patient surgery imaging camera 520 is coupled to the end of the head camera position control unit to emit a laser, receives a signal reflected from the surgical part of the hair transplant patient, and senses the distance, area, and height of the surgical part to sense the three-dimensional point It plays a role in extracting shape data of objects through

This extracts the surgical part of the hair transplant patient as three-dimensional data and transmits data information to the smart controller, or extracts two-dimensional data and transmits it to the smart controller so that the smart controller infers three-dimensional data.

Hereinafter, a detailed operation process of the hair evaluation device for hair transplant surgery according to the present invention will be described.

First, when installing the hair evaluation device, one hair counting body is selectively installed and fixed among the stationary body and the table fixed body depending on the situation of the operating room.

Next, the fixed height, angle, and fixed interval of the hair harvesting camera unit, the display unit, and the head camera unit are adjusted.

At this time, the hair-collecting camera unit is positioned and fixed to facilitate photographing at the position where the hair to be collected is placed, and the display unit is positioned and fixed to facilitate the treatment of the doctor's gaze during surgery, and the head camera unit is photographed on the surgical part of the patient during surgery. Position it so that it is easy to fix.

Next, the hair collected from the scalp of the hair transplant patient by either a non-incision method or an incision method is accommodated in a hair storage container in which the hair follicle preservation solution is stored and stored.

At this time, by adjusting the vertical height of the hair harvesting camera unit, the collected hair is focused and photographed.

Next, single hair, double hair, and triple hair are automatically classified according to the number of hairs per follicle of the collected hair photographed through the smart controller, and the number of each is displayed. Alternatively, by measuring the thickness of the collected hair photographed through the smart control unit, the hair thickness is automatically classified within the set range to display the number of steps, and the outer boundary of the collected hair is measured to automatically classify whether the hair is damaged within the set range. Indicate the number of steps.

Next, the surgical part sketch area marked by the doctor on the surgical part of the hair transplant patient is photographed and recognized through the head camera unit.

Finally, information on the number and ratio of the patient's hair transplantation portion and the remaining hair harvested during the hair transplantation operation is provided to the doctor through the display unit.

Through this, the total number of hairs and (i) the ratio of single hair, double hair, triple hair or more, (ii) the number of steps according to the thickness of the hair, and/or (iii) the hair ratio of the number of hairs according to whether or not the hair is damaged is displayed so that the doctor can check in the middle of the operation, maintain an appropriate ratio according to the hair transplant surgery plan, and plant hair according to the plan, thereby increasing the satisfaction of hair transplant patients.

[Explanation of code]

100: hair evaluation device body 110: rod support fixing part

120: surgical support fixing unit 200: hair harvesting camera unit

210: hair collection camera position control unit 220: hair collection camera

300: display unit 310: display position control unit

320: display output unit 321: patient operation state screen unit

322: screen of collected hair state 322a: hair counting display unit

322b: used hair ratio display unit 322c: hair thickness display unit

322d: hair damage display unit 400: control unit

410: hair collection analysis unit 420: surgical site analysis unit

500: head camera unit 510: head camera position adjustment unit

520: camera for patient surgery

Claims (19)

1. A hair evaluation device (1) for counting the number of hairs from image information captured to include hair collected from a patient,

   The evaluation device body 100 for controlling and supporting the three-dimensional position and orientation of the hair harvesting camera unit and the display unit;

   It is a camera shape coupled to one side of the evaluation device body or connected by wire or wirelessly, and the hair part collected from the hair transplant patient is accommodated at the lower end of the camera, and the collected hair part is photographed as a two-dimensional image or a three-dimensional image for depth. The hair harvesting camera unit 200 for measuring information or allowing a smart control unit to infer the depth information;

   A display unit 300 for displaying on a screen the depth 3D image information or 2D image information captured by the hair harvesting camera unit and virtual information analyzed and compared by the smart control unit,

   Formed inside the evaluation device body to identify depth 3D image information photographed by the hair harvesting camera unit or inferring depth 3D image information from the 2D image information photographed by the hair harvesting camera unit, the three-dimensional It includes the smart control unit 400 that automatically classifies the object extracted from the image information based on the setting data, compares and analyzes the classified information and transmits it to the display unit,

   The smart control unit 400 is

   It characterized in that it comprises a hair collection analysis unit 410 that compares and analyzes the hair detected from the skin tissue collected from the hair transplant patient with the set data through the three-dimensional image information photographed or inferred by the hair collection camera unit. Hair evaluation device for hair transplant surgery.
2. The method of claim 1, wherein the hair collection analysis unit 410 is

   A hair image detection step (S413) of detecting a hair image from the photographed image, and

   A hair count identification step (S414) of identifying information on the number of hairs per follicle classified based on the number of hairs formed in one hair follicle in the detected hair image;

   Hair evaluation device for hair transplant surgery, characterized in that the information transfer step (S415) of transferring the identified number of hair information is sequentially performed.
3. 3. The method of claim 2,

   In the step of determining the number of hairs (S414),

   Hair evaluation device for hair transplant surgery, characterized in that it additionally grasps information on the number of relatively thin hairs.
4. According to claim 1,

   The hair evaluation device 1 further includes a head camera unit 500 that measures the depth information by taking a three-dimensional image of the treatment position of the head of the hair transplant patient,

   The smart control unit 400 is

   Detecting the surgical part image information of the hair transplant patient through the three-dimensional image information photographed or inferred by the head camera unit 500, and comparing and analyzing the surgical location information using the hair data detected by the hair harvesting analysis unit A hair evaluation device for hair transplant surgery, further comprising a surgical site analysis unit 420 .
5. 5. The method of claim 4,

   The method of claim 1, wherein the surgical site analysis unit 420 is

   A region measuring step (S421) of detecting a line contour image to be designed on the surgical part of the hair transplant patient and measuring the inner area area based on the peripheral surface of the contour image;

   Detecting the number of hair images to be planted in the measured region based on the peripheral surface of the contour image, and counting information to determine the number of hairs planted per detected follicle based on the number of hairs formed in one follicle among the hairs planted in the region Step (S424) and,

   Hair evaluation apparatus for hair transplant surgery, characterized in that the steps including the information transfer step (S425) of transmitting the detected number of planted hair information to the smart control unit are sequentially performed.
6. The smart control unit 400 according to claim 4,

   Receives information on the detection of the number of hairs secured before the hair transplantation operation through the hair harvesting camera unit, and receives line contour image detection information to be designed for the surgical part of the hair transplant patient through the head camera unit 500, A hair evaluation device for hair transplant surgery, characterized in that it forms a virtual image on the patient's operation state screen by automatically distributing it in the form of dots according to the number of hairs secured in the surgical site area.
7. According to claim 1, wherein the smart control unit 400

   The indication is changed according to the number of hairs per follicle classified based on the number of hairs formed in one follicle from the detected hair, and when automatically distributed in a dot form, the number of hairs per follicle is distributed according to a predetermined arrangement for the patient Hair evaluation device for hair transplant surgery, characterized in that the virtual image is formed on the operation state screen part.
8. According to claim 1, wherein the smart control unit 400

   Planted head area among the number of hairs planted/displayed area: The standard density of the hair to be planted is automatically calculated based on the ratio of the number of remaining incised hairs/the unplanted head area among the displayed area, and ratio distribution information and remaining Hair evaluation device for hair transplant surgery, characterized in that it provides the number of remaining hairs compared to the area in real time.
9. The hair evaluation device 1 for evaluating the quality of hair from the image information captured to include the hair collected from the patient

   The hair evaluation device body 100 for controlling and supporting the three-dimensional position and orientation of the hair harvesting camera unit and the display unit;

   It is a camera shape coupled to one side of the body of the hair evaluation device or connected by wire or wirelessly, and the hair part collected from the hair transplant patient is accommodated at the lower end of the camera, and the collected hair part is photographed as a two-dimensional image or a three-dimensional image. A hair harvesting camera unit 200 that measures depth information or causes a smart controller to infer the depth information;

   A display unit 300 for displaying on a screen the depth 3D image information or 2D image information captured by the hair harvesting camera unit and virtual information analyzed and compared by the smart control unit,

   Formed inside the body of the hair evaluation device to identify depth 3D image information captured by the hair harvesting camera unit or inferring depth 3D image information from the 2D image information captured by the hair harvesting camera unit, the 3 A smart control unit 400 that automatically classifies the object extracted from the dimensional image information based on the setting data, compares and analyzes the classified information, and delivers it to the display unit;

   Includes a head camera unit 500 that measures the depth information by taking a three-dimensional image of the treatment position of the head of the hair transplant patient,

   The display unit 300 is

   A display position adjustment unit 310 coupled to one side of the hair evaluation device body to adjust the three-dimensional position and orientation of the display screen;

   At least one of a patient operation state screen 321 that displays image information captured by the head camera unit 500 on a screen and a hair collection state screen 322 that displays image information captured by the hair collecting camera unit on the screen and a display output unit 320 that outputs an image to the screen, or divides each image and outputs it to the screen,

   The hair collection state screen 322 is

   A hair thickness display unit 322c that selects an image from one end to the other end of the hair included in the detected image area, measures the average thickness of the selected hair, and expresses it in a unit of a predetermined length;

   A hair damage display unit 322d that selects an image from the tip of the hair included in the detected image area to the opposite end, measures whether each of the outer borders of the selected hair is bent, extracts the outline, and expresses the degree of hair damage (322d) A hair evaluation device for hair transplant surgery, characterized in that selectively displaying one display unit or displaying both display units.
10. 10. The method of claim 9,

    The entire range to which the average thickness of hair belongs is divided into two or more hair thickness ranges,

    The hair thickness display unit 322c is, for each of the hair thickness ranges, automatically calculates the thickness of the hair identified as belonging to the respective hair thickness range, the average thickness of the measured hair included in the region, the number of hairs and A hair evaluation device for hair transplant surgery, indicating the proportion of identified hair among the total number of measured hairs.
11. The method of claim 9, wherein the hair damage display unit (322d) is

    Normal hair, which is shiny hair with a close and densely arranged cuticle layer on the surface of the hair, according to the degree of damage to the hair based on the result of measuring the outer surface and outer boundary of the hair captured within the area, and the degree of luster, and At least a portion of the cuticle layer surrounding the outer surface of the hair comprises a normal hair and a damaged hair detection unit for detecting damaged hair, wherein the damaged hair is classified into one or more categories according to the degree of damage to the damaged hair, characterized in that Hair evaluation device for hair transplant surgery.
12. The method of claim 9, wherein the smart control unit 400

    A hair collection analysis unit 410 that compares and analyzes hair collected from a hair transplant patient with set data through three-dimensional image information photographed or inferred from the hair collection camera unit;

    A surgery that detects the surgical part image information of the hair transplant patient through the three-dimensional image information photographed or inferred by the head camera unit 500, and compares and analyzes the surgical location information using the hair data detected by the hair collection analysis unit Hair evaluation device for hair transplant surgery, characterized in that it comprises a region analysis unit (420).
13. The method of claim 12, wherein the hair collection analysis unit 410 is

    A hair image detection step (S413) of detecting a hair image from the photographed image, and

    A hair damage identification step (S414) of enlarging a part of the detected hair image area to identify and display the thickness and damage of the hair;

    A hair count identification step 415 of detecting a hair image and identifying information on the number of hairs per follicle classified based on the number of hairs formed in one hair follicle from the detected hair;

    Hair evaluation device for hair transplant surgery, characterized in that the steps including the information transfer step (416) of transmitting the identified number of hair information to the control unit.
14. 13. The method of claim 12,

    The entire range to which the average thickness of hair belongs is divided into two or more hair thickness ranges,

    The smart control unit 400,

    In the detected hair, the display image is displayed differently according to each of the hair thickness ranges identified based on the average thickness information, and a virtual image is formed on the surgical site of the hair transplant patient with different display information according to the hair thickness to form a hair transplant. A hair evaluation device for hair transplant surgery that recommends a location.
15. In the method for evaluating image information of the photographed patient's hair by a computing device,

    A hair image detection step of detecting a hair image from a photographed image by a hair harvesting analysis unit implemented by a computing device;

    A process of identifying information on the number of hairs per follicle classified based on the number of hairs formed in one follicle in the detected hair image, and enlarging a portion of the detected hair image area to identify the thickness and damage of hair performing at least one of the following processes; and

    The hair collection analysis unit,

    (i) information on the number of hairs identified above, and

    (ii) the thickness of the hair and whether the damage is

    An information delivery step of causing a predetermined display unit to display at least one of (i) and (ii) by delivering at least one of

    A method for evaluating hair for hair transplant surgery, comprising a.
16. In the method for evaluating image information of the photographed patient's hair by a computing device,

    a region measuring step of detecting, by the surgical site analysis unit implemented by the computing device, a line contour image to be designed in the surgical part of the hair transplant patient, and measuring the inner area area based on the peripheral surface of the contour image;

    Number of detecting hair images to be planted in an area measured based on the circumferential surface of the outline image, and identifying information on the number of hairs planted per detected hair follicle based on the number of hairs formed in one follicle among hairs planted in the area information acquisition step; and

    An information delivery step of causing a predetermined display unit to display the number information by transmitting the detected number information of the planted hair

    A method for evaluating hair for hair transplant surgery, comprising a.
17. 17. The method of claim 16,

    The information transfer step is

    By transmitting the number information and the detection information of the line contour image, the display unit automatically distributes a virtual image in the form of dots according to the number of hairs secured in the surgical location area on the patient operation state screen displayed on the display unit. A method for evaluating hair for hair transplant surgery, characterized in that it is formed.
18. 17. The method of claim 16,

    The information transfer step is

    Planted head area among the number of hairs planted/displayed area: The standard density of the hair to be planted is automatically calculated based on the ratio of the number of remaining incision hairs/the unplanted head area among the displayed area, and ratio distribution information and remaining Hair evaluation for hair transplant surgery, characterized in that by transmitting the number of remaining hairs compared to the existing area, the display unit provides ratio distribution information in the area according to the standard density and the number of remaining hairs compared to the remaining area in real time Way.
19. 17. The method of claim 15 or 16,

    The information transfer step is

    In the patient operation status screen displayed on the display unit, the display is changed according to the number of hairs per follicle classified based on the number of hairs formed in one hair follicle from the detected hair, and when automatically distributed in the form of dots, hair follicles are displayed. A method for evaluating hair for hair transplant surgery, characterized in that a virtual image in which each number of hairs is distributed according to a predetermined arrangement is formed.

Images