WO2020138671A1

WO2020138671A1 - Virtual reality-based surgery assessment system, using simulator, for otolaryngology and neurosurgery

Info

Publication number: WO2020138671A1
Application number: PCT/KR2019/013827
Authority: WO
Inventors: 김성원; 김도현; 최요철; 김태균; 김현문; 허재일
Original assignee: 주식회사 홀로웍스; 가톨릭대학교 산학협력단
Priority date: 2018-12-27
Filing date: 2019-10-21
Publication date: 2020-07-02
Also published as: KR20200080534A; KR102143784B1

Abstract

The present invention relates to a system for quantitatively assessing skill level in otolaryngology or neurosurgery surgery on the basis of virtual reality, the system comprising: goggles for visually providing space information to a medical trainee; a controller for mapping, in the space information, moving information about the movement of the hands of the medical trainee; a space information receiving unit for receiving the space information provided by the goggles; a moving information receiving unit for receiving the moving information, of the medical trainee, mapped by the controller; a reference data configuration unit for receiving, in advance, and configuring, on the space information, pre-configured reference data associated with the moving information; and an assessment measurement unit for calculating a quantitative score of the moving information of the medical trainee.

Description

Surgery evaluation system of otolaryngology and neurosurgery simulator based on virtual reality

The present invention relates to an otorhinolaryngology and neurosurgery surgery evaluation system, and more specifically, based on virtual reality, such as VR (virtual reality), AR (Augmented　Reality), MR (MixedalReality), of an otolaryngology subject or neurosurgery This is a technical field for surgical evaluation systems such as medical trainees.

Virtual reality (VR) technology is emerging as an alternative to nurturing medical professionals and psychological therapy to cope with the increasing demand for medical services such as psychological diseases caused by the age of ultra-aging and competition.

The medical field is emerging as an application field of VR that is developing around games, and attempts to actively introduce VR in hospitals are underway.

The VR technology industry is also predicting that the medical service will become the representative VR B2B market in the future, and is expanding its sales force by trying various projects.

Accordingly, there have been several technical attempts that combine educational and medical functions of VR technology, and among them, "augmented reality based laparoscopic surgery simulation system and method using the same (Registration No. 10-1887805) , Hereinafter referred to as Patent Document 1)".

In the case of Patent Document 1, a simulation system for laparoscopic surgery based on augmented reality and a method using the same are disclosed. The augmented reality-based simulation system for laparoscopic surgery includes a laparoscopic surgical tool for generating first laparoscopic surgical information; A simulator module that is provided with a human body model therein to generate second laparoscopic surgical information when it is sensed that the laparoscopic surgical instrument is cutting the human body model or inserted into the human body model; An information processing module for generating augmented reality information based on the first laparoscopic surgical information and the second laparoscopic surgical information; And augmented reality glass to output the augmented reality information. It includes. Thereby, by using augmented reality information, the learner simulates laparoscopic surgery or compares the image information of the previously stored laparoscopic surgery with the laparoscopic surgery simulated by the learner himself, and compares the laparoscopic surgery simulated by the learner with respect to the previously stored laparoscopic surgery. It is possible to evaluate which information matches the image information, so that the surgical technique required for laparoscopic surgery can be effectively polished, and the educator can easily use the augmented reality information to facilitate educational 3D content for laparoscopic surgery. Can be produced.

Likewise, there is a "laparoscopic surgery education system using augmented reality (published number 10-2018-0123310, hereinafter referred to as Patent Document 2)".

In the case of patent document 2, it relates to a laparoscopic surgical education system using augmented reality that gives a user the feeling of actually performing an operation and allows them to practice while being guided by a surgical method. To this end, a laparoscopic surgical practice system using virtual reality glasses is provided. Therefore, according to the present invention, it is possible to overcome the reality that is difficult to practice in person, thereby giving an opportunity to deal with the actual internal organs, and thus has an advantage of being effective education even indirectly to students receiving medical education.

In addition, there is also a "virtual reality training system and method for dentistry (Publication No. 2003-0044909, hereinafter referred to as Patent Document 3)".

In the case of Patent Literature 3, it detects data regarding the spatial position of an actual element that can be held and used in hand, displays a three-dimensional display of a virtual object on a screen, and displays a virtual device corresponding to the actual spatial location of the actual element. Virtual reality practice to obtain procedural movement in dentistry by processing spatial location data to provide spatial representation, providing a virtual instrument operating on the virtual object, and modeling the interaction between the virtual object and the virtual instrument It is about a system. The hand-held element is a tactile human-machine interface (IHM) device having an actuator that is controlled to provide force feedback to a user holding the real element in hand when the virtual instrument interacts with the virtual object. Belongs. The invention is useful for educational or professional purposes.

In addition, there is also a "virtual surgery simulation apparatus and its operation method (Publication No. 10-2016-0092425, hereinafter referred to as Patent Document 4)".

In the case of patent document 4, a virtual surgical simulation apparatus is provided. The apparatus includes a control unit for performing virtual surgery on the patient by using a 3D image of a patient's surgical target area; An image processing unit generating a surgical image including at least a part of the process of the virtual surgery; And it characterized in that it comprises a communication unit for transmitting at least one of the surgical image and the surgical results.

However, in the case of these patent documents, most of them exist only in certain medical fields such as orthopedic surgery, plastic surgery, and dentistry, and only a few documents in other medical fields are described, and surgical procedures in the relevant fields can be evaluated. There is a problem that education methods are not efficient because there is no means to do so.

Existing conventional technologies are based on virtual reality, such as virtual reality (VR), Augmented Reality (AR), and Mixed Reality (MR), providing technical support for medical students or doctors for specific procedures or surgery, or telemedicine and diagnosis. Though it had a concept for, it is not only for trainees, such as medical students, medical specialists, or those who require the latest medical practice, go beyond VR (virtual reality), AR (Augmented　Reality), MR(Mixed　Reality) based practice, and learn about these behaviors. There was no technical platform to provide quantitative evaluation and guidelines.

The surgical evaluation system of the virtual reality based otolaryngology and neurosurgery simulator according to the present invention is devised to solve the conventional problems as described above, and presents the following problems to be solved.

First, it is intended to provide a technical system for medical practitioners to be trained on the basis of virtual reality, not through physical exercises such as bodies or dolls.

Second, in the otolaryngology surgery or neurosurgery surgery, I would like to be able to receive a quantitative evaluation of the experience of surgery on major areas of major surgery.

Third, it is intended to enable medical trainees to evaluate surgery based on objective data, and share this with external servers to secure the right to receive high-quality medical services from the public.

The problem of the present invention is not limited to those mentioned above, and other problems not mentioned will be clearly understood by those skilled in the art from the following description.

The surgical evaluation system of the virtual reality based otolaryngology and neurosurgery simulator according to the present invention has the following problem solving means for the above-mentioned problems.

A surgical evaluation system of a virtual reality based otolaryngology and neurosurgery simulator according to the present invention is mounted on the front face of a medical practitioner, and includes goggles for visually providing spatial information to the medical practitioner; A controller provided in the hand of the medical practitioner to map moving information of the motion of the medical practitioner's hand into the spatial information; A spatial information receiving unit receiving the spatial information provided by the goggles; A moving information receiver configured to receive the moving information of the medical practitioner mapped by the controller; A reference data setting unit for pre-acquiring and setting preset reference data for the moving information on the spatial information; And an evaluation measurement unit receiving the preset reference data from the reference data setting unit and comparing the moving information of the medical practitioner on the spatial information to calculate a quantitative score.

The preset reference data of the surgical evaluation system of the virtual reality-based otolaryngology and neurosurgery simulator according to the present invention is obtained by obtaining the moving information provided by a plurality of specialists in advance, by the plurality of specialists on the spatial information It can be characterized in that it is set to the average value of the traces in the three-dimensional coordinates of the moving information.

The goggles of the surgical evaluation system of a virtual reality based otolaryngology and neurosurgery simulator according to the present invention is characterized by providing at least one virtual reality among virtual reality (VR), Augmented Reality (AR), or Mixed Reality (MR) can do.

The evaluation measurement unit of the surgical evaluation system of the virtual reality-based otolaryngology and neurosurgery simulator according to the present invention includes: a spatial coordinate recognition unit for reading and acquiring the spatial information in three-dimensional spatial coordinates; A moving coordinate recognition unit for acquiring 3D spatial coordinates of the moving information in the 3D spatial coordinates of the spatial information; And a dimension extraction unit for extracting a predetermined dimension for evaluating the moving information on a predetermined surgical site in the spatial information.

The dimensional extraction unit of the surgical evaluation system of the virtual reality-based otolaryngology and neurosurgery simulator according to the present invention sets the predetermined dimension to a plurality of one-dimensional, and the evaluation measurement unit touches the predetermined surgical site in one dimension It may be characterized in that it further comprises a point triggering unit which is set as a touch line and is set as a fail line at a lower portion having a predetermined depth from the touch line.

The point triggering unit of the surgical evaluation system of the virtual reality-based otolaryngology and neurosurgery simulator according to the present invention includes: a target point setting unit configured to set the predetermined surgical site and provide the spatial information through the goggles; A touch line recognition unit recognizing whether the moving information of the medical practitioner input by the controller touches the touch line; And a fail line recognition unit recognizing whether the moving information of the medical practitioner input by the controller touches the fail line formed under the touch line.

The point triggering unit of the surgical evaluation system of the virtual reality based otolaryngology and neurosurgery simulator according to the present invention comprises: a touch time recognition unit for acquiring the total time that the moving information of the medical practitioner stays at the predetermined surgical site; A depth weighting unit continuously calculating a score of the moving information according to the depth of the moving information inserted into a space extending from the touch line to the failing line, and continuously subtracting the score in proportion to the depth of the moving information; And a depth dispersion measurement unit configured to measure a variance of the depth of the moving information inserted into a space leading from the touch line to the fail line, and to give a score of the moving information in inverse proportion to the variance. .

The dimensional extraction unit of the surgical evaluation system of the virtual reality-based otolaryngology and neurosurgery simulator according to the present invention sets the predetermined dimension in two dimensions, and the evaluation measurement unit sets the predetermined surgical area in a two-dimensional area, , It may be characterized in that it further comprises a line trigger for calculating a distance spaced from the origin of the two-dimensional area.

The line triggering unit of the surgical evaluation system of the virtual reality based otolaryngology and neurosurgery simulator according to the present invention includes: a target area setting unit for setting the origin of the two-dimensional area as a target area for the predetermined surgical area; A coordinate setting unit configured to set the two-dimensional area as x-y coordinates and recognize coordinates in the x-y coordinates of the two-dimensional area of the moving information; Deviation diameter calculation unit for measuring the distance the moving information is spaced on the x-y coordinates from the origin; And a coordinate shift unit configured to shift the two-dimensional area to cause the target region setting unit to reset the target region for the surgical site.

The line triggering unit of the surgical evaluation system of the virtual reality based otolaryngology and neurosurgery simulator according to the present invention counts the number of times the moving information of the medical practitioner touches the xy coordinates of the two-dimensional area, and the moving information is the It may be characterized in that it further comprises a touch count unit for recognizing whether to touch the xy coordinates of the two-dimensional area multiple times.

The virtual reality-based otolaryngology and neurosurgery simulator surgical evaluation system according to the present invention having the above configuration provides the following effects.

First, it enables a variety of experiences based on virtual reality for medical trainees, such as virtual reality (VR), Augmented Reality (AR), and Mixed Reality (MR).

Second, in the virtual reality such as VR (virtual reality), AR (Augmented　Reality), and MR(Mixed　Reality) for medical trainees, they can perform surgery on a specific area and receive a quantitative evaluation System.

Third, it is possible to benchmark how far the VR (virtual reality), AR (Augmented,Reality), and MR(Mixed　Reality) for medical practitioners deviated from the standard data of the specialists for the relevant area.

The effects of the present invention are not limited to those mentioned above, and other effects not mentioned will be clearly understood by those skilled in the art from the following description.

1 is a conceptual diagram of a surgical evaluation system of a virtual reality based otolaryngology and neurosurgery simulator according to an embodiment of the present invention.

2 is a block diagram of a surgical evaluation system of a virtual reality based otorhinolaryngology and neurosurgery simulator according to an embodiment of the present invention.

FIG. 3 is a block diagram showing sub-components of an evaluation measurement unit that is one component of a surgical evaluation system of a virtual reality-based otolaryngology and neurosurgery simulator according to an embodiment of the present invention.

4 is an exemplary screen of a virtual reality that a medical trainee can access through VR or the like for use of a surgical evaluation system of a virtual reality based otolaryngology and neurosurgery simulator according to an embodiment of the present invention.

5 is an exemplary screen of a virtual reality that a medical trainee can access through AR or MR for use in a surgical evaluation system of a virtual reality based otolaryngology and neurosurgery simulator according to an embodiment of the present invention.

6 is a block diagram showing sub-components of a point triggering unit which is a component of a surgical evaluation system of a virtual reality based otolaryngology and neurosurgery simulator according to an embodiment of the present invention.

FIG. 7 is a front cross-sectional view showing a touch line and a fail line for a target point of a point triggering unit of a surgical evaluation system of a virtual reality based otolaryngology and neurosurgery simulator according to an embodiment of the present invention. .

FIG. 8 is a side cross-sectional view showing a touch line and a fail line for a target point of a point triggering unit of a surgical evaluation system of a virtual reality based otolaryngology and neurosurgery simulator according to an embodiment of the present invention. .

9 is a block diagram showing sub-components of a line triggering unit which is a component of a surgical evaluation system of a virtual reality based otolaryngology and neurosurgery simulator according to an embodiment of the present invention.

10 is a conceptual diagram illustrating coordinates of a target region of a line triggering unit, which is a component of a surgical evaluation system of a virtual reality-based otolaryngology and neurosurgery simulator according to an embodiment of the present invention.

The surgical evaluation system of the virtual reality-based otorhinolaryngology and neurosurgery simulator according to the present invention can apply various changes and have various embodiments, and specific embodiments will be illustrated in the drawings and described in detail in the detailed description. However, this is not intended to limit the present invention to specific embodiments, and should be understood to include all modifications, equivalents, and substitutes included in the technical spirit and technical scope of the present invention.

1 is a conceptual diagram of a surgical evaluation system of a virtual reality based otolaryngology and neurosurgery simulator according to an embodiment of the present invention. 2 is a block diagram of a surgical evaluation system of a virtual reality based otorhinolaryngology and neurosurgery simulator according to an embodiment of the present invention. FIG. 3 is a block diagram showing sub-components of an evaluation measurement unit that is one component of a surgical evaluation system of a virtual reality-based otolaryngology and neurosurgery simulator according to an embodiment of the present invention. 4 is an exemplary screen of a virtual reality that a medical trainee can access through VR or the like for use of a surgical evaluation system of a virtual reality based otolaryngology and neurosurgery simulator according to an embodiment of the present invention. 5 is an exemplary screen of a virtual reality that a medical trainee can access through AR or MR for use in a surgical evaluation system of a virtual reality based otolaryngology and neurosurgery simulator according to an embodiment of the present invention. 6 is a block diagram showing sub-components of a point triggering unit which is a component of a surgical evaluation system of a virtual reality based otolaryngology and neurosurgery simulator according to an embodiment of the present invention. FIG. 7 is a front cross-sectional view showing a touch line and a fail line for a target point of a point triggering unit of a surgical evaluation system of a virtual reality based otolaryngology and neurosurgery simulator according to an embodiment of the present invention. . FIG. 8 is a side cross-sectional view showing a touch line and a fail line for a target point of a point triggering unit of a surgical evaluation system of a virtual reality based otolaryngology and neurosurgery simulator according to an embodiment of the present invention. . 9 is a block diagram showing sub-components of a line triggering unit which is a component of a surgical evaluation system of a virtual reality based otolaryngology and neurosurgery simulator according to an embodiment of the present invention. 10 is a conceptual diagram illustrating coordinates of a target region of a line triggering unit, which is a component of a surgical evaluation system of a virtual reality-based otolaryngology and neurosurgery simulator according to an embodiment of the present invention.

The surgical evaluation system of the virtual reality-based otorhinolaryngology and neurosurgery simulator according to the present invention is as shown in FIG. 1, medical students, interns, residents, general doctors, majors, or other persons engaged in medical systems (hereinafter referred to as'medical practice') It is a technical field of a system that allows a person to have an experience related to surgery through spatial information, which is a virtual reality, without using tangible objects, and to allow quantitative evaluation through such experiences.

As shown in Figure 1, the medical practitioner wears goggles (goggle, 11), and then provides a virtual reality (virtual reality) to the medical practitioner, the progress of the surgery through the operation of their hands in this virtual reality Based on how close the procedure is to the procedure normally performed by medical professionals who are proficient in the operation, the technical idea of quantitative evaluation is disclosed.

The surgical evaluation system of the virtual reality based otorhinolaryngology and neurosurgery simulator according to the present invention has an otorhinolaryngology surgical evaluation system, as shown in FIG. 1, and in front of such a system, goggles 11 that provide VR and medical practice It may include a controller 12 that reads the motion of the child's hand, that is, moving information in three dimensions.

As described above, the goggles 11 are configured to provide spatial information to the medical practitioner while being mounted on the front face of the medical practitioner.

As the goggles 11, various blank information is provided from a storage in which raw data 13 are stored, and this spatial information is three-dimensional stereoscopic information about the nasal cavity of the otorhinolaryngology system as shown in FIGS. .

In the case of the goggles 11, at least one virtual reality among virtual reality (VR), augmented reality (AR), and mixed reality (MR) may be provided.

In the case of the controller 12, as shown in FIG. 1, it is provided to the hand of a medical practitioner to read the movement of the hand of the medical practitioner, that is, moving information, and the goggles 11 as described above are provided. It is a configuration that maps to spatial information.

In the case of the controller 12, the hands of the medical practitioner can read all the three-dimensional moving information necessary to proceed with the surgery.

It is preferable that the controller 12 be able to grasp a fine motion to read a fine motion that moves within a volume of an adult male fist, rather than encompassing an area having a large radius of action.

In the case of the spatial information receiving unit 100, it is a configuration that receives the spatial information provided by the goggles 11.

In the case of the spatial information receiving unit 100, the 3D stereoscopic information visually provided through the face of the medical practitioner through the goggles 11 is provided.

The spatial information receiving unit 100 may receive the visual elements of the spatial information provided by the virtual reality providing unit 10 to the goggles 11 as it is, and may also abbreviate and accommodate only spatial coordinate information, not visual elements. have.

The moving information receiving unit 200 is configured to receive moving information of a medical practitioner mapped by the controller 12.

The moving information receiving unit 200 is computationally connected to the controller 12 to accommodate the motion of the practitioner's hands, that is, reading moving information, in three-dimensional spatial coordinates.

In the case of the reference data setting unit 300, the spatial information receiving unit 100 obtains and sets desirable moving information to be moved by the medical practitioner, that is, preset reference data, in advance on the spatial information received from the goggles 11 .

Here, in the case of the preset reference data, it corresponds to the average value of traces in three-dimensional coordinates with respect to the desired hand movement of the surgical site that the surgical practitioner is currently experiencing and tested. More specifically, moving information by a plurality of specialists on spatial information is obtained on three-dimensional coordinates, and an average value of traces by moving information by a plurality of specialists is set as preset reference data. .

Naturally, the preset reference data may be obtained after concentrating the controller 12 in a state where a plurality of specialists respectively wear goggles 11.

In the case of the evaluation measurement unit 400, the preset reference data is received from the reference data setting unit 300, the moving information of the medical practitioner is compared on the spatial information as described above, and the moving information of the medical practitioner is preset. It corresponds to the configuration that calculates a quantitative score by comparing it with the reference data (moving information of professional medical staff).

In more detail, in the case of the evaluation measurement unit 400, as shown in FIG. 3, a spatial coordinate recognition unit 410, a moving coordinate recognition unit 420, and a dimension extraction unit 430 may be included.

First, in the case of the spatial coordinate recognition unit 410, the spatial information as shown in FIG. 4 is read and obtained as three-dimensional spatial coordinates.

That is, the spatial information of FIGS. 4 and 5 is obtained by reflecting microscopic coordinate information by a three-dimensional x-y-z axis, in addition to a shape visually or visually confirmed through the goggles 11.

In the case of the moving coordinate recognition unit 420, the three-dimensional spatial coordinates of the moving information in the spatial information to which the moving information is reflected and mapped are acquired according to the change of time.

In the case of the dimension extraction unit 430, a configuration for extracting a predetermined dimension for evaluating moving information on a predetermined surgical site in spatial information.

Referring to FIG. 7, the fail line of FIG. 7 can be set as a blood vessel that should not be touched among surgical sites, and the touch line is incised by a medical practitioner and neatly cut through a mass It can be set to the line that should go out.

In FIG. 7, the predetermined surgical site can be viewed as a touch line, and as described above, in order to determine the hand motion of the medical practitioner, that is, moving information, a predetermined dimension as shown in FIG. 8 is a straight line, that is, a one-dimensional You can also set

For another example, referring to FIG. 10, a solid black line in FIG. 10 means a preferred incision line in which a medical practitioner is required to cut a specific skin surface in the nasal cavity into a weak S-shape through a mass. In this case, a plane orthogonal to the corresponding incision line, that is, a two-dimensional plane is extracted.

Therefore, as described above, a predetermined dimension means a hand gesture of a medical practitioner, that is, a dimension extracted for quantitative evaluation of moving information.

In the case of the dimension extraction unit 430, as illustrated in FIG. 6, a point triggering unit 440 may be further included.

7 and 8, the dimension extraction unit 430 sets a plurality of predetermined dimensions to two one-dimensional lines, in this case, the point triggering unit 440 is previously determined as described above. The surgical site is set as a one-dimensional touch line, and a fail line is set below the touch line having a predetermined depth.

The predetermined depth may be arbitrarily set at the ENT surgical site, and the surface of arteries or veins or nerves under the swollen skin tissue and the swollen skin tissue may be set as a fail line.

Furthermore, in the case of the point triggering unit 440, a target point setting unit 441, a touch line recognition unit 442, and a fail line recognition unit 443 may be included.

In the case of the target point setting unit 441, a surgical site, that is, a predetermined surgical site is set, and spatial information is visually provided through the goggles 11 to the medical practitioner.

If the predetermined surgical site is a specific tissue in the nasal cavity, for example, a ganglion, the target point setting unit 441 visually provides the crystalline species in the nasal cavity through the goggles 11. The medical practitioner can determine the existence of these tissues only by visual observation, and through the visual observation, the medical practitioner can find the crystalline species.

In the case of the touch line recognition unit 442, it is recognized whether the moving information of the medical practitioner input by the controller touches the touch line.

As in the above-described example, if there is a crystalline species in the nasal cavity, the optimal line to be pierced with a mass is cut to recognize the crystalline species as a touch line. Wealth 442 will recognize.

Of course, in the case of the mechanism of the touch line recognition unit 442, it is assumed that spatial information and moving information are coordinated with each other in coordinate coordinate points in a three-dimensional coordinate space.

In the case of the fail line recognition unit 443, the moving information of the medical practitioner input by the controller 12, that is, the 3D coordinate information of the hand gesture, touches a fail line formed below the touch line. Or not.

Referring again through the above-described example, if there is a crystalline species in the nasal cavity, a mass is cut and a best line to be pierced is recognized as a touch line in order to cut the crystalline species, and the mass is cut and the mass is lowered. After going down to, the failline recognition unit 443 recognizes whether or not an area that should not be touched, such as a nerve, an artery, or a vein, is touched.

The fail line recognition unit 443 recognizes only whether the fail line is touched or not, and if there is a touch of the fail line, the failing operation of the medical practitioner is recognized as failing.

Furthermore, the point triggering unit 440 may further include a touch time recognition unit 444, a depth weighting unit 445, and a depth dispersion measurement unit 446.

In the case of medical practitioners, the area to be operated should be incised smoothly through a mass at an appropriate rate, which should take into account the sharpness of the mass blade, the elasticity of the surgical site, tissue bleeding, and moisture evaporation. Because.

Therefore, the speed of the incision is important for the total time that the medical practitioner's moving information stays at the surgical site, and the touch time recognition unit 444 acquires the medical practitioner.

The touch time recognition unit 444 measures the time around which the medical practitioner concentrates the mass and cuts it in the virtual space.

As described above, in the case of the touch line recognition unit 442 and the fail line recognition unit 443, it is possible to determine how well the touch line is cut along and only touches the fail line. Further, the depth weight unit 445 In the case of, the penalties are imparted proportionally according to how much more mass enters the touch line and the mass entered deeper.

In FIG. 8(a), only the recognition of the touch line and the recognition of the fail line are determined. In FIG. 8(b), the depth of the deduction is continuously increased according to the depth from the touch line to the fail line. The weight unit 445 is set.

In the depth dispersion measurement unit 446, the variance of the depth of the moving information inserted in the space from the touch line to the fail line is measured, and the moving information is scored in inverse proportion to the variance.

That is, when the medical practitioner penetrates the touch line through the mass in FIG. 8(b) and the depth of the mass is uneven and fluctuates between the touch line and the fail line, the degree of dispersion increases and the low score increases. On the contrary, even if the mass penetrates through the touch line and before the fail line, if the depth is uniform, a better score is obtained than if it is not uniform.

The evaluation measurement unit 400 may further include a line triggering unit 450 together with or separately from the point triggering unit 440.

As shown in FIG. 10, in the case of the line triggering unit 450, the dimension extracting unit 430 sets a predetermined dimension in two dimensions, but the line triggering unit 450 sets the predetermined surgical area to a two dimensional area. It is a configuration that calculates the distance (l) spaced apart from the origin (c) of the two-dimensional area.

As described above, the solid line in FIG. 10 means preset reference data, that is, a desirable incision line, which is displayed when a plurality of specialists perform surgery.

9 and 10, the line triggering unit 450 includes a target area setting unit 451, a coordinate setting unit 452, a deviation diameter calculating unit 454, and a coordinate shift unit 455. can do.

First, in the case of the target region setting unit 451, the origin c of the two-dimensional area is set as a target region for a predetermined surgical site.

As shown in FIG. 10, in the case of a solid line, a specific surface in the nasal cavity needs to be cut, and this part corresponds to preset reference data.

The incision is set as the origin (c), and another virtual two-dimensional plane perpendicular to the incision line, that is, an area is extracted in a predetermined dimension.

In the case of the coordinate setting unit 452, by setting the two-dimensional area as the xy coordinate as described above, the moving information of the medical practitioner, that is, the part where the mass passes through the nasal cavity, which is a virtual space, passes through FIG. 10. It is recognized as the xy coordinate of. Of course, here, c means the solid line in Fig. 10, and the two-dimensional area corresponds to the area w crossing the solid line.

In the case of the departure diameter calculating unit 454, the distance l from c in the x-y coordinates of the moving information recognized by the coordinate setting unit 452 is measured.

Of course, the larger the distance l separated from the origin c on the x-y coordinate by the departure diameter calculating unit 454, the lower the score is given.

In the case of the coordinate shift unit 455, as shown in FIG. 10, from w to w', the two-dimensional area is shifted to cause the target region setting beam 451 to reset the target region for the surgical site.

Furthermore, in the case of the line triggering unit 450, the touch counting unit 453 may be further included.

In the case of the touch counting unit 453, the number of times the moving information of the medical practitioner touches the x-y coordinate of the 2D area is counted to recognize whether the moving information touches the x-y coordinate of the 2D area multiple times.

In the case of the touch counting unit 453, the number of such incisions is counted because the incision line as shown in FIG. 10 must not be passed twice, that is, the incision should not be performed twice.

In the case of the moving time measuring unit 456, similar to the touch time recognition unit 442, the cutting time of the mass moving along the cutting line of FIG. 10 is measured.

In the case of the reference data backup unit 500, information previously obtained by a plurality of specialists as described above, that is, a desirable mass movement that medical practitioners should imitate, that is, a storage for backing up moving information, which is preset in such storage Reference data may be physically divided and stored.

The scope of rights of the present invention is determined by the matters described in the claims, and the parentheses used in the claims are not used for selective limitation, but are used for clear elements, and the descriptions in parentheses are also interpreted as essential elements. Should be.

Claims

A goggle mounted on the front face of the medical practitioner to visually provide spatial information to the medical practitioner;

A controller provided in the hand of the medical practitioner to map moving information of the motion of the medical practitioner's hand into the spatial information;

A spatial information receiving unit receiving the spatial information provided by the goggles;

A moving information receiver configured to receive the moving information of the medical practitioner mapped by the controller;

A reference data setting unit for pre-acquiring and setting preset reference data for the moving information on the spatial information; And

And an evaluation measurement unit that receives the preset reference data from the reference data setting unit and compares the moving information of the medical practitioner on the spatial information to calculate a quantitative score. .
According to claim 1, The preset reference data,

Otorhinolaryngology surgical evaluation system, characterized in that the moving information provided by a plurality of specialists is obtained in advance and set as an average value of traces in three-dimensional coordinates of moving information by the plurality of specialists on the spatial information.
According to claim 1, wherein the goggles,

Otorhinolaryngology surgical evaluation system, characterized by providing at least one virtual reality of virtual reality (VR), Augmented Reality (AR) or Mixed Reality (MR).
According to claim 1, The evaluation measurement unit,

A spatial coordinate recognition unit that reads and obtains the spatial information in 3D spatial coordinates;

A moving coordinate recognition unit for acquiring 3D spatial coordinates of the moving information in the 3D spatial coordinates of the spatial information; And

And a dimensional extraction unit for extracting a predetermined dimension for evaluation of the moving information on a predetermined surgical site in the spatial information.
According to claim 4, The dimension extraction unit,

Set the predetermined dimension to a plurality of one-dimensional,

The evaluation measurement unit,

A point triggering unit for setting the predetermined surgical site as a one-dimensional touch line, and setting a fail line below a predetermined depth from the touch line is further provided. Otolaryngology surgery evaluation system, characterized in that it comprises.
The method of claim 5, wherein the point triggering unit,

A target point setting unit that sets the predetermined surgical site and provides the spatial information through the goggles;

A touch line recognition unit recognizing whether the moving information of the medical practitioner input by the controller touches the touch line; And

And a fail line recognition unit for recognizing whether or not the moving information of the medical practitioner input by the controller touches the fail line formed below the touch line.
The method of claim 6, wherein the point triggering unit,

A touch time recognition unit acquiring a total time for which the moving information of the medical practitioner stays at the predetermined surgical site;

A depth weighting unit continuously calculating a score of the moving information according to the depth of the moving information inserted into a space extending from the touch line to the failing line, and continuously subtracting the score in proportion to the depth of the moving information; And

And characterized in that it further comprises a depth variance measurement unit for measuring the variance of the depth of the moving information inserted into the space leading from the touch line to the failing line, to give the score of the moving information inversely proportional to the variance, otolaryngology surgery Evaluation system.
According to claim 4, The dimension extraction unit,

Set the predetermined dimension to 2D,

The evaluation measurement unit,

Otolaryngology surgical evaluation system further comprising a line triggering unit for setting the predetermined surgical area in a two-dimensional area and calculating a distance spaced from the origin of the two-dimensional area.
The line triggering unit of claim 8,

A target area setting unit that sets the origin of the two-dimensional area as a target area for the predetermined surgical site;

A coordinate setting unit configured to set the two-dimensional area as x-y coordinates and recognize coordinates in the x-y coordinates of the two-dimensional area of the moving information;

Deviation diameter calculation unit for measuring the distance the moving information is spaced on the x-y coordinates from the origin; And

And a coordinate shift unit configured to shift the two-dimensional area and cause the target region setting unit to reset the target region for the surgical site.
The line triggering unit of claim 9,

Further comprising a touch count unit for counting the number of times the moving information of the medical practitioner touches the xy coordinates of the 2D area, and recognizing whether the moving information touches the xy coordinates of the 2D area multiple times. Otolaryngology surgery evaluation system, characterized by.