KR102143784B1 - System for estimating otorhinolaryngology and neurosurgery surgery based on simulator of virtual reality - Google Patents

Abstract

The present invention is a system for quantitatively evaluating proficiency in otolaryngology or neurosurgery based on virtual reality, comprising: goggles for visually providing spatial information to medical practitioners; A controller configured to map moving information of a hand movement of a medical practitioner into the spatial information; A spatial information receiver for receiving spatial information provided by goggles; A moving information receiver configured to receive moving information of medical practitioners mapped by the controller; A reference data setting unit that obtains and sets preset reference data regarding moving information on the spatial information; And an evaluation and measurement unit that calculates a quantitative score of moving information of a medical practitioner.

Description

System for estimating otorhinolaryngology and neurosurgery surgery based on simulator of virtual reality}

The present invention relates to an ENT and neurosurgery evaluation system, and in more detail, based on virtual reality such as VR (virtual reality), AR (Augmented 　 Reality), MR (Mixed 　 Reality), ENT subjects or neurosurgeons It is a technical field related to the surgical evaluation system for medical students.

Virtual reality (VR) technology is emerging as an alternative to nurturing medical experts and psychological treatment in order to respond to the increasing demand for medical services such as psychological diseases caused by the ultra-aging era and intensifying competition.

The medical field is emerging as an application field of VR that is developing around games, and an attempt is being made to actively introduce VR in hospitals.

The VR technology industry also predicts that medical services will become a representative VR B2B market in the future, and is expanding its sales power by attempting various projects.

Accordingly, there have been a number of technical attempts to combine the educational and medical functions of VR technology, among which, representatively, "Augmented Reality-based laparoscopic surgery simulation system and method using the same (registration number 10-1887805) , Hereinafter referred to as Patent Document 1)" exists.

In the case of Patent Document 1, a simulation system for laparoscopic surgery based on an augmented reality and a method using the same are disclosed. The augmented reality-based simulation system for laparoscopic surgery includes: a laparoscopic surgical tool for generating first laparoscopic surgery information; A simulator module in which a human body model is provided inside and configured to generate second laparoscopic surgery information when it is sensed that the laparoscopic surgical tool cuts the human body model or is inserted into the human body model; An information processing module for generating augmented reality information based on the first laparoscopic surgery information and the second laparoscopic surgery information; And augmented reality glasses to output the augmented reality information. Includes. Accordingly, by using the augmented reality information, the learner simulates laparoscopic surgery or compares the image information on the pre-stored laparoscopic surgery with the laparoscopic surgery simulated by the learner, and the laparoscopic surgery simulated by the learner is pre-stored. Since it is possible to evaluate which information matches the image information, it is possible to effectively hone the surgical skills necessary for laparoscopic surgery.In addition, the educator can easily use the augmented reality information to provide educational 3D contents for laparoscopic surgery. Can be produced.

Similarly, there is also a "laparoscopic surgery education system using augmented reality (Publication No. 10-2018-0123310, hereinafter referred to as Patent Document 2)".

In the case of patent document 2, it relates to a laparoscopic surgery education system using augmented reality that gives the user the feeling of actually performing surgery and allows the user to practice while being guided by the surgical method. To this end, it provides a laparoscopic surgery training system using virtual reality glasses. Accordingly, according to the present invention, it is possible to overcome a reality that is difficult to practice directly and provide an opportunity to deal with the actual internal organs, and thus, there is an advantage of being indirectly effective education for students receiving medical education.

In addition, there is also a "virtual reality training system and method for dentistry (Publication No. 2003-0044909, hereinafter referred to as Patent Document 3)".

In the case of Patent Document 3, the data on the spatial position of an actual element that can be held and written in the hand is sensed, a three-dimensional display of a virtual object is displayed on the screen, and the virtual apparatus corresponding to the actual spatial position of the real element Virtual reality practice for obtaining procedural movements in dentistry by processing spatial location data to provide a spatial indication, providing a virtual instrument that operates on the virtual object, and modeling the interaction between the virtual object and the virtual instrument. For the system. The handheld element is a tactile human-machine interface (IHM) device with an actuator that is controlled to provide force feedback to a user holding the real element in the hand when the virtual instrument interacts with the virtual object. Belongs. The invention is useful for educational or professional purposes.

In addition, there is also a "virtual surgery simulation apparatus and its operation method (Publication No. 10-2016-0092425, hereinafter referred to as Patent Document 4)".

In the case of Patent Document 4, a virtual surgery simulation device is provided. The device may include a control unit for performing a virtual operation on the patient by using a 3D image of a region to be operated on of the patient; An image processing unit generating a surgical image including at least a portion of the virtual surgery process; And a communication unit for transmitting at least one of the surgical image and the surgical result.

However, in the case of these patent documents, most of them exist only in specific medical fields such as orthopedic surgery, plastic surgery, and dentistry, and only a small number of documents related to other medical fields are described. There is a problem that the education method is inefficient because there is no means to do so.

Existing conventional technologies are based on virtual reality, such as VR (virtual reality), AR (Augmented Reality), MR (Mixed Reality), etc., and technical support for specific procedures or surgery by medical students or doctors, or remote medical treatment and diagnosis. Although they had the concept of, trainees, such as medical students, medical specialists, or those who need the latest medical-related practice, go beyond the practice based on VR (virtual reality), AR (Augmented Reality), and MR (Mixed Reality). There was no technical platform to present quantitative evaluation and guidelines.

Registration number 10-1887805 Publication No. 10-2018-0123310 Publication No. 2003-0044909 Publication No. 10-2016-0092425

The surgical evaluation system of the virtual reality-based otolaryngology and neurosurgery simulator according to the present invention has been devised to solve the conventional problems as described above, and presents the following problems to be solved.

First, it is intended to provide a technical system for medical trainees to receive education based on virtual reality, not through physical exercises such as bodies or dolls.

Second, in otolaryngology surgery or neurosurgery, the experience of surgery on major areas of major surgery and quantitative evaluation of this is intended to be obtained.

Third, we intend to allow medical interns to evaluate surgery based on objective data, and share the information with external servers to secure the right to receive high-quality medical services from the public.

The problem of the present invention is not limited to those mentioned above, and other problems not mentioned will be clearly understood by those skilled in the art from the following description.

The surgical evaluation system of the virtual reality-based otorhinolaryngology and neurosurgery simulator according to the present invention has the following problem solving means for the problem to be solved.

The surgical evaluation system of the virtual reality-based otorhinolaryngology and neurosurgery simulator according to the present invention is mounted on a face of a medical practitioner, and visually provides spatial information to the medical practitioner; A controller provided to the medical practitioner's hand to map moving information of the movement of the medical practitioner's hand into the spatial information; A spatial information receiver configured to receive the spatial information provided by the goggles; A moving information receiver configured to receive the moving information of the medical practitioner mapped by the controller; A reference data setting unit for obtaining and setting preset reference data regarding the moving information on the spatial information; And an evaluation and measurement unit configured to receive the preset reference data from the reference data setting unit and calculate a quantitative score by comparing the moving information of the medical practitioner on the spatial information.

The preset reference data of the surgical evaluation system of the virtual reality-based otorhinolaryngology and neurosurgery simulator according to the present invention is obtained by obtaining moving information provided by a plurality of specialists in advance, and by the plurality of specialists on the spatial information. It may be characterized in that it is set as an average value of traces in 3D coordinates of moving information.

The goggles of the surgical evaluation system of the virtual reality-based otolaryngology and neurosurgery simulator according to the present invention provide at least one virtual reality of VR (virtual reality), AR (Augmented 　 Reality), or MR (Mixed 　 Reality). can do.

The evaluation and measurement unit of the surgical evaluation system of the virtual reality-based otolaryngology and neurosurgery simulator according to the present invention includes: a spatial coordinate recognition unit that reads and acquires the spatial information as three-dimensional spatial coordinates; A moving coordinate recognition unit that obtains a three-dimensional spatial coordinate of the moving information within the three-dimensional spatial coordinate of the spatial information; And a dimension extraction unit for extracting a predetermined dimension for evaluating the moving information on a predetermined surgical site in the spatial information.

The dimension extraction unit of the surgical evaluation system of the virtual reality-based otolaryngology and neurosurgery simulator according to the present invention sets the predetermined dimension to a plurality of one-dimensional, but the evaluation measurement unit touches the predetermined surgical site in one dimension. It may be characterized in that it further includes a point triggering unit that is set as a touch line and is set as a fail line below the touch line having a predetermined depth.

The point triggering unit of the surgical evaluation system of the virtual reality-based otorhinolaryngology and neurosurgery simulator according to the present invention includes: a target point setting unit that sets the predetermined surgical site and provides the spatial information through the goggles; A touch line recognition unit for recognizing whether the moving information of the medical practitioner inputted by the controller touches the touch line; And a fail line recognition unit configured to recognize whether the moving information of the medical practitioner input by the controller touches the fail line formed under the touch line.

The point triggering unit of the surgical evaluation system of the virtual reality-based otorhinolaryngology and neurosurgery simulator according to the present invention comprises: a touch time recognition unit for acquiring a total time for the moving information of the medical practitioner to stay at the predetermined surgical site; A depth weighting unit that continuously calculates a score of the moving information according to a depth of the moving information inserted into a space extending from the touch line to the fail line, and continuously reduces a score in proportion to the depth of the moving information; And a depth variance measuring unit that measures a variance of the depth of the moving information inserted into the space extending from the touch line to the fail line and gives a score of the moving information in inverse proportion to the variance. .

The dimension extraction unit of the surgical evaluation system of the virtual reality-based otorhinolaryngology and neurosurgery simulator according to the present invention sets the predetermined dimension as two-dimensional, and the evaluation and measurement unit sets the predetermined surgical site as a two-dimensional area, and , It may be characterized in that it further comprises a line triggering unit for calculating a distance separated from the origin of the two-dimensional area.

The line triggering unit of the surgical evaluation system of the virtual reality-based otorhinolaryngology and neurosurgery simulator according to the present invention includes: a target area setting unit for setting an origin of the two-dimensional area as a target area for the predetermined surgical site; A coordinate setting unit configured to set the 2D area as an x-y coordinate and recognize a coordinate within the x-y coordinate of the 2D area of the moving information; A departure diameter calculator configured to measure a distance in which the moving information is separated from the origin on the x-y coordinate; And a coordinate shifting unit for shifting the two-dimensional area and causing the target area setting unit to reset a target area for the surgical site.

The line triggering unit of the surgical evaluation system of the virtual reality-based otorhinolaryngology and neurosurgery simulator according to the present invention counts the number of times that the moving information of the medical practitioner touches the xy coordinate of the two-dimensional area, and the moving information is the It may be characterized in that it further comprises a touch count unit for recognizing whether the xy coordinate of the 2D area is touched a plurality of times.

The surgical evaluation system of the virtual reality-based otorhinolaryngology and neurosurgery simulator according to the present invention having the above configuration provides the following effects.

First, it allows medical students to experience various experiences based on virtual reality, such as VR (virtual reality), AR (Augmented 　 Reality), and MR (Mixed 　 Reality).

Second, for medical students to perform surgery on a specific area in virtual reality, such as VR (virtual reality), AR (Augmented Reality), and MR (Mixed Reality), they can perform surgery on a specific area and receive a quantitative evaluation. Provides a system to do.

Third, it is possible to benchmark how far VR (virtual reality), AR (Augmented 　 Reality), MR (Mixed 　 Reality), etc. for medical trainees deviated from the standard data of the existing medical staff.

The effects of the present invention are not limited to those mentioned above, and other effects not mentioned will be clearly understood by those skilled in the art from the following description.

1 is a conceptual diagram of a surgical evaluation system of a virtual reality-based otorhinolaryngology and neurosurgery simulator according to an embodiment of the present invention.
2 is a block diagram of a surgical evaluation system of a virtual reality based otolaryngology and neurosurgery simulator according to an embodiment of the present invention.
FIG. 3 is a block diagram showing sub-components of an evaluation measurement unit, which is one of the components of a surgical evaluation system of a virtual reality based otolaryngology and neurosurgery simulator according to an embodiment of the present invention.
4 is an exemplary screen of virtual reality that medical trainees can access through VR or the like for use of a surgical evaluation system of a virtual reality-based otorhinolaryngology and neurosurgery simulator according to an embodiment of the present invention.
5 is an exemplary screen of virtual reality that medical trainees can encounter through AR or MR for use of a surgical evaluation system of a virtual reality-based otorhinolaryngology and neurosurgery simulator according to an embodiment of the present invention.
FIG. 6 is a block diagram showing sub-components of a point triggering unit that is a component of a surgical evaluation system of a virtual reality-based otolaryngology and neurosurgery simulator according to an embodiment of the present invention.
7 is a front sectional view showing a touch line and a fail line for a target point by a point triggering unit of a surgical evaluation system of a virtual reality-based otolaryngology and neurosurgery simulator according to an embodiment of the present invention .
8 is a side cross-sectional view illustrating a touch line and a fail line for a target point by a point triggering unit of a surgical evaluation system of a virtual reality-based otolaryngology and neurosurgery simulator according to an embodiment of the present invention. .
9 is a block diagram showing the sub-components of a line triggering unit that is a component of a surgical evaluation system of a virtual reality-based otolaryngology and neurosurgery simulator according to an embodiment of the present invention.
10 is a conceptual diagram showing coordinates of a target area of a line triggering unit, which is a component of a surgical evaluation system of a virtual reality-based otolaryngology and neurosurgery simulator according to an embodiment of the present invention.

The surgical evaluation system of the virtual reality-based otorhinolaryngology and neurosurgery simulator according to the present invention can make various changes and have various embodiments. Specific embodiments are illustrated in the drawings and will be described in detail in the detailed description. However, this is not intended to limit the present invention to specific embodiments, and should be understood to include all modifications, equivalents, and substitutes included in the technical spirit and technical scope of the present invention.

1 is a conceptual diagram of a surgical evaluation system of a virtual reality-based otorhinolaryngology and neurosurgery simulator according to an embodiment of the present invention. 2 is a block diagram of a surgical evaluation system of a virtual reality based otolaryngology and neurosurgery simulator according to an embodiment of the present invention. FIG. 3 is a block diagram showing sub-components of an evaluation measuring unit, which is one of the components of a surgical evaluation system of a virtual reality based otolaryngology and neurosurgery simulator according to an embodiment of the present invention. 4 is an exemplary screen of virtual reality that medical trainees can access through VR or the like for use of a surgical evaluation system of a virtual reality-based otorhinolaryngology and neurosurgery simulator according to an embodiment of the present invention. 5 is an exemplary screen of virtual reality that medical trainees can encounter through AR or MR for use of a surgical evaluation system of a virtual reality-based otorhinolaryngology and neurosurgery simulator according to an embodiment of the present invention. 6 is a block diagram showing the sub-components of a point triggering unit, which is a component of a surgical evaluation system of a virtual reality based otolaryngology and neurosurgery simulator according to an embodiment of the present invention. 7 is a front sectional view showing a touch line and a fail line for a target point by a point triggering unit of a surgical evaluation system of a virtual reality-based otolaryngology and neurosurgery simulator according to an embodiment of the present invention . 8 is a side sectional view showing a touch line and a fail line for a target point by a point triggering unit of a surgical evaluation system of a virtual reality-based otolaryngology and neurosurgery simulator according to an embodiment of the present invention . 9 is a block diagram showing the sub-components of a line triggering unit, which is a component of a surgical evaluation system of a virtual reality-based otolaryngology and neurosurgery simulator according to an embodiment of the present invention. 10 is a conceptual diagram showing coordinates of a target area of a line triggering unit, which is a component of a surgical evaluation system of a virtual reality-based otolaryngology and neurosurgery simulator according to an embodiment of the present invention.

As shown in Figure 1, the surgical evaluation system of the virtual reality-based otolaryngology and neurosurgery simulator according to the present invention is a medical student, an intern, a resident, a general doctor, a doctor or a person engaged in other medical systems (hereinafter,'medical practice It is a technical field related to a system that allows a person to have surgery-related experiences through spatial information, which is virtual reality, without using tangible objects, and allows quantitative evaluation through such experiences.

As shown in FIG. 1, after wearing goggles 11, medical practitioners provide virtual reality to medical practitioners to proceed with surgery through their hand movements in this virtual reality. It discloses a technical idea for a quantitative evaluation based on how close the process is to the surgical process commonly performed by professional medical staff proficient in the operation.

As shown in FIG. 1, the surgical evaluation system of the virtual reality-based otolaryngology and neurosurgery simulator according to the present invention includes an otolaryngology surgical evaluation system, and in front of such a system, goggles 11, which is an equipment providing VR, and medical practice It may include a controller 12 that reads the user's hand motion, that is, moving information in three dimensions.

As described above, the goggles 11 are mounted on the front face of the medical practitioner and provide spatial information to the medical practitioner.

The goggles 11 are provided with various ball information from a storage in which raw data 13 is stored, and this spatial information is three-dimensional three-dimensional information about the nasal cavity of the otolaryngology system as shown in FIGS. 4 and 5 .

In the case of the goggles 11, at least one or more of virtual reality (VR), augmented reality (AR), and mixed reality (MR) may be provided.

In the case of the controller 12, as shown in FIG. 1, it is provided to the hands of the medical practitioner to read the movement of the hands of the medical practitioner, that is, moving information, and the goggles 11 are provided as described above. It is a configuration that maps to spatial information to be performed.

In the case of the controller 12, a medical practitioner's hand may perform an operation and read all three-dimensional moving information necessary for performing an operation.

It is preferable that the controller 12 can grasp a delicate motion so that it can read a minute motion moving within a single volume of an adult male's fist, rather than covering an area having a large motion radius.

In the case of the spatial information receiving unit 100, it is a configuration that receives the spatial information provided by the goggles (11).

In the case of the spatial information receiving unit 100, the three-dimensional three-dimensional information visually provided through the face of the medical practitioner is provided through the goggles 11.

The spatial information receiving unit 100 may receive the visual element of the spatial information provided by the virtual reality providing unit 10 to the goggles 11 as it is, and may receive only spatial coordinate information rather than a visual element. have.

In the case of the moving information receiving unit 200, the controller 12 is configured to receive moving information of a medical practitioner mapped by the controller 12.

The moving information receiving unit 200 is electronically connected to the controller 12, so that the controller 12 receives the practitioner's hand motion, that is, reading the moving information in three-dimensional space coordinates.

In the case of the reference data setting unit 300, the spatial information receiving unit 100 obtains and sets in advance desirable moving information that the medical practitioner should move on the spatial information received from the goggles 11, that is, preset reference data. .

Here, in the case of preset reference data, it corresponds to the average value of traces in 3D coordinates for the desired hand movement of the surgical site that the surgical practitioner currently experiences and is tested. In more detail, moving information by a plurality of specialists on spatial information is acquired on 3D coordinates, and the average value of the traces by moving information by the plurality of specialists is set as preset reference data. .

Naturally, the preset reference data may be obtained after a plurality of specialists operate the controller 12 in a state of wearing goggles 11, respectively.

In the case of the evaluation and measurement unit 400, preset reference data is received from the reference data setting unit 300, and the moving information of the medical practitioner is preset by comparing the moving information of the medical practitioner on the spatial information as described above. It is a component that calculates a quantitative score by comparing it with reference data (moving information of professional medical staff).

In more detail, the evaluation and measurement unit 400 may include a spatial coordinate recognition unit 410, a moving coordinate recognition unit 420, and a dimension extraction unit 430, as shown in FIG. 3.

First, in the case of the spatial coordinate recognition unit 410, it is a configuration that reads and acquires spatial information as shown in FIG. 4 as three-dimensional spatial coordinates.

That is, the spatial information of FIGS. 4 and 5 is obtained by reflecting not only a shape that can be visually or visually confirmed by a person through the goggles 11, but also microscopic coordinate information by a three-dimensional x-y-z axis.

In the case of the moving coordinate recognition unit 420, the moving information is reflected and three-dimensional spatial coordinates of the moving information in the mapped spatial information are acquired according to the transition of time.

In the case of the dimension extraction unit 430, it is a configuration that extracts a predetermined dimension for evaluation of moving information on a predetermined surgical site within spatial information.

Referring to FIG. 7, the fail line of FIG. 7 can be set as a blood vessel that must not be touched among the surgical sites, and the touch line is performed by a medical practitioner and neatly incised through a mass. It can be set to the line that should exit.

In FIG. 7, the predetermined surgical site can be viewed as a touch line, and as described above, in order to determine the hand motion of the medical practitioner, that is, moving information, a predetermined dimension as shown in FIG. You can also set it to.

For another example, referring to FIG. 10, a solid black line in FIG. 10 means a preferred incision line in which a medical practitioner must cut a specific skin surface in the nasal cavity in a weak S-shape through a mass. In this case, a plane orthogonal to the cut line, that is, a two-dimensional plane is extracted.

Therefore, as described above, the predetermined dimension means a dimension extracted for quantitative evaluation of the medical practitioner's hand motion, that is, moving information.

In the case of the dimension extraction unit 430, as shown in FIG. 6, a point triggering unit 440 may be further included.

7 and 8, the dimension extraction unit 430 sets a plurality of predetermined dimensions, in this case, two one-dimensional lines, and in this case, the point triggering unit 440 is determined in advance as described above. The surgical site is set as a one-dimensional touch line, and a fail line is set in the lower part having a predetermined depth from the touch line.

Here, the predetermined depth may be arbitrarily set at the site of the otolaryngology surgery, and the surface of arteries, veins, or nerves under the swollen skin tissue in the nasal cavity and the swollen skin tissue may be set as a line.

Further, the point triggering unit 440 may include a target point setting unit 441, a touch line recognition unit 442, and a fail line recognition unit 443.

In the case of the target point setting unit 441, an operation site, that is, a predetermined operation site is set, and spatial information is visually provided to a medical practitioner through the goggles 11.

If the predetermined surgical site is a specific tissue in the nasal cavity, for example, a ganglion, the target point setting unit 441 visually provides the intranasal crystal species through the goggles 11. The medical practitioner can determine the existence or absence of such tissues only by visual observation, and through such visual observation, the medical practitioner finds the crystal species.

In the case of the touch line recognition unit 442, it is recognized whether the moving information of the medical practitioner inputted by the controller touches the touch line.

As in the above example, if there is a crystal species in the nasal cavity, in order to incise the crystal species, the optimal line to be cut and pierced by the mass is recognized as a touch line, and whether or not such a battery line is touched is recognized by the touch line. The unit 442 will recognize.

Of course, in the case of such a mechanism of the touch line recognition unit 442, it is assumed that spatial information and moving information are mutually interlocked with coordinate points in a three-dimensional coordinate space.

In the case of the fail line recognition unit 443, moving information of the medical practitioner input by the controller 12, that is, 3D coordinate information of the hand motion, touches a fail line formed under the touch line. Whether or not.

When explained again through the above-described example, if there is a crystal species in the nasal cavity, the mass is incised to cut the crystal species and the optimum line to be pierced is recognized as a touch line. After descending to, the failline recognition unit 443 recognizes whether or not an area that should never be touched, such as a nerve, an artery, or a vein, is touched.

The fail line recognition unit 443 only recognizes whether or not the fail line is touched, and if there is a touch of the fail line, it recognizes that the operation of the medical practitioner has failed.

Furthermore, the point triggering unit 440 may further include a touch time recognition unit 444, a depth weighting unit 445, and a depth dispersion measurement unit 446.

In the case of medical practitioners, the area to be operated should be incised smoothly through the mass at an appropriate speed, which should take into account the sharpness of the blade of the mass, the elasticity of the surgical site, bleeding of the tissue, and evaporation of water. Because.

Accordingly, the speed of the incision is the total time that the moving information of the medical practitioner stays at the surgery site, and the touch time recognition unit 444 obtains the time by the medical practitioner.

The touch time recognition unit 444 measures the time in which the medical practitioner picks up the mass and cuts it in a virtual space.

As described above, in the case of the touch line recognition unit 442 and the fail line recognition unit 443, it is possible to grasp only how well the touch line is cut along and touch the fail line, and further, the depth weighting unit 445 In the case of, the mass that pierces the touch line and enters deeper is given a deduction in proportion to how much more the mass enters from the touch line.

In Fig. 8(a), only whether or not the touch line is recognized and whether or not the fail line is recognized is determined. In Fig. 8(b), the depth of the deduction is continuously increased according to the degree of depth from the touch line to the fail line. The weight unit 445 is set.

In the case of the depth variance measurement unit 446, the variance of the depth of moving information inserted in the space extending from the touch line to the fail line is measured, and points are given to the moving information in inverse proportion to the variance.

That is, in FIG. 8(b), after a medical practitioner penetrates the touch line through the mass, if the depth of the mass between the touch line and the fail line is uneven and goes up and down, the degree of dispersion increases and the score is low. Conversely, even if the mass penetrates through the touch line and before the fail line, if the depth is uniform, the score is better than the case where it is not uniform.

The evaluation measurement unit 400 may further include a line triggering unit 450 together with or separately from the point triggering unit 440.

As shown in FIG. 10, in the case of the line triggering unit 450, the dimension extraction unit 430 sets a predetermined dimension to two-dimensional, but the line triggering unit 450 sets a predetermined surgical site to a two-dimensional area. It is set, and the distance (l) separated from the origin (c) of the two-dimensional area is calculated.

As described above, the solid line in FIG. 10 means preset reference data, that is, a preferred incision line, which is indicated when a plurality of specialists perform an operation and perform an operation.

To this end, as shown in FIGS. 9 and 10, the line triggering unit 450 includes a target region setting unit 451, a coordinate setting unit 452, a departure diameter calculation unit 454, and a coordinate shift unit 455. can do.

First, in the case of the target region setting unit 451, the origin c of the two-dimensional area is set as a target region for a predetermined surgical site.

As shown in FIG. 10, in the case of a solid line, a specific surface in the nasal cavity is to be cut, and this part corresponds to preset reference data.

This incision is set as the origin (c), and another virtual two-dimensional plane, that is, an area perpendicular to the incision line, is extracted to a predetermined dimension.

In the case of the coordinate setting unit 452, the two-dimensional area as described above is set as xy coordinates, and moving information of the medical practitioner, that is, the part where the mass passes by cutting in the nasal cavity, which is a virtual space, is shown in FIG. Is recognized as the xy coordinate of. Of course, c here means the solid line of FIG. 10, and the two-dimensional area corresponds to the area w that crosses the solid line.

In the case of the deviation diameter calculation unit 454, the distance l separated from c in the x-y coordinate of the moving information recognized by the coordinate setting unit 452 is measured.

Of course, by the departure diameter calculation unit 454, the moving information of the medical practitioner is given a lower score as the distance (l) separated from the origin (c) on the x-y coordinate increases.

In the case of the coordinate shifting unit 455, as moving from w to w'in FIG. 10, the two-dimensional area is shifted, and the target area setting beam 451 resets the target area for the surgical site.

Furthermore, the line triggering unit 450 may further include a touch count unit 453.

In the case of the touch counting unit 453, the number of times the moving information of the medical practitioner touches the x-y coordinate of the 2D area is counted, and recognizes whether the moving information touches the x-y coordinate of the 2D area a plurality of times.

In the case of the touch counting unit 453, since the incision line as shown in FIG. 10 must not be passed twice, that is, the incision should not be made twice, the number of such incisions is counted.

In the case of the moving time measurement unit 456, similar to the touch time recognition unit 442, the cutting time of the mass moving along the cutting line of FIG. 10 is measured.

In the case of the reference data backup unit 500, as a storage for backing up information previously acquired by a plurality of specialists, that is, desirable mass movements that medical practitioners should imitate as much as possible, that is, moving information, preset in this storage The reference data can be physically divided and stored.

The scope of rights of the present invention is determined by the matters described in the claims, and the parentheses used in the claims are not described for selective limitation, but are used for clear components, and the descriptions in parentheses are also interpreted as essential components. Should be.

1: surgical mass 10: virtual reality providing unit
11: goggle 12: controller
13: raw data 20: data management unit
21: database 22: folder
23: website
100: spatial information receiving unit 101: central control unit
102: backup storage 200: moving information receiver
300: reference data setting unit 400: evaluation measurement unit
410: spatial coordinate recognition unit 420: moving coordinate recognition unit
430: dimension extraction unit 440: point triggering unit
441: target point setting unit 442: touch line recognition unit
443: failline recognition unit 444: touch time recognition unit
445: depth weighting unit 446: depth dispersion measuring unit
450: line triggering unit 451: target area setting unit
452: coordinate setting unit 453: touch count unit
454: deviation diameter calculation unit 455: coordinate shift unit
456: moving time measurement unit 500: reference data backup unit

Claims (10)

Goggles that are mounted on a front face of a medical practitioner and visually provide spatial information to the medical practitioner;
A controller provided to the medical practitioner's hand to map moving information of the movement of the medical practitioner's hand into the spatial information;
A spatial information receiver configured to receive the spatial information provided by the goggles;
A moving information receiver configured to receive the moving information of the medical practitioner mapped by the controller;
A reference data setting unit for obtaining and setting preset reference data regarding the moving information on the spatial information; And
Including an evaluation and measuring unit for receiving the preset reference data from the reference data setting unit, and calculating a quantitative score by comparing the moving information of the medical practitioner on the spatial information,
The evaluation measurement unit,
A spatial coordinate recognition unit that reads and obtains the spatial information as three-dimensional spatial coordinates;
A moving coordinate recognition unit that obtains a three-dimensional spatial coordinate of the moving information within the three-dimensional spatial coordinate of the spatial information; And
A dimension extraction unit for extracting a predetermined dimension for evaluating the moving information on a predetermined surgical site in the spatial information,
The dimension extraction unit,
Setting the predetermined dimension to a plurality of one-dimensional,
The evaluation measurement unit,
A point triggering unit for setting the predetermined surgical site as a one-dimensional touch line, and setting as a fail line at a lower portion having a predetermined depth from the touch line It characterized in that it comprises, ENT surgery evaluation system.
Goggles that are mounted on a front face of a medical practitioner and visually provide spatial information to the medical practitioner;
A controller provided to the medical practitioner's hand to map moving information of the movement of the medical practitioner's hand into the spatial information;
A spatial information receiver configured to receive the spatial information provided by the goggles;
A moving information receiver configured to receive the moving information of the medical practitioner mapped by the controller;
A reference data setting unit for obtaining and setting preset reference data regarding the moving information on the spatial information; And
Including an evaluation and measuring unit for receiving the preset reference data from the reference data setting unit, and calculating a quantitative score by comparing the moving information of the medical practitioner on the spatial information,
The evaluation measurement unit,
A spatial coordinate recognition unit that reads and obtains the spatial information as three-dimensional spatial coordinates;
A moving coordinate recognition unit that obtains a three-dimensional spatial coordinate of the moving information within the three-dimensional spatial coordinate of the spatial information; And
A dimension extraction unit for extracting a predetermined dimension for evaluating the moving information on a predetermined surgical site in the spatial information,
The dimension extraction unit,
Set the predetermined dimension to two-dimensional,
The evaluation measurement unit,
Further comprising a line triggering unit for setting the predetermined surgical site as a two-dimensional area and calculating a distance separated from the origin of the two-dimensional area,
The line triggering unit,
A target area setting unit that sets the origin of the two-dimensional area as a target area for the predetermined surgical site;
A coordinate setting unit that sets the 2D area as xy coordinates and recognizes coordinates within the xy coordinate of the 2D area of the moving information;
A departure diameter calculator configured to measure a distance in which the moving information is separated from the origin on the xy coordinate; And
By shifting the two-dimensional area, the target region setting unit comprises a coordinate shift unit for resetting a target region for the surgical site, otolaryngology surgery evaluation system.
The method of claim 1, wherein the point triggering unit,
A target point setting unit that sets the predetermined surgical site and provides the spatial information through the goggles;
A touch line recognition unit for recognizing whether the moving information of the medical practitioner inputted by the controller touches the touch line; And
And a fail line recognition unit for recognizing whether the moving information of the medical practitioner inputted by the controller touches the fail line formed under the touch line.
The method of claim 3, wherein the point triggering unit,
A touch time recognition unit for acquiring a total time during which the moving information of the medical practitioner stays at the predetermined surgical site;
A depth weighting unit that continuously calculates a score of the moving information according to a depth of the moving information inserted into a space extending from the touch line to the fail line, and continuously reduces a score in proportion to the depth of the moving information; And
Otolaryngology surgery, characterized in that it further comprises a depth variance measurement unit that measures the variance of the depth of the moving information inserted into the space extending from the touch line to the fail line and gives a score of the moving information in inverse proportion to the variance Evaluation system.
The method of claim 2, wherein the line triggering unit,
Further comprising a touch count unit for counting the number of times the moving information of the medical practitioner touches the xy coordinate of the 2D area, and recognizing whether the moving information touches the xy coordinate of the 2D area a plurality of times Characterized in, ENT surgery evaluation system.
The method of claim 1 or 2, wherein the preset reference data,
Moving information provided by a plurality of specialists is obtained in advance and is set as an average value of traces in three-dimensional coordinates of the moving information by the plurality of specialists on the spatial information.
The method of claim 1 or 2, wherein the goggles,
VR (virtual reality), AR (Augmented Reality), or MR (Mixed Reality), characterized in that it provides at least one or more virtual reality, ENT surgery evaluation system.
delete delete delete

Images