TWI522975B - Automatic scoring method applying to the cutting and dissection skills training of minimally invasive surgery - Google Patents

Description

Automatic scoring method for training in minimally invasive surgery

The present invention relates to a training method for minimally invasive surgery, in particular to an automatic scoring method for training in minimally invasive surgery.

Minimally invasive surgery is a technique in which the inside of the incision is observed through a small incision and through an endoscope and various imaging techniques, so that the surgeon can still perform the surgery without causing a huge wound to the patient. Complete the operation. Minimally invasive surgery is currently the new mainstream of global surgical surgery because of the small incision of the patient, which can reduce the pain and bleeding of the patient, and make the wound heal after healing, and reduce the second degree of trauma and infection in the operation.

In minimally invasive surgery, laparoscopic surgery is the earliest and most mature application area. For surgeons, laparoscopic surgery has become an important item for physician training. However, since laparoscopic surgery requires a lot of practice, the actual surgery can be performed. So far, laparoscopic surgery has the following training methods: The first type is the physical training method. The trainees need to operate the actual equipment and perform the skills training during the operation, such as clamping, cutting or sewing. However, due to cost and safety considerations, beginners will first train with alternative methods such as locating beans and sewing sponges. The second category is the training method of virtual surgery, which uses virtual reality technology, virtual It is similar to the training of peas and sewing sponges. However, the first type of method is mainly subjective scoring at this stage. The trainer observes the trainee's training process and then proposes the direction of improvement. This method is quite lacking in objectivity in addition to the considerable labor cost. . The second type of method, although it can provide objective assessment, is a virtual world after all, so the physical response of touch, force feedback and muscle tissue can not provide complete information compared with the actual surgery. More importantly, the first category lacks an objective scoring method. The second type of training machine is currently at a relatively high price, requires extremely high cost, and cannot provide an effective scoring method.

Therefore, how to reduce the manufacturing cost of the surgical training device and provide a scoring method for the trainer and its instructor to refer to their training results is a problem to be solved in the technical field.

It is an object of the present invention to provide an objective automatic scoring method for training in minimally invasive surgical cutting techniques.

In order to achieve the above objective, the present invention provides an automatic scoring method for training a minimally invasive surgical cutting technique, comprising: providing a first object, a second object, and a surgical instrument, wherein the first object has a first a color area, the second object has a second color area, the first object is superposed on the second object and one of the second color areas is covered by the first color area, and the first color area is available a subject uses a surgical instrument for cutting; providing an imaging device that captures an overlapping state of the first color region and the second color region before the subject cuts the first color region to generate an initial image; a display interface electrically connected to the camera device for displaying an initial picture and an operation screen; providing an image processing unit electrically connected to the display interface, the image processing unit being the first of the plurality of initial pictures The color area is converted into a first pixel value, and the second color area is converted into a second pixel value; the camera device captures the overlapping state of the first color area and the second color area after the subject cuts the first color area, And generating a completion screen on the display interface; the image processing unit converts the first color area in the plurality of completed pictures into a third pixel value, and converts the second color area into a fourth pixel value; providing a scoring unit And calculating by using the first pixel value, the second pixel value, the third pixel value, and the fourth pixel value, and obtaining a skill rating of the subject operating the surgical instrument.

In an embodiment, the automatic scoring method applied to the minimally invasive surgery cutting skill training further includes: the camera device captures the first color region before the plurality of cuts and the second color region before the plurality of cuts; The processing unit filters the first color regions before the clipping and removes the noise, and then converts the plurality of first color values into a plurality of first pixel values, and filters the second color regions before the clipping and removes the noise, and then converts the noise into A plurality of second pixel values.

In an embodiment, the automatic scoring method applied to the minimally invasive surgery cutting skill training further includes: the camera device captures the plurality of cut first color regions and the plurality of cut second color regions; The processing unit filters the first color regions after the clipping and removes the noise, and converts the noise into a plurality of third pixel values, and filters and removes the cut second color regions into a plurality of noises. The fourth pixel value.

In an embodiment, the step of converting the second color region into the second pixel value by the image processing unit defines that the second pixel value is equal to zero.

In an embodiment, the automatic scoring method applied to the minimally invasive surgery cutting skill training further comprises: the scoring unit calculates an interval interval between the shooting initial screen and the shooting completion screen, and displays the interval time on the display interface.

In an embodiment, the automatic scoring method applied to the training of the minimally invasive surgery cutting skill further comprises: the scoring unit provides a formula to calculate the operation skill rating, and the formula is: Wherein Rp is the first pixel value, Ra is the third pixel value, and Ba is the fourth pixel value; and the calculated skill rating is displayed on the display interface.

In an embodiment, the automatic scoring method applied to the training of the minimally invasive surgery cutting skill further comprises: the scoring unit provides a formula to calculate the operation skill rating, and the formula is: Wherein Rp is an average value of the first pixel value, Ra is an average value of the third pixel value, and Ba is an average value of the fourth pixel value; and the calculated skill rating is displayed on the display interface.

100‧‧‧ computer

110‧‧‧ camera

120‧‧‧Image Processing Unit

130‧‧‧Display interface

200‧‧‧ scoring unit

300‧‧‧Operation platform

310‧‧‧Surgical instruments

311‧‧‧ clip

312‧‧‧ scissors

320‧‧‧First object

321‧‧‧First color area

330‧‧‧Second object

331‧‧‧Second color area

FIG. 1 is a training device and an operation platform for performing a scoring method applied to a minimally invasive surgery cutting skill training according to the present invention.

2 is a first object and a second object of the present invention.

FIG. 3 is a flow chart of the automatic scoring method for the minimally invasive surgery cutting skill training of the present invention.

4 is a display screen in a display interface according to an embodiment of the present invention.

Figure 5 is a method for the scoring unit to calculate the simulated operation minimally invasive surgery skills.

The above and other technical contents, features and advantages of the present invention will be apparent from the following detailed description of the preferred embodiments. The following examples The directional terms mentioned in the above, such as: up, down, left, right, front or back, etc., are only used to refer to the direction of the accompanying drawings. Therefore, the directional terms are used for illustration only and are not intended to limit the invention.

Please refer to FIG. 1 , which is a training device and an operation platform for performing a scoring method applied to minimally invasive surgery cutting skill training according to an embodiment of the present invention. In order to perform a scoring method applied to minimally invasive surgical cutting skill training, the present invention utilizes a computer 100 to perform a scoring unit 200 and provides an operating platform 300 for the subject and his or her instructor to refer to their operational situation. The computer hardware architecture for performing the scoring method applied to the minimally invasive surgery cutting skill training is as follows. The scoring unit 200 is installed in the computer 100. The computer 100 includes a camera device 110, an image processing unit 120, and a display interface 130 electrically connected to each other. The operating platform 300 provides a surgical instrument 310, a first object 320 and a second object 330. The surgical instrument 310 includes a clip 311 and a pair of scissors 312, and the first object 320 and the second object 330 are respectively a color paper. Please refer to FIG. 2, which is a first object 320 and a second object 330 according to an embodiment of the present invention. The first object 320 covers the second object 330. The first object 320 includes a first color area 321 and the second object 330 includes a second color area 331. The first color area 321 is smaller than the second color area. 331.

3 and FIG. 4, FIG. 3 is a flowchart of an automatic scoring method applied to minimally invasive surgical cutting skill training according to an embodiment of the present invention, and FIG. 4 is a display interface according to an embodiment of the present invention. Display the screen.

Step S110: The imaging device 110 captures an initial screen 400 of the overlapping state of the first color region 321 and the second color region 331 before cutting to be displayed on the display interface 130.

Step S120: The image processing unit 120 filters the plurality of initial screens 400. And removing the noise, converting the processed first color region 321 into a first pixel value, and converting the second color region 331 into a second pixel value, and displaying the first object 320 in the initial screen 400 covering the second pixel Above the object 330, since only the first color region 321 can be captured, the second pixel value is defined to be equal to zero.

Step S130: Start operating the operation platform 300 for minimally invasive surgery training, and the subject views and holds the operation clip 311 and the scissors 312 through the display interface 130 to cut the first color region 321 on the first object 320.

Step S140: The camera device 110 captures a cutting process and displays it on the display interface 130 in synchronization.

Step S150: The camera device 110 captures a completed screen 410, and the image processing unit 120 filters and removes the noise from the plurality of completed images 410, and converts the processed first color region 321 into a third pixel value, and second. The color area 331 is converted into a fourth pixel value.

Step S160: The scoring unit 200 performs calculation by using the processed first pixel value, the second pixel value, the third pixel value, and the fourth pixel value, for example, using an average of the first pixel value of the initial picture and the plurality of completed pictures. The value, the average of the second pixel value, the average of the third pixel value, and the average of the fourth pixel value are calculated, and a skill rating of the subject operating the surgical instrument 310 is calculated and displayed on the display interface 130.

Step S170: The scoring unit 200 calculates an interval time from the shooting initial screen 400 to the shooting completion screen 410, and displays the interval time on the display interface 130.

As shown in FIG. 5, the scoring unit 200 of step S160 calculates a skill evaluation method for operating the minimally invasive surgical shearing device. The scoring unit 200 provides a formula to calculate a skill rating, which is: Wherein Rp is an average value of the first pixel value or the first pixel value, Ra is an average value of the third pixel value or the third pixel value, and Ba is an average value of the fourth pixel value or the fourth pixel value. The final scoring unit 200 displays the skill rating on the display interface 130.

In the present embodiment, the first color region 321 completely covers the second color region 331 so that the second pixel value is equal to zero. When the cut is completed, the first pixel value is equal to the third pixel value, and when the second pixel value is equal to 0, the skill rating is 0%. That is, the initial picture is the same as the completed picture, and the first object 320 is not clipped.

If the third pixel value is equal to 0, and the first pixel value is equal to the fourth pixel value, the skill rating is 100%. That is, the first color region 321 in the first object 320 is completely cut.

If the third pixel value is equal to 0.1 times the first pixel value, and the fourth pixel value is equal to 0.9 times the first pixel value, the skill rating is 90%. That is to say, the first color area 321 cut out is slightly less.

If the third pixel value is equal to 0, and the fourth pixel value is equal to 1.2 times the first pixel value, the skill rating is 80%. That is to say, the cut first color area 321 is slightly larger.

If the third pixel value is equal to 0.5 times the first pixel value, and the fourth pixel value is equal to 0.5 times the first pixel value, the skill rating is 50%.

If the third pixel value is equal to 0.2 times the first pixel value, and the fourth pixel value is equal to 1.2 times the first pixel value, the skill rating is 48%.

If the third pixel value is equal to the first pixel value and the fourth pixel value is equal to the first pixel value, the skill rating is 0%. That is, although the first object 320 is cut but not cut to the first color Color area 321.

The present invention proposes a set of scoring units for the subject to train and evaluate the cutting skills in laparoscopic surgery, and provides an automatic scoring function, the subject operates the machinery in the operating platform, and the colored paper (or other materials as required). Cut into the specified shape, the scoring unit will record the operation time of the subject, and finally use the image recognition method to score the results of the test. The scoring unit evaluates the shape of the cut by using two upper and lower objects or materials of different colors to evaluate the shearing technique by the ratio of the areas between the different colors. Therefore, the present invention mainly proposes a new training method for the shearing technique in entity training, and performs objective scoring by image processing technology, improves past training methods and evaluation deficiencies, and provides a function of training software and objective scoring.

The above is only the preferred embodiment of the present invention, and the scope of the invention is not limited thereto, that is, the simple equivalent changes and modifications made by the scope of the invention and the description of the invention are All remain within the scope of the invention patent. In addition, any of the objects or advantages or features of the present invention are not required to be achieved by any embodiment or application of the invention. In addition, the abstract sections and headings are only used to assist in the search of patent documents and are not intended to limit the scope of the invention.

100‧‧‧ computer

110‧‧‧ camera

120‧‧‧Image Processing Unit

130‧‧‧Display interface

200‧‧‧ scoring unit

300‧‧‧Operation platform

310‧‧‧Surgical instruments

311‧‧‧ clip

312‧‧‧ scissors

320‧‧‧First object

321‧‧‧First color area

330‧‧‧Second object

331‧‧‧Second color area

Claims (7)

An automatic scoring method for training a minimally invasive surgical cutting technique includes: providing a first object, a second object, and a surgical instrument, wherein the first object has a first color region, and the second object has a a second color region, the first object is superposed on the second object such that a portion of the second color region is covered by the first color region, and the first color region is available to a subject The surgical instrument performs cutting; providing an imaging device that captures an overlapping state of the first color region and the second color region before the subject cuts the first color region, thereby generating an initial image; a display interface electrically connected to the camera device to display the initial screen and a cutting process by the subject using the surgical instrument for cutting; providing an image processing unit electrically connected to the display interface The image processing unit converts the first color region in the initial screen into a first pixel value, and the second color region is converted into a second pixel value; After the first color area is cut by the subject, the overlapping state of the first color area and the second color area is captured, thereby generating a completed picture on the display interface; the image processing unit is in the completed picture Converting the first color region to a third pixel value, and converting the second color region to a fourth pixel value; and providing a scoring unit electrically connected to the image processing unit, the scoring unit utilizing the first A pixel value, the second pixel value, the third pixel value, and the fourth pixel value are calculated to obtain a skill rating of the subject operating the surgical instrument. The automatic scoring method for the training of minimally invasive surgery cutting skills as described in claim 1 of the patent scope includes: The image capturing device captures the plurality of first color regions before cutting and the plurality of second color regions before cutting; and the image processing unit filters and removes noise from the first color regions before cutting Then converted into a plurality of first pixel values, and the second color regions before the clipping are filtered and the noise is removed and converted into a plurality of second pixel values. The automatic scoring method applied to the minimally invasive surgery cutting skill training according to the second aspect of the patent application further includes: the camera device capturing the plurality of cut first color regions and the plurality of cuts a second color region; and the image processing unit filters and removes the first color regions after the clipping, and converts the noise into a plurality of third pixel values, and performs the cut second color regions After filtering and removing noise, it is converted into a plurality of fourth pixel values. An automatic scoring method for training minimally invasive surgery cutting skill according to claim 3, wherein the image processing unit converts the second color region into the second pixel value, and defines the second The pixel value is equal to zero. The automatic scoring method applied to the minimally invasive surgery cutting skill training according to claim 3, further comprising: the scoring unit calculates an interval interval between the shooting of the initial screen and the photographing of the completed screen, and the interval time Displayed on the display interface. The automatic scoring method applied to the minimally invasive surgery cutting skill training according to the third aspect of the patent application includes: the scoring unit provides a formula to calculate the skill rating, the formula is: Wherein Rp is the first pixel value, Ra is the third pixel value, and Ba is the fourth pixel value; and the calculated skill rating is displayed on the display interface. The automatic scoring method applied to the minimally invasive surgery cutting skill training according to the third aspect of the patent application includes: the scoring unit provides a formula to calculate the skill rating, the formula is: Wherein Rp is an average value of the first pixel values, Ra is an average of the third pixel values, and Ba is an average of the fourth pixel values; and the calculated skill rating is displayed. On the display interface.