KR101864380B1 - Surgical image data learning system - Google Patents

Abstract

Disclosed is a surgical image data learning system which includes a server for learning at least one model to provide surgical guide information and a client which stores the at least one model learned in the server, recognizes a surgical image obtained in a surgery using the stored model, and provides surgical guide information corresponding to the recognized surgical image. The client transmits first learning data, obtained from the surgical image obtained in the surgery, to the server, receives information for updating the stored model from the server, and updates the stored model based on the received information. Accordingly, the present invention can easily learn and update the model.

Description

{SURGICAL IMAGE DATA LEARNING SYSTEM}

The present invention relates to a surgical image data learning system.

In the surgical procedure, development of techniques capable of providing information for assisting the surgeon of the doctor is required. In order to provide information for assisting the operation, it is necessary to be able to recognize the operation.

Therefore, it is required to develop a technique in which a computer can recognize a surgical operation from a surgical image.

In recent years, deep learning has been widely used in the analysis of medical images. Deep learning is defined as a set of machine learning algorithms that try to achieve high levels of abstraction (a task that summarizes key content or functions in large amounts of data or complex data) through a combination of several nonlinear transformation techniques. Deep learning can be viewed as a field of machine learning that teaches computers how people think in a big way.

A problem to be solved by the present invention is to provide a surgical image data learning system.

The problems to be solved by the present invention are not limited to the above-mentioned problems, and other problems which are not mentioned can be clearly understood by those skilled in the art from the following description.

According to one aspect of the present invention, there is provided a surgical image data learning system including a server for learning one or more models for providing surgical guide information, at least one model learned in the server, And a client for recognizing a surgical image obtained during the operation using the model and providing surgical guide information corresponding to the recognized surgical image, wherein the client includes: first learning data obtained from the surgical image acquired during the operation; To the server, receives information for updating the stored model from the server, and updates the stored model based on the received information.

The at least one model may include a first model for segmenting and recognizing a surgical image and a second model for calculating an optimized surgical method, and the first learning data may include at least one of a first model and a second model, And at least one model stored in the client may include the first model.

Further, the client may segment the surgical image acquired during the operation into one or more surgical steps, recognize the divided one or more surgical steps, and transmit the recognition result to the server as the first learning data .

Further, the client may assign a predetermined code to each of the divided one or more surgical steps, and may transmit the predetermined code assigned to each of the divided one or more surgical steps to the server.

The client may compare the model stored in the client with the model stored in the server and update the model stored in the client from the server when the model stored in the server is an updated model than the model stored in the client And update the model stored in the client based on the received information.

In addition, the server may acquire information for dividing at least one surgical image and the at least one surgical image, and may generate second learning data using the obtained information.

The server receives the learning condition, extracts a data set corresponding to the input learning condition from the second learning data, and performs learning on the at least one model using the extracted data set can do.

Also, the server may generate a test data set corresponding to the input learning condition, perform a learning test on the at least one model using the generated test data set, Lt; / RTI >

The server may also be configured to receive one or more new second learning data, to generate a data set that includes at least one new second learning data, and to use the generated data set for the at least one model Learning can be performed.

The server may also acquire a test data set and perform a learning test on the at least one model learned using the generated data set using the test data set, Lt; / RTI >

Also, the server may generate the data set including the new second learning data and existing second learning data selected according to a predetermined criterion, and use the generated data set to generate the second learning data for the at least one model Learning can be performed.

According to an aspect of the present invention, there is provided a method for learning surgical image data, the method comprising: learning one or more models of a server providing surgical guide information; Receiving training data obtained from a surgical image obtained during surgery by the client from the client, updating the learned one or more models, and transmitting information about the updated at least one model to the client To the mobile station.

According to an aspect of the present invention, there is provided a server comprising a memory for storing one or more instructions and a processor for executing the one or more instructions stored in the memory, the processor executing the one or more instructions The method comprising the steps of: learning one or more models providing surgical guide information; transmitting information about the learned at least one model to a client; transmitting learning data, which is obtained from a surgical image acquired by the client during surgery, , Updating the learned one or more models, and transmitting information about the updated at least one model to the client.

According to an aspect of the present invention, there is provided a computer program stored in a recording medium readable by a computer, the computer program being capable of performing a surgical image data learning method according to an embodiment of the present invention in combination with a hardware computer.

Other specific details of the invention are included in the detailed description and drawings.

According to the disclosed embodiments, it is possible to provide a surgical image data learning system based on a server and a client, so that it is possible to provide quick data processing and operation guide information during surgery, and, when the operation is not performed, And the model stored in the client can be updated.

In addition, according to the disclosed embodiment, there is an advantage that a scheduler that establishes a learning plan automatically and instructs the learning is automatically provided without a human instruction, thereby facilitating learning and updating of the model.

The effects of the present invention are not limited to the above-mentioned effects, and other effects not mentioned can be clearly understood by those skilled in the art from the following description.

1 is a simplified schematic diagram of a system capable of performing robotic surgery in accordance with the disclosed embodiments.
2 is a diagram illustrating a surgical image data learning system according to an embodiment.
FIG. 3 is a flowchart briefly illustrating an operation of a surgical image data learning system according to an embodiment.
FIG. 4 is a flowchart illustrating an operation of a surgical image data learning system according to an embodiment.
5 is a block diagram conceptually illustrating a method of scheduling learning according to an embodiment.
6 is a configuration diagram of a server according to an embodiment.

BRIEF DESCRIPTION OF THE DRAWINGS The advantages and features of the present invention, and the manner of achieving them, will be apparent from and elucidated with reference to the embodiments described hereinafter in conjunction with the accompanying drawings. It should be understood, however, that the invention is not limited to the disclosed embodiments, but may be embodied in many different forms and should not be construed as limited to the embodiments set forth herein, Is provided to fully convey the scope of the present invention to a technician, and the present invention is only defined by the scope of the claims.

The terminology used herein is for the purpose of illustrating embodiments and is not intended to be limiting of the present invention. In the present specification, the singular form includes plural forms unless otherwise specified in the specification. The terms " comprises "and / or" comprising "used in the specification do not exclude the presence or addition of one or more other elements in addition to the stated element. Like reference numerals refer to like elements throughout the specification and "and / or" include each and every combination of one or more of the elements mentioned. Although "first "," second "and the like are used to describe various components, it is needless to say that these components are not limited by these terms. These terms are used only to distinguish one component from another. Therefore, it goes without saying that the first component mentioned below may be the second component within the technical scope of the present invention.

Unless defined otherwise, all terms (including technical and scientific terms) used herein may be used in a sense that is commonly understood by one of ordinary skill in the art to which this invention belongs. In addition, commonly used predefined terms are not ideally or excessively interpreted unless explicitly defined otherwise.

As used herein, the term "part" or "module" refers to a hardware component, such as a software, FPGA, or ASIC, and a "component" or "module" performs certain roles. However, "part" or " module " is not meant to be limited to software or hardware. A "module " or " module " may be configured to reside on an addressable storage medium and configured to play back one or more processors. Thus, by way of example, "a" or " module " is intended to encompass all types of elements, such as software components, object oriented software components, class components and task components, Microcode, circuitry, data, databases, data structures, tables, arrays, and variables, as used herein. Or " modules " may be combined with a smaller number of components and "parts " or " modules " Can be further separated.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

Referring to FIG. 1, there is shown a simplified schematic representation of a system capable of performing robotic surgery in accordance with the disclosed embodiments.

1, the robotic surgery system includes a medical imaging apparatus 10, a server 20, a control unit 30 provided in an operating room, a display 32, and a surgical robot 34. Depending on the embodiment, the medical imaging equipment 10 may be omitted from the robotic surgery system according to the disclosed embodiment.

In one embodiment, the surgical robot 34 includes a photographing device 36 and a surgical tool 38.

In one embodiment, robotic surgery is performed by the user controlling the surgical robot 34 using the control unit 30. [ In one embodiment, robot surgery may be performed automatically by the control unit 30 without user control.

The server 20 is a computing device including at least one processor and a communication unit.

The control unit 30 includes a computing device including at least one processor and a communication unit. In one embodiment, the control unit 30 includes hardware and software interfaces for controlling the surgical robot 34.

The photographing apparatus 36 includes at least one image sensor. That is, the photographing device 36 includes at least one camera device, and is used for photographing a body part of the object, that is, a surgical part. In one embodiment, the imaging device 36 includes at least one camera coupled with a surgical arm of the surgical robot 34.

In one embodiment, the image photographed at the photographing device 36 is displayed on the display 340. [

In one embodiment, the surgical robot 34 includes one or more surgical tools 38 that can perform cutting, clipping, anchoring, grabbing, etc., of the surgical site. The surgical tool 38 is used in combination with the surgical arm of the surgical robot 34.

The control unit 30 receives information necessary for surgery from the server 20, or generates information necessary for surgery and provides the information to the user. For example, the control unit 30 displays on the display 32 information necessary for surgery, which is generated or received.

For example, the user operates the control unit 30 while viewing the display 32 to perform the robot surgery by controlling the movement of the surgical robot 34.

The server 20 generates information necessary for robot surgery using the medical image data of the object (patient) photographed beforehand from the medical imaging apparatus 10, and provides the generated information to the control unit 30. [

The control unit 30 provides the information received from the server 20 to the user by displaying the information on the display 32 or controls the surgical robot 34 using the information received from the server 20. [

In one embodiment, the means that can be used in the medical imaging equipment 10 is not limited, and various other medical imaging acquiring means such as CT, X-Ray, PET, MRI and the like may be used.

In the disclosed embodiment, the surgical image obtained in the photographing device 36 is transmitted to the control section 30. [

In one embodiment, the control unit 30 may segment the surgical image obtained during the operation in real time.

In one embodiment, the control unit 30 transmits a surgical image to the server 20 during or after surgery.

The server 20 can divide and analyze the surgical image.

2 is a diagram illustrating a surgical image data learning system according to an embodiment.

Referring to FIG. 2, the surgical image data learning system includes a client 100 and a server 200.

In one embodiment, client 100 and server 200 are computing devices that include at least one processor.

In one embodiment, the client 100 may be a computing device in an operating room (surgical site). For example, the client 100 may correspond to the control unit 30 shown in FIG. As another example, the client 100 may be provided in the operating room as a separate computing device from the control unit 30, and may be connected to the control unit 30. In this specification, a connection includes not only a physical connection but also an electronic connection concept, and it can also be understood as a concept of connection that the communication state is mutually communicable. For example, the client 100 may be connected to the control unit 30 by wire or wireless, and may be in a state where they can communicate with each other using short-range wireless communication or network communication.

In one embodiment, the client 100 determines the surgical situation in the operating room and provides corresponding surgical guide information. The client 100 uses the learned model to determine the surgical situation and provide corresponding surgical guide information.

In one embodiment, the learned model may be a learned model using machine learning. Machine learning can mean, but is not limited to, deep learning.

In one embodiment, the client 100 acquires a surgical image, and the server 200 performs learning using the acquired surgical image. Since machine learning is a task requiring a lot of resources, it may be difficult to perform in the client 100. Further, since a lot of learning data is required for the machine learning, it is difficult for sufficient learning data to be secured by the information collected by the client 100 alone.

Accordingly, the server 200 constructs learning data using information collected from different sources, determines a surgical situation based on the learning data, and learns a model capable of providing surgical guide information.

The client 100 must determine the operation status in real time and provide necessary surgical guide information. Therefore, in order to save time required for communication with the server 200 and to prevent errors due to communication errors, the information about the model learned by the server 200 is stored in the client 100 in advance.

The client 100 can restore the model learned in the server 200 using the information obtained from the server 200 and provide the operation guide information in real time using the model.

FIG. 3 is a flowchart briefly illustrating an operation of a surgical image data learning system according to an embodiment.

The client 100 and the server 200 described in connection with FIG. 2 correspond to the client 100 and the server 200 in FIG. 3, respectively.

In step S210, the server 200 learns a model for providing surgical guide information using the learning data obtained from the surgical image.

In the disclosed embodiment, the model providing the surgical guide information includes a first model for recognizing the surgical image in a divided manner, and a second model for calculating the optimized surgical method.

In one embodiment, the training data may refer to the surgical image itself, or may be data obtained by analyzing the surgical image. For example, the training data may include data obtained by dividing a surgical image into predetermined motion units. Further, the learning data may include data labeled with a surgical image. The type of learning data is not limited to this.

In step S220, the server 200 transmits information about the learned model to the client 100. [ For example, the information about the learned model may include information about the weight of the learned neural network. In one embodiment, the information provided to the client 100 includes information about the first model, which divides and recognizes the surgical image.

In one embodiment, the server 200 transmits information about the learned model to the client 100 when the operation using the client 100 is not performed, i.e., when the client 100 is not assisting the operation . That is, during the operation, the operation guide information is provided based on the information pre-stored in the client 100, and when the operation is not performed (for example, before the operation is performed) May be transmitted from the server 200 to the client 100 in advance.

Referring to FIG. 4, the server 200 acquires a medical image including a surgical region of the patient from the medical image capturing apparatus 10. The server 200 performs 3D modeling on the surgical site of the patient based on the acquired medical image (step S222).

The 3D modeling information of the patient's surgical site is used to determine the position and shape of each organ according to the angle of the camera during surgery, and to provide information on the invisible body part by the camera.

The server 200 transmits the 3D modeling information generated in step S222 to the client 100 (step S224). The client 100 stores the 3D modeling information transmitted from the server 200.

The client 100 acquires and stores the learned model based on the information transmitted from the server 200. [ In step S110, the client 100 provides the operation guide information corresponding to the operation image acquired during the operation using the model stored in the client 100 during the operation. For example, the client 100 can determine the operation status by dividing and recognizing the surgical image using the stored model, and provide the surgical guide information based on the judgment.

In one embodiment, the server 200 transmits 3D modeling information including the surgical site of the patient in advance to the client 100 before the surgery for a specific patient begins. The client 100 stores the 3D modeling information transmitted from the server 200 and uses the 3D modeling information stored in the client 100 and information about the learned model during the operation, Provide surgical guide information.

For example, the surgical guide information may include an optimal surgical procedure corresponding to the current surgical situation. In addition, the surgical guide information may include information about the body part of the patient that is not identified by the camera (e.g., hidden from view by another organ). In addition, the surgical guide information may include information on a position of a body part that should not be damaged during surgery such as a blood vessel or a nerve. In addition, the surgical guide information may include information on an event occurring during surgery or a surgical error, and information on a recognized situation or information on a recognized situation.

In step S120, after the operation is completed, the client 100 transmits the learning data obtained from the operation image acquired during the operation to the server. In one embodiment, the training data includes a surgical image. In one embodiment, the training data includes information that divides the surgical image acquired during surgery into one or more surgical steps and recognizes one or more surgical steps that have been split.

In one embodiment, the client 100 segments the surgical image acquired during surgery into one or more surgical steps. The client 100 may segment the surgical image into one or more predetermined surgical steps using the learned model. For example, the predetermined operation step divides each operation included in the operation based on the position and the change of the organ and the position and movement of the surgical tool according to a predetermined criterion, and assigns a standardized name May be granted.

In one embodiment, predetermined codes may be assigned to each of the divided operations. The client 100 grants a predetermined code for each of the one or more surgical steps that have been divided.

In one embodiment, the client 100 may send to the server 100 predetermined codes assigned for each of the one or more surgical steps that were split instead of the surgical image. The server 100 may obtain information on the sequence of each surgical step and the overall surgical operation based on the received code. In this case, the amount of data transmission is greatly reduced compared with the case of transmitting the operation image to the server 200. [ Accordingly, it is possible to transmit learning data to the server 200 in real time (step S120) even during surgery, that is, while the client 100 provides the surgical guide information (step S110), if necessary.

In step S230, the server 200 updates the learned model based on the information received from the client 100. [ For example, the server 200 can re-learn the model using the information received from the client 100 or fine tuning the model. In one embodiment, the server 200 learns a second model that computes an optimized surgical procedure based on the information received from the client 100. In one embodiment, the server 200 may learn a first model that divides and recognizes a surgical image based on information received from the client 100. [ For example, the server 200 may learn a model for recognizing the movement of the surgical tool based on the information received from the client 100. [

In addition, the server 200 may learn a first model that divides and recognizes a surgical image based on information for dividing at least one surgical image and at least one surgical image obtained from the outside.

In step S240, the server 200 transmits the updated model to the client 100 through step S230. The client 100 receives information on the updated model from the server 200 when the operation is not performed, i.e., information for updating the model stored in the client 100, and transmits the updated information to the client 100 based on the received information. Lt; RTI ID = 0.0 > stored < / RTI >

Referring to FIG. 4, the client 100 checks the update state of the model to the server 200 (step S130).

For example, the client 100 compares the learned model stored in the client 100 with the learned model stored in the server 200, and the learned model stored in the server 200 is stored in the client 100 If the model is an updated model than the learned model, the client 100 receives information for updating the learned model from the server 200, and updates the learned model stored in the client 100 based on the received information do.

5 is a block diagram conceptually illustrating a method of scheduling learning according to an embodiment.

In one embodiment, the scheduler 300, the database 320, the learning unit 330, the testing unit 340, and the model 350 may each comprise a module implemented in hardware or software in the server 200, one or more instructions The data stored in the memory, or the operations performed by the server 200. [0043] FIG.

In one embodiment, the learning information input unit 310 means a computing device capable of directly or indirectly communicating with the server 200 or the server 200.

For example, the learning information input unit 310 may input information for dividing a surgical image acquired by the server 200. [ For example, the learning information input unit 310 may be a computing device that inputs information for a doctor to view a surgical image and directly divide a surgical image into predetermined operation units. The source of the surgical image used for the learning is not limited. The server 200 may provide various user interfaces through which the learning information input unit 310 can easily input information for dividing a surgical image by using an application or a web page.

The information that divides the surgical image and the surgical image is stored in the database 320. [

The scheduler 300 plays a role of controlling the learning process of the server 200. In the past, it was common for the developer to set the data set for learning directly and to learn the model by learning instruction.

According to the disclosed embodiment, the scheduler 300 automatically learns a model by automatically generating a learning data set, performing learning, and testing a learning result.

In one embodiment, the scheduler 300 may set a learning plan and determine whether to plan the next learning based on the progress level of the learning.

For example, the scheduler 300 performs learning on the basis of predetermined learning data, performs a test on the learning results, and when the learning over a predetermined threshold (for example, accuracy of 80% or more) is completed, And plan the next lesson. For example, the scheduler 300 can plan and perform the next learning based on the learning data newly obtained when the learning on the predetermined learning data is finished.

When predetermined learning data is stored in the database 320, the scheduler 300 extracts the learning data set from the learning data stored in the database 320. [ The scheduler 300 inputs the extracted learning data set to the learning unit 330 and performs learning.

In one embodiment, the scheduler 300 receives a predetermined learning condition for learning, extracts a learning data set corresponding to the learning condition input from the learning data stored in the database 320, Unit 330 to perform learning.

For example, the learning conditions may include, but are not limited to, gender, age group, type of disease, etc.

In one embodiment, the scheduler 300 tests the learned model using the test unit 340 when the learning is completed. For example, the scheduler 300 generates a predetermined test data set, and performs a learning test on the learned model using the generated test data set. The scheduler 300 provides feedback according to the results of the learning test. In addition, the scheduler 300 determines whether to finish the learning and whether to plan the next learning as described above according to the learning results.

For example, if the accuracy of the learning test result is equal to or greater than a predetermined reference value, the generation of the learned model 350 can be terminated by assuming that the test has passed. In addition, the next learning for the learned model 350 can be planned and executed.

Further, if the accuracy of the learning test result is less than the predetermined reference value, it is determined that the test is not passed, and the learning is again performed through the learning unit 330, or the learning condition can be reset.

As another example, when additional learning is performed using the new data in the already learned model, the accuracy of the already learned model can be compared with the accuracy of the model in which the additional learning is performed using the new data. If the accuracy of the model in which the additional learning is performed is higher, the scheduler 300 can update the learned model.

In one embodiment, when learning is performed based on a predetermined learning condition, the test unit 340 generates a test data set corresponding to a predetermined learning condition, Test the model.

In one embodiment, when the new learning data is received in the server 200, the scheduler 300 generates a learning data set including new learning data, inputs the generated data set to the learning unit 330, .

In one embodiment, the scheduler 300 may perform learning each time new learning data is received, and may generate learning data sets every time the learning data is accumulated over a predetermined amount to perform learning, It is not.

In one embodiment, the test unit 340 can generate a test data set for testing the learned model using new learning data, and test the learned model. If the accuracy of the learned model is higher than the accuracy of the existing model using the new learning data, the scheduler 300 can update the learned model.

In one embodiment, the scheduler 300 may perform learning based on rules for generating a learning data set that includes new learning data, so as not to forget previously learned results.

For example, when the learning unit 330 performs learning using a neural network, when learning is performed using new learning data, compared to performing learning using existing learning data, Do not change.

In addition, the feature extracted from the existing learning data using the learned model using the new learning data should be close to the feature extracted from the existing learning data using the existing learned model.

In one embodiment, the scheduler 300 generates a learning data set that includes new learning data and existing learning data selected in accordance with a predetermined criterion, and transmits the learning data set to the learning unit 330 using the generated learning data set Learning.

When selecting the existing learning data, the scheduler 300 selects the existing learning data that can prevent the model learned by the new learning data set from forgetting the previously learned information.

In one embodiment, the client 100 compares the learned model 350 with the model stored in the client 100, and if the learned model 350 is an updated model than the model stored in the client 100, And updates the model stored in the client (100).

FIG. 6 is a configuration diagram of a server 200 according to an embodiment.

The processor 202 may include one or more cores (not shown) and a connection path (e.g., a bus, etc.) to transmit and receive signals to and / or from a graphics processing unit (not shown) .

The processor 202 in accordance with one embodiment performs the surgical video data learning method described with respect to Figures 1-5 by executing one or more instructions stored in the memory 204. [

For example, the processor 202 may learn one or more models that provide surgical guide information by executing one or more instructions stored in memory, send information about the learned at least one model to a client, Receiving training data obtained from the surgical image acquired during surgery from the client, updating the learned one or more models, and transmitting information about the updated at least one model to the client.

The processor 202 may include a random access memory (RAM) (not shown) and a read-only memory (ROM) for temporarily and / or permanently storing signals (or data) , Not shown). In addition, the processor 202 may be implemented as a system-on-chip (SoC) including at least one of a graphics processing unit, a RAM, and a ROM.

The memory 204 may store programs (one or more instructions) for processing and control of the processor 202. The programs stored in the memory 204 may be divided into a plurality of modules according to functions.

As described above, the surgical image segmentation method according to an embodiment of the present invention may be implemented as a program (or an application) to be executed in combination with a hardware computer and stored in a medium.

The above-described program may be stored in a computer-readable medium such as C, C ++, JAVA, machine language, or the like that can be read by the processor (CPU) of the computer through the device interface of the computer, And may include a code encoded in a computer language of the computer. Such code may include a functional code related to a function or the like that defines necessary functions for executing the above methods, and includes a control code related to an execution procedure necessary for the processor of the computer to execute the functions in a predetermined procedure can do. Further, such code may further include memory reference related code as to whether the additional information or media needed to cause the processor of the computer to execute the functions should be referred to at any location (address) of the internal or external memory of the computer have. Also, when the processor of the computer needs to communicate with any other computer or server that is remote to execute the functions, the code may be communicated to any other computer or server remotely using the communication module of the computer A communication-related code for determining whether to communicate, what information or media should be transmitted or received during communication, and the like.

The medium to be stored is not a medium for storing data for a short time such as a register, a cache, a memory, etc., but means a medium that semi-permanently stores data and is capable of being read by a device. Specifically, examples of the medium to be stored include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, and the like, but are not limited thereto. That is, the program may be stored in various recording media on various servers to which the computer can access, or on various recording media on the user's computer. In addition, the medium may be distributed to a network-connected computer system so that computer-readable codes may be stored in a distributed manner.

The steps of a method or algorithm described in connection with the embodiments of the present invention may be embodied directly in hardware, in software modules executed in hardware, or in a combination of both. The software module may be a random access memory (RAM), a read only memory (ROM), an erasable programmable ROM (EPROM), an electrically erasable programmable ROM (EEPROM), a flash memory, a hard disk, a removable disk, a CD- May reside in any form of computer readable recording medium known in the art to which the invention pertains.

While the present invention has been described in connection with what is presently considered to be practical exemplary embodiments, it is to be understood that the invention is not limited to the disclosed embodiments, but, on the contrary, You will understand. Therefore, it should be understood that the above-described embodiments are illustrative in all aspects and not restrictive.

100: Client
200: Server

Claims (14)

A server that learns one or more models that provide surgical guide information; And
A client for storing at least one model learned in the server, recognizing a surgical image acquired during operation using the stored model, and providing surgical guide information corresponding to the recognized surgical image; Lt; / RTI >
The client includes:
Transmitting the first learning data obtained from the surgical image obtained during the operation to the server, receiving information for updating the stored model from the server, updating the stored model based on the received information,
The server comprises:
Extracting a data set corresponding to the input learning condition from the first learning data, performing learning on the at least one model using the extracted data set, A test data set corresponding to the condition, performing a learning test on the at least one model using the generated test data set, and providing feedback according to a result of the learning test, Learning system. The method according to claim 1,
Wherein the one or more models comprise:
A first model for segmenting and recognizing a surgical image; And
A second model for calculating an optimized surgical procedure; / RTI >
Wherein the first learning data is used for learning at least one of the first model and the second model,
And the first model is stored in the client. The method according to claim 1,
The client includes:
Segmenting the surgical image acquired during the operation into one or more surgical steps,
Recognizing the divided one or more surgical steps,
And transmits the recognition result to the server as the first learning data. The method of claim 3,
The client includes:
A predetermined code is assigned to each of the divided one or more surgical steps,
And transmits the predetermined code assigned to each of the divided one or more surgical steps to the server. The method according to claim 1,
The client includes:
Comparing the model stored in the client with the model stored in the server and receiving information for updating the model stored in the client from the server when the model stored in the server is an updated model than the model stored in the client, And updates the model stored in the client based on the received information. The method according to claim 1,
The server comprises:
Obtaining information for dividing at least one surgical image and the at least one surgical image,
And generates second learning data using the acquired information. delete delete delete A server that learns one or more models that provide surgical guide information; And
A client for storing at least one model learned in the server, recognizing a surgical image acquired during operation using the stored model, and providing surgical guide information corresponding to the recognized surgical image; Lt; / RTI >
The client includes:
Transmitting the first learning data obtained from the surgical image obtained during the operation to the server, receiving information for updating the stored model from the server, updating the stored model based on the received information,
The server comprises:
Receiving at least one new second learning data, generating a data set including at least one new second learning data, performing learning on the at least one model using the generated data set, Performing a learning test on the at least one model learned using the generated data set using the test data set and providing feedback based on the results of the learning test, Surgical Image Data Learning System. 11. The method of claim 10,
The server comprises:
Generating the data set including the new second learning data and existing second learning data selected according to a predetermined criterion and performing learning on the at least one model using the generated data set, Image data learning system. Allowing the server to learn one or more models to provide surgical guide information;
The server sending information about the learned at least one model to a client;
The server receiving training data from the client, wherein the training data is obtained from a surgical image acquired by the client during surgery;
The server updating the learned one or more models; And
The server sending information about the updated at least one model to the client; Lt; / RTI >
Wherein the updating comprises:
Receiving, by the server, a learning condition;
The server extracting a data set corresponding to the input learning condition from the learning data;
The server performing learning on the at least one model using the extracted data set;
The server generating a test data set corresponding to the input learning condition;
The server performing a learning test on the at least one model using the generated test data set; And
The server providing feedback according to the results of the learning test;
Wherein the method comprises the steps of: A memory for storing one or more instructions; And
And a processor executing the one or more instructions stored in the memory,
The processor executing the one or more instructions,
Learning one or more models that provide surgical guide information;
Transmitting information about the learned at least one model to a client;
Receiving learning data from the client, wherein the learning data is obtained from a surgical image acquired by the client during surgery;
Updating the learned one or more models; And
Transmitting information about the updated at least one model to the client; Lt; / RTI >
Wherein the updating comprises:
Receiving learning conditions;
Extracting a data set corresponding to the input learning condition from the learning data;
Performing learning on the at least one model using the extracted data set;
Generating a test data set corresponding to the input learning condition;
Performing a learning test on the at least one model using the generated test data set; And
Providing feedback according to the results of the learning test;
To do this, the server. A computer program stored in a computer readable recording medium in combination with a computer which is hardware and which is capable of performing the method of claim 12.

Images