WO2024085466A1

WO2024085466A1 - Surgery image transmission method using cache server and system using same

Info

Publication number: WO2024085466A1
Application number: PCT/KR2023/014130
Authority: WO
Inventors: 정윤상; 심지우; 김나영
Original assignee: 주식회사 메디씽큐
Priority date: 2022-10-20
Filing date: 2023-09-19
Publication date: 2024-04-25
Also published as: KR102539674B1

Abstract

According to the present invention, provided is a surgery image transmission system using a cache server, the system comprising: a content server configured to store a plurality of surgery images; an image patch management server configured to receive surgery-related information including surgery date and time and surgery type, and select related surgery images, among the plurality of surgery images stored in the content server, on the basis of the surgery-related information; and the cache server which is configured to receive and store at least a portion of the related surgery images from the content server, and transmit the at least portion of the surgery images to a user terminal when a reference image is requested by the user terminal, wherein the cache server is selected from among a plurality of cache servers on the basis of response speed and the proximity to the position of the user terminal.

Description

Method for transmitting surgical images using a cache server and a system using the same

The present invention relates to a method of transmitting surgical images using a cache server and a system using the same. More specifically, it relates to a method and system that can provide stable streaming of a plurality of segmented surgical images to a user terminal without delay using a cache server.

Recently, as multimedia technology has developed rapidly and is used in various fields, technology has been developed in the medical field to produce recorded videos of patients' surgery scenes so that doctors can present them at medical conferences or use them for other purposes. It is becoming.

In addition, in many cases, surgery images are taken to record the surgery and defend against any medical disputes that may arise, or during joint surgery, the lesion is checked with the naked eye through an ultra-small camera through endoscopic surgery, and diagnosis and treatment are often performed. Recently, As most medical equipment is equipped with an imaging function, surgical imaging is rapidly increasing.

The surgical videos recorded in this way have various uses for other doctors, patients, researchers, etc. In particular, if various medical information is added to surgical images, their utilization and asset value can increase.

Accordingly, new methods and systems are needed to prevent falsification of medical imaging records and to safely store and broker transactions. Additionally, methods and systems that can provide medical images more quickly and reliably without interruption during surgery are needed. In addition, methods and systems are needed that can more effectively provide images of detailed surgical steps that doctors and medical staff can refer to during surgery.

The present invention, for example, separates a recorded video of a surgery scene into a plurality of piece images, manages the connection link information and section information of each piece video with a blockchain, thereby preventing forgery and falsification of the surgery video, and records the order of the surgery. The purpose is to provide a method and system to prevent manipulation or disposal of surgical records.

In addition, the present invention divides the surgical recording video into a plurality of piece images and constructs a block using a combination of link information and section information, thereby enabling efficient management of the surgical recording video while reducing the capacity of the block data. The purpose is to build a system.

In addition, the purpose of the present invention is to establish a medical image management system that transparently manages the use and transaction of recorded surgical images through transactions through smart contracts and generates monetization through them.

In addition, the purpose of the present invention is to provide a method and system that can reduce buffering during video playback and transmit surgical images more quickly and stably for reference by doctors and medical staff performing surgery using a cache server.

In addition, the purpose of the present invention is to provide a cache server system that can provide stable streaming of a plurality of segmented surgical images to a user terminal without delay.

Additionally, the purpose of the present invention is to provide an image transmission system that can generate and recommend optimal surgical images based on information related to the surgery being performed.

In addition, the present invention aims to provide a surgical stage image transmission system configured to determine detailed surgical steps of a more efficient and safe surgery based on past surgical record information and transmit a plurality of image fragments generated based thereon.

In addition, the purpose of the present invention is to provide a method and system that can recommend optimal detailed surgical steps appropriate for a surgical patient using artificial intelligence technology and sequentially provide detailed surgical step images to medical staff based on these.

The problems to be solved by the present invention are not limited to the contents mentioned above, and other technical problems not mentioned will be clearly understood by those skilled in the art from the description below.

According to one embodiment of the present invention, a surgical image transmission system using a cache server includes: a content server configured to store a plurality of surgical images; an image fragment management server configured to receive surgery-related information including the surgery date and time and type of surgery, and determine a related surgery image among a plurality of surgery images stored in the content server based on the surgery-related information; And a cache server configured to receive and store at least some of the related surgical images from the content server, and to transmit at least some of the surgical images to the user terminal when a reference image is requested from the user terminal, the cache The server may provide a surgical image transmission system that is determined based on proximity to the location of the user terminal or response speed among a plurality of cache servers.

Here, the image fragment management server may be configured to divide the related surgical image into a plurality of fragment images of less than or equal to a predetermined capacity.

In addition, the plurality of fragment images are sequentially generated based on timestamp information of each section within the surgical image, and the image fragment management server selects at least one fragment image corresponding to the front of the plurality of fragment images. It can be configured to forward to a cache server.

Additionally, the image fragment management server may be configured to deliver the at least one image fragment to the cache server before the surgery date and time based on the surgery date and time.

Additionally, the video fragment management server may be configured to determine a related surgical image among a plurality of surgical images stored in the content server based on similarity judgment with reference image information previously used in the user terminal.

In addition, when more than a predetermined ratio of the at least one video fragment is streamed from the user terminal, the cache server requests the video fragment management server for the remaining video fragments excluding the front part of the plurality of video fragments to the video fragment management server. Can be configured to receive and store.

In addition, when the plurality of fragment images are all streamed from the user terminal, the cache server may be configured to transmit at least a portion of the second surgical image corresponding to the next sequence of the transmitted surgical image to the user terminal. .

In addition, through image analysis of the plurality of fragment images, at least one main fragment image among the plurality of fragment images is determined based on at least one of the movement of surgical tools, the amount of blood generated, and the degree of change in organs related to the surgery, The video fragment management server may be configured to transmit a main video fragment among the plurality of video fragments to the cache server.

According to another embodiment of the present invention, a method of transmitting surgical images using a cache server includes: storing a plurality of surgical images in a content server; Receiving surgery-related information including the surgery date and time and type of surgery from an image fragment management server, and determining a related surgery image among a plurality of surgery images stored in the content server based on the surgery-related information; determining a cache server connected to the user terminal among a plurality of cache servers based on proximity to the location of the user terminal or response speed; Receiving and storing at least some of the related surgical images from the content server at the cache server; And when there is a request for a reference image from the user terminal in the cache server, a method of transmitting a surgical image including transmitting at least a portion of the surgical image to the user terminal can be provided.

According to the present invention, for example, a recorded video of a surgery scene is separated into a plurality of piece images, and the connection link information and section information of each piece image are managed by blockchain to prevent forgery and falsification of the surgery video, and to keep the surgical procedure in order. A method and system can be provided to prevent record manipulation or disposal of surgical records.

In addition, according to the present invention, the surgical recorded video can be efficiently managed while reducing the capacity of the block data by splitting the surgical recorded video into a plurality of piece images and forming blocks using a combination of connecting link information and section information. A system that can be built can be built.

In addition, according to the present invention, it is possible to build a medical image management system that transparently manages the use and transaction of recorded surgical images through transactions through smart contracts and generates monetization through them.

In addition, according to the present invention, it is possible to provide a method and system that can reduce buffering during video playback and transmit surgical images more quickly and stably for reference by doctors and medical staff performing surgery using a cache server.

In addition, according to the present invention, it is possible to provide a cache server system that can provide stable streaming of a plurality of segmented surgical images to a user terminal without delay.

In addition, according to the present invention, it is possible to provide an image transmission system that can generate and recommend optimal surgical images based on information related to the surgery being performed.

In addition, according to the present invention, it is possible to provide a surgical stage image transmission system configured to determine detailed surgical steps of a more efficient and safe surgery based on past surgical record information and transmit a plurality of image fragments generated based on them.

In addition, according to the present invention, it is possible to provide a method and system that can recommend optimal detailed surgical steps suitable for a surgical patient using artificial intelligence technology and sequentially provide detailed surgical step images to medical staff based on these.

The effects of the present invention are not limited to the contents mentioned above, and other effects not mentioned will be clearly understood by those skilled in the art from the description below.

Figure 1 is a conceptual diagram showing the configuration of a system for managing records of medical images using blockchain according to an embodiment of the present invention.

Figure 2 is a block diagram for explaining the configuration of a medical image management server according to an embodiment of the present invention.

Figure 3 is an example diagram showing the creation of a block created on a blockchain network for a plurality of fragment images related to a medical image according to an embodiment of the present invention.

Figure 4 is an example diagram for explaining the header structure of a block according to an embodiment of the present invention.

Figure 5 is a flowchart explaining a method for managing medical images using blockchain according to an embodiment of the present invention.

Figure 6 is a conceptual diagram for explaining the configuration of a surgical image transmission system using a cache server according to an embodiment of the present invention.

Figure 7 is a block diagram for explaining the configuration of a cache server according to an embodiment of the present invention.

Figure 8 is an example diagram for explaining a method for providing a plurality of image fragments related to a surgical image using a cache server according to an embodiment of the present invention.

Figure 9 is a flowchart illustrating a method of transmitting surgical images using a cache server according to an embodiment of the present invention.

Figure 10 is a conceptual diagram for explaining the configuration of a surgical stage image transmission system using a cache server according to an embodiment of the present invention.

Figure 11 is an exemplary diagram for explaining a configuration for recommending detailed surgical steps for a surgical patient according to an embodiment of the present invention.

Figure 12 is an example diagram for explaining a method for providing images of detailed surgical steps using a cache server according to an embodiment of the present invention.

Hereinafter, with reference to the attached drawings, the present invention will be described in detail so that those skilled in the art can easily practice it. However, the present invention may be implemented in many different forms and is not limited to the embodiments described herein.

The terminology used herein is for describing embodiments and is not intended to limit the invention. As used herein, singular forms also include plural forms, unless specifically stated otherwise in the context.

As used herein, “comprises”, “comprising” refers to the presence or absence of one or more other components, steps, operations and/or elements. Addition is not ruled out.

Additionally, terms containing ordinal numbers, such as first, second, etc., used in the present invention may be used to describe constituent elements, but the constituent elements should not be limited by the terms. These terms are used only to distinguish one component from another. Additionally, when describing the present invention, if it is determined that a detailed description of related known technologies may obscure the gist of the present invention, the detailed description will be omitted.

Additionally, the components appearing in the embodiments of the present invention are shown independently to show different characteristic functions, and this does not mean that each component is comprised of separate hardware or one software component. That is, for convenience of explanation, each component is listed and described as each component, and at least two of each component may be combined to form one component, or one component may be divided into a plurality of components to perform a function. Integrated embodiments and separate embodiments of each of these components are also included in the scope of the present invention as long as they do not deviate from the essence of the present invention.

Hereinafter, embodiments according to the present invention will be described in detail with reference to the attached drawings. The configuration of the present invention and its operational effects will be clearly understood through the detailed description below.

The medical image management system may be composed of a medical image capture unit 100, a medical image management server 200, and a blockchain network 300. The medical image capture unit 100 may be located in a space such as an operating room, treatment room, or clinic within a hospital. It can be configured to record images related to surgery, treatment, treatment, etc., and transmit the recorded medical images to the medical image management server 200. The medical imaging unit 100 may take the form of a plurality of cameras or CCTV of various types, such as a head-mounted display (HMD) camera that can be worn by medical staff such as doctors, a camera installed in an operating room, and an endoscope camera used in endoscopic surgery. You can. For example, the camera installed in the operating room is installed on the ceiling and can identify the initial location by specifying the coordinates of each object in the initial real-time video, and track movement by identifying the surgical scene and the operation of the operating surgeon. In addition, it can be configured to automatically photograph and record surgical scenes by tracking the movements of all objects, such as surgical tools, that are photographed using image recognition technology.

The medical image management server 200 receives medical images recorded related to surgery or treatment using the medical image capture unit 100, and creates blocks on the blockchain network 300 based on data related to the medical images. It may be configured to generate and update the block based on new data related to the medical image. The medical image management server 200 may include a memory for storing data and instructions and a processor for executing instructions to manage information related to each module configured to receive and manage medical images. A more detailed configuration of the medical image management server 200 will be described with reference to FIG. 2 .

The medical image management server 200 may be a server corresponding to one of the blockchain nodes constituting the blockchain network 300, or may be a server for managing the blockchain network 300. Blockchain technology is based on the P2P (Peer-to-Peer) method and stores the data subject to management in a distributed data storage environment called a block, which is formed by connecting countless small data in the form of a chain, so that no one can arbitrarily modify it and anyone can change it. This is a technology that allows you to view the results. The block records all transaction details or status information that were spread to users before the block was discovered, and since this is transmitted equally to all users in a P2P manner, transaction details or status information cannot be arbitrarily modified or omitted. . In the present invention, data or data bundles for medical image management that are stored and updated through the blockchain network 300 are referred to as 'blocks.'

The medical image management server 200 includes an image receiving unit 210, an image segmentation unit 220, a connection link management unit 230, a block generation processing unit 240, a block update processing unit 250, and a contract processing unit 260. These components may include programs or program modules that can be executed by one or more processors. Programs or program modules included in the medical image management server 200 may be configured in the form of an operating system, application program, or program, and may be physically stored on various types of widely used storage devices. It can be saved as . Such a program or program module consists of one or more routines, subroutines, programs, objects, components, instructions, data structures, and specific operations ( It may include various forms for performing a task or executing a specific data type, and is not limited to these forms.

First, the image receiver 210 is configured to receive medical images recorded related to surgery or treatment using the medical image capture unit 100, and can be connected to the medical image capture unit 100 using wired or wireless Internet. there is.

The image segmentation unit 220 is configured to divide the medical image into a plurality of slice images, and blocks corresponding to each slice image information through the block generation processor 240 based on data related to the plurality of slice images thus divided. You can create and record them in order. For example, the image segmentation unit 220 may sequentially generate a plurality of fragment images from one medical image based on timestamp information set for each section within the medical image. For example, timestamp information can be set for each stage by dividing each detailed procedure within the surgery by the surgeon or medical staff who performed the surgery, or it can be set automatically using artificial intelligence technology, etc. In addition, the plurality of fragment images may further include tag information inserted into the recorded surgery video, and the tag information may include at least one of the surgical subject, comments related to the surgical situation, surgical sequence, surgical tools, and surgery-related events. You can. Such tag information can be entered by medical staff in association with each timestamp information, or the related information can be automatically input using artificial intelligence technology, etc.

The block generation processing unit 240 may be configured to generate a block on the blockchain network 300 based on data related to the medical image, and may be configured, for example, to generate a new block for each fragment image of a plurality of fragment images. You can. Additionally, the header of the generated block may include information related to a connection link accessible to each of the plurality of fragment images. Additionally, the header of the generated block may further include section information generated based on timestamp information at the start and end points of each of the plurality of fragment images.

The block update processing unit 250 may be configured to update block information about the generated block based on tag information, etc. For example, it may include additional tag information, viewing history, transaction history, usage history, etc., corresponding to each piece of video. For example, the information of the person accessed through the connection link of the video fragment, connection IP information, and access time information can be tracked through log records, and such access information can be updated by recording it in the body of the block corresponding to the video fragment. .

The contract processing unit 260 is configured to conclude various transaction contracts for the use of medical images and process related processes, and such transaction contracts use smart contracts to ensure that costs are settled according to preset transaction conditions. It can be configured. The contract processing unit 260 may be configured to create a block for a smart contract on the blockchain network 300 based on data related to the use of medical images through a smart contract, and the period of use of the medical images It may include information, that is, information about start and end dates, information about access and editing rights to the video, etc.

Referring to FIG. 3, for example, a medical image related to a stent procedure or surgery consists of four steps: 1) surgical preparation and anesthesia, 2) catheter insertion, 3) balloon inflation, 4) catheter removal, and stent installation. Accordingly, it can be separated into four fragment images, and each fragment image may include section information related to the start and end points of t1~t2, t2~t3, t3~t4, and t4~t5 as timestamp information. , Different accessible connection links may be assigned to each segmented image fragment, and connection link information, which is information related to the connection link corresponding to each fragment image, may be generated. In this way, a plurality of blocks including connection link information and time section information can be generated for each of the plurality of fragment images into which the medical image is sequentially divided.

The structure of a block can largely be composed of a block hash that serves as a block identifier, a header with basic information, and a body with transaction information. Here, the header generally includes information such as version, previous block hash, Merkle root, time, difficulty goal, and nonce, and the block according to the present invention includes a connection link accessible to each of a plurality of fragment images in the header. It may further include section information generated based on related connection link information and timestamp information at the start and end points of each of the plurality of fragment images.

Through this block structure, it is possible to prevent falsification of medical image records by matching accessible link information to surgical video fragments or still cuts for each fragmented and distributed ledger and recording them using blockchain. For example, link information can be encrypted. Also, by setting the storage space where the video or still cut is stored to read-only so that it cannot be modified, the video at the access location cannot be changed.

The present invention splits the surgical recording video into a plurality of piece images and constructs a block using a combination of link information and section information, thereby efficiently managing the surgical recording video while reducing the capacity of the block data. The system can be provided and the problem of surgical history being discarded due to expiration of the storage period or major information related to the surgery being falsified can be resolved.

Referring to FIG. 5, first, a medical image captured and recorded through the medical image capture unit 100 may be received through the image receiver 210 of the medical image management server 200 (S510).

The medical image management server 200 may sequentially divide the medical image into a plurality of fragment images through the image segmentation unit 220 (S520).

The medical image management server 200 may create a connection link for a plurality of image fragments through the connection link manager 230 and generate section information for each image fragment (S530).

The medical image management server 200 may sequentially record data related to a plurality of fragment images in blocks through the block generation processing unit 240. (S540) At this time, the header of the block is a connection that can be connected to each of the plurality of fragment images. It may include section information generated based on connection link information related to the link and timestamp information at the start and end of each of the plurality of fragment images.

In addition, the medical image management server 200 may perform a block update based on tag information related to a plurality of image fragments through the block update processor 250 (S550). For example, tag information corresponding to each fragment image. The block can be updated based on additional information, viewing history, transaction history, usage history, etc.

In addition, the medical image management server 200 can track accessor information, access IP information, and access time information through log records (S560). In this way, access information is monitored by tracking access-related information accessed through the corresponding link. can do. In addition, the corresponding block can be updated based on such connection-related information to prevent modification of the connection record.

Referring to FIG. 6, the user terminal 400 is used by users such as doctors or medical staff performing surgery, treatment, treatment, etc., and is used by, for example, a content server 600, a cache server 700, and an image fragment management server 800. Devices configured to be accessible, such as smart phones, tablet computers, desktop computers, laptop computers, notebooks, workstations, PDAs (Personal Digital Assistants), Portable computer, wireless phone, mobile phone, e-book, portable multimedia player (PMP), portable game console, digital camera, television , it may be any one of a wearable device, a head mounted display (HMD), or an artificial intelligence (AI) speaker, but is not limited to these. Additionally, the user terminal 400 may include a display unit for providing a medical image screen or may be connected to the display unit to be controllable.

The user terminal 400 is configured to communicate with various servers, such as the content server 600, the cache server 700, and the video fragment management server 800, through the network 500, and the network 500 is configured to communicate with the user terminal ( It is a component for performing wired and wireless communication for data transmission and reception between 400) and a plurality of

servers

600, 700, and 8000. If the network is a wireless communication network, it may include cellular communication or short-distance communication. For example, cellular communications include LTE (Long-Term Evolution), LTE-A (LTE Advanced), 5G (5th Generation), CDMA (Code Division Multiple Access), WCDMA (Wideband CDMA), UMTS (Universal Mobile Telecommunications System), and WiBro. It may include at least one of (Wireless Broadband), or GSM (Global System for Mobile Communications). Additionally, short-range communication may include at least one of Wi-Fi (Wireless Fidelity), Bluetooth, Zigbee, NFC (Near Field Communication), or RFID (Radio Frequency Identification). However, the communication method is not limited to this and will also include wireless communication technology to be developed in the future.

Next, the content server 600 may be configured to store a plurality of surgical images, for example, through various types of cameras through the medical image capture unit 100, such as surgery, treatment, etc. in a space such as an operating room, treatment room, or clinic within a hospital. It may be configured to store recorded images related to medical treatment, etc.

The cache server 700 receives and stores at least some of the surgical images related to the surgery among the plurality of surgical images stored from the content server 600, and when there is a request for a reference image from the user terminal 400, the user terminal 400 ) may be configured to transmit at least some of the surgical images. Additionally, the cache server 700 may be selected as the most advantageous cache server among a plurality of cache servers based on proximity to the location of the corresponding user terminal 400 or response speed.

The video fragment management server 800 receives surgery-related information including the surgery date and type of surgery, and determines a surgery image related to the surgery among the plurality of surgery images stored in the content server 600 based on the surgery-related information. And, it may be configured to divide the related surgical image into a plurality of slice images of less than or equal to a predetermined capacity.

The plurality of fragment images divided in this way are sequentially generated based on the timestamp information of each section within the corresponding surgical image, and the image fragment management server 800 selects at least one fragment image corresponding to the front part of the plurality of fragment images. It may be configured to deliver to the cache server 700.

Additionally, the image fragment management server 800 may be configured to transmit at least one image fragment to the cache server 700 before the surgery date and time based on a predetermined surgery date and time. For example, based on a predetermined standard, the fragment image can be delivered to the cache server 700 in advance and stored in the cache server 700 1 day or 1 hour before the surgery date.

In addition, the video fragment management server 800 is configured to determine a related surgical image among a plurality of surgical images stored in the content server 600 based on similarity judgment with reference image information previously used in the user terminal 400. It can be. In other words, a surgical image that is likely to be referred to during the relevant surgery can be determined using past history data that the user of the user terminal 400 has previously referenced or searched for.

In addition, if more than a predetermined ratio of at least one video fragment is streamed from the user terminal 400, it is determined that the user refers to the video fragment, and the cache server 700 stores the video fragment in the video fragment management server 800. By configuring to request, receive and store the remaining fragment images excluding the front part of the middle, transmission delay is minimized when streaming the corresponding surgical video through the user terminal 400 by storing the remaining fragment images in advance in the cache server 700. can do.

In addition, when a plurality of fragment images are all streamed from the user terminal 400, the cache server 700 transmits at least some of the second surgical images corresponding to the next sequence of the transmitted surgical images to the user terminal 400. It can be configured. In addition, when at least one fragment image of the second surgery image or more than a predetermined ratio of all fragment images is streamed from the user terminal 400, it is determined that the user refers to the corresponding fragment image among the second surgery images and the cache server ( 700) may be configured to request, receive, and store, from the video fragment management server 800, the remaining video fragments excluding the first part among the plurality of video fragments.

In addition, the image fragment management server 800 analyzes a plurality of fragment images through artificial intelligence technology, etc. to create a plurality of fragments based on at least one of the movement of surgical tools, the amount of blood generated, and the degree of change in organs related to the surgery. It may be configured to determine at least one main fragment image among the images and transmit the main fragment image among the plurality of fragment images to the cache server 700. In this way, the video fragment management server 800 determines the main fragment image that is judged to be important among the plurality of fragment images and transmits only the main fragment image to the cache server 700, thereby efficiently using the limited storage space of the cache server 700. It can be used as.

Referring to Figure 7, the image fragment management server 800 according to the present invention may include a surgical information receiving unit 810, a surgical image determining unit 820, an image segmentation processing unit 830, and an image transmission processing unit 840. These components may include programs or program modules that can be executed by one or more processors. Programs or program modules included in the video fragment management server 800 may be configured in the form of an operating system, application program, or program, and may be physically stored on various types of widely used storage devices. It can be saved as . Such a program or program module consists of one or more routines, subroutines, programs, objects, components, instructions, data structures, and specific operations ( It may include various forms for performing a task or executing a specific data type, and is not limited to these forms.

First, the surgery information receiver 810 is configured to receive surgery-related information, including information related to the surgery date and time, surgery target, surgery site location, and type of surgery, from the user terminal 400 or other servers or terminals that manage surgery information. You can.

The surgical image determination unit 820 is configured to determine a surgical image to be provided as a surgical reference image to the user terminal 400, and selects a relevant surgical image among the plurality of surgical images stored in the content server 600 based on the received surgery-related information. It may be configured to determine the image. In addition, the surgery image determination unit 820 uses the previous history information of the user terminal 400 to determine the similarity with reference image information previously used by the user of the user terminal 400 in relation to the type of surgery. A related surgical image may be determined among a plurality of surgical images stored in the content server 600.

In addition, the surgical image determination unit 820 uses image analysis of a plurality of slice images through artificial intelligence technology or operator processing based on at least one of the movement of the surgical tool, the amount of blood generated, and the degree of change in organs related to the surgery. Thus, it may be configured to determine at least one main fragment image among the plurality of fragment images and transmit only the main fragment image among the plurality of fragment images to the cache server 700. In this way, by determining the main fragment image that is judged to be important among the plurality of fragment images and transmitting only the major fragment image to the cache server 700, the limited storage space of the cache server 700 can be efficiently utilized, and from the medical staff's perspective, You can use your time efficiently by only referring to the main sculpture videos in a limited time.

The image segmentation processing unit 830 may be configured to divide the relevant surgical image determined by the surgical image determination unit 820 into a plurality of slice images of less than or equal to a predetermined capacity. At this time, a plurality of fragment images are sequentially generated based on the timestamp information of each section within the surgical image, and the image fragment management server 800 selects at least one fragment corresponding to the front among the plurality of sequentially generated fragment images. It may be configured to transmit the video to the cache server 700 through the video transmission processor 840.

The video transmission processing unit 840 is configured to perform transmission processing and transmission schedule management of the video to be delivered to the cache server 700, and transmits the video to the user terminal 400 based on proximity to the location of the user terminal 400 or the response speed of each cache server. One cache server connected to (400) can be determined. Additionally, the image transmission processing unit 840 may be configured to transmit at least one fragment image to the cache server 700 before the surgery date and time based on the surgery date and time information included in the surgery-related information.

For example, a scheduled surgery includes two types of surgery and may include a plan to sequentially perform a first surgery image related to the first surgery and a second surgery image related to the second surgery.

First, the first surgery image determined as a reference image in relation to the first surgery may be a sequence of five image fragments created sequentially based on the timestamp information (t1 to t6) of each section, and the first surgery image corresponding to the front part may be The video fragment and the second video fragment may be pre-stored in the cache server. At this time, if all of the first video fragments have been streamed and viewed through the user terminal 400 beyond the time point t2, for example, subsequent video fragments, such as the third video fragment, the fourth video fragment, and the fifth video fragment, are stored in the cache server 700. It may be configured to request and receive a video fragment from the video fragment management server 800 and store it. By delivering and storing subsequent video fragments to the cache server 700 in advance depending on whether the segmented video fragments are viewed or not, the surgical video that is the target of the user's viewing can be viewed without delay.

Meanwhile, if video streaming ends before t2, which is a predetermined standard through the user terminal 400, the reference video is determined to be unnecessary and the cache server 700 stores subsequent video fragments, for example, after the third video fragment. It can be configured not to request video fragments of . Additionally, in order to efficiently manage storage capacity in the cache server 700, video fragments whose video streaming has ended before a certain point may be determined to be not of interest to the user and all deleted.

In addition, when streaming viewing of the first surgery video is completed through the user terminal 400, the cache server 700 sends the front video fragment as at least a portion of the second surgery video corresponding to the next turn to the user terminal 400. ) can be configured to transmit. At this time, if the image fragment in front of the second surgery image is not stored in the cache server 700, for example, before viewing of the first surgery image ends, the cache server 700 stores the second image fragment at, for example, t4 or t5. It may be configured to request and receive an image fragment of the front part of the surgical image from the image fragment management server 800 and store it in advance.

First, a plurality of surgical images can be stored in the content server 600 (S910). At this time, the surgical image may include the type of surgery, surgical target, time stamp information for each section, and tag information.

The video fragment management server 800 may receive surgery-related information including the surgery date and time and type of surgery through the surgery information receiver 810 (S920).

The image fragment management server 800 may determine a related surgical image based on surgery-related information through the surgical image determination unit 820 (S930).

The image fragment management server 800 may divide the surgical image into a plurality of image fragments through the image segmentation processor 830. (S940) For example, the surgical image has a plurality of image fragments based on the timestamp information of each section. It may have been created sequentially.

The video fragment management server 800 determines one cache server connected to the user terminal 400 based on proximity to the location of the user terminal 400 or the response speed of each cache server through the video transmission processing unit 840. (S950)

The determined cache server 700 may receive and store some fragment images among the related surgical images from the image fragment management server 800 (S960).

Some fragment images may be provided as streaming through the cache server 700 determined when a surgical reference image is requested from the user terminal 400 (S970).

In addition, following some fragment images, the remaining fragment images can be requested from the user terminal 400 and provided as streaming through the cache server 700. (S980) The plurality of front portions of the corresponding surgery image is transmitted through the user terminal 400. If the fragment is streamed until a certain ratio is exceeded, the cache server 700 requests the video fragment management server 800 for the remaining video fragments, receives them, and stores them so that the entire video can be viewed without delay. can do.

The surgical stage image transmission system of FIG. 10 is a form in which a surgical stage determination server 900 is added to the configuration of the surgical image transmission system using the cache server shown in FIG. 6.

Here, the content server 600 may be configured to store a plurality of surgical images.

The image fragment management server 800 receives surgery-related information including the type of surgery, and divides and stores a plurality of surgery images stored in the content server 600 based on the received surgery-related information based on detailed surgical steps. It can be configured further.

The surgical stage determination server 900 may be configured to determine detailed surgical stages based on the type of surgery of the patient and determine each image piece related to each detailed surgical stage.

Additionally, the surgical stage determination server 900 may be configured to determine detailed surgical stages based on the type of surgery of the surgical patient and record information of a plurality of previous surgical patients who underwent the same surgery. Additionally, the record information of the patient who had previous surgery may include at least one of gender, age, surgery period, underlying disease, history of other surgeries, postoperative prognosis, and surgery recovery period. In other words, when determining the detailed surgical stage, record information of previous surgical patients can be used to utilize surgical stages and conditions with a good prognosis and recovery period under similar conditions to the current patient.

Additionally, the surgical stage determination server 900 may be configured to determine the detailed surgical stage by combining the detailed surgical stage of a plurality of previous surgery patients. For example, by combining the detailed surgical steps of the first previous surgery patient who underwent the same surgery type as the current surgery patient and the different detailed surgical stages of the second previous surgery patient who underwent the same surgery type as the current surgery patient. It can be configured to determine the detailed surgical stage of the current surgery patient.

In addition, the surgical stage decision server 900 uses a learning model using artificial intelligence to utilize record information from previous patients to derive detailed surgical stages with the best prognosis and recovery period under similar conditions to the current patient. Accordingly, it can be configured to recommend the optimal detailed surgical steps to the current surgical patient through an artificial intelligence learning model.

The cache server 700 receives and stores each of a plurality of image fragments related to each detailed surgical step from the image fragment management server 800, and receives a request for detailed surgical step images from the user terminal 400. It may be configured to transmit a plurality of image fragments related to detailed surgical steps determined by the surgical step decision server 900. At this time, the cache server 700 may determine the cache server at the optimal location among a plurality of cache servers based on proximity to the location of the user terminal 400 or response speed.

In addition, the cache server 700 checks whether each image fragment related to each detailed surgical step determined by the surgical step decision server 900 is stored, and the surgical patient's It may be configured to receive and store the corresponding image fragment from the image fragment management server 800 based on the surgery schedule. For example, the cache server 700 checks whether each image fragment related to each detailed surgical step is stored before the surgery date and time of the patient, for example, 1 hour or 1 day before, and saves the image fragment for the image fragment that is not stored. By making a request to the fragment management server 800, the corresponding video fragments can be stored in advance before the surgery date.

The user terminal 400 may be configured to receive a plurality of image fragments based on detailed surgical steps determined by the surgical step determination server 900.

One surgery can be divided into several detailed surgical steps, and image pieces can be divided for each detailed surgical step. In Figure 11, it is assumed that Patient 1, Patient 2, and Patient 3 have records of previously performing the same type of surgery, and Patient 4 is scheduled to undergo the same type of surgery.

For example, looking at the previous surgical record of patient 1, it has detailed surgical stages consisting of three stages: stage A, stage B, and stage C, and the previous surgical record of phantom limb 2 has stage D added between stages A and B, for a total of three stages. It has 4 detailed surgical steps. Additionally, in Patient 3's previous surgical record, stage E was added after stages A, B, and C, resulting in a total of 4 detailed surgical stages. Likewise, even in the case of the same type of surgery, some detailed surgical steps may be added or changed depending on the patient's situation and the situation of the surgery. As such surgical data accumulates, probabilistic judgments about the results of detailed surgical steps can be made. It becomes possible.

The detailed surgical steps determined by the surgical step decision server 900 for patient 4, who is scheduled to undergo the same type of surgery as patients 1 to 3, are a combination of the detailed surgical steps of patients 1 to 3, and are stages A and D. , includes a total of 5 detailed surgical stages consisting of stage B, stage C, and stage E, and detailed surgical stage images corresponding to these 5 stages can be provided to medical staff as reference images. Recommendation suggestions and decisions on such detailed surgical steps can be made using, for example, historical information from previous patients using a learning model using artificial intelligence to derive detailed surgical steps with the best prognosis and recovery period under similar conditions of the current patient. , it is possible to find and recommend detailed surgical stage conditions with the best prognosis and recovery conditions under patient environmental conditions such as same gender, similar age, and similar underlying disease.

Referring to FIG. 12, the detailed surgical stage of patient 4 determined by the surgical stage determination server 900 includes a stage A image, a stage B image, and a stage C image as the surgery image of patient 1, and also includes a stage A image, a stage B image, and a stage C image of the surgery image of patient 2. It may include intermediate level D images.

At this time, the cache server 700 may first check whether the stage D image of patient 1's surgical image and patient 2's surgical image is stored before the surgery date and time of the corresponding surgical patient. For example, as shown in FIG. 12, patient 1 All of the surgical images of stage A, stage B, and stage C were stored, but if it was determined that stage D, which was determined as the detailed surgical stage for reference among patient 2's surgery images, was not being stored, the cache server (700 ) may request transmission of the stage D image among the surgical images of patient 2 to the image fragment management server 800. At this time, based on the surgery schedule of patient 4, the image transmission date and time can be scheduled so that the cache server 700 receives and stores the stage D image of patient 2 before the surgery date and time.

Although various methods and systems according to embodiments of the present invention have been described above as various specific embodiments, this is merely an example, and the present invention is not limited thereto, and has the widest scope following the basic ideas disclosed in the present specification. must be interpreted. A person skilled in the art may implement a pattern of a shape not specified by combining and substituting the disclosed embodiments, but this also does not depart from the scope of the present invention. In addition, a person skilled in the art can easily change or modify the embodiments disclosed based on the present specification, and it is clear that such changes or modifications also fall within the scope of the present invention.

Claims

In a surgical image transmission system using a cache server,

A content server configured to store a plurality of surgical images;

an image fragment management server configured to receive surgery-related information including the surgery date and time and type of surgery, and determine a related surgery image among a plurality of surgery images stored in the content server based on the surgery-related information; and

A cache server configured to receive and store at least some of the related surgical images from the content server, and to transmit at least some of the surgical images to the user terminal when a reference image is requested from the user terminal.

Including,

The cache server is determined based on proximity to the location of the user terminal or response speed among a plurality of cache servers,

The image fragment management server is configured to divide the related surgical image into a plurality of fragment images of a predetermined capacity or less,

The plurality of fragment images are sequentially generated based on timestamp information of each section within the surgical image, and the image fragment management server sends at least one fragment image corresponding to the front part of the plurality of fragment images to the cache server. It is configured to be delivered to,

When more than a predetermined ratio of the at least one video fragment is streamed from the user terminal, the cache server requests the video fragment management server for the remaining video fragments excluding the front part among the plurality of video fragments and receives the remaining video fragments. and a surgical image transmission system configured to store.
The surgical image transmission system according to claim 1, wherein the image fragment management server is configured to transmit the at least one image fragment to the cache server before the surgery date and time based on the surgery date and time.
The method of claim 1, wherein the image fragment management server is configured to determine a related surgical image among a plurality of surgical images stored in the content server based on similarity judgment with reference image information previously used in the user terminal. , surgical video transmission system.
The method of claim 1, wherein when the plurality of fragment images are all streamed from the user terminal, the cache server transmits at least some of the second surgical images corresponding to the next sequence of the transmitted surgical images to the user terminal. Consisting of a surgical video transmission system.
The method of claim 1, wherein through image analysis of the plurality of fragment images, at least one main fragment image among the plurality of fragment images is selected based on at least one of the movement of surgical tools, the amount of blood generated, and the degree of change in organs related to the surgery. , and the image fragment management server is configured to transmit a main fragment image among the plurality of fragment images to the cache server.
In a method of transmitting surgical images using a cache server,

Storing a plurality of surgical images in a content server;

Receiving surgery-related information including the surgery date and time and type of surgery from an image fragment management server, and determining a related surgery image among a plurality of surgery images stored in the content server based on the surgery-related information;

determining a cache server connected to the user terminal among a plurality of cache servers based on proximity to the location of the user terminal or response speed;

Receiving and storing at least some of the related surgical images from the content server at the cache server; and

Transmitting at least some of the surgical images from the cache server to the user terminal when there is a request for a reference image from the user terminal

Including,

The image fragment management server is configured to divide the related surgical image into a plurality of fragment images of a predetermined capacity or less,

The plurality of fragment images are sequentially generated based on timestamp information of each section within the surgical image, and the image fragment management server sends at least one fragment image corresponding to the front part of the plurality of fragment images to the cache server. It is configured to be delivered to,

When more than a predetermined ratio of the at least one video fragment is streamed from the user terminal, the cache server requests the video fragment management server for the remaining video fragments excluding the front part among the plurality of video fragments, and receives the remaining video fragments. A method of transmitting surgical images further comprising the step of storing them.