KR20160136833A - medical education system using video contents - Google Patents

medical education system using video contents Download PDF

Info

Publication number
KR20160136833A
KR20160136833A KR1020150070927A KR20150070927A KR20160136833A KR 20160136833 A KR20160136833 A KR 20160136833A KR 1020150070927 A KR1020150070927 A KR 1020150070927A KR 20150070927 A KR20150070927 A KR 20150070927A KR 20160136833 A KR20160136833 A KR 20160136833A
Authority
KR
South Korea
Prior art keywords
image
medical
editing
content
client
Prior art date
Application number
KR1020150070927A
Other languages
Korean (ko)
Inventor
김기진
김용준
김태환
김빈스
Original Assignee
쓰리디메디비젼 주식회사
김기진
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 쓰리디메디비젼 주식회사, 김기진 filed Critical 쓰리디메디비젼 주식회사
Priority to KR1020150070927A priority Critical patent/KR20160136833A/en
Publication of KR20160136833A publication Critical patent/KR20160136833A/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00—Systems or methods specially adapted for specific business sectors, e.g. utilities or tourism
    • G06Q50/10—Services
    • G06Q50/20—Education
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00—Systems or methods specially adapted for specific business sectors, e.g. utilities or tourism
    • G06Q50/10—Services
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00—Systems or methods specially adapted for specific business sectors, e.g. utilities or tourism
    • G06Q50/10—Services
    • G06Q50/22—Social work
    • H04N13/0454—

Abstract

The present invention relates to a medical education system capable of providing rich and various information to users. According to the present invention, the medical education system can increase efficiency of teaching and learning by enabling a reader to view a surgery site without directly visiting the surgery site and also providing various medical information to the user, and also can increase participation opportunity in medical education and provide an education service covering various surgery cases without constraints of time and space. In addition, the present invention uses a two-dimensional image as an image of a content by converting the two-dimensional image into a three-dimensional image when an input image is a two-dimensional image, and can increase learning efficiency and education concentration by using a three-dimensional image as the image of the content by processing the three-dimensional image to have better cubic effect when the input image is a three-dimensional image. Also, the medical education content is configured not only to simply display a surgery image but also to establish a position requiring additional information in the image as a mapping point and at the same time display the additional information for each established mapping point by a pop-up method.

Description

A medical education system using video contents {medical education system using video contents}

The present invention relates to a medical education system using image contents. More specifically, the present invention relates to a medical education system using image contents, which comprises medical education contents including surgical images and additional information related to surgery, Education system.

With the expansion of Internet infrastructure and the development of digital device technology, the media and content industries have also developed exponentially, and various studies on services utilizing media and contents have been actively conducted.

Especially, as the quality of video contents is improved and the interest in education is increased, the demand for e-learning using video has been expanded. Such an e-learning system is not limited by time and space, Utilization and application areas are gradually increasing due to possible advantages.

However, while the demand for e - learning system is rapidly increasing in various fields, research on e - learning system in medical field is still insufficient. Especially, although medical is a very important field dealing with life, technology introduction and research are insufficient compared with e-learning systems in other fields.

This medical education is expensive because of the limited space and time because it is based on the training through surgery, 2) it takes a great deal of money for training and practice as the reliance of medical technology on advanced and advanced equipment is increased, and 3) Due to the fact that surgical know-how is not shared by the closed environment of the hospital, the shortage of specialists with skilled knowledge is intensifying because it has a long time and cost to train a skilled specialist.

Recently, the use of surgical techniques such as minimally invasive method, image-based surgery, and micro-surgery has been widely used as the field of application and utilization of surgery has increased. However, 2) it is difficult to store and manage data due to its huge data size because it is a video that captures the entire operation process; and 3) it has a high proportion of meaningless images not related to education. Use and sharing are difficult.

The map system disclosed in Korean Patent Publication No. 2002-0081377 (titled "remote internet technology map teaching delivery system and communication system using telecommunication network using an operator's vision") transmits a surgical image to a connected client, By providing two-way voice service of viewers, it is possible to provide education service that shows special technology in real-time.

However, since the guidance system, which has to concentrate on the operation, transmits the information to the viewer or responds to the viewer's answer while performing the surgery, the accuracy of the operation is lowered or the efficiency of information transmission is decreased. It is difficult to apply the present invention.

In general, medical surgery has various characteristics and characteristics such that various variables and unexpected situations arise and various actions are taken according to the judgment and experience of the master even though the same variables and unexpected situations are present. However, Because information can be delivered, the information delivery power is low, resulting in poor educational efficiency.

In addition, since the education is performed through the surgical image in which the timeline is not edited, the map system has a disadvantage that the browsing concentration and the learning efficiency are inferior in view of the characteristic of the surgical image having a high proportion of meaningless images without regard to education.

FIG. 1 is a block diagram showing a moving image providing system disclosed in Korean Patent Laid-Open No. 10-2011-0092633 (entitled "Method for providing a beauty and cosmetic surgery technique video using the Internet network").

The video providing system 100 of FIG. 1 includes a plurality of multimedia cameras 103 for capturing an HD-quality high-quality video and transmitting the video information to the server 103, An input data recording means 104 for recording information input data, a data providing means 105 for providing various medical information data to the server 103, And a suburban operation server 101 for providing an on-line live broadcast or video to the subscribing members 109 through the Internet 110 via the Internet 110, Video and medical information, and provides the multimedia contents to the connected members 109. Thus, even if the viewer does not visit the operating room directly, the medical education service .

However, since the multimedia data is produced by the projector 106, the multimedia data can be produced only by the expert skilled in the projector 106 in order to produce the multimedia data.

In recent years, as the 3D image processing technology and the technology for the 3D device have been developed, the penetration rate of the 3D image has been increasing. Such a 3D image has characteristics of high realism and high living feeling as compared with the 2D image, Since the multimedia is produced with only the edited operation image of the timeline, there is a limitation in that the sense of presence and feel of the image is inferior.

1) improve the efficiency of medical education and learning through medical education contents including various additional information related to surgical images and surgical images, 2) make medical education contents easily by using editing tools, 3) It is urgent to study the medical education system which can enhance the sense of presence and liveliness by processing the surgical image into 3D image.

SUMMARY OF THE INVENTION The present invention has been made to solve the above problems and it is an object of the present invention to provide medical education contents to a connected client by displaying a surgical video, It is possible not only to visit the operation site but also to receive various medical information as well as to increase the efficiency of education and learning and to expand the opportunities for participating in medical education, The present invention provides a medical education system that utilizes image contents that can perform learning about various surgical cases without using a medical image.

Another object of the present invention is to provide a content editing program for creating a medical education content, which comprises: determining whether an input image is a 2D image or a 3D image, and using the 3Dconversion algorithm when the input image is a 2D image, And to provide a medical education system using image contents capable of providing medical education services based on surgical images having excellent liveliness by converting input images into 3D.

In addition, the present invention provides a medical education contents display system that not only displays a surgical image but also sets a location requiring additional information in a video as a mapping point, and adds additional information about each set mapping point to a pop- So as to provide a medical education system using image contents which can provide more various medical related information.

According to an aspect of the present invention, there is provided a medical education system for providing a training service based on a surgical image, the system comprising: cameras for capturing an operation scene and acquiring the operation image; When receiving the time code classification information indicating the patch order of the frames of the surgical image and the additional information related to the surgical image, the medical client transmits a surgical image, input time code classification information, ; An editing client in which a content editing program for creating educational contents is installed; And a management server for storing the training content received from the editing client, the surgical video transmitted from the medical client, time code classification information, and additional information, and providing the training content in response to a request from a connected client, A time line editing unit for editing the time line of the operation video according to the time code classification information when the operation program received from the management server receives the operation video, the time code classification information, and the side information received from the management server; And an image display field in which a surgical image edited by the time line editing unit is displayed, wherein the additional information setting unit displays the additional information according to the display method determined by the additional information setting unit, And a content creating unit for creating an educational content for displaying the content The.

According to another aspect of the present invention, there is provided a medical education system for providing an educational service based on a surgical image, the system comprising: cameras for capturing an operation scene and acquiring the operation image; When receiving the time code classification information indicating the patch order of the frames of the surgical image and the additional information related to the surgical image, the surgical video, the inputted time code classification information, and the additional information are uploaded to the external server Client; An editing client that receives a content editing program for creating an educational content from an external server; Time code classification information and additional information uploaded by the content editing program and the medical client, and stores the stored content editing program, the operation video, the time code classification information, and the additional information at the request of the connected editing client And a medical education management server for storing the education contents by the editing client and providing the education contents according to a request of a client connected to the editing client, A supplementary information setting unit for registering contents of the additional information and determining an exhibition method, and a video display field for displaying a surgical image edited by the time line editing unit, And the display method determined by the additional information setting unit And a content creation unit for creating an educational content for displaying the additional information.

Further, in the present invention, the additional information may further include position information of a mapping point (P) which is an area where additional information is required in the image, and the content editing program displays the position of the mapping point (P) A mapping point setting unit for setting a mark symbol and an exposure time; And a tracking processing unit for tracking the position of the mapping point in the surgical image, wherein the content generating unit generates the mapping point P according to the position tracked by the tracking processing unit, the marking weight and the exposure time, ) Is preferably displayed on the surgical image displayed through the image display field.

The content editing program may further include a 3D image processing unit, wherein the 3D image processing unit includes a determination module for determining whether the input image is a 2D image or a 3D image using a predetermined image analysis algorithm; And a 3D image conversion module that is driven when the input image is determined to be a 2D image by the determination module and converts the input 2D image into a 3D image using a predetermined 3D conversion algorithm.

In the present invention, the 3D image processing unit is driven when the input image is determined to be a 3D image by the determination module or when a 3D image is input from the 3D image conversion module, and the 3D image, which is an input image, And a 3D image processing module for performing graphic editing for enhancing the stereoscopic effect of the 3D image processing module.

In the present invention, it is preferable that the educational contents expose the additional information corresponding to the mapping point in a toggle-mode pop-up mode.

According to the present invention having the above-mentioned problems and solutions, it is possible not only to browse the operation site even if the reader does not visit the surgery site, but also to provide various medical-related information to the reader, Increase opportunities for participation in education, and provide education services for various surgical cases without space and time constraints.

According to the present invention, when the input image is a 2D image, the 2D image is converted into a 3D image and used as an image of the content. If the input image is a 3D image, the 3D image is processed to have a more stereoscopic effect, It is possible to increase learning efficiency and education concentration.

Further, according to the present invention, the medical education contents do not merely display the surgical images, but set locations where additional information is required in the image as mapping points and additional information about each set mapping point is displayed in a pop- Thereby providing a variety of medical-related information.

FIG. 1 is a block diagram showing a moving image providing system disclosed in Korean Patent Laid-Open No. 10-2011-0092633 (entitled "Method for providing a beauty and cosmetic surgery technique video using the Internet network").
2 is a configuration diagram illustrating a medical education system according to an embodiment of the present invention.
Figure 3 is a block diagram illustrating the editing client of Figure 2;
FIG. 4 is a flowchart illustrating a process of manufacturing medical education contents according to the present invention.
Fig. 5 is a diagram showing the relationship shown in Fig.
Fig. 6 is a flowchart showing the contents production step of Fig. 5;
7 is a block diagram showing the contents editing program of Fig.
8 is an exemplary diagram for explaining the mapping point setting unit of FIG.
9 is a block diagram showing the 3D image processing unit of Fig.
FIG. 10 is an exemplary view showing medical education contents generated by the content generation unit of FIG. 7; FIG.
11 is a view of FIG.

Hereinafter, an embodiment of the present invention will be described with reference to the accompanying drawings.

2 is a configuration diagram illustrating a medical education system according to an embodiment of the present invention.

The medical education system 1 shown in Fig. 2 provides clients connected with contents (hereinafter referred to as medical education contents) composed of processed and edited surgical images and medical-related information (hereinafter referred to as additional information) related to the operation videos Thereby providing various medical education services to clients even if the clients do not visit the surgery site directly.

In addition, the medical education system 1 includes at least one camera 2 installed in an operating room for acquiring a surgical image by capturing an image of a home site, a terminal carried by the home doctor and uploading a surgical image acquired by the camera 2 (3) for determining editing information (contents) of medical education contents to be produced in an editing client (4) to be described later at the same time when the medical client (3) An editing client 4 that processes and edits a surgical image uploaded by the medical client 3 through a content editing program 7 to be described later according to the editing information to generate medical education contents, (6-N), which stores and manages the generated medical education contents and provides corresponding medical education contents at the request of browsing clients (6-1), ..., (6-N) (6-N), which is a terminal held by a lecturer and is connected to a medical education management server (5) to download medical education contents and browse the medical education contents, An application program (hereinafter referred to as a content editing program) 7 installed in the medical client 3 and the editing client 4 for processing and editing a surgical image and generating medical education contents including additional information, And a communication network 10 for providing a data movement path between the connection targets 3, 4, 5, 6-1, ..., 6-N.

The medical client 3 and the camera 2 are connected to the data communication network 10 and the surgical image obtained by the camera 2 is transmitted to the medical client 3 and stored.

In the present invention, the content editing program 7 is provided in the medical client 3 and the editing client 4 for convenience of explanation. However, the medical education system 1 is not limited to the cloud computing ), And the content editing program 7 may be stored in the medical education management server 5, and since such a cloud computing system is a technique commonly used in various software services, Is omitted.

The communication network 10 is connected to the data movement path between the medical education management server 5, the medical client 3, the editing client 4 and the browsing clients 6-1, ..., 6-N, And various known communication networks supporting data communication such as a wide area network (WAN), a mobile communication network, and a wired communication network can be applied.

At least one camera (2) is installed in the operating room, and the operation image is acquired by photographing the home site.

Further, the camera 2 transmits the obtained surgical image to the medical client 3.

The camera 2 may be a 2D camera for acquiring a 2D image or a 3D camera for acquiring a 3D image. In detail, a stereo camera, pan-tilt, and zoom A variety of configurations capable of taking an operation site such as a high-definition PTZ camera, a micro camera mounted on a surgical instrument mounted on a surgical instrument such as a microscope, and the like can be applied.

The medical client 3 is a digital terminal possessed by a medical staff having a skilled knowledge of performing a house or a house, and is a desk-top PC, a note-book, a tablet PC, A smart phone, a personal digital assistant (PDA), and the like.

The medical client 3 also includes a communication interface module for supporting connection with the communication network 10, input means for inputting a command from a user (user), and a monitor for displaying the content.

The medical client 3 is also provided with a content editing program 7 of FIG. 7 to be described later.

The medical client 3 also exports the operation image transmitted from the camera 2 through the content editing program 7 and uploads the operation image to the medical education management server 5. At this time, the medical education management server 5 is preferably constructed as a cloud server when the present invention is implemented as a cloud computing system as described above.

In addition, the medical client 3 provides the editing client 4 with editing information for the medical education contents to be produced through the installed content editing program 7. At this time, the editing information includes time code classification information indicating the arrangement order of the surgical images, information on the position (hereinafter referred to as mapping point) of the object requiring additional information in the surgical image frame, additional information (video, , Link information, etc.), and additional information (video, audio, text, link information, etc.) related to the currently displayed surgical image.

Further, when the medical education contents are produced by the editing client 4 according to the edited information provided by the medical client 3, the medical client 3 receives the medical education contents and examines them. At this time, the medical education contents that have been reviewed by the medical client 3 are transmitted to the medical education management server 5 and stored.

The editing client 4 is a digital terminal possessed by an editor who is skilled in the content editing program 7. Specifically, the editing client 4 is a desk-top PC, a note-book, a tablet PC A PC, a smart phone, a personal digital assistant (PDA), and the like.

In addition, the editing client 4 is provided with a content editing program 7 of Fig. 7 to be described later.

The editing client 4 accesses the medical education management server 5 after executing the content editing program 7 and down-loads the surgical video and editing information uploaded by the medical client 3 Importing. In the present invention, for convenience of explanation, the editing client 4 accesses the medical education management server 5 to separately download and import the editing information. However, It is possible to provide a bi-directional conversation service so that a medical person and an editor share direct editing information.

Further, the editing client 4 processes and edits the surgical image imported through the content editing program 7 according to the editing information to produce medical education contents. At this time, the medical education contents include a surgery image in which a time code is classified (edited), mapping points to be tracked, additional information related to each of the mapping points, and the like.

The viewing clients 6-1, ..., and 6-N are terminals for displaying medical education contents received from the medical education management server 5. [ At this time, the viewing clients 6-1, ..., 6-N may or may not support the 3D image.

The medical education management server 5 stores the medical education contents transmitted from the editing client 4 and stores the medical education contents stored in the medical education contents storage unit 6-1, Lt; / RTI > At this time, the medical education management server 5 generates a list of the stored medical education contents and provides the list to the browsing clients 6-1, ..., 6-N, And providing medical education contents. Since the list generation method is a technique commonly used in an application system, a detailed description will be omitted.

In addition, the medical education management server 5 stores the surgical image and the editing information uploaded by the medical client 3 and transmits the uploaded surgical image and editing information to the editing client 4 at the request of the editing client 4 send.

In addition, the medical education management server 5 includes a plurality of cloud database servers for storing data according to data types when the present invention is implemented as a cloud computing system, and a utility server for storing a content editing program.

In addition, the medical education management server 5 may be implemented as a contents management system (CMS) for contents management and a contents delivery network (CDN) for enhancing the stability of contents provision. The detailed description will be omitted.

Figure 3 is a block diagram illustrating the editing client of Figure 2;

The editing client 4 has a monitor 41 provided in a typical digital terminal in which general characters, symbols, contents and the like are displayed, a communication interface 41 for supporting data communication between the medical client 3 and the medical education management server 5, An input unit 45 for inputting characters and symbols from a user (editor), a control unit 47 for controlling an OS (operating system) of the terminal and controlling the object to be controlled, And a program management unit 49 installed in order to execute the program.

The program management section 49 manages and controls the content editing program 7 to be described later. In the present invention, the content editing program 7 is installed in the medical client 3 and the editing client 4 for convenience of explanation. However, as described above, the present invention is not limited to the cloud computing system It is needless to say that the content editing program 7 can be configured to be stored in the utility data server of the medical education management server 5. [

FIG. 4 is a flowchart for explaining a process of manufacturing the medical education contents of the present invention, and FIG. 5 is a diagram showing the relationship shown in FIG.

The medical education contents production process S200 includes an image acquisition step S210 in which a home site is photographed by the camera 2 to acquire a surgical image as shown in FIGS. 4 and 5, A first uploading step S220 of exporting the surgical image and the time code classification information obtained in step S210 and uploading it to the medical education management server 5 and the editing client 4 in the medical education management server 5 (S230) for editing the surgical image according to the time code classification information after downloading and importing the surgical video and time code classification information stored in the editing client (4) and the editing client (4) in the primary editing step S230 A second uploading step S240 of uploading the first surgical image edited by the medical client 3 to the medical education management server 5 and a second uploading step S240 of downloading the first surgical image stored in the medical education management server 5 by the medical client 3, After the first inspection, A third uploading step S260 in which the medical client 3 uploads the editing information to the medical education management server 5 when there is no modification by the first authentication step S250 and the second authentication step S250, A content creation step S270 for processing and editing the first surgical image in accordance with the editing information uploaded to the medical education management server 5 by the editing client 4 and processing the surgical image into a 3D image to produce medical education contents A fourth uploading step S280 of the editing client 4 uploading the medical education contents produced by the content producing step S270 to the medical education management server 5 and the fourth uploading step S280 of the medical client 3, (S290) of inspecting the medical education contents uploaded by the uploading step (S280), and editing of the medical education contents is completed when the correction is not made by the second checking step (S290).

Fig. 6 is a flowchart showing the contents production step of Fig. 5;

6, the content creation step S270 includes an image input step S271 for inputting a surgical image and a determination step for determining whether the image input through the image input step S271 is a 2D image or a 3D image, A 3D image conversion step S273 for converting an input image into a 3D image using a predetermined 3D conversion algorithm when the input image is a 2D image by a determination step S272 and a determination step S272, A step of advancing the 3D image input from the 3D image conversion step S273 or performing an image editing process for enhancing the stereoscopic effect of the image such as rendering of the 3D image, A mapping point setting step (S275) of setting a mark symbol and an exposure time to be displayed at a position of the mapping point (P) in the 3D image processed by the image processing step (S274) S275) A tracking processing step S276 for tracking the position of the fixed mapping point and a mapping point according to the position, mark symbol and exposure time tracked by the tracking processing step S276 in the 3D image (S278) for registering the content of the additional information corresponding to the mapping point set by the mapping point setting step (S275) and determining the display method of the additional information (S278) And a content creation step S279 for creating a medical education content in which the additional information is exposed according to the display method set by the 3D image and the additional information setting step S278 in which the mapping point is matched by the matching step S277 .

In this case, the content creation step S279 may set the time at which the additional information is exposed to be equal to the exposure time at the corresponding mapping point.

7 is a block diagram showing the contents editing program of Fig.

The content editing program 7 is an application program installed in the medical client 3 and the editing client 4 and is a graphic user interface (GUI) having an editing tool for processing and editing an imported surgical image, ) To generate and produce medical education contents as interaction design.

In the present invention, the content editing program 7 is installed in the medical client 3 and the editing client 4 for convenience of explanation. However, when the present invention is implemented in the cloud computing, (7) may be stored and operated in the medical education management server (5).

The content editing program 7 includes a data input / output unit 72 for inputting / outputting data to / from the terminal of the medical client 3 or the editing client 4, a memory 71 for storing data, And the uploading information such as the operation image, the time code classification information, the first operation image, the editing information, the medical education contents, and the like, and then uploads the upload information to the medical education management server 5 A time line editing unit 75 for editing the time line of the surgical image according to the inputted time code classification information, a position and position of a mapping point which is an object requiring additional information among the objects in the image frame, A mapping point setting unit 76 for setting a mapping point set by the mapping point setting unit 76, A tracking processing unit 78 for tracking the mapping point set by the mapping point setting unit 76, a tracking processing unit 78 for processing the time-line-edited surgical image into a 3D image A content generating unit 80 for generating medical education contents based on the data processed by the components 75, 76, 77, and 78, The control unit 70 controls the control objects 71, 72, 73, 74, 75, 76, 77, 78, 79, .

The interface processing unit 73 displays the manufactured graphic user interface according to a predetermined procedure. When a command is requested through a graphical user interface currently displayed from the user, the interface processing unit 73 inputs the command to the corresponding component. At this time, the graphical user interface includes an editing function for editing a time line of a surgical image, a mapping point setting function for setting a mapping method while setting a mapping point, additional information related to each mapping point is registered, A function of setting a display method of information, a function of registering additional information as related information on a currently displayed image, a function of tracking a mapping point, a function of receiving basic information related to a center or a medical center, , An input function for inputting data to be uploaded, and the like.

The control unit 70 controls and controls the control objects 71, 72, 73, 74, 75, 76, 77, 78, 79, And when the operation image and the edit information are input through the graphic user interface, the upload processing unit 74 is controlled to upload the inputted operation image and edit information to the medical education management server 5.

When the medical education contents are generated by the content generation unit 80, the control unit 70 controls the upload processing unit 74 to upload the generated medical education contents to the medical education management server 5.

The memory 71 stores a preset tracking algorithm and a mapping setting algorithm.

Also stored in the memory 71 are matching information of graphical user interfaces (GUIs) produced by the medical client 3 and the editing client 4.

The data input / output unit 72 inputs and outputs data with the terminals of the medical client 3 or the editing client 4.

When the data is inputted through the graphic user interface, the upload processor 74 exports the data inputted according to the format of the medical education management server 5 and uploads the data to the medical education management server 5. At this time, the data are, in detail, the operation image registered by the medical client 3 or the time code classification information registered by the medical client 3, the editing information registered by the medical client 3 (additional information, additional information And basic information), a first surgical image registered by the editing client 4, medical education contents registered by the editing client 4, and the like.

That is, the editing client 4 or the medical client 3 exports and uploads data through a graphical user interface displayed when the content editing program 7 is activated, downloads the re-uploaded data, .

The time line editing unit 75 edits the time line of the surgical video in accordance with the input time code classification information and downloads the surgical video and time code classification information from the medical education management server 5, do. At this time, the technique and method for editing the timeline of the image are techniques commonly used in the multimedia and image processing technology, and thus a detailed description thereof will be omitted.

The first operation image processed by the time line editing unit 75 is exported by the upload processing unit 74 and then uploaded to the medical education management server 5.

The time code classification information applied to the time line editing unit 75 is set by the medical client 3 through the first uploading step S220 described above.

8 is an exemplary diagram for explaining the mapping point setting unit of FIG.

The mapping point setting unit 76 sets the position, display method, and display period T of the mapping point, which is an object requiring additional information among the objects of the image frame 700. At this time, It is preferable that any one of them is used.

In addition, the mapping point setting unit 76 displays the mapping point at the corresponding position during the input period T by using the stored mapping setting algorithm when the location of the mapping point is clicked from the user.

For example, the mapping point setting unit 76 sets the clicked position as a mapping point P when a specific position among the objects 710, 720, 730, and 740 of the image frame is clicked, The set mapping point P is indicated by a known marking symbol.

The additional information setting unit 77 registers the additional information related to the mapping point set by the mapping point setting unit 76. [ At this time, the additional information is composed of video, audio, image, text, etc., and can be provided to a viewer through a pop-up system of a toggle mode or a separate graphic user interface when a mapping point is clicked by a viewer.

That is, the present invention provides additional information related to each of the mapping points as well as the actual operation image to the trainee, so that the trainee can learn various parameters that may occur during the operation and information on coping with the unexpected situation.

The tracking processing unit 78 tracks the mapping point P set by the mapping point setting unit 76 so that the position of the mapping point corresponding to the field of view movement of the image is moved.

The tracking processing unit 78 tracks the trajectory of the feature point using a feature matching method in which similar feature points are found and linked in the forward and backward frames or adjacent frames within a certain range, It is possible to trace the trajectory of the mapping point P by connecting SURF matching to compare the SURF descriptors between the minutiae points and finding similar similar minutiae.

The tracking processor 78 tracks the mapping point P by using the SURF matching method. However, the operation of the tracking processor 78 is not limited thereto. And various known techniques and methods such as a similar feature point detection method including SIFT and the like can be applied.

9 is a block diagram showing the 3D image processing unit of Fig.

The 3D image processing unit 79 processes the edited image by the time line editing unit 75 into a 3D image so that the browsing client 6 can view the medical education contents as a 3D image when 3D is supported, Accordingly, a more realistic and lively image can be read.

9, the 3D image processing unit 79 includes a determination module 791 for determining whether the input image is a 2D image or a 3D image using a predetermined image analysis algorithm, and a determination module 791 for determining whether the input image is a 2D image or a 3D image, A 3D image conversion module 793 which is driven when the input image is judged to be a 2D image and transforms the 2D image into a 3D image and inputs the converted 3D image to a 3D image processing module 795 to be described later, A graphics editing process is performed to increase the stereoscopic effect of the image, such as rendering a 3D image, which is driven when the input image is determined to be a 3D image by the input unit 791 or when the 3D image is input from the 3D image conversion module 793, And a 3D image processing module 795.

The 3D image converted and processed by the 3D image processing unit 79 is input to the content generation unit 80. [

The 3D image conversion module 793 cuts each of the frames of the input 2D image and converts the cut frame into a 3D image using a known 3D conversion algorithm. At this time, the 3D conversion algorithm extracts at least one feature information from the image frame, calculates a weight between pixels of the image frame and adjacent pixels based on the extracted characteristic information, (2D image) is converted into 3D image by setting the depth value of the image frame based on the information and updating the paying back in consideration of the weight.

In the present invention, the 3D image conversion module 793 converts the 2D image into the 3D image using the 3D conversion algorithm that updates the depth value according to the weight, The algorithm is not limited thereto, and various known methods can be applied.

The content generation unit 80 generates a first surgical image edited by the time line editing unit 75, a mapping point processed by the mapping point setting unit 76 and the tracking processing unit 78, ) And the basic information registered from the medical client 3, and produces the medical education contents 900 of FIG. 8 to be described later.

The medical education contents 900 generated by the content generation unit 80 are uploaded to the medical education management server 5 by the upload processing unit 74 under the control of the control unit 70. [

FIG. 10 is an exemplary view showing a medical education content generated by the content generation unit of FIG. 7, and FIG. 11 is an actual view of FIG.

The medical education contents 900 are multimedia data provided to the browsing clients 6-1, ..., 6-N produced by the content generating unit 80 of FIG. 5 and connected thereto.

7 and 8, the medical education contents 900 includes a time line editing unit 75, a mapping point setting unit 76, an additional information setting unit 77, a tracking processing unit 78, A related information display field 920 in which related information related to a surgical image displayed through the image display field 910 is displayed, A first display field 930 for displaying icons for controlling contents such as contents search, list view, and information display, a second display field 940 for displaying basic information, And a reproduction control field 950 for controlling.

The medical education contents 900 further includes additional information 970 associated with the clicked mapping point when any one of the mapping points P1, P2, and P3 is clicked by the user (viewers) And displays it on the monitor of the browsing client in a pop-up manner.

1: medical education system 2: camera 3: medical client
4: Edit Client 5: Medical Education Management Server
6-1, ..., 6-N: browsing clients 7: content editing program
10: communication network 70: control unit 71: memory
72: data input / output unit 73: interface processing unit
74: Upload processing unit 75: Timeline editing unit 76: Mapping point setting unit
77: additional information setting unit 78: tracking processing unit 79: 3D image processing unit
80:

Claims (6)

What is claimed is: 1. A medical education system for providing educational services based on surgical images, comprising:
Cameras for capturing an operation scene and acquiring the operation image;
A time code classification information indicating an arrangement order of frames of the surgical image and additional information related to the surgical image, a medical client for transmitting a surgical image, input time code classification information, ;
An editing client in which a content editing program for creating educational contents is installed;
And a management server for storing the training content received from the editing client, the surgical video transmitted from the medical client, time code classification information, and additional information, and providing the training content according to a request from a connected client,
The content editing program
A time line editor for editing the time line of the surgical video according to the time code classification information when the operation video, the time code classification information and the additional information transmitted from the management server are received; And an image display field in which a surgical image edited by the time line editing section is displayed, wherein the additional information is displayed according to an exhibition method determined by the additional information setting section And a content generation unit for generating the educational contents. What is claimed is: 1. A medical education system for providing educational services based on surgical images, comprising:
Cameras for capturing an operation scene and acquiring the operation image;
The time code classification information indicating the arrangement order of the frames of the surgical image and the additional information related to the surgical image, the operation image, the input time code classification information, and the additional information inputted by the cameras are uploaded to the external server Medical client;
An editing client that receives a content editing program for creating an educational content from an external server;
Time code classification information and additional information uploaded by the content editing program and the medical client, and stores the stored content editing program, the operation video, the time code classification information, and the additional information at the request of the connected editing client And a medical education management server for storing the education contents by the editing client and providing the education contents according to a request of a connected client,
The content editing program
A time line editing unit for editing the time line of the operation video according to the time code classification information, an additional information setting unit for registering contents of the inputted additional information and determining an exhibition method, And an image display field on which the operated surgical image is displayed, the apparatus comprising: a content generation unit for generating an educational content for displaying the supplementary information according to the display method determined by the supplementary information setting unit. The method according to claim 1 or 2, wherein the additional information further includes position information of a mapping point (P)
The content editing program
A mapping point setting unit for setting a mark symbol and an exposure time displayed at a position of the mapping point P in the surgical image;
Further comprising a tracking processing unit for tracking the position of the mapping point (P) in the surgical image,
Wherein the content generation unit generates the training content displayed on the surgical image displayed on the image display field by the mapping point (P) according to the position tracked by the tracking processing unit, the marking weight, and the exposure time Medical education system. The content editing program according to claim 3, wherein the content editing program further comprises a 3D image processing unit,
The 3D image processing unit
A determination module for determining whether the input image is a 2D image or a 3D image using a predetermined image analysis algorithm;
And a 3D image conversion module that is driven when the input image is determined to be a 2D image by the determination module and converts the input 2D image into a 3D image using a predetermined 3D conversion algorithm. 5. The apparatus according to claim 4, wherein the 3D image processing unit
When the input image is determined to be a 3D image by the determination module or when a 3D image is input from the 3D image conversion module, graphic editing is performed to enhance 3D sensation such as rendering of an input 3D image And a 3D image processing module for performing a 3D image processing operation. The medical education system according to claim 5, wherein the training content exposes additional information corresponding to the mapping point in a toggle-mode pop-up mode.
KR1020150070927A 2015-05-21 2015-05-21 medical education system using video contents KR20160136833A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR1020150070927A KR20160136833A (en) 2015-05-21 2015-05-21 medical education system using video contents

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020150070927A KR20160136833A (en) 2015-05-21 2015-05-21 medical education system using video contents

Publications (1)

Publication Number Publication Date
KR20160136833A true KR20160136833A (en) 2016-11-30

Family

ID=57707544

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020150070927A KR20160136833A (en) 2015-05-21 2015-05-21 medical education system using video contents

Country Status (1)

Country Link
KR (1) KR20160136833A (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR102071606B1 (en) * 2019-04-09 2020-01-30 동서대학교 산학협력단 Assessment System for Error Situation in Nursing Based on Virtual Reality
WO2020116701A1 (en) * 2018-12-05 2020-06-11 쓰리디메디비젼 주식회사 System for producing surgical video and method for producing surgical video
CN111798727A (en) * 2020-05-26 2020-10-20 福建省立医院 Virtual lateral ventricle puncture auxiliary training method, device, equipment and medium
WO2021215800A1 (en) * 2020-04-21 2021-10-28 사회복지법인 삼성생명공익재단 Surgical skill training system and machine learning-based surgical guide system using three-dimensional imaging

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2020116701A1 (en) * 2018-12-05 2020-06-11 쓰리디메디비젼 주식회사 System for producing surgical video and method for producing surgical video
KR20200068355A (en) 2018-12-05 2020-06-15 쓰리디메디비젼 주식회사 Surgical video procution system and surgical video procution method
US11185388B2 (en) 2018-12-05 2021-11-30 3D Medivision Inc. Surgical video production system and surgical video production method
KR102071606B1 (en) * 2019-04-09 2020-01-30 동서대학교 산학협력단 Assessment System for Error Situation in Nursing Based on Virtual Reality
WO2021215800A1 (en) * 2020-04-21 2021-10-28 사회복지법인 삼성생명공익재단 Surgical skill training system and machine learning-based surgical guide system using three-dimensional imaging
CN111798727A (en) * 2020-05-26 2020-10-20 福建省立医院 Virtual lateral ventricle puncture auxiliary training method, device, equipment and medium
CN111798727B (en) * 2020-05-26 2021-12-14 福建省立医院 Virtual lateral ventricle puncture auxiliary training method, device, equipment and medium

Similar Documents

Publication Publication Date Title
US10996915B2 (en) Surrogate visitor mixed-reality live environment sharing system with remote visitors
CN110300909B (en) Systems, methods, and media for displaying an interactive augmented reality presentation
US20190026945A1 (en) Real-time immersive mediated reality experiences
Pea et al. The diver project: Interactive digital video repurposing
Reyna The potential of 360-degree videos for teaching, learning and research
Kurillo et al. 3D teleimmersion for collaboration and interaction of geographically distributed users
CN106170101A (en) Contents providing system, messaging device and content reproducing method
CN107798932A (en) A kind of early education training system based on AR technologies
Nebeling et al. Xrstudio: A virtual production and live streaming system for immersive instructional experiences
JP2002366972A (en) Pseudo three-dimensional space representation system, pseudo three-dimensional space construction system, game system and electronic map providing system
CN112135158B (en) Live broadcasting method based on mixed reality and related equipment
US11501658B2 (en) Augmented reality platform for collaborative classrooms
TW202123178A (en) Method for realizing lens splitting effect, device and related products thereof
US11181862B2 (en) Real-world object holographic transport and communication room system
KR20160136833A (en) medical education system using video contents
KR20200134575A (en) System and method for ballet performance via augumented reality
CN105791390A (en) Data transmission method, device and system
Venigalla et al. Towards enhancing user experience through a web-based augmented reality museum
CN114463470A (en) Virtual space browsing method and device, electronic equipment and readable storage medium
Langlotz et al. AR record&replay: situated compositing of video content in mobile augmented reality
KR100901111B1 (en) Live-Image Providing System Using Contents of 3D Virtual Space
KR20160069663A (en) System And Method For Producing Education Cotent, And Service Server, Manager Apparatus And Client Apparatus using therefor
CN108320331B (en) Method and equipment for generating augmented reality video information of user scene
Gomes Jr et al. Semi-automatic methodology for augmented panorama development in industrial outdoor environments
Lundman Bringing planning to the streets: using site-specific video as a method for participatory urban planning

Legal Events

Date Code Title Description
A201 Request for examination
E902 Notification of reason for refusal
E601 Decision to refuse application