JP2019185726A - Video browsing device, control method of video browsing device, and program - Google Patents

Abstract

To provide a video browsing device, a control method of the video browsing device, and a program that enable a user to browse optimal surgical operation videos.SOLUTION: A surgical operation video browsing device 1 includes: a video input unit 10 in which videos are input and registered in a database 200; a scene analysis unit 20 which extracts a feature amount of a scene in the registered video; a scene name assignment unit 30 which assigns a scene name to each scene and associates each scene with the scene name; a descriptive information registration unit 40 which associates a video with descriptive information described with regard to the video; and an extraction unit 50 which extracts related videos related to a video, from the database 200, on the basis of at least the scene name and the descriptive information.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a moving image browsing device, a method for controlling a moving image browsing device, and a program.

  In the technical field of viewing surgical videos, Patent Document 1 divides the optimal technique video of each technique from the surgical video and registers it in the database, and creates a simulation video for surgery by combining the registered technique videos Techniques to do this are disclosed.

JP 2005-301453 A

  However, the simulation video of Patent Document 1 includes an optimal technique video for those who view the simulation video because the optimal technique video for each technique is selected according to the subjectivity of the person who created the simulation video. Not necessarily.

  In addition, since the technique video is edited in the simulation video of Patent Document 1, a portion that the viewer of the simulation video wants to watch may be cut, and the user desires to watch an unedited video. I couldn't respond.

  Then, the subject of this invention is providing the moving image browsing apparatus which can make a user browse the optimal operation | movement video, the control method of a moving image browsing apparatus, and a program.

In order to solve the above problems, one aspect of the video browsing apparatus of the present invention is
A video input unit for inputting a video and registering it in the database;
A scene analysis unit that extracts a feature amount of a scene in the registered moving image;
A scene name assigning unit that assigns a scene name to each scene and associates the scene name with each scene;
A description information registration unit for associating description information described for the video with the video;
An extraction unit that extracts a related moving image related to the moving image based on at least the scene name and the description information from the database;
It is characterized by that.

  In this aspect, “description information” is a concept including, for example, a moving image title, a moving image description, a tag, a category, and the like.

  According to this aspect, since the related moving image is extracted based on at least the scene name and the description information for the input moving image, the user is made to view the optimal surgical moving image.

Another aspect of the moving image browsing apparatus of the present invention is to solve the above problems,
A video input unit that inputs surgical videos and registers them in the database;
A scene analysis unit that extracts a feature amount of the scene in the registered surgical video;
A scene name assigning unit that assigns a scene name to each scene and associates the scene name with each scene;
A description information registration unit for associating description information described for the surgical video with the surgical video;
An extraction unit that extracts a related moving image related to the surgical moving image based on at least the scene name and the description information from the database;
It is characterized by that.

  In another aspect, the “scene” is a concept including a procedure, for example, and the “scene name” is a concept including a procedure name. The “description information” is a concept including, for example, a title of an operation video, a technique, a description of the operation video, a tag, a category, and the like.

  According to the another aspect, since the related video or the related technique video is extracted based on at least the playback time of the technique video as the scene, the browsing history, and the tag with respect to the input surgical video, To view the optimal surgical video or procedure video.

The video browsing device of one embodiment
The scene name assigning unit assigns the scene name based on a predetermined name according to the order of the scenes.
It is characterized by that.

  According to the moving image browsing apparatus of this embodiment, since the scene name is assigned even if the user does not manually assign the scene name, a moving image browsing apparatus that is convenient for the user is provided.

The video browsing device of one embodiment
Based on the scene name and the playback time of the scene, a graph display unit that displays the playback time of the scene in a graph,
The extraction unit extracts the related moving image including a scene related to the scene of the selected scene name when the scene name displayed in the graph is selected.
It is characterized by that.

  According to the moving image browsing apparatus of this embodiment, by selecting a scene displayed in a graph, it is possible to display another surgical moving image including a scene highly related to the scene included in the surgical moving image. As a result, if a scene of a surgical video that is focused on takes a lot of time, a hint that leads to improvement can be obtained by comparing it with other surgical videos.

The video browsing device of one embodiment
A marking portion for marking a predetermined position of the surgical video,
The scene analysis unit defines the scene based on the marked position.
It is characterized by that.

  According to the moving image browsing apparatus of this embodiment, since the scene can be defined by the user, it is possible to view the surgical moving image according to the user's needs.

The video browsing device of one embodiment
A browsing history recording unit that records browsing history for each surgical video or for each scene,
The extraction unit extracts a related moving image related to the surgical video based on at least one of the scene name, the description information, the browsing history, and the playback time of the surgical video, or a combination thereof. It is characterized by.

  According to the moving image browsing apparatus of this embodiment, a surgical moving image that is optimal for the user and to be viewed by the user is browsed.

In order to solve the above problem, one aspect of the control method of the moving image browsing apparatus of the present invention,
Entering the surgical video and registering it in the database by the video input unit;
A step of extracting a feature amount of a scene in the registered surgical video by a scene analysis unit;
A step of assigning a scene name to each scene by the scene name assigning unit and associating the scene name with each scene;
A step of associating description information described about the surgical video with the surgical video by a description information registration unit;
Extracting a related moving image related to the surgical moving image based on at least the scene name and the description information from the database by the extraction unit;
It is characterized by that.

  According to this aspect, since the related moving image is extracted based on at least the scene name and the description information for the input moving image, the user is made to view the optimal surgical moving image.

In order to solve the above problems, one aspect of the program of the present invention is
A program in a video browsing device, the program being stored in a computer,
Entering surgical videos and registering them in the database;
Extracting a feature amount of a scene in the registered surgical video;
Assigning a scene name to each scene and associating the scene name with each scene;
Linking the description information described about the surgical video to the surgical video;
Extracting a related video associated with the surgical video based on at least the scene name and the description information from the database;
It is characterized by that.

  According to this aspect, since the related moving image is extracted based on at least the scene name and the description information for the input moving image, the user is made to view the optimal surgical moving image.

  As is clear from the above, according to the moving image browsing apparatus, the control method of the moving image browsing apparatus, and the program of the present invention, it is possible to allow the user to view an optimal surgical moving image. Further, even when there are videos that have been stored, in the video browsing device of the present invention, the control method of the video browsing device, and the program, by registering these videos in the database, these videos can be used effectively. be able to.

It is a block diagram which shows the structure of the surgery moving image browsing apparatus in 1st Embodiment of this invention. It is a figure which shows an example of the data structure for managing a surgery moving image etc. It is a figure which shows an example of a surgery moving image browsing screen. It is a figure for demonstrating the example of a display of the graph displayed by the graph display mode. It is a figure which shows the example of a display of a related moving image selection screen. It is a figure which shows the example of a display of the surgery moving image browsing screen in the case of a comparison reproduction. It is a flowchart which shows the process sequence of a surgery moving image browsing apparatus. It is a flowchart which shows the process sequence of a surgery moving image browsing apparatus.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

(First embodiment)
A surgical video browsing apparatus 1 according to a first embodiment of the present invention will be described with reference to FIG.

(Overview of surgical video viewing device)
FIG. 1 is a block diagram illustrating a configuration of the surgical moving image browsing apparatus according to the present embodiment. As shown in FIG. 1, the surgical video browsing apparatus 1 includes a video input unit 10, a technique analysis unit 20, a technique name assignment unit 30, a description information registration unit 40, an extraction unit 50, and a browsing history recording unit 60. A display control unit 70, a data storage unit 80, a display unit 90, an operation unit 100, and a storage unit 110. In addition, the surgical moving image browsing apparatus 1 can communicate with an external database 200 via, for example, the Internet.

  The video input unit 10 inputs a surgical video. When the user stores the surgical video in a predetermined folder or drags and drops the surgical video to a predetermined area on the video registration screen, the video input unit 10 inputs the surgical video and registers it in the database 200. To do. The video input unit 10 displays a file dialog when the registration button is clicked on the video registration screen, and inputs the selected surgical video file when a surgical video file is selected in the file dialog. It may be registered in the database 200.

  A procedure analysis unit 20 as a scene analysis unit analyzes a procedure that is a scene in a registered surgical moving image. The technique analysis unit 20 includes a histogram analysis circuit and an edge extraction circuit. The histogram analysis circuit extracts a feature amount of an image by calculating a pixel histogram of R, G, and B color component images in a surgical moving image. The edge extraction circuit extracts the feature amount of the image by extracting the edge of the image. The technique analysis unit 20 defines a surgical moving image for each of several techniques according to the extracted feature amount. Moreover, since the procedure time is determined by defining the procedure, the procedure analysis unit 20 stores the procedure and the procedure time in the database 200 in association with each other.

  A technique name assigning unit 30 as a scene name assigning part assigns a technique name to each of the defined techniques. Since the order of procedures is determined to some extent depending on the type and procedure of surgery, such as pre-operative preparation, incision, separation, resection, and post-operative processing, a procedure name corresponding to each procedure is determined in advance. The technique name given by the technique name giving unit 30 may be corrected by the user using the operation unit 100. On the movie registration screen, a procedure name may be selected or input for each procedure while viewing the registered surgical movie.

  The procedure name assigning unit 30 determines whether each procedure depends on whether the edge portion in the image of the operation movie or the image portion obtained by extracting the distal end portion of the treatment tool corresponds to the characteristic movement pattern of the pre-registered image. You may make it learn by machine learning which technique name is attached to. In this case, an operation moving image stored in the database 200 may be used as an image to be compared.

  The description information registration unit 40 associates the description information described about the surgical video with the surgical video and registers it in the database 200. The description information includes, for example, a moving image title, an operation category, operation information such as a diagnosis name and an operation name, patient information, an operation description, and a tag. In the present embodiment, although illustration is omitted, description information input is displayed on the moving image registration screen, and the user inputs description information.

  The browsing history recording unit 60 records the browsing history of the surgical video and the browsing history for each procedure in the surgical video. After the operation video is stored in the database 200, it can be browsed by the user. However, the browsing history recording unit 60 records the browsing history for each surgery video and procedure in the database 200 in association with the surgery video and procedure. To do.

  The extraction unit 50 uses, as a related video, a surgical video related to a registered surgical video from the database 200 based on any one of a scene name, description information, a browsing history, and a playback time of the surgical video, or a combination thereof. Extract. Further, when a technique is designated by the user, the extraction unit 50 extracts a surgical video including a technique related to the designated technique from the database 200 based on the tag, the browsing history, and the like as a related video. .

  The display control unit 70 displays a registered operation video, description information, a graph corresponding to the procedure, a related video, and the like on the screen of the display unit 90. The graph is a graph showing the treatment time for each procedure included in the surgery video displayed on the display unit 90, as will be described later, for example, and the display mode displayed below the surgery video and the right side of the surgery video Display modes. The display control unit 70 functions as a graph display unit.

  The data storage unit 80 stores the registered surgical video, description information, procedure name of the defined procedure, treatment time of each procedure, browsing history, and the like in the database 200 in association with the surgical movie.

  The display unit 90 is a display such as a liquid crystal display or an organic EL display, for example. The operation unit 100 is a device such as a keyboard and a mouse, for example. The storage unit 110 is, for example, a hard disk drive or a solid state drive using a semiconductor element memory. The storage unit 110 stores the program of the present invention.

(data structure)
Next, a data structure for managing a surgical video and the like used in the present embodiment will be described with reference to FIG. FIG. 2 is a diagram illustrating an example of a data structure for managing a surgical moving image or the like used in the present embodiment.

  As shown in FIG. 2, the surgical video management table TBL1 includes a surgical video ID column 300, a date column 301, a title column 302, a surgeon ID column 303, a surgical video browsing history column 304, a procedure video ID column 305, and a separation column. 306, a procedure name column 307, a treatment time column 308, a procedure browsing history column 309, and an other column 310 are provided.

  In the operation video ID column 300, an operation video ID uniquely determined for the operation video stored in the database 200 is stored. Although illustration is omitted, the surgical video data is stored in the database 200 in association with the surgical video ID. Therefore, by reading the operation video ID from the operation video ID column 300 of the operation video management table TBL1, it is possible to access the operation video data corresponding to the operation video ID.

  The date column 301 stores the date on which the surgical video is stored in the database 200. The title column 302 stores the title of the surgical video attached by the user. The surgeon ID column 303 stores the ID of the surgeon who performed the surgery related to the surgery video. The surgeon ID is determined in advance, and for example, the surgeon ID input when logging into the surgical video browsing apparatus 1 of the present embodiment may be stored in this field. The operation movie browsing history column 304 stores the operation movie browsing history. In the browsing history, for example, an access log is stored for each user.

  The procedure video ID column 305 stores a surgical video ID uniquely determined for a surgical video. Since one surgical video includes a plurality of surgical videos, a plurality of procedure video ID columns 305 are provided for one surgical video.

  The separation column 306 stores a separation defined as one procedure, for example, a temporal separation. As the time interval, the elapsed time when the surgery video is played from the beginning is stored for the start and end of the procedure. Retrieval of the procedure selected by the user by accessing the operation movie data based on the operation movie ID and accessing the operation movie data of the corresponding period based on the start and end times of the procedure stored in the section 306 You can seek the position.

  In the procedure name column 307, the procedure name assigned to each procedure is stored as text data. The treatment time column 308 stores the treatment time for each procedure. The technique video browsing history column 309 stores a browsing history for each technique video, for example, the number of browsing times. The other field 310 stores information such as a tag input by the user, a category of a surgical video, a shooting angle of a surgical video, and a tool used.

  The surgical video management table TBL1 as described above may be stored in the database 200 or in the storage unit 110 of the surgical video viewer 1. The database 200 may be provided in the surgical video browsing apparatus 1.

(Display example)
Next, an example of a surgical video browsing screen on the display unit 90 of the surgical video browsing device 1 of the present embodiment will be described with reference to FIG. FIG. 3 is a diagram illustrating an example of a surgical video browsing screen.

  As shown in FIG. 3, the surgical video browsing screen 400 includes a surgical video display unit 401, a graph display unit 403, a display mode switching button 404, a video title display unit 405, a basic setting button 406, and a technique setting button. 407 and a category and tag display unit 408. The operation video browsing screen 400 includes a user name and group display unit 409, a posting date display unit 410, a browsing count display unit 411, a diagnosis name display unit 412, a surgical procedure name display unit 413, and patient information. A display unit 414, an operation explanation display unit 415, and a related video list display unit 416 are provided.

  The surgical video display unit 401 displays the registered surgical video. Although not displayed in the state shown in FIG. 3, when a surgical moving image is reproduced, an operation display unit is displayed below the surgical moving image. In the operation display section, operation buttons for operating a moving image such as a play button, a stop button, a volume adjustment bar, and a slider bar are displayed.

  The graph display unit 403 displays a so-called stacked horizontal bar graph. The graph is divided for each procedure, and the name of the procedure is displayed on each horizontal bar. The graph display unit 403 displays the start time of each procedure. The last time is displayed in the last procedure.

  By selecting each horizontal bar of the stacked horizontal bar graph displayed in the graph display unit 403, a balloon 417 pops up as shown in FIG. 3, and a seek to the selected procedure and a procedure related to the selected procedure are displayed. It is possible to display a list of related videos including it. In the example shown in FIG. 3, when “seek to procedure” is selected, the selected procedure is sought, and when “related surgery” is selected, a related moving image list is displayed.

  A display mode switching button 404 is provided at the lower right of the graph display unit 403. By selecting the display mode switching button 404, the display mode can be switched between the timeline display mode and the graph display mode. The surgical video browsing screen 400 shown in FIG. 3 shows a display example in the timeline display mode. When the graph display mode is selected, as shown in FIG. 4, the operation moving image browsing screen 400 is displayed in the graph display mode, and the graph display unit 403 displays a vertical bar graph. The vertical bar graph represents each technique of the stacked horizontal bar graph as a vertical bar. In the case of a vertical bar graph, the treatment time for each procedure is displayed on the vertical axis, and the name of each procedure is displayed on the horizontal axis. Also in the case of a vertical bar graph, by selecting each vertical bar of the horizontal bar graph, a balloon 417 pops up as shown in FIG. 4, and a related video including a seek to the selected procedure and a procedure related to the selected procedure is displayed. The list can be displayed.

  The user can grasp the treatment time of each procedure at a glance from the graph displayed on the graph display unit 403, and can review whether or not the procedure that takes time is appropriate.

  The moving image title display unit 405 displays the moving image title input by the user. On the right side of the moving image title display portion 405, a basic setting button 406 and a technique setting button 407 are displayed. When the basic setting button 406 is selected, a description information input screen including a moving image title is displayed, and the description information can be corrected and added. When the procedure setting button 407 is selected, procedure settings are displayed, and the user can input the position of each procedure and select or input the procedure name.

  A surgical video browsing screen 400 shown in FIG. 3 is a surgical video browsing screen browsed by a user who has registered a surgical video. In order to enable correction of description information, a technique name, and the like by the user, a basic setting button 406, A procedure setting button 407 is displayed. The surgical video browsing screen 400 can be browsed by other users other than the user who registered the surgical video, and the basic setting button 406 and the technique setting button 407 are not displayed on the surgical video browsing screen 400 browsed by other users. . However, even if it is another user, the basic setting button 406 and the procedure setting button 407 may be displayed on the surgical moving image browsing screen 400 that is browsed by a user having access authority.

  The category and tag display unit 408 displays the category and tag input by the user. The user name and group display unit 409 displays the user name and the group name to which the user belongs. As the user name, for example, a user name input when logging in to the surgical video browsing apparatus 1 of the present embodiment or a user name stored in advance as login information may be used. The group name is selected on the moving image registration screen or the description information input screen displayed when the basic setting button 406 is selected. The posting date display section 410 displays the posting date on which the surgical video is posted. The browsing frequency display section 411 displays the browsing frequency of the surgical video.

  The diagnosis name display unit 412 displays the diagnosis name input by the user. The technique name display unit 413 displays the technique name input by the user. The patient information display unit 414 displays patient information such as the operation date, sex, operator, age, patient ID, and the like input by the user. The explanation about the surgery input by the user is input to the surgery description display unit 415. The description information including the diagnosis name, surgical procedure name, patient information, and operation description is input by the user on the movie registration screen or the description information input screen displayed when the basic setting button 406 is selected. It is possible.

  The related video list display unit 416 displays a list of related videos related to the surgical video displayed on the surgical video display unit 401. Extraction of related moving images is performed by appropriately using information such as moving image titles, technique names, categories, description information such as surgery descriptions, the number of browsing times, and scene names. The extraction of the related moving image by the extraction unit 50 is learned and optimized by machine learning.

  The related video displayed on the related video list display unit 416 can be selected. When any related video is selected, the selected related video is displayed on the surgery video display unit 401.

  For example, the related moving images displayed on the related moving image list display unit 416 may be displayed side by side in descending order of the number of browsing times, or may be displayed in order from the shortest total playback time, but is not limited thereto.

  Next, a display example of the surgery video browsing screen 400 at the time of comparative reproduction will be described. With the stacked bar chart procedure displayed on the graph display unit 403 shown in FIG. 3 or the vertical bar chart procedure displayed on the graph display unit 403 shown in FIG. When “Related Surgery” is selected, a related video selection screen 420 is displayed as shown in FIG.

  The related moving image displayed on the related moving image selection screen 420 is extracted by the extraction unit 50 as a surgical moving image including a procedure related to the procedure selected by the user in the graph. For extraction of related procedures, a procedure name, a category of a surgical moving image, a procedure time of the procedure, and the like are referred to. As shown in FIG. 5, a video page button 421 and a comparison playback button 422 are displayed on the right side of the thumbnail of the related video displayed on the related video selection screen 420. When the movie page button 421 is selected, a related movie is displayed on the surgery movie display unit 401. On the other hand, when the comparison playback button 422 is selected, a related video is displayed on the right side of the surgical video display unit 401 as shown in FIG. FIG. 6 is a diagram illustrating a display example at the time of comparative reproduction in which the operation video 423 and the related video 424 are displayed side by side.

  The operation moving image 423 and the related moving image 424 at the time of comparative reproduction shown in FIG. 6 are seeked to the position of the selected procedure, and can be compared and reproduced from the position of the selected procedure.

  By this comparative reproduction, the user can compare the technique of the surgical moving image of interest and the related moving image including the highly related technique among the techniques of other surgical moving images. As a result, when the procedure of the surgical video of interest takes a long time, a hint that leads to improvement can be obtained by comparing with the other video of the procedure.

  In addition, when extracting a related video to be displayed on the related video selection screen 420, a related video including a procedure with a treatment time shorter than the procedure time of the user's procedure can be extracted. By performing such extraction, the user can view related videos that include a technique superior to his / her technique in the video. Therefore, the user is easily aware of the shortcomings and improvement points of his / her technique, is motivated to learn an excellent technique, and the learning effect is improved.

(Processing procedure)
Next, a processing procedure in the surgical video browsing apparatus 1 of the present embodiment will be described with reference to the flowcharts of FIGS. 7 and 8 are flowcharts showing the processing procedure of the surgical moving image browsing apparatus 1 according to this embodiment.

  First, when a user registers a surgical video, the video input unit 10 inputs the registered surgical video and stores it in the database 200 (S10). When a user registers a surgical video, when the description information such as the title of the video, the name of the surgical procedure, or a description of the surgery is input on the operation unit 100 on the video registration screen, the description information registration unit 40 Are stored in the database 200 in association with the description information.

  Next, the technique analysis unit 20 extracts the feature amount of the registered surgical moving image, and demarcates the technique from the surgical moving image (S20). In addition, the technique analysis unit 20 calculates a treatment time for the defined technique (S30), associates the technique with the treatment time, and stores them in the database 200.

  The procedure name assigning unit 30 assigns a procedure name of the defined procedure, associates the procedure name with the procedure, and stores it in the database 200 (S40).

  The display control unit 70 displays the input operation video, description information, related video, and graph on the operation video browsing screen 400 of the display unit 90 as shown in FIG. 3 (S50).

  As described above, when a predetermined operation is performed by the user in a state where the operation moving image and the graph are displayed on the operation moving image browsing screen 400, processing corresponding to the operation is performed. FIG. 8 is a flowchart showing processing when a technique, a technique name, or a related moving image is selected. The process shown in FIG. 8 is performed every predetermined time.

  When the user selects a procedure in the graph displayed on the graph display unit 403 by clicking or the like (S100: YES), the extraction unit 50 designates from the database 200 based on the procedure name, category, procedure time, etc. A related moving image including a procedure related to the performed procedure is extracted (S110). The display control unit 70 displays the extracted related video on the related video selection screen 420 as shown in FIG. 5 (S120).

  In addition, when the user selects a related video from the related video selection screen 420 and selects the video page button 421 (S130: YES), the display control unit 70 causes the surgical video display unit 401 to display the selected related video. (S140).

  Further, when the user selects a related video from the related video selection screen 420 and selects the comparison playback button 422 (S150: YES), as shown in FIG. 6, the related video is displayed on the right side of the surgery video, and the comparative playback is performed. (S160).

  As described above, according to the present embodiment, by registering a surgical video, the procedure in the surgical video is automatically defined and the treatment time of each procedure is displayed in a graph. It is possible to easily grasp the treatment time.

  Moreover, according to this embodiment, the related moving image containing the technique relevant to the selected technique can be extracted by selecting the technique displayed on the graph. As a result, when a long time is required for the technique of the surgical video to be noticed, a hint for improvement can be obtained by comparing with the other surgical video. Thus, according to the present embodiment, it is possible to show a surgical moving image including a procedure that the user should see to the user.

  In addition, according to the present embodiment, since the operation video and the related video can be compared and reproduced, the user can view the operation video showing his / her technique and the other's operation video while comparing them. it can. Further, if a surgical video including a procedure with a procedure time shorter than the procedure time of the user's procedure is displayed as the related movie, the user can watch the related movie including a procedure superior to his procedure in the video. Can do. Therefore, the user is easily aware of the shortcomings and improvement points of his / her technique, and is motivated to learn an excellent technique, thereby improving the learning effect.

  Furthermore, the surgical moving image browsing apparatus 1 of the present embodiment can effectively use these moving images as moving image resources by registering the surgical moving images recorded on the DVD or the like and stored.

(Second Embodiment)
Next, a second embodiment of the present invention will be described. In the first embodiment, the mode in which the procedure is defined by the procedure analysis unit 20 has been described. In the present embodiment, in addition to the aspect of the first embodiment, or in place of the aspect of the first embodiment, an aspect in which the procedure is defined by the user performing marking will be described.

  In the present embodiment, marking can be performed when the user performs a click or the like on the operation moving image displayed on the operation moving image display unit 401 or on the slider bar of the operation display unit. In this case, the operation unit 100 functions as a marking unit. The marked position is a start position or an end position of the procedure, and the user can define the procedure at a desired position while playing the surgical animation. In this case, the technique analysis unit 20 defines the technique according to the position marked by the user.

  When the procedure is automatically defined by the procedure analysis unit 20 as in the first embodiment, the user can correct the position of the defined procedure by performing this marking.

  When the procedure is not automatically defined by the procedure analysis unit 20 as in the first embodiment, the graph is not displayed immediately after the surgery movie is displayed on the surgery movie display unit 401, and marking by the user is not performed. You may make it display a graph after it is performed.

  As described above, according to the present embodiment, in addition to the effects of the first embodiment, the procedure can be defined by the user, so that it is possible to view the operation video or the procedure video according to the user's needs. To do.

(Modification)

  In the graph display, the treatment time of the user's procedure and the predetermined treatment time serving as a reference may be displayed in a graph so as to be comparable. For example, if a white graph representing the average treatment time of the procedure is displayed next to the hatched bar graph representing the treatment time of the user, for example, the user will exceed the average treatment time of his / her procedure. You can know if you are. In such a case, if the user watches the procedure video of the part of peeling, for example, it is possible to know whether the user's own skill level is low, or whether the adhesion was so bad that it took time for peeling. . On the other hand, it can be seen that for incision and resection, the treatment time is shorter than the average. Also in this case, if the user views the technique video of the part, it is possible to further extend the place where the user's skill is good.

  In the above-described embodiment, the aspect in which the procedure is defined by extracting the feature amount of the image has been described. However, the present invention is not limited to such an embodiment. For example, an edge portion in an image of a plurality of frames constituting a surgical moving image or an image portion obtained by extracting the distal end portion of a treatment instrument is registered in advance. It may be determined whether or not the technique is an anastomosis or the like depending on whether or not it corresponds to a characteristic movement pattern of the image.

  In the above-described embodiment, the aspect in which the present invention is applied to an apparatus for viewing a surgical moving image has been described. However, the present invention is not limited to such an embodiment, and can be applied to all types of moving images. For example, in a baseball video, a home run scene may be defined as a specific scene instead of a procedure, and a video including a related scene may be extracted as a related video from another baseball video.

  In this case, the technique analysis unit 20 functions as a scene analysis unit that extracts a scene feature amount in the input video, and the browsing history recording unit 60 records a browsing history for each video or each scene. Functions as a recording unit. Further, the extraction unit 50 functions as a scene extraction unit that extracts a related moving image from the database based on at least the sea name and description information.

  In the above-described embodiment, related information such as a book related to a registered surgical video, a related instrument, and a related medicine may be acquired from the database 200 or another database, for example. The related information is not limited to information such as books, and may include various information such as information on the operative of the operation video, information on the date and time of operation, patient information, and disease information.

  The above embodiments are merely examples, and various modifications can be made without departing from the scope of the present invention. The plurality of embodiments described above can be established independently, but combinations of the embodiments are also possible. In addition, various features in different embodiments can be established independently, but the features in different embodiments can be combined.

DESCRIPTION OF SYMBOLS 1 Surgical moving image browsing apparatus 10 Moving image input part 20 Procedure analysis part 30 Scene name provision part 40 Description information registration part 50 Extraction part 60 Browse history recording part 70 Display control part 80 Data storage part 90 Display part 100 Operation part 110 Storage part 200 Database

Claims (8)

A video input unit for inputting a video and registering it in the database;
A scene analysis unit that extracts a feature amount of a scene in the registered moving image;
A scene name assigning unit that assigns a scene name to each scene and associates the scene name with each scene;
A description information registration unit for associating description information described for the video with the video;
An extraction unit that extracts a related moving image related to the moving image based on at least the scene name and the description information from the database;
A video browsing apparatus characterized by that. A video input unit that inputs surgical videos and registers them in the database;
A scene analysis unit that extracts a feature amount of the scene in the registered surgical video;
A scene name assigning unit that assigns a scene name to each scene and associates the scene name with each scene;
A description information registration unit for associating description information described for the surgical video with the surgical video;
An extraction unit that extracts a related moving image related to the surgery moving image based on at least the scene name and the description information from the database;
A video browsing apparatus characterized by that. The scene name assigning unit assigns the scene name based on a predetermined name according to the order of the scenes.
The moving image browsing apparatus according to claim 2, wherein: Based on the scene name and the playback time of the scene, a graph display unit that displays the playback time of the scene in a graph,
The extraction unit extracts the related moving image including a scene related to the scene of the selected scene name when the scene name displayed in the graph is selected.
The moving image browsing apparatus according to claim 2 or claim 3, wherein A marking portion for marking a predetermined position of the surgical video,
The scene analysis unit defines the scene based on the marked position.
The moving image browsing apparatus according to any one of claims 2 to 4, wherein the moving image browsing device is characterized in that: A browsing history recording unit that records browsing history for each surgical video or for each scene,
The extraction unit extracts a related video related to the surgical video based on at least one of the scene name, the description information, the browsing history, and the playback time of the surgical video, or a combination thereof.
The moving image browsing apparatus according to any one of claims 2 to 5, wherein the moving image browsing device is characterized in that: Entering the surgical video and registering it in the database by the video input unit;
A step of extracting a feature amount of a scene in the registered surgical video by a scene analysis unit;
A step of assigning a scene name for each scene and linking the scene name for each scene by a scene name assigning unit;
A step of associating description information described about the surgical video with the surgical video by a description information registration unit;
Extracting a related moving image related to the surgical moving image based on at least the scene name and the description information from the database by the extraction unit;
A method for controlling a moving image browsing apparatus. A program in a video browsing device, the program being stored in a computer,
Entering surgical videos and registering them in the database;
Extracting a feature amount of a scene in the registered surgical video;
Assigning a scene name to each scene and associating the scene name with each scene;
Linking the description information described about the surgical video to the surgical video;
Extracting a related video associated with the surgical video based on at least the scene name and the description information from the database;
A program characterized by that.