JP3104051U - Editing device for video recording of surgical operation - Google Patents

Abstract

An object of the present invention is to create an index image from a recorded moving image without relying on a conventional general time code method or scene change method, and to respond to a professional search request of a surgeon or the like.
An instrument data storing means for storing data for individually specifying instruments to be used for surgery, an instrument selecting means for selecting and specifying a specific instrument existing in the instrument data storing section, and the instrument Indexing means for recording, as an index image, one frame of the moving image corresponding to the operation timing of the selecting means. Since an index is created by specifying a surgical instrument appearing in a moving image, it is easy to search for necessary scenes and so-called heading.
[Selection diagram] Fig. 1

Description

  The present invention relates to an apparatus for editing a moving image recorded in a surgical operation, and particularly to an index processing technique for easily searching a necessary moving image portion from a huge amount of recorded moving images.

  Surgery (including dental surgery; hereinafter the same) requires a high degree of expertise and skill. It also has a direct impact on the patient's physical life. For this reason, in the surgical operation, moving image recording using a video photographing device or the like has been conventionally performed. A large number of recorded moving images (for example, videotapes) are stored in hospitals where surgery is performed, and the number is increasing weekly.

  The recorded video is necessary for doctors who have little experience with a certain surgical technique to study the actual flow of surgery and emergency procedures to conduct sufficient image training, and there was an accident (failure) If so, it will be a valuable asset for investigating the cause.

  However, since the recording amount of moving images is increasing only weekly, it is very difficult for any hospital to find the scene to be viewed from stored recording media (such as video tapes). Is the actual situation.

  For example, even in the case of an ophthalmic surgery in which the operation time is relatively short, the time required for the operation is an average of 1 to 2 hours. At hospitals that perform 20 eye surgery each week, the number of video tapes increases by 20 and the time increases by about 30 hours. In terms of one year, about 1000 video tapes and about 1500 hours of recorded moving images increase.

  By the way, there has not been proposed a technique for editing such a moving image record of a surgical operation so that it can be efficiently searched. Incidentally, there is Japanese Patent Application Laid-Open No. 2003-333939 as a technique for capturing a moving image record of a surgical operation. Techniques for editing the state of the surgical apparatus and individual data of a patient at the time of imaging include, for example, JP-A-2003-076786 and JP-A-2000-276540.

  However, these are proposals for carefully recording the history of the operation in a time sequence, and are not techniques for facilitating retrieval at a later date.

  On the other hand, in order to be able to search for a specific scene from moving image data recorded on a video tape, conventionally, two methods are generally used. One is the time code method. This is a method of creating an index image (thumbnail; the same applies hereinafter) at predetermined time intervals. According to this, for example, one exposure in a moving image can be extracted every five minutes and used as an index image, so that processing is also easy.

The other is a scene change method. This is a method of creating an index image by capturing a change in a constituent image when a large change occurs in the image structure of a moving image. Since automatic processing can be performed by detecting changes in color composition and brightness, processing costs are higher than in the time code method, but the processing is as easy as the time code method. This method is used, for example, for creating an index based on a movie scene change.
JP 2003-339939 A JP 2003-076786 A JP 2000-276540 A

  The problem is that both the time code method and the scene change method are not suitable for editing moving images in surgical operations, particularly operations using a microscope or an endoscope.

  In surgery, there is a certain formula for every operation, so that it may not be difficult for a specialist to search for necessary scenes over time. However, depending on the condition of the patient, the situation of the surgeon or the surgeon team, etc., the flow of the operation usually changes each time. The progress does not always go on time. For this reason, if the time code method is adopted, it is not possible to meet the user's request to quickly extract and reproduce a necessary scene from a huge amount of moving images.

  On the other hand, the scene change method cannot be adopted for surgical moving images having similar image configurations. In particular, in operations such as ophthalmic surgery and brain surgery, in which a specific part is magnified and imaged using a microscope, similar processing is continuous, and automatic processing that captures changes in color and brightness is almost impossible. . The same applies to operations using an endoscope such as a gastric camera.

  Therefore, an object of the present invention is to respond to a surgeon's specialized search request by providing an editing device capable of extracting and creating an index image from a recorded moving image without relying on a conventional general time code method or scene change method. It is in.

  In order to achieve the above object, an apparatus for editing a moving image of a surgical operation according to the present invention includes an instrument data storage unit that stores data for individually specifying an instrument used for the operation, and an instrument data storage unit that stores the data. Device selecting means for selecting and specifying a specific device to be operated, and index creating means for recording, as an index image, one exposure of a moving image corresponding to the operation timing of the device selecting device.

  According to such a configuration, when an index image (thumbnail) is created from a long moving image, the index image can be easily created at the timing when the instrument is changed during the operation. A start scene when reproducing a scene can be provided with excellent accuracy. An index title using characters, numerals, and the like can be displayed on the index image at the same time. Note that the original moving image data for creating the index image may be input from an external video device or the like, or may be a moving image stored in a recording device (hard disk) provided in the present device. For example, a numeric keypad, a mouse, and a touch panel can be used as the device selecting means.

  According to a second aspect of the present invention, there is provided an apparatus for storing an index image together with a moving image of a surgical operation on an optical external recording medium. The index image is desirably stored on the hard disk together with the moving image. However, it is preferable to provide a means for storing the index image in an external recording medium, for example, for backup or to be portable. For example, it is recorded on a DVD.

  ADVANTAGE OF THE INVENTION According to the apparatus which concerns on this invention, it becomes possible to list and display the specific scene during the operation which a doctor etc. may want to confirm reproduction as an index image with excellent precision.

  FIG. 1 illustrates an apparatus for editing a surgical operation moving image according to the present invention. This editing device is an example of a device that simultaneously creates an index image when moving image data input from a video reproducing device 1 as an external device is stored in the moving image data storage unit 11. FIG. 2 shows an example of a device that processes an index image based on moving image data already stored in the hard disk (moving image data storage unit 11). The basic configuration is the same.

  Returning to FIG. 1, a moving image input / output unit 13 outputs a moving image reproduction signal from a moving image reproducing device (for example, the video reproducing device 1) to the moving image data storage unit 11 and the monitor device 12.

  Reference numeral 14 denotes an instrument name storage unit that stores the name of each instrument set used for the operation. The names of various appliances stored in the appliance name storage unit 14 are stored in association with an identification number or an identification symbol (for example, an initial) for specifying one of them. For example, when an identification number is used to specify one of the appliances, the number of the appliance is input using the numeric keypad 15.

  To specify the device, the name may be entered using a keyboard, but the timing of creating the index image tends to be delayed. Preferably, it is an identification symbol using one or two digits or one or two alphabetic characters. The embodiment of FIG. 1 exemplifies a case of using an appliance using numbers, and uses a numeric keypad 15 for inputting numbers. The operator who creates the index image operates the numeric keypad 15 when another instrument appears on the screen while looking at the monitor device 12, and selects and extracts one exposure at the timing as an index image. Specifically, it is as follows.

  For example, cataract surgery typically uses more than 40 instruments. A plurality of the same appliances may be prepared and appear repeatedly in the moving image. However, when the same appliances are processed as the same number, it is desirable to assign an identification number to each appliance name. For example, as shown in Table 1, Assign a number.

  When an index image is created in accordance with Table 1, for example, when "cloth forceps" appears in a moving image and a numeral "4" is input with the key switch of the ten key 15, one frame of the timing at which the cloth forceps appears becomes an index image. It becomes. Similarly, if the number “33” is input using the numeric keypad 15, one exposure when the “Kenma needle” appears in the moving image becomes the index image.

  Reference numeral 16 denotes an index creation unit that extracts one exposure in a moving image as an index image when the pressing operation of the numeric keypad 15 is completed, and stores the extracted image in an index storage unit 17 at a later stage in an appropriate layout. In the list image stored in the index storage unit 17, it is desirable to display, for example, the name of the instrument, the elapsed time from the start of the operation, and the like as characters. The method of displaying a list of index images is not limited.

  Reference numeral 18 denotes an index call operation unit for calling a list image stored in the index storage unit 17. The index call operation unit 18 includes, for example, a keyboard (not shown) of the editing apparatus itself, the numeric keypad 15, or an external device (for example, a PC terminal or a PDA of a hospital LAN) connected via a public line or a dedicated line. The list image is transmitted to the device that has received the request command via the index display unit 19 in response to the request operation from. For example, when a display request for a list image is received from the editing device itself by a keyboard device, the list image stored in the index storage unit 17 is sent to the monitor device 12 and displayed. The same applies to a display request from an external device.

  Reference numeral 20 denotes an accompanying data storage unit having a function of displaying other accompanying data when reproducing a moving image stored in the moving image data storage unit 11 or displaying a list of index images. . Other accompanying data include, for example, the patient's name, age, gender, disease name, medical condition, surgeon's name, operation start time, elapsed time since the start, operation record (characteristics / voice data special notes), Of still images or moving images (photos / sketches / video moving images).

  Therefore, according to such a configuration, an index image can be created using the numeric keypad 15 each time a new instrument appears in the recorded moving image of the operation. Since an index image can be created and stored each time a new device appears, it is extremely easy to search for necessary scenes from a large amount of moving images.

  For example, when the patient name and the date of the operation are known, the necessary scene can be easily found from the moving image recording video of the patient. Even when the patient's name or the date of the operation is unknown, the necessary scene can be searched based only on the appearance order of the instruments, such as when the order of using the instruments is special. No matter how many surgeons experience the surgeon, the surgeon memorizes the order of use of the instruments during the operation relatively clearly, so that the surgeon can search for the necessary scene based on the memorization of the order of use of the instruments. Also, in cases that may lead to an accident, it is considered that retrieval based on the order of use of appliances is the most efficient.

  Accompanying data is also a key to narrowing down the search. The information includes the patient's name, age, gender, disease name, medical condition, surgeon's name, operation start time, operation start time, operation record, still image and moving image at the time of examination stored in the accompanying data storage unit 20, and the like. This is because the search operation becomes easier when there are more narrowing conditions.

  The list image stored in the index storage unit 17 is a means for starting reproduction of a moving image, that is, a thumbnail for cueing, and is not merely for presenting a still image. Therefore, if one of the list images is selected and the moving image is reproduced, it is natural that the moving image is reproduced from the scene. At this time, for example, the elapsed time of the operation recorded in the accompanying data storage unit 20 may be displayed in the moving image.

  FIG. 2 exemplifies an apparatus configuration when an index image is created from a state in which a moving image is already recorded on a hard disk of the editing apparatus according to the present invention. Since the index creation operation requires a certain amount of specialized knowledge, it is not possible to simultaneously create an index when capturing moving image data from an external recording such as a video tape. Therefore, it is often necessary to precede the process of storing moving images, which is a relatively simple task, and to perform index creation afterwards. In this case, an index image is created while reproducing and displaying the moving image stored in the moving image data storage unit 11 on the monitor device 12.

  In the case of FIG. 1, an index image is created based on an image input from the video playback apparatus 1, but in the apparatus configuration of FIG. 2, an index is created based on an image stored in a hard disk (moving image data storage unit 11). . However, since both the base moving images are displayed on the monitor device 12, the operation feeling of the operator at the time of index creation is the same, and the use effect after the index creation is the same. Parts that perform the same functions as in FIG. 1 are given the same reference numerals, and duplicate descriptions are omitted.

  When the operator specifies an appliance in the moving image and creates an index image, the operator only needs to input the name of the appliance that has appeared in the moving image by using an identification number or an identification symbol. That is, since it is only necessary to input the number or symbol of the device while looking at the monitor image, it is not always necessary to register (store) the name of the device inside the editing device. Even if the editing device does not have the name of the device, the index image can be created by operating the numeric keypad or the keyboard while referring to the code table or the like. When displaying the device name in the index list, it is also possible to cope with the problem by subsequently inputting only the device name. As a means for selecting an appliance, an input using a mouse or an input using a touch panel is also possible in addition to the input using a numeric keypad. Alternatively, a keyboard may be used.

FIG. 2 is a block diagram illustrating a configuration of the editing device according to the first embodiment. It is a block diagram which illustrates the composition of the editing device concerning a second embodiment.

Explanation of reference numerals

DESCRIPTION OF SYMBOLS 1 Video reproduction device 11 Video data storage part 12 Monitor device 13 Video input / output part 14 Appliance name storage part 15 Numeric keypad 16 Index creation part 17 Index storage part 18 Index call operation part 19 Index display part 20 Associated data storage part

Claims (2)

An apparatus for editing a video recording a surgical operation,
Instrument data storage means for storing data for individually specifying instruments to be used for the operation,
Appliance selecting means for selecting and specifying a specific appliance existing in the appliance data storage unit;
An index creating means for recording one frame of a moving image corresponding to an operation timing of the instrument selecting means as an index image, the editing apparatus for a moving image recorded in a surgical operation.   2. The editing apparatus according to claim 1, further comprising image data writing means for storing the index image created by the index creation means in an optical external recording medium together with the recording movie of the surgical operation. apparatus.

Images