JP6594679B2 - Endoscopy data recording system - Google Patents

Description

  The present invention relates to an endoscopic examination data recording system for recording examination data of an endoscopic examination.

  Currently, data recorded for endoscopy is mainly still images, moving images, and report information created by a doctor after the examination. It is also possible to record general numerical information such as the overall time required for the inspection together with the report information.

  In recent years, many attempts have been made to obtain new knowledge and knowledge by realizing big data from various events in the real world using information output from devices, sensing technology, etc., and to realize various improvements and efficiencies. Has been made. If you are going to do the same thing in endoscopic medicine, for example, how is endoscopy effective for finding lesions, and what is the difference between skilled and unskilled physicians? It is expected to discover various knowledge and knowledge such as where it appears, whether it is compliant with the so-called routine inspection standards and protocols, and how to improve the standards and protocols. Conceivable.

JP 2008-220977 A

  However, it is difficult to quantitatively and objectively evaluate and compare the endoscopy with the various data currently recorded. That is, it is not possible to easily grasp what procedure and time distribution the inspection is performed and what observation and instrument operation is performed (how many times). In addition, it is not possible to easily perform an evaluation or comparison as to whether or not the inspection has been performed according to a protocol in a so-called routine inspection. In addition, for example, it is troublesome to analyze differences in examination procedures between doctors and hospitals that find many lesions and doctors and hospitals that do not. For example, it is necessary to perform comparison while watching a moving image in which several examinations are recorded as samples, but there is a problem that time is required and only limited examination examples are provided.

  The present invention has been made in view of such circumstances, and an object thereof is to provide a technique that enables quantitative and objective analysis of endoscopy.

  In order to solve the above-described problems, an endoscope inspection data recording system according to an aspect of the present invention uses an inspection data holding unit for holding inspection data of an endoscopic inspection, and is used in an endoscopic inspection. An irradiation light type data acquisition unit that acquires data indicating the type of irradiation light, a drug distribution data acquisition unit that acquires data indicating a distribution state of a drug distributed in the patient's body in an endoscopic examination, and an endoscope A treatment execution data acquisition unit that acquires data indicating the execution status of a treatment performed by a doctor in an examination, and imaging state data acquisition that acquires data indicating an imaging state of an image captured by an endoscope in an endoscopic examination The data acquired by the imaging unit, the irradiation light type data acquisition unit, the drug distribution data acquisition unit, the treatment execution data acquisition unit, and the imaging state data acquisition unit. Each endoscopy and and a data recording unit for recording the test data holding unit.

  It should be noted that any combination of the above-described constituent elements and a conversion of the expression of the present invention between a method, an apparatus, a system, a recording medium, a computer program, and the like are also effective as an aspect of the present invention.

  According to the present invention, endoscopic examination can be analyzed quantitatively and objectively.

It is a figure which shows the structure of the endoscopy data recording system which concerns on Embodiment 1 of this invention. It is a figure which shows the structure of the endoscope system which concerns on Embodiment 1. FIG. It is a figure which shows the structure of the endoscopic examination data recording device which concerns on Embodiment 1. FIG. 2 is a diagram illustrating a configuration of a terminal device according to Embodiment 1. FIG. It is a figure which shows an example of the endoscopic image containing a biopsy forceps. 6A to 6C are diagrams illustrating examples of a master information table held in the master information holding unit. It is a figure which shows an example of the test | inspection data recorded on a test | inspection data holding part. It is a figure which shows another example of the test | inspection data recorded on a test | inspection data holding part. 6 is a flowchart for explaining an operation example of the endoscope system according to the first embodiment. 5 is a flowchart for explaining an operation example of the endoscopic examination data recording device according to the first embodiment. It is a figure which shows the structure of the endoscope system which concerns on Embodiment 2. FIG. It is a figure which shows the structure of the endoscopic examination data recording device which concerns on Embodiment 2. FIG. 13A and 13B are diagrams illustrating an example of an imaging distance master table held in the master information holding unit and an example of inspection data recorded in the inspection data holding unit. FIG. 10 is a diagram illustrating a configuration of an endoscope system according to a third embodiment. FIG. 10 is a diagram illustrating a configuration of an endoscopic examination data recording device according to a third embodiment. It is a figure which shows an example of the imaging state master table hold | maintained at a master information holding part. It is a figure which shows an example of the test | inspection data recorded on a test | inspection data holding part. It is a figure which shows an example of the change evaluation value and imaging state master table hold | maintained at a master information holding part. It is a figure which shows an example of the test | inspection data recorded on a test | inspection data holding part. 10 is a flowchart for explaining an operation example of the endoscope system according to the application example of the third embodiment. It is a figure which shows the structure of the endoscopic examination data recording device which concerns on Embodiment 4. FIG. It is a figure which shows an example of the statistical data recorded on a statistical data holding part. 15 is a flowchart for explaining an operation example of the endoscopic examination data recording device according to the fourth embodiment. It is a figure which shows the structure of the endoscopic examination data recording device which concerns on Embodiment 5. FIG. FIGS. 25A and 25B are diagrams illustrating an example of a part specifying screen for assigning part information to an endoscopic image in the order of photographing. 16 is a flowchart for explaining an operation example of the endoscopic examination data recording device according to the fifth embodiment. It is a figure which shows an example of the designation | designated screen of 2 points | pieces in an endoscopy. It is a figure which shows an example of the part selection screen in endoscopy. It is a figure which shows the 1st state (immediately after a test | inspection start) of the example of a screen which represented transition of the endoscopy by data. It is a figure which shows the 2nd state (at the time of 5 minutes progressing from a test | inspection start) of the example of a screen which represented the transition of the endoscopic examination by data. It is a figure which shows the 3rd state (at the time of 11 minutes progressing from the test | inspection start) of the example of a screen which represented the transition of the endoscopy as data. It is a figure which shows the 4th state (at the time of completion | finish of an examination) of the example of a screen which represented transition of the endoscopy by data.

(Embodiment 1)
FIG. 1 is a diagram showing a configuration of an endoscopic examination data recording system 1 according to Embodiment 1 of the present invention. The endoscopic examination data recording system 1 is installed in the endoscopic department and operates in cooperation with an endoscopic operation support system (not shown). The endoscopic examination data recording system 1 includes an endoscopic system 10, an endoscopic examination data recording device 20, and a terminal device 30, which are interconnected by a network 2 such as a LAN.

  The endoscopic examination data recording system 1 can be linked with another system in a medical facility. For example, a gateway device (not shown) is connected to the network 2, and the endoscopic examination data recording system 1 can cooperate with an ordering system, an electronic medical record system, a medical accounting system, and the like via this gateway device.

  FIG. 2 is a diagram illustrating a configuration of the endoscope system 10 according to the first embodiment. The endoscope system 10 includes an endoscope 11, an endoscope processing device (also referred to as a camera control unit) 12, a display device 13, and a light source device 14. The endoscope 11 is inserted into the patient's body and images the patient's body. The endoscope 11 includes an image sensor 111, a forceps channel 112 and an operation unit 113.

  The image sensor 111 includes a CCD image sensor, a CMD image sensor, or a CMOS image sensor, and photoelectrically converts incident light. The image signal generated by the photoelectric conversion is subjected to signal processing such as A / D conversion and noise removal by a signal processing circuit (not shown), and is output to the endoscope processing device 12. The forceps channel 112 is a channel for passing a treatment tool such as forceps. The operation unit 113 is provided with a release button, an angle knob for bending the distal end of the endoscope, and the like.

  The display device 13 displays an image input from the endoscope processing device 12. For example, an image in the patient's body imaged by the endoscope 11 is displayed in real time. The light source device 14 includes a light source such as a xenon lamp and sends light to the distal end of the endoscope 11. The light source device 14 can irradiate the endoscope 11 with a plurality of types of observation light. For example, white light, narrow band imaging (NBI), fluorescence, and near infrared light can be irradiated.

  The endoscope processing device 12 controls the entire endoscope system 10. The endoscope processing apparatus 12 includes a control unit 121 and a communication unit 126. The control unit 121 includes an irradiation light switching control unit 122 and an image recognition unit 123. The image recognition unit 123 includes a medicine dispersion detection unit 123a and a treatment execution detection unit 123b. In the control unit 121 of FIG. 2, only functional blocks related to the processing of the first embodiment are illustrated.

  The function of the control unit 121 can be realized by cooperation of hardware resources and software resources, or only by hardware resources. Processors, ROM, RAM, and other LSIs can be used as hardware resources. Programs such as operating systems and applications can be used as software resources. For example, the image recognition unit 123 may be configured by an FPGA.

  FIG. 3 is a diagram illustrating a configuration of the endoscopic examination data recording device 20 according to the first embodiment. The endoscopic examination data recording device 20 is configured by a server or a PC, for example. The endoscopic examination data recording device 20 includes a communication unit 21, a control unit 22, a storage unit 23, and a console unit 24. The control unit 22 includes a data acquisition unit 221, an operation reception unit 222, a display control unit 223, a data calculation unit 224, and a data recording unit 225. The data acquisition unit 221 includes an irradiation light type data acquisition unit 221a, a medicine distribution data acquisition unit 221b, and a treatment execution data acquisition unit 221c. Also in the control unit 22 of FIG. 3, only functional blocks related to the processing of the first embodiment are drawn. The function of the control unit 22 can also be realized by cooperation of hardware resources and software resources, or only by hardware resources.

  The storage unit 23 includes a recording medium such as an HDD or an SSD, and includes a master information holding unit 231 and an inspection data holding unit 232. Also in the storage unit 23 of FIG. 3, only functional blocks related to the processing of the first embodiment are depicted.

  FIG. 4 is a diagram illustrating a configuration of the terminal device 30 according to the first embodiment. The terminal device 30 is a terminal device used by a medical worker engaged in a medical institution such as a doctor or a nurse, and is composed of, for example, a PC, a tablet, or a PDA. When a portable terminal device such as a tablet or PDA is used, an access point (not shown) is installed in the network 2 and connected to the network 2 by a wireless LAN. The terminal device 30 includes a communication unit 31, a control unit 32, a storage unit 33, a display unit 34, and an operation input unit 35. Hereinafter, it demonstrates concretely, referring FIGS.

  An endoscopic image obtained by photographing the inside of a patient with the endoscope 11 is input to the endoscope processing device 12 as a moving image. For example, it is input at a frame rate of 30 Hz. A display control unit (not shown) of the endoscope processing device 12 displays the input endoscope moving image on the display device 13. An operation reception unit (not shown) of the endoscope processing apparatus 12 receives a doctor's operation performed on the operation unit 113 of the endoscope 11. For example, a press of a release button by a doctor is accepted. An image extraction unit (not shown) of the endoscope processing device 12 extracts a still image from the endoscope moving image at the timing when the release button is pressed. The extracted still image is stored in a storage device (not shown) of the endoscope system 10 or transferred to an endoscope image recording device (not shown) via the network 2 and stored. The data may be transferred and stored in the endoscopic examination data recording device 20, or may be transferred and stored in a PACS (Picture Archiving and Communication System) (not shown).

  The irradiation light switching control unit 122 receives an observation light switching operation performed by a doctor with respect to an operation unit (not shown) of the endoscope processing apparatus 12, and emits the type of observation light instructed by the switching operation. The light source device 14 is controlled. The observation light emitted from the light source device 14 is guided to the patient's body cavity through the endoscope 11 and irradiates the body cavity.

  The medicine distribution detection unit 123a detects the medicine used in the endoscopy from the frame image included in the endoscope moving image by image recognition. The medicine distribution detection unit 123a periodically searches for medicines at predetermined time intervals by image recognition from the frame image. For example, the search is executed every N seconds or every N frames. For example, it searches every 1 second or every 5 seconds.

  The drug to be searched is a coloring agent / staining agent dispersed in the patient's body. The coloring agent is used for observing the shape and unevenness by being stored on the surface without being absorbed by the living mucous membrane. Staining agents are used to observe differences in mucosal surface properties and cellular structures depending on the presence or absence of absorption and the response of tissues.

  Representative pigments / staining agents include indigo carmine, lugol (iodo), pioctanine (crystal violet), methylene blue, acetic acid, and ink. The main sprayed organs of indigo carmine are the stomach and large intestine, and are used for differential diagnosis and range diagnosis of neoplastic lesions (cancer, adenoma, etc.) and non-neoplastic lesions (hyperplastic polyps). Lugol's main spraying organ is the esophagus, which is used for differential diagnosis and range diagnosis of esophageal cancer. The main organ to which poctanine is sprayed is the large intestine, and is used for differential diagnosis and depth diagnosis of neoplastic and non-neoplastic lesions including colorectal cancer. The main sprayed organs of methylene blue are the stomach and large intestine, which are used to diagnose gastrointestinal metaplasia. In recent years, it is also used for nuclear staining for observation of ultra-endoscopic endoscopy (EC). In addition, there is a case where pioctane is used for this purpose. The main sprayed organs of acetic acid are the stomach and large intestine, and are used for differential diagnosis and range diagnosis of neoplastic lesions (cancer, adenoma, etc.) and non-neoplastic lesions (hyperplastic polyps). Used in combination with indigo carmine to increase the accuracy of range diagnosis.

  The drug spraying detection unit 123a is configured to store a drug (for example, indigo carmine (blue to green-blue), lugol (brown to tan), pioctane (purple to blue-violet), methylene blue (blue), acetic acid (white) from the endoscopic image. ) Is detected based on the color tone characteristic amount. For example, the methods described in Japanese Patent Application No. 7-116138 and Japanese Patent Application No. 2014-191781 can be used as the detection method based on the color tone feature amount.

  The medicine scattering detection unit 123a calculates a color tone feature amount for each endoscopic image to be searched, and detects the presence or absence of the medicine scattering in each endoscopic image to be searched. When the medicine is sprayed, the type of the medicine is specified. The drug distribution detection unit 123a passes the drug distribution data indicating the drug distribution state in the patient's body to the data transmission unit 125 every N seconds or N frames.

  The treatment execution detection unit 123b detects a treatment tool used in the endoscopic examination from the frame image included in the endoscope moving image by image recognition, and detects a treatment performed based on the detected treatment tool. To do. The treatment execution detection unit 123b periodically searches for a treatment tool by image recognition from the frame image. Usually, it is processed in synchronism with the image recognition process of the medicine by the medicine scattering detection unit 123a.

  The treatment tool includes forceps. The forceps include biopsy forceps, grasping forceps, hot biopsy forceps, and the like. A hot biopsy forceps is a forceps that can be energized with a high frequency and can be removed by picking up a foreign object. The treatment instrument includes an injection needle. The injection needle includes a biopsy needle and a local injection needle for local injection of physiological saline. The treatment instrument includes a high-frequency treatment instrument. Examples of high-frequency treatment tools include snares, incision forceps, knives, and hemostatic forceps. The high frequency snare is used for EMR (Endoscopic Mucosal Resection). The high-frequency knife is used for ESD (Endoscopic Submucosal Dissection).

  The treatment tool also includes a clip used for hemostasis. The treatment tool also includes a ligation device for tying polyps in the digestive tract. The treatment tool includes a duodenal scope treatment tool. Examples of the duodenal scope treatment tool include a cannula, a contrast tube, and a lithotripsy tool. The cannula is used for ERCP (Endoscopic Retrograde Cholangiopancreatography).

  The treatment instrument includes a guide wire, a brush, a basket, a tube, a stent, a balloon, a catheter, and the like. Guide wires and catheters are used for ERCP. Brushes are used for cytology. The basket is used for quarrying and collecting foreign matter. The tube is used for dye application. Stents are used for indwelling procedures. Balloons are used for dilatation.

  Hereinafter, a specific method for detecting a treatment tool will be described. The position of the forceps channel 112 of the treatment instrument is determined depending on the type of the endoscope 11. There is also a model in which the forceps channel 112 has two channels. An endoscopic image obtained when each treatment tool is inserted into the forceps channel 12 is used as a template image, and by comparing with an endoscopic image at the time of examination, which treatment tool is used is detected. For the treatment tool, a plurality of images with different forceps channel directions, protrusion lengths, and open / close states are prepared for each treatment instrument. For an asymmetric treatment instrument whose shape changes on the image by rotation, a plurality of images having different rotation angles are prepared.

  In order to detect the treatment tool from the endoscopic image, first, an edge is detected from the endoscopic image. A red (R) image or a green (G) image is used as the edge detection image. When the treatment instrument sheath is red, a green (G) image may be used. Next, a line segment shape is detected from the edge image using template matching, Hough transform, and the like. Next, the detected line segment shape is collated with the template image, and the degree of coincidence is calculated. The treatment tool of the template image having the highest degree of coincidence is set as the detection result.

  FIG. 5 is a diagram illustrating an example of an endoscopic image 40 including the biopsy forceps 41. As shown in FIG. 5, the treatment tool is basically framed in from 4 to 8 o'clock. Accordingly, it is only necessary to prepare a template image of the treatment instrument that is oriented in the direction from 4 to 8 o'clock. Thereby, the number of template images and the amount of calculation required for collation can be reduced.

  In detecting the treatment instrument, it is possible to consider the color information of the sheath. Also, an algorithm using feature quantities such as SIFT (Scale-Invariant Feature Transform) and SURF (Speeded Up Robust Features) that have been used in recent years for pattern detection may be used.

  The treatment execution detection unit 123b detects the treatment being performed based on the treatment tool detected by the image recognition. For example, when a biopsy forceps is detected, it is determined that a biopsy is being performed. The treatment execution detection unit 123b passes the treatment execution data indicating the implementation status of the treatment performed by the doctor to the data transmission unit 125 every N seconds or every N frames.

  The irradiation light switching control unit 122 is an observation light that is used in the light source device 14 every N seconds or every N frames in synchronization with the detection timing of drug distribution and treatment execution by the drug distribution detection unit 123a and the treatment execution detection unit 123b. Irradiation light type data indicating the type of the data is passed to the data sending unit 125.

  The data sending unit 125 receives the irradiation light type data passed from the irradiation light switching control unit 122, the medicine scattering data passed from the medicine scattering detection unit 123a, and the treatment execution data passed from the treatment execution detection unit 123b. 2 is sent to the endoscopic examination data recording device 20. The data transmission unit 125 may transmit the irradiation light type data, the drug distribution data, and the treatment execution data delivered at predetermined time intervals each time, or after temporarily storing the data in a buffer (not shown). You may transmit in bulk. For example, the irradiation light type data, medicine distribution data, and treatment execution data of the endoscopic examination may be transmitted collectively after the endoscopic examination is completed. If the buffer (not shown) is designed to have a small capacity, the accumulated data is transmitted all at once when the buffer (not shown) has no free capacity.

  The irradiation light type data acquisition unit 221a, the drug distribution data acquisition unit 221b, and the treatment execution data acquisition unit 221c of the endoscopic examination data recording device 20 store the irradiation light type data, drug distribution data, and treatment execution data in the endoscope. Obtained from the system 10 respectively. The data recording unit 225 records the transition of data acquired by the irradiation light type data acquisition unit 221a, the medicine distribution data acquisition unit 221b, and the treatment execution data acquisition unit 22c in the examination data holding unit 232, respectively.

  In the present embodiment, the irradiation light type data acquisition unit 221a, the drug distribution data acquisition unit 221b, and the treatment execution data acquisition unit 221c respectively acquire irradiation light type data, drug distribution data, and time series data of treatment execution data. . The data recording unit 225 records the acquired time series data in the inspection data holding unit 232 as it is or after being processed.

  6A to 6C are diagrams illustrating examples of a master information table held in the master information holding unit 231. FIG. 6A shows an example of the observation light type master table 213a, FIG. 6B shows an example of the medicine type master table 213b, and FIG. 6C shows an example of the treatment type master table 213c. .

  In the observation light type master table 213a shown in FIG. 6A, four types of white light = 1, narrow band light = 2, fluorescence = 3, and near infrared light = 4 are defined as the observation light types. In the drug type master table 213b shown in FIG. 6B, five types of drug types, indigo carmine = 1, lugol = 2, bioctane = 3, methylene blue = 4, and acetic acid = 5, are defined. The number 0 indicates that no drug is detected. In the treatment type master table 213c shown in FIG. 6C, nine types of biopsy = 1, polypectomy = 2, local injection = 3,..., Stent = 9 are defined as treatment types. The number 0 indicates that no treatment is detected. Although not shown, a treatment tool master table in which each treatment and a treatment tool used in each treatment are linked is provided, and a treatment type is specified based on the treatment tool detected by image recognition.

  The same table as the observation light type master table 213 a is also provided in the irradiation light switching control unit 122 of the endoscope system 10. The same table as the medicine type master table 213b is also provided in the medicine spraying detection unit 123a of the endoscope system 10. The same table as the treatment type master table 213c and the treatment tool master table is also provided in the treatment execution detection unit 123b of the endoscope system 10.

  The irradiation light switching control unit 122 confirms the type of observation light at a predetermined time interval, converts the confirmed type of observation light into a number with reference to the observation light type master table, and passes the number to the data transmission unit 125. The medicine distribution detection unit 123a searches for the medicine in the endoscopic image at a predetermined time interval, converts the search result into a number with reference to the medicine type master table, and passes it to the data transmission unit 125. The treatment execution detection unit 123b searches for a treatment tool in the endoscopic image at a predetermined time interval, converts the search result into a number with reference to the treatment tool master table and the treatment type master table, and sends it to the data transmission unit 125. hand over.

  FIG. 7 is a diagram illustrating an example of inspection data 232 a recorded in the inspection data holding unit 232. In the example illustrated in FIG. 7, the data recording unit 225 has the irradiation light type data acquisition unit 221 a, the drug distribution data acquisition unit 221 b, and the irradiation light type data acquired by the treatment execution data acquisition unit 221 c, the drug distribution data, and the treatment execution. This is an example in which time-series data of data is recorded in the inspection data holding unit 232 as it is.

  In this example, observation light, drug distribution, and treatment data are recorded in time series in units of 1 second from the start of the test to the end of the test. Note that the time series data may be frame unit data instead of time unit data. In the example shown in FIG. 7, the observation light is switched from white light to narrow-band light when 2 seconds elapse from the start of the inspection. In addition, biopsy is started when 100 seconds have passed since the start of the examination. Lugor is sprayed when 1000 seconds have passed since the start of the inspection.

  In order to record the endoscopy more accurately, in addition to the start time and end time of the endoscopy, the time when the endoscope 11 is inserted into the body cavity and the time when it is removed from the body cavity are recorded. It is desirable.

  An examination start / end detection unit (not shown) of the endoscope system 10 detects the start of an endoscopic examination when a doctor presses an examination start button, and transmits examination start detection data including the detection time. Pass to unit 125. The inspection start may be detected due to the attachment of the endoscope 11 to the light source device 14 or the power source of the light source device 14 being turned on. The examination start / end detection unit (not shown) detects the end of the endoscopic examination when the doctor presses the examination end button, and passes the examination end detection data including the detection time to the data sending unit 125. The end of the inspection may be detected due to extraction of the endoscope 11 from the light source device 14 or power-off of the light source device 14.

  When a body cavity insertion state detection unit (not shown) of the endoscope system 10 detects that the endoscope 11 has been inserted into the body cavity, endoscope insertion detection data including the detection time is sent to the data sending unit 125. To pass. The insertion of the endoscope 11 into the body cavity and the removal of the endoscope 11 outside the body cavity can be detected by the method described in Japanese Patent Application No. 7-116138. Also, the body cavity insertion state detection unit (not shown) may detect that the endoscope 11 has been inserted into the body cavity based on the increase rate of the red (R) component of the endoscopic image, for example. Moreover, based on the detection signal of the sensor with which the patient's mouthpiece was mounted | worn, you may detect that the endoscope 11 passed the mouthpiece and was inserted in the body cavity.

  In addition, when detecting that the endoscope 11 has been removed from the body cavity, the body cavity insertion state detection unit (not shown) passes the endoscope removal detection data including the detection time to the data sending unit 125. A body cavity insertion state detection unit (not shown) may detect that the endoscope 11 has been removed from the body cavity based on the reduction rate of the red (R) component of the endoscopic image, for example. Further, based on a detection signal from a sensor attached to the patient's mouthpiece, it may be detected that the endoscope 11 has passed through the mouthpiece and removed from the body cavity.

  The data sending unit 125 includes the examination start detection data and the examination end detection data passed from the examination start / end detection unit (not shown), and the endoscope insertion detection passed from the body cavity insertion state detection unit (not shown). The data and the endoscope removal detection data are sent to the endoscope inspection data recording device 20 via the network 2.

  The examination start / end data acquisition unit (not shown) and the body cavity insertion state detection data acquisition unit (not shown) of the endoscope examination data recording device 20 have examination start detection data, examination end detection data, and endoscope insertion detection. Data and endoscope removal detection data are acquired. The data recording unit 225 records inspection start detection data, inspection end detection data, endoscope insertion detection data, and endoscope removal detection data in the inspection data holding unit 232.

  The data calculation unit 224 of the endoscopic examination data recording device 20 uses the observation light usage time in the endoscopy based on the time series data of the irradiation light type data acquired by the irradiation light type data acquisition unit 221a. And / or calculating the number of times each observation light is used. The usage time of the observation light can be calculated from the time during which the observation light is continuously irradiated. Although details will be described later, the observation using the specific observation light manually input by the irradiation light information included in the accompanying information of the moving image or the still image captured by the endoscope 11 or the user is started. It can be calculated from the time difference between the time and the observation end time.

  Further, the data calculation unit 224 uses the time series data of the drug distribution data acquired by the drug distribution data acquisition unit 221b and the observation time and / or use of each drug in the endoscopy. Calculate the number of times. The observation time using the medicine can be calculated from the time during which the medicine is framed in the moving image. Although details will be described later, it can be calculated from the time difference between the observation start time and the observation end time using a specific medicine manually input by the user.

  In addition, the data calculation unit 224 calculates the execution time of each treatment and / or the number of times of each treatment in the endoscopy based on the time series data of the treatment execution data acquired by the treatment execution data acquisition unit 221c. . The treatment execution time can be calculated from the time during which the treatment tool is framed in the moving image. Although details will be described later, it can be calculated from the time difference between the treatment start time and the treatment end time manually input by the user.

  The data recording unit 225 includes a use time of each observation light calculated by the data calculation unit 224, a use number of each observation light, an observation time using each drug, a use number of each drug, an execution time of each treatment, In addition, at least one of the number of times each treatment is performed is recorded in the examination data holding unit 232.

  FIG. 8 is a diagram illustrating another example of the inspection data 232 b recorded in the inspection data holding unit 232. In the example shown in FIG. 8, the data recording unit 225 uses the observation time for each observation light, the number of times each observation light is used, the observation time using each medicine in the endoscopy calculated by the data calculation unit 224, This is an example in which the number of times each drug is used, the duration of each treatment, and the number of times each treatment is recorded in the examination data holding unit 232. The inspection data 232b shown in FIG. 8 is data generated by processing the raw inspection data 232a shown in FIG.

  In the example shown in FIG. 8, in the “endoscope” of the detection information type column, number 0 indicates insertion into the body cavity, and number 1 indicates removal from the body cavity. “Observation light” is white light for 0 to 1 second from the start of inspection, narrow band light for 2 to 98 seconds from the start of inspection, and white light (second time) for 99 to 2000 seconds from the start of inspection. As a treatment, a biopsy is performed in a period of 100 to 600 seconds from the start of the examination. Lugol is sprayed in the period of 1000 to 1500 seconds from the start of the inspection as drug spraying.

  In this way, the original time-series data indicating the transition of the endoscopy can be processed and recorded into the type, start time, end time, and number of events that occurred in the endoscopy. Note that when the processed data is generated, the original time-series data may be deleted to compress the data amount. The processing method of the raw time series data is not limited as long as the original time series data can be restored, and the processing method and the recording method are not limited.

  In the above description, an example has been given in which drug dispersion and treatment execution are detected by image recognition. In this respect, the user may manually input the medicine distribution and the treatment execution. For example, a doctor or a nurse looks at an endoscopic image displayed on the display device 13 of the endoscope system 10 or the display unit 34 of the terminal device 30 during or after an endoscopic examination, and then disperses medicines and / or Information regarding treatment implementation may be entered.

  Specifically, the name of the sprayed medicine is input, and frame images at the observation start time and the observation end time in the medicine spraying state are designated. Also, the name of the performed treatment is input, and frame images at the treatment start time and treatment end time are designated. The operation accepting unit 222 of the endoscopic examination data recording device 20 accepts information related to drug distribution and / or treatment execution input by a doctor or nurse and passes the information to the data recording unit 225 and the data calculation unit 224. Depending on the part in the body cavity, there is a part where the accuracy of image recognition is lowered, and when erroneous data is detected by the image recognition, it is manually corrected by a doctor or a nurse.

  Regarding the type of observation light, the doctor or nurse can manually input the observation light switching point and the type of observation light after switching. In some cases, the type of observation light and the switching time can be specified from the incidental information of the moving image or frame image captured by the endoscope 11.

  FIG. 9 is a flowchart for explaining an operation example of the endoscope system 10 according to the first embodiment. When the inspection start / end detection unit (not shown) of the endoscope system 10 detects the start of the endoscopic inspection (Y in S10), the data transmission unit 125 is notified of the detection time. Thereafter, when a body cavity insertion state detection unit (not shown) detects the insertion of the endoscope 11 into the body cavity (Y in S11), the detection time is passed to the data sending unit 125.

  The image recognition unit 123 acquires an endoscopic image captured by the endoscope 11 (S12). The medicine distribution detection unit 123a searches for the medicine in the acquired endoscopic image, and the treatment execution detection part 123b searches for the treatment tool in the acquired endoscopic image (S13). The medicine dispersion detection unit 123a and the treatment execution detection unit 123b pass the search result to the data transmission unit 125. The irradiation light switching control unit 122 confirms the type of observation light (S14). The irradiation light switching control unit 122 passes the confirmation result to the data transmission unit 125. The data sending unit 125 temporarily holds data relating to observation light, medicine, and treatment in a buffer (not shown) (S15).

  When the insertion state detecting unit (not shown) in the body cavity does not detect removal of the endoscope 11 from the body cavity (N in S16) and N seconds elapse from the acquisition of the endoscope image (Y in S17), Returning to step S12, a new endoscopic image is acquired (S12). When a body cavity insertion state detection unit (not shown) detects removal of the endoscope 11 from the body cavity (Y in S16), the detection time is passed to the data sending unit 125. Thereafter, when the examination start / end detection unit (not shown) detects the end of the endoscopic examination (Y in S18), the data sending unit 125 is notified of the detection time. The data sending unit 125 sends the data stored in the buffer (not shown) to the endoscopy data recording device 20 as time series data (S19).

  FIG. 10 is a flowchart for explaining an operation example of the endoscopic examination data recording device 20 according to the first embodiment. The data acquisition unit 221 of the endoscope examination data recording device 20 acquires various time series data from the endoscope system 10 (S20). The data calculation unit 224 calculates the use time and use count of the observation light for each type based on the acquired time-series data regarding the observation light (S21). Further, the data calculation unit 224 calculates the observation time using the medicine and the number of times the medicine is used for each type based on the acquired time-series data related to the medicine dispersion (S22). Further, the data calculation unit 224 calculates the execution time and the number of executions for each type based on the acquired time-series data regarding the execution of the treatment (S23). The data recording unit 225 records the acquired time series data and the calculated processing data in the inspection data holding unit 232 (S24).

  As described above, according to the first embodiment, the type of observation light used in the endoscopy, the precise diagnosis by various drug spraying, and various treatments such as biopsy can be recorded as data at each time point. Therefore, it is possible to grasp the time and number of times required for drug application and treatment, as well as grasp the order of appearance, quantitative evaluation such as average calculation, and comparison with other examinations. Can be accurately and objectively evaluated. In the present embodiment, the endoscopic examination data recording system for recording the time series data acquired with respect to the observation light, the drug distribution, and the execution of the treatment and the calculated processing data has been described. It is of course possible to selectively acquire or record such information, and the data may be selectively acquired and recorded as appropriate in accordance with the purpose of use of the data, available computing resources, or the like.

  Conventionally, information related to observation light switching, drug application, and treatment execution during endoscopy has been recorded manually by doctors and nurses based on the memories of doctors and nurses. However, since there is a wide variety of information to be recorded, the recording accuracy and granularity tend to vary from one recording person to another, and unified data recording has not been realized. Also, manual recording by doctors and nurses is a complicated task. On the other hand, according to the first embodiment, the trajectory of the endoscopic examination can be automatically recorded in time series based on information detected by image recognition from the endoscopic image during the endoscopic examination. . Therefore, the workload of doctors and nurses can be reduced, and unified data recording becomes possible.

  In addition, the procedure used in the endoscopy can be identified based on the detection order of each event such as drug spraying. For example, if a high-frequency snare is detected after a local injection needle is detected, it can be estimated that EMR has been performed. In addition, when a magnified observation is performed while using narrowband light (NBI), a medical fee is added. However, according to the present embodiment, since the observation light switching time and the treatment execution time are recorded, it is automatically recorded. It is also possible to calculate the sum of medical fees.

  Endoscopy is performed on a daily basis, regardless of whether it is in Japan or overseas, and big data can be generated by accumulating these data. The accumulated big data can be used for various statistical analyzes and data mining.

(Embodiment 2)
In the first embodiment, an example has been described in which data relating to observation light switching, drug distribution, and treatment execution is recorded in time series. In the second embodiment, in addition to them, an example in which data indicating the distance between the organ surface in the patient's body and the endoscope 11 and / or data indicating the magnification of the endoscope 11 is recorded in time series. explain.

  FIG. 11 is a diagram illustrating a configuration of the endoscope system 10 according to the second embodiment. The endoscope system 10 according to the second embodiment has a configuration in which an imaging distance estimation unit 123c and a magnification control unit 124 are added to the endoscope system 10 according to the first embodiment illustrated in FIG. Hereinafter, differences from the first embodiment will be described.

  The imaging distance estimation unit 123c estimates the imaging distance between the organ surface in the patient's body and the tip of the endoscope 11 from the frame image included in the endoscope moving image. The imaging distance estimation unit 123c estimates the imaging distance using, for example, the method described in Japanese Patent No. 5028138. In the present embodiment, the estimated imaging distance is classified into “far”, “medium”, and “near”. In addition, you may classify | categorize into not only 3 categories but 2 categories or 4 categories or more.

  The imaging distance estimation unit 123c estimates the imaging distance every N seconds or every N frames in synchronization with the image recognition processing of the medicine and the treatment tool by the medicine scattering detection part 123a and the treatment execution detection part 123b, and transmits the estimation result as data. Pass to unit 125. As the estimation start timing of the imaging distance, any one of an endoscope moving image recording start timing, a stopwatch measurement start timing in the image recording apparatus, and an initial release timing can be used. As the imaging distance estimation end timing, any of an endoscope moving image recording end timing, a stopwatch measurement end timing in the image recording apparatus, and an inspection end button press timing can be used.

  The magnification control unit 124 controls the magnification of the magnifying endoscope according to the operation of the doctor with respect to the operation unit 113 when the magnifying endoscope having the magnifying observation function is attached to the light source device 14. The magnification control unit 124 confirms the magnification of the magnifying endoscope every N seconds or every N frames, and passes the confirmation result to the data transmission unit 125. The magnification control unit 124 may pass the zoom magnification as it is, or may pass it as a percentage value with 0% at the maximum wide angle and 100% at the maximum telephoto. Instead of acquiring the zoom magnification from the magnifying endoscope, it may be detected by image recognition whether it is wide-angle observation or close-up observation.

  In addition to the irradiation light type data, the drug distribution data, and the treatment execution data, the data transmission unit 125 includes the imaging distance data indicating the imaging distance passed from the imaging distance estimation unit 123c and the enlargement passed from the magnification control unit 124. The magnification data indicating the magnification of the endoscope is sent to the endoscope inspection data recording device 20 via the network 2.

  FIG. 12 is a diagram illustrating a configuration of the endoscopic examination data recording device 20 according to the second embodiment. In the endoscopic examination data recording device 20 according to the second embodiment, an imaging distance data acquisition unit 221d and a magnification data acquisition unit 221e are added to the endoscopic examination data recording device 20 according to the first embodiment shown in FIG. It is the structure which was made. Hereinafter, differences from the first embodiment will be described.

  The imaging distance data acquisition unit 221d and the magnification data acquisition unit 221e acquire imaging distance data and magnification data from the endoscope system 10, respectively. The data recording unit 225 records the data transition acquired by the imaging distance data acquisition unit 221d and the magnification data acquisition unit 221e in the inspection data holding unit 232, respectively. In the present embodiment, the imaging distance data acquisition unit 221d and the magnification data acquisition unit 221e acquire time series data of the imaging distance data and the magnification data, and the data recording unit 225 maintains the acquired time series data as they are, or Processed and recorded in the inspection data holding unit 232.

  13A and 13B are diagrams showing an example of the imaging distance master table 231d held in the master information holding unit 231 and an example of inspection data 232c recorded in the inspection data holding unit 232. In the imaging distance master table 231d shown in FIG. 13A, three categories of far = 1, medium = 2, and near = 3 are defined as the imaging distance classification.

  The same table as the imaging distance master table 231d is also provided in the imaging distance estimation unit 123c of the endoscope system 10. The imaging distance estimation unit 123c estimates the imaging distance from the endoscopic image at a predetermined time interval, converts the estimation result into a number with reference to the imaging distance master table, and passes the result to the data transmission unit 125.

  In the example shown in FIG. 13B, the data recording unit 225 includes an irradiation light type data acquisition unit 221a, a drug distribution data acquisition unit 221b, a treatment execution data acquisition unit 221c, an imaging distance data acquisition unit 221d, and a magnification data acquisition unit 221e. This is an example in which the time series data of irradiation light type data, drug distribution data, treatment execution data, imaging distance data, and magnification data acquired as described above is recorded in the examination data holding unit 232 as it is.

  In this example, data relating to observation light, drug distribution, treatment, imaging distance, and magnification is recorded in time series in units of 1 second from the start to the end of the inspection. In the example shown in FIG. 13B, the imaging distance changes from “far” to “medium” when 2 seconds have elapsed from the start of the examination (that is, the endoscope 11 approaches the organ surface), and the imaging distance when 100 seconds have elapsed. Has changed from “medium” to “near” (that is, the endoscope 11 is closer to the organ surface). Further, when the biopsy is started when 100 seconds have elapsed from the start of the examination, the magnification of the magnifying endoscope is 80%.

  As described above, according to the second embodiment, the following effects are obtained in addition to the effects of the first embodiment. By recording the imaging distance to the organ surface and the magnification at the time of use of the magnifying endoscope in a state that can be handled quantitatively and objectively, it is possible to evaluate and compare with respect to detailed examination such as range diagnosis and differential diagnosis.

  In general, observation for finding a lesion tends to be observed in a distant view, and detailed observation after finding a lesion tends to be observed in a near view. Therefore, based on the imaging distance data, it can be estimated whether the observation for finding the lesion or the detailed observation is performed. Further, by storing the imaging distance data at the time of drug distribution, at the time of each treatment, and at the time of using narrowband light, the tendency of the position of the endoscope 11 at the time of performing these can be derived as a database.

  In an examination using a magnifying endoscope, observation for finding a lesion is generally observed at a wide angle, and detailed observation after finding a lesion tends to be observed in an enlarged state. Therefore, based on the magnification data of the magnifying endoscope, it can be estimated whether the observation for finding the lesion or the detailed observation is performed. In recent years, bifocal switching type magnifying endoscopes that switch the focus by button operation have also been put into practical use, and when using such a model, either a wide angle or an enlarged state is not a continuous magnification change. It becomes observation with. Also, by storing magnification data of the magnifying endoscope at the time of drug distribution, at the time of each treatment, and at the time of using narrow band light, the magnification of the magnifying endoscope at the time of performing it can be made into a database and a tendency can be derived. .

(Embodiment 3)
In the first embodiment, an example has been described in which data relating to observation light switching, drug distribution, and treatment execution is recorded in time series. In the third embodiment, in addition to these, an example in which data indicating the imaging state of an image captured by the endoscope 11 is recorded in time series will be described.

  FIG. 14 is a diagram illustrating a configuration of the endoscope system 10 according to the third embodiment. The endoscope system 10 according to the third embodiment has a configuration in which an imaging state classification unit 123d is added to the endoscope system 10 according to the first embodiment illustrated in FIG. Hereinafter, differences from the first embodiment will be described.

  The imaging state classification unit 123d classifies the imaging state of each endoscopic image captured in time series by the endoscope 11. Specifically, it is classified as to whether or not the endoscopic image is in a state where an organ surface in the body cavity of the patient is appropriately imaged. That is, the image is classified into an image that can sufficiently observe the organ in the body cavity and an image that cannot sufficiently observe the organ in the body cavity. Hereinafter, the former is classified as A and the latter is classified as B. The images of category B include images including halation, color misregistration, red balls (too close to the large intestine), a large amount of bubbles, residue, liquid, defocus (blur), blur, and water supply. As a method for classifying the imaging state of an endoscopic image, for example, the methods described in Japanese Patent Nos. 4615963, 4624841, and 5530406 can be used. Using these methods, an endoscopic image corresponding to class B is detected, and an endoscopic image not corresponding to class B is classified into class A.

  The imaging state classification unit 123d classifies the imaging state of the endoscopic image every N seconds or every N frames in synchronization with the image recognition processing of the medicine and the treatment tool by the medicine scattering detection part 123a and the treatment execution detection part 123b. The classification result is passed to the data transmission unit 125.

  In addition to the irradiation light type data, the drug distribution data, and the treatment execution data, the data sending unit 125 uses the imaging state data passed from the imaging state classification unit 123d via the network 2 for the endoscopy data recording device 20. To send.

  FIG. 15 is a diagram illustrating a configuration of the endoscopic examination data recording device 20 according to the third embodiment. The endoscopic examination data recording device 20 according to the third embodiment has a configuration in which an imaging state data acquisition unit 221f is added to the endoscopic examination data recording device 20 according to the first embodiment illustrated in FIG. Hereinafter, differences from the first embodiment will be described.

  The imaging state data acquisition unit 221f acquires imaging state data from the endoscope system 10. The data recording unit 225 records the transition of the imaging state data acquired by the imaging state data acquisition unit 221f in the inspection data holding unit 232. In this embodiment, the imaging state data acquisition unit 221f acquires time-series data of imaging state data, and the data recording unit 225 records the acquired time-series data in the inspection data holding unit 232 as it is or after being processed.

  FIG. 16 is a diagram illustrating an example of the imaging state master table 231f held in the master information holding unit 231. In the example shown in FIG. 16, the classification A “image that can sufficiently observe an organ in a body cavity” is further subdivided into two types: observation good = 0 and observation = 1. In addition, the “image in which the organ in the body cavity cannot be sufficiently observed” of the classification B is further expressed as residue, liquid, water supply = 2, halation = 3, color shift = 4, out-of-focus (blur), blur = 5, indeterminate = 6 Subdivided into 5 types. Therefore, the imaging state is classified into a total of seven categories.

  The same table as the imaging state master table 231f is also provided in the imaging state classification unit 123d of the endoscope system 10. The imaging state classification unit 123d detects the imaging state of the endoscope image at a predetermined time interval, converts the detection result into a number with reference to the imaging state master table, and passes the detection result to the data transmission unit 125.

  FIG. 17 is a diagram illustrating an example of inspection data 232 c recorded in the inspection data holding unit 232. In the example shown in FIG. 17, the data recording unit 225 irradiates the irradiation light type data acquired by the irradiation light type data acquisition unit 221a, the medicine distribution data acquisition unit 221b, the treatment execution data acquisition unit 221c, and the imaging state data acquisition unit 221f. This is an example in which the time series data of the drug distribution data, the treatment execution data, and the imaging state data are recorded in the examination data holding unit 232 as they are.

  In this example, data relating to observation light, drug distribution, treatment, and imaging state is recorded in time series in units of 1 second from the start of the test to the end of the test. In the example shown in FIG. 17, defocusing or blurring is detected at the start of inspection, color shift is detected when 1 second has elapsed since the start of inspection, and observation is in good condition when 2 seconds have elapsed since the start of inspection. While the endoscope 11 immediately after the start of the examination moves from the mouth to the esophagus, the captured image is likely to be blurred. In addition, water is supplied when 700 seconds have elapsed from the start of the inspection, and the imaging state is incapable of sufficient observation.

(Application example of Embodiment 3)
In the above description according to Embodiment 3, the imaging state classification unit 123d classifies the imaging state by detecting a static imaging state from a single frame image. In the application example described below, a dynamic imaging state is detected based on a change between frame images, and the imaging state is classified.

  The imaging state classification unit 123d calculates an evaluation value based on a change between frame images in an endoscopic image captured in time series. The evaluation value based on the change between frame images can be calculated by, for example, the method described in Japanese Patent No. 5147308. Hereinafter, the calculated evaluation value is referred to as a change evaluation value P.

  The change evaluation value P is calculated every N seconds or every N frames in synchronization with the image recognition processing of the medicine and the treatment tool by the medicine dispersion detection unit 123a and the treatment execution detection unit 123b. At this time, the change evaluation value P may be calculated based on a change between the current frame image and a frame image of N seconds or N frames in the past, or may be changed based on a change between the current frame image and the previous frame image. The evaluation value P may be calculated. The imaging state classification unit 123d detects and classifies a dynamic imaging state based on the calculated change evaluation value P.

  The change evaluation value P takes a smaller value as the change between frame images is smaller, indicating that the movement of the endoscope 11 is smaller. When the doctor stops the movement of the endoscope 11 and observes a specific part, the change evaluation value P takes a value close to zero.

  The imaging state classification unit 123d synchronizes with the image recognition processing of the medicine and the treatment tool by the medicine scattering detection unit 123a and the treatment execution detection unit 123b, and performs static and dynamic imaging of the endoscopic image every N seconds or N frames. The imaging state is detected and classified into categories, and the classification result is passed to the data sending unit 125. The data sending unit 125 receives the static imaging state data and the dynamic imaging state data passed from the imaging state classification unit 123d via the network 2 in addition to the irradiation light type data, the drug distribution data, and the treatment execution data. The data is sent to the endoscope inspection data recording device 20.

  The imaging state data acquisition unit 221f acquires static imaging state data and dynamic imaging state data from the endoscope system 10. The data recording unit 225 records the static imaging state data acquired by the imaging state data acquisition unit 221f and the transition of the imaging state data in the inspection data holding unit 232. In the present embodiment, the imaging state data acquisition unit 221f acquires time-series data of static imaging state data and dynamic imaging state data, and the data recording unit 225 directly or processes the acquired time-series data. The data is recorded in the inspection data holding unit 232.

  FIG. 18 is a diagram illustrating an example of the change evaluation value / imaging state master table 231g held in the master information holding unit 231. In the example illustrated in FIG. 18, an image classified into the classification A in the static imaging state classification process is the target of the dynamic imaging state classification process, and is classified into the classification B in the static imaging state classification process. The classified image is not subjected to a dynamic imaging state classification process.

  Of the “images that can sufficiently observe the organs in the body cavity” classified into the category A, the images in which the image evaluation value P is in the range of 0.0 ≦ P <0.3 (class Aa) have a dynamic imaging state. Good observation = 0. Images in which the image evaluation value P is in the range of 0.3 ≦ P <0.8 (classification Ab) are classified as observable dynamic imaging states = 1. An image in which the image evaluation value P is in a range of 0.8 ≦ P ≦ 1.0 (classification Ac) is classified into a dynamic imaging state of inappropriate observation = 2.

  The same table as the change evaluation value / imaging state master table 231g is also provided in the imaging state classification unit 123d of the endoscope system 10. The imaging state classification unit 123d calculates a change evaluation value P between endoscopic images at a predetermined time interval, converts it into a number with reference to the change evaluation value / imaging state master table, and passes it to the data transmission unit 125. Note that the calculation of the change evaluation value P may be skipped for an endoscopic image in which the static imaging state is classified into classification A.

  FIG. 19 is a diagram illustrating an example of inspection data 232 d recorded in the inspection data holding unit 232. In the example illustrated in FIG. 19, the data recording unit 225 has the irradiation light type data acquired by the irradiation light type data acquisition unit 221 a, the medicine distribution data acquisition unit 221 b, the treatment execution data acquisition unit 221 c, and the imaging state data acquisition unit 221 f, This is an example in which time series data of drug distribution data, treatment execution data, static imaging state data, change evaluation value P, and dynamic imaging state data are recorded as they are in the examination data holding unit 232. In this example, the endoscopic image in which the static imaging state is classified into the classification B is an example in which the change evaluation value P and the dynamic imaging state data are not recorded. Also for the mirror image, the change evaluation value P and the dynamic imaging state data may be calculated and classified and recorded.

  In the example shown in FIG. 19, observation light, drug distribution, treatment, static imaging state, change evaluation value, and dynamic imaging state data are recorded in time series in units of 1 second from the start of the test to the end of the test. . In the example shown in FIG. 19, the endoscope 11 is moved at the time when 4 seconds have elapsed and the time when 1300 seconds have elapsed since the start of the examination, and is in an unsuitable state of observation.

  FIG. 20 is a flowchart for explaining an operation example of the endoscope system 10 according to the application example of the third embodiment. When the inspection start / end detection unit (not shown) of the endoscope system 10 detects the start of the endoscopic inspection (Y in S10), the data transmission unit 125 is notified of the detection time. Thereafter, when a body cavity insertion state detection unit (not shown) detects the insertion of the endoscope 11 into the body cavity (Y in S11), the detection time is passed to the data sending unit 125.

  The image recognition unit 123 acquires an endoscopic image captured by the endoscope 11 (S12). The imaging state classification unit 123d detects and classifies the static imaging state of the acquired endoscopic image, and passes the classification result to the data transmission unit 125 (S121). The imaging state classification unit 123d calculates the change evaluation value P based on the difference between the endoscope image acquired this time and the endoscope image acquired last time, and passes the change evaluation value P to the data transmission unit 125. (S122). The imaging state classification unit 123d detects and classifies the dynamic imaging state of the endoscope image acquired this time based on the calculated change evaluation value P, and passes the classification result to the data transmission unit 125 (S123). .

  The medicine spraying detection unit 123a searches for a medicine in the endoscope image acquired this time, and the treatment execution detection part 123b searches for a treatment tool in the endoscope image acquired this time (S13). The medicine dispersion detection unit 123a and the treatment execution detection unit 123b pass the search result to the data transmission unit 125. The irradiation light switching control unit 122 confirms the type of observation light (S14). The irradiation light switching control unit 122 passes the confirmation result to the data transmission unit 125. The data sending unit 125 temporarily stores data relating to observation light, medicine, treatment, static imaging state, change evaluation value P, and dynamic imaging state in a buffer (not shown) (S15).

  When the insertion state detecting unit (not shown) in the body cavity does not detect removal of the endoscope 11 from the body cavity (N in S16), and N seconds have elapsed from the acquisition of the current endoscopic image (Y in S17). ), The process returns to step S12, and a new endoscopic image is acquired (S12). When a body cavity insertion state detection unit (not shown) detects removal of the endoscope 11 from the body cavity (Y in S16), the detection time is passed to the data sending unit 125. Thereafter, when the examination start / end detection unit (not shown) detects the end of the endoscopic examination (Y in S18), the data sending unit 125 is notified of the detection time. The data sending unit 125 sends the time series data stored in the buffer (not shown) to the endoscopic examination data recording device 20 (S19).

  Note that the processing in steps S122 and S123 can be skipped when the currently acquired endoscopic image is classified as category B in the static imaging state classification processing in step S121.

  Further, even when the change evaluation value P and the dynamic imaging state data are generated for the endoscopic images classified into the classification B, they may be excluded from the transmission target in the time-series data transmission processing in step S19. .

  As described above, according to the third embodiment, in addition to the effects of the first embodiment, the following effects can be obtained. By classifying and recording each imaging state of a plurality of endoscopic images taken in time series, whether or not the organ surface is properly imaged (that is, the organ surface can be sufficiently observed). Status information such as whether or not there is) can be recorded quantitatively and objectively. Furthermore, the movement of the endoscope 11 can be recorded by calculating and recording a change evaluation value between adjacent frame images. For example, it can be inferred from the transition of the change evaluation value that the endoscope 11 is being inserted (moved) and that the doctor is observing the organ surface.

  The recording of the imaging state is not premised on the storage of the endoscope image, and the imaging state of the endoscope moving image section that is not stored and the endoscope image that is discarded is also recorded. The recording of the time series data of the imaging state is mainly intended to record the handling of the endoscope 11 by the doctor during the endoscopy in a time series, and the quality of the stored endoscopic image The main purpose is not to record.

(Embodiment 4)
In the fourth embodiment, an example of a method for using the endoscopic examination data stored in the endoscopic examination data recording device 20 will be described.

  FIG. 21 is a diagram illustrating a configuration of the endoscopic examination data recording device 20 according to the fourth embodiment. In the endoscopic examination data recording device 20 according to the fourth embodiment, a data analysis unit 224a and a statistical data holding unit 233 are added to the endoscopic examination data recording device 20 according to the third embodiment shown in FIG. It is a configuration. Hereinafter, processing according to Embodiment 4 will be described.

  In the endoscopic examination, (a) examination time per examination is as follows: (b) time from the start of examination until the endoscope 11 is inserted into the body cavity of the patient, (c) non-observation time, (d) normal It can be defined as the total of the observation time, (e) detailed observation time, (f) treatment time, and (g) the time from removal of the endoscope 11 outside the body cavity of the patient until the end of the examination.

  (C) The non-observation time refers to a time during which a doctor cannot perform sufficient observation due to pulsation of an organ of a patient, breathing, image disturbance (halation, etc.) due to contraction of an observation site, and the like. (D) The normal observation time is a time for observing the presence or absence of a lesion from a relatively far observation distance while moving the observation site relatively slowly or with the movement of the scope stopped (detailed observation time). Except for times classified as). (E) Detailed observation time means time to observe with caution when a lesion such as proximity observation, NBI observation, magnified observation, or drug spraying is found. (F) The treatment time refers to time for performing various treatments such as biopsy, stent placement / removal, and EMR.

  The data calculation unit 224 calculates the examination time (a) from the examination start time and examination end time of the endoscopic examination to be held in the examination data holding unit 232. The data calculation unit 224 also determines (b) the time from the start of the examination until the insertion of the endoscope 11 into the body cavity of the patient, the examination start time of the endoscope examination held in the examination data holding unit 232, and the internal Calculated from the insertion time of the endoscope.

  The data calculation unit 224 calculates (c) non-observation time based on the imaging state data of the endoscopic examination held in the examination data holding unit 232. For example, in an imaging state classification process of static imaging, “an image in which an organ in a body cavity cannot be sufficiently observed” = an endoscopic image classified into classification B, and in an imaging inappropriate classification in a classification process of dynamic imaging state The total time of the section in which the endoscopic image is captured is defined as (c) non-observation time.

  In addition, the data calculation unit 224 uses (e) the detailed observation time, the irradiation time of the special light in the endoscopic examination held in the examination data holding unit 232, the enlargement observation time using the magnifying endoscope, and the medicine. It is calculated based on the observation time. Further, the data calculation unit 224 calculates (f) the treatment time based on the execution time of the treatment performed in the endoscopic examination held in the examination data holding unit 232. The data calculation unit 224 also determines (g) the time from the removal of the endoscope 11 to the outside of the body cavity of the patient until the end of the examination, and the endoscope removal time of the endoscopic examination held in the examination data holding unit 232. And calculated from the inspection end time.

  The data calculation unit 224 also determines (d) normal observation time from (a) examination time, (b) time from the start of examination to insertion of the endoscope 11 into the patient's body cavity, and (c) non-observation time. (D) Normal observation time, (e) Detailed observation time, (f) Treatment time, (g) By subtracting the total time from the removal of the endoscope 11 to the outside of the patient's body cavity until the end of the examination calculate.

  The data calculation unit 224 calculates (a) the examination time, (b) the time from the start of the examination until the endoscope 11 is inserted into the body cavity of the patient, (c) the non-observation time, (d) the normal observation time. (E) Detailed observation time, (f) Treatment time, (g) The time from the removal of the endoscope 11 outside the body cavity of the patient to the end of the test is recorded in the test data holding unit 232.

  The data analysis unit 224 a performs statistical analysis based on the data recorded in the inspection data holding unit 232 and records the generated statistical data in the statistical data holding unit 233.

  FIG. 22 is a diagram illustrating an example of statistical data 233 a recorded in the statistical data holding unit 233. In this example, the data analysis unit 224a classifies the inspection data of the endoscopy by the inspection item, the site, and the lesion type, and (c) non-observation time, (d) normal observation time, and (e) details for each classification. Each average value of observation time and (f) treatment time is calculated.

  In the example shown in FIG. 22, (c) non-observation time, (d) normal observation time, and (e) of endoscopy classified into examination items = upper endoscopy, observation site = stomach, lesion = polyp. Detailed observation time, (f) average time of treatment time, examination item = lower endoscopy, observation site = sigmoid colon, lesion = endoscopy of adenoma (c) non-observation time, (D) Normal observation time, (e) detailed observation time, and (f) treatment time average time are calculated. Furthermore, examination item = upper endoscopy, observation site = stomach, lesion = recovery rate of endoscopy classified as polyp, examination item = lower endoscopy, observation site = sigmoid colon, lesion = The lesion detection rate of endoscopy classified as adenoma is calculated respectively.

  By generating such statistical data, the characteristics of endoscopy can be investigated for each classification of endoscopy. Further, for each classification of endoscopic examination, the difficulty level of the operation and procedure of the endoscope 11 can be quantified, and it can be used for creating an examination protocol and improving the procedure. It is also possible to examine and investigate which time is required to greatly contribute to the detection of lesions.

  FIG. 23 is a flowchart for explaining an operation example of the endoscopic examination data recording device 20 according to the fourth embodiment. The data calculation unit 224 reads various types of data for endoscopic examination from the examination data holding unit 232 (S2240). The data calculation unit 224 has various required times ((a) examination time, (b) time from the start of examination until the endoscope 11 is inserted into the body cavity of the patient, (c) The non-observation time, (e) detailed observation time, (f) treatment time, (g) time from the removal of the endoscope 11 to the outside of the patient's body cavity until the end of the examination are calculated (S2241).

  The data calculation unit 224 includes (a) examination time − {(b) time from the start of examination to insertion of the endoscope 11 into the body cavity of the patient + (c) non-observation time + (e) detailed observation time + (F) treatment time, (g) time from removal of the endoscope 11 outside the body cavity of the patient until the end of the examination} are calculated, and (d) normal observation time is calculated (S2242). The data calculation unit 224 stores the calculated various required times in the inspection data holding unit 232 (S2243). The data calculation unit 224 executes the above process for all examination data for endoscopy in principle.

  The data analysis unit 224a reads various required times from the examination data holding unit 232 for each classification of the endoscopic examination (S2244). The data calculation unit 224 calculates statistical values (for example, average value, median value) of the various required times read (S2245). The data analysis unit 224a stores the calculated statistical values of various required times in the statistical data holding unit 233 (S2246). The data analysis unit 224a executes the above processing for the designated classification of endoscopy.

  As described above, according to the fourth embodiment, since the data indicating the state at each time point in the endoscopic examination is recorded in time series, various required times in the endoscopic examination can be accurately calculated. Therefore, the endoscopic examination process can be objectively evaluated, and can be used for finding a doctor's habits and improvement points. In addition, since data having the same specification is collected in a plurality of endoscopic examinations, objective statistical data in the endoscopic examinations can be calculated. Therefore, it can be used to create and improve inspection protocols. It can also be used as academic data.

(Embodiment 5)
In the fifth embodiment, a method for giving site information to an endoscopic image captured by the endoscope 11 will be described.

  FIG. 24 is a diagram illustrating a configuration of the endoscopic examination data recording device 20 according to the fifth embodiment. In the endoscopic examination data recording device 20 according to the fifth embodiment, an image acquisition unit 221g and a part information adding unit 226 are added to the endoscopic examination data recording device 20 according to the first embodiment shown in FIG. It is a configuration. Hereinafter, processing according to the fifth embodiment will be described.

  In Embodiment 1-4, the process of transferring the endoscope image captured by the endoscope 11 from the endoscope system 10 to the endoscope inspection data recording device 20 is not essential. Embodiment 5 Therefore, it is essential to transfer an endoscopic image. The endoscopic image to be transferred is a still image captured by a doctor releasing the shutter or operating the foot switch. The still image is an image for storage, and among these images, an image selected by the doctor is attached to the report. It should be noted that the transfer of the endoscope moving image from the endoscope system 10 to the endoscope inspection data recording device 20 is not essential.

  The image acquisition unit 221g acquires a plurality of endoscopic images captured by the endoscope 11 from the endoscope system 10 by a doctor's operation. The part information giving unit 226 gives part information (eg, duodenum, stomach, esophagus) to the acquired endoscopic image. The site information can be given by the following method, for example.

  The part information giving unit 226 gives part information manually input by a doctor or a nurse. Specifically, the display control unit 223 displays the endoscope image acquired by the image acquisition unit 221g on the display device 13 of the endoscope system 10 or the display unit 34 of the terminal device 30 during or after the inspection. A doctor or a nurse manually inputs which part of the displayed endoscopic image the endoscopic image is. The operation accepting unit 222 of the endoscopic examination data recording device 20 accepts the part information input by the doctor or nurse and passes it to the part information giving unit 226.

  The part information adding unit 226 can also specify a part by image recognition from an endoscopic image. For example, the acquired endoscopic image and the pattern data of each part are matched to specify the part. Note that a doctor or a nurse manually inputs an endoscopic image whose part cannot be specified by image recognition.

  The part information adding unit 226 can also add part information to the endoscopic image in accordance with the part imaging order defined in the examination protocol. The inspection protocol is a procedure in which the site to be observed, the precautions during observation, the conditions of the still image to be recorded, etc. are arranged in order, and is used when a routine inspection is performed. For example, in the upper endoscopy, a procedure is used in which the endoscope 11 is first inserted up to the duodenum and the endoscope 11 is returned to the direction of the esophagus.

  FIGS. 25A and 25B are diagrams illustrating an example of a part specifying screen 50 for giving part information to an endoscopic image in the order of photographing. The display control unit 223 of the endoscopic examination data recording device 20 displays the region specifying screen 50 on the display device 13 of the endoscope system 10 or the display unit 34 of the terminal device 30. The part specifying screen 50 shown in FIG. 25A is a screen before the part information is given to the endoscopic image. In the upper endoscopy examination protocol shown in this example, (1) duodenum, (2) duodenum, (3) stomach (pylorus), (4) stomach (gastric body), (5) stomach (gastric corner) ), (6) stomach (cardia), (7) esophagus (lower part), (8) esophagus (middle part), (9) esophagus (upper part), (10) ten endoscopic images in the order of the throat. It is prescribed to shoot.

  The duodenum is set in the part information field 51a of the first endoscope image field 51, and the stomach (stomach body part) is set in the part information field 54a of the fourth endoscope image field 54. ... The throat portion is set in the region information field 510a of the tenth endoscope image field 510.

  The doctor inserts the endoscope 11 to the back of the duodenum according to the inspection protocol of the upper endoscopy, and sequentially captures images of the specified parts. As shown in FIG. 25B, the first photographed image is assigned to the first endoscope image column 51. When the doctor presses the OK button 50a, the image assignment is confirmed. If the part shown in the assigned endoscopic image does not match the part information in the assigned field, the assignment can be canceled by pressing the cancel button 50b.

  In the example shown in FIG. 25B, the doctor skips imaging of the stomach (gastric corner). For example, when the endoscope image of the third stomach (pylorus) is assigned (waiting for the assignment of the endoscope image of the fourth stomach (gastric corner)), the OK button 50a is pressed. When pressed, the assignment of the endoscopic image of the stomach (gastric corner) can be skipped. In accordance with the imaging sequence of the site defined in the examination protocol described above, the process of adding the site information to the endoscopic image taken by the endoscope 11 may be performed simultaneously during the endoscopy. It may be performed after the inspection.

  FIG. 26 is a flowchart for explaining an operation example of the endoscopic examination data recording device 20 according to the fifth embodiment. This operation example is an example in which part information is given to an endoscopic image that is actually taken in accordance with the order of photographing the part specified by the examination protocol. The image acquisition unit 221g acquires endoscopic images captured in the endoscopy from the endoscope system 10 in the order of imaging (S2260). The part information adding unit 226 adds part information to the endoscopic image acquired from the endoscope system 10 in accordance with the part imaging order specified by the examination protocol (S2261). The site information adding unit 226 transfers the endoscopic image to which the site information is added to the image recording apparatus (not shown) via the network 2 (S2262). When an endoscopic image is also stored in the endoscopic examination data recording device 20, it is stored in an image holding unit (not shown) in the storage unit 23.

  As described above, according to the fifth embodiment, it is possible to easily give site information to an endoscopic image for storage captured in an endoscopic examination. In particular, in the method of assigning site information to an endoscopic image in accordance with the imaging order of the site specified in the test protocol, a doctor is motivated to consciously follow the test protocol. Since it is not necessary to manually input the part information, a complicated operation by a doctor or a nurse becomes unnecessary. In addition, the method of detecting a part from an endoscopic image by image recognition processing may misrecognize the part. However, in the method of assigning part information to an endoscopic image according to the imaging order, the doctor observes the imaging order. If so, incorrect site information is not given.

(Embodiment 6)
The data calculation unit 224 of the endoscopic examination data recording device 20 according to the first embodiment uses the usage time of each irradiation light, the number of times each irradiation light is used, and each drug based on various time series data. Observation time, number of times each drug was used, duration of each treatment, and number of times of each treatment were calculated. The time-series data used as the basis of this calculation is data for the entire endoscopic examination period (the period from the examination start time to the examination end time).

  In the fifth embodiment, the data calculation unit 224 uses each irradiation light usage time, the number of times each irradiation light is used, the observation time using each medicine, and each medicine between two designated points in the endoscopy. At least one of the number of times used, the execution time of each treatment, and the number of executions of each treatment is calculated. Two points in the endoscopy can be designated by time, detection information, captured images, and the like.

  FIG. 27 is a diagram illustrating an example of a two-point designation screen 60 in the endoscopy. The display control unit 223 of the endoscope examination data recording device 20 displays the two-point designation screen 60 on the display device 13 of the endoscope system 10 or the display unit 34 of the terminal device 30. The designation screen 60 includes an arbitrary button 61, an observation light button 62, a medicine button 63, and a treatment button 64.

  The arbitrary button 61 is a button for designating two points by time. The observation light button 62 is a button for selecting the type of observation light and designating the use start time and use end time of the selected observation light as two points. The medicine button 63 is a button for selecting the type of medicine and designating the observation start time and the observation end time using the selected medicine as two points. The treatment button 64 is a button for selecting a treatment type and designating the execution start time and the execution end time of the selected treatment as two points.

  FIG. 27 illustrates a state in which the medicine button 63 is pressed by the doctor or nurse and the medicine selection window 63a is displayed. For example, when Lugor is selected, the observation start time and the observation end time in a state where Lugor is dispersed are designated as two points.

  Two points in the endoscopy can also be specified by selecting two pieces of part information. As described in the fourth embodiment, when site information is given to an endoscopic image, two points can be designated also by selecting two endoscopic images to which the site information is given.

  FIG. 28 is a diagram illustrating an example of the inter-part selection screen 70 in the endoscopy. The display control unit 223 of the endoscopic examination data recording device 20 displays the inter-part selection screen 70 on the display device 13 of the endoscope system 10 or the display unit 34 of the terminal device 30. The part selection screen 70 includes a first area 71 and a second area 72.

  The first area 71 is an area for selecting between two parts by selecting two part names. FIG. 28 illustrates an example in which the stomach (pylorus) is selected from the pull-down menu in the first selection column 71a and the stomach (cardia) is selected from the pull-down menu in the second selection column 71b.

  The second area 72 is an area for selecting two endoscopic images from a plurality of endoscopic images to which the part information is added, selecting two parts, and selecting between the parts. FIG. 28 illustrates an example in which an endoscope image 72a of the stomach (pylorus) photographed third and an endoscope image 72b of the stomach (cardia) photographed sixth are selected.

  As described above, according to the sixth embodiment, since an observation time or the like between any two points in the endoscopy can be calculated, detailed analysis and evaluation of the endoscopy can be performed. For example, in the observation of the stomach, the observation time for each part such as the cardia, stomach body, and stomach corners can be calculated, so that detailed analysis and evaluation are possible. For example, it can be analyzed whether the observation procedure is performed according to the inspection protocol according to the standard time.

(Embodiment 7)
If an inexperienced unskilled doctor performs an endoscopy, the skilled doctor will also provide guidance after the inspection, such as no observations being overlooked, diagnostic errors, imaging / inspection performed correctly, etc. It is common to perform a check (double check). For this purpose, it is necessary for a skilled doctor to be present at the examination of a non-skilled doctor, but it is difficult and efficient for a skilled doctor to always be present in an actual medical field. For this reason, the inspection status of all the inspection rooms is collectively displayed in a monitor room or the like. In this case, a moving image captured by the endoscope 11 is often displayed in real time. Even if information of a plurality of examination rooms is displayed in parallel, it is difficult to grasp all the information in detail. It is also important to evaluate the process under examination from the viewpoint of skill improvement of endoscopy of unskilled doctors.

  Therefore, in the seventh embodiment, data indicating the state at each time point of the endoscopy is recorded and displayed on the monitor in real time. Thereby, evaluation (double check) and guidance of an unskilled doctor can be efficiently supported, which contributes to skill improvement of the unskilled doctor.

  In the seventh embodiment, the data sending unit 125 of the endoscope system 10 includes the irradiation light type data passed from the irradiation light switching control unit 122, the medicine scattering data passed from the medicine scattering detection unit 123a, and the treatment execution detection unit. The treatment execution data passed from 123b is sent to the endoscopic examination data recording device 20 via the network 2 in real time. That is, the received data is sequentially transmitted without accumulating data in a buffer (not shown).

  As described above, the transition of data respectively acquired by the irradiation light type data acquisition unit 221a, the medicine distribution data acquisition unit 221b, and the treatment execution data acquisition unit 221c of the endoscopic examination data recording device 20 is performed by the data recording unit 225. It is recorded in the inspection data holding unit 232. At the same time, the transition of the data is transferred to the terminal device 30 by the display control unit 223 and displayed on the screen of the display unit 34. The display control unit 223 may display the image captured by the endoscopy together with the transition of data indicating the state at each time point of the endoscopy on the screen. The endoscope moving image may be continuously displayed in real time, or a still image captured by a doctor's operation may be displayed. Note that the same screen as the screen may be displayed on the display device 13 of the endoscope system 10. In that case, the doctor who is performing the examination can see the screen.

  FIG. 29 is a diagram illustrating a first state (immediately after the start of examination) of a screen example in which transition of the endoscopic examination is represented by data. FIG. 30 is a diagram illustrating a second state of the screen example in which the transition of the endoscopic examination is represented by data (at the time when 5 minutes have elapsed from the start of the examination). FIG. 31 is a diagram illustrating a third state of the screen example in which the transition of the endoscopic examination is represented by data (when 11 minutes have elapsed from the start of the examination). FIG. 32 is a diagram illustrating a fourth state (at the end of the examination) of the screen example in which the transition of the endoscopic examination is represented by data.

  In the screens 34a to 34d shown in FIGS. 29 to 32, the type of observation light being used is represented by a pattern. Note that the type of observation light may be expressed in different colors. Further, when an event such as the timing when the release is cut off or the timing when the medicine is sprayed, the event content and time information are displayed. In addition, an endoscopic image captured with the release cut is displayed at a position corresponding to the time when the release was cut. Data indicating the state at each time point of the endoscopic examination as described above is added to the screen as the endoscopic examination progresses.

  Note that an examination protocol (insertion method, observation site, observation method, imaging timing, etc.) may be displayed on the screens 34a to 34d so that it can be confirmed whether or not an endoscopic examination is performed according to the examination protocol.

  In addition, when endoscopy is performed simultaneously in a plurality of examination rooms, data indicating transition of each endoscopy may be displayed in a screen division. A plurality of monitors may be prepared and displayed on each monitor.

  As described above, according to the seventh embodiment, not only the time-series data indicating the transition of the endoscopic examination is recorded, but also the data is displayed on the monitor in real time so that the examination is performed. It is possible to monitor whether the process is in compliance with the inspection protocol, and to confirm the state of compliance with the inspection protocol and the degree of progress over time. Therefore, it is possible to prevent mistakes and to grasp the progress and efficiency of inspection. In addition, when displayed on the display device 13 of the endoscope system 10, a doctor performing the examination can confirm the process and can perform self-evaluation.

  The present invention has been described based on the embodiments. This embodiment is an exemplification, and it will be understood by those skilled in the art that various modifications can be made to combinations of the respective constituent elements and processing processes, and such modifications are also within the scope of the present invention. is there. Various combinations of the methods described in Embodiment 1-6 are possible, and are not limited to the combinations illustrated in FIGS.

  In the first to seventh embodiments, the configuration in which the image recognition unit 123 is provided in the endoscope processing device 12 has been described. However, the image recognition unit 123 may be provided in the endoscope inspection data recording device 20, It may be provided in another device other than the endoscope processing device 12 and the endoscope inspection data recording device 20.

  In Embodiment 1-7 described above, various data are detected every N seconds or every N frames from the light source device 14 and the endoscopic image, and transmitted to the endoscopic examination data recording device 20. In this regard, depending on the type of data, only the data at the time of event occurrence may be detected and transmitted to the endoscopy data recording device 20. For example, it is possible to set so that the data of the period when the medicine is not sprayed is not transmitted to the endoscopy data recording device 20.

  DESCRIPTION OF SYMBOLS 1 Endoscopy data recording system, 2 Network, 10 Endoscope system, 11 Endoscope, 111 Image pick-up element, 112 Forceps channel, 113 Operation part, 12 Endoscope processing apparatus, 121 Control part, 122 Irradiation light switching Control unit, 123 image recognition unit, 123a medicine dispersion detection unit, 123b treatment execution detection unit, 123c imaging distance estimation unit, 123d imaging state classification unit, 124 magnification control unit, 125 data transmission unit, 126 communication unit, 13 display device, DESCRIPTION OF SYMBOLS 14 Light source device, 20 Endoscopy data recording device, 21 Communication part, 22 Control part, 221 Data acquisition part, 221a Irradiation light classification data acquisition part, 221b Drug distribution data acquisition part, 221c Treatment execution data acquisition part, 221d Imaging Distance data acquisition unit, 221e times Data acquisition unit, 221f imaging state data acquisition unit, 221g image acquisition unit, 222 operation reception unit, 223 display control unit, 224 data calculation unit, 224a data analysis unit, 225 data recording unit, 226 site information addition unit, 23 storage unit 231 Master information holding unit, 232 Inspection data holding unit, 233 Statistical data holding unit, 24 console unit, 30 terminal device, 31 communication unit, 32 control unit, 33 storage unit, 34 display unit, 35 operation input unit.

Claims (10)

An inspection data holding unit for holding inspection data of an endoscopic examination;
Irradiation light type data acquisition unit for acquiring data converted into numerical information based on the observation light type master table for the type of irradiation light used in the endoscopy,
A drug distribution data acquisition unit for acquiring data converted into numerical information based on a drug type master table for a distribution state of a drug distributed in a patient's body in an endoscopic examination;
A treatment execution data acquisition unit that acquires data converted into numerical information based on a treatment type master table for the implementation status of a treatment performed by a doctor in an endoscopic examination;
An imaging state data acquisition unit that acquires data converted into numerical information based on an imaging state master table for an imaging state of an image captured by an endoscope in an endoscopic examination;
For each endoscopic examination, the examination data holding part shows the transition of data obtained by the irradiation light type data obtaining part, the medicine distribution data obtaining part, the treatment execution data obtaining part, and the imaging state data obtaining part, respectively. A data recording section for recording in
An endoscopy data recording system comprising:   The endoscope according to claim 1, wherein the imaging state data acquisition unit acquires a result determined or classified as to whether or not the image is in a state of appropriately capturing an organ surface. Inspection data recording system. The imaging state data acquisition unit acquires time-series data of an imaging state based on a value related to a change between frames of an image captured by an endoscope,
The endoscope according to claim 1, wherein the data recording unit records the time series data acquired by the imaging state data acquisition unit as it is or after processing the data in the inspection data holding unit. Inspection data recording system. Of the data acquired by the irradiation light type data acquisition unit, the data acquired by the drug distribution data acquisition unit, the data acquired by the treatment execution data acquisition unit, and the data acquired by the imaging state data acquisition unit in endoscopy based on at least one time use of each irradiation light, the number of uses of each irradiation light observation time of using each agent, the number of times of using each agent, implementation time of each treatment, And a data calculation unit for calculating at least one of the number of times each treatment is performed,
The endoscopic examination data recording system according to any one of claims 1 to 3, wherein the data recording unit records the data calculated by the data calculating unit in the examination data holding unit. Of the data acquired by the irradiation light type data acquisition unit, the data acquired by the drug distribution data acquisition unit, the data acquired by the treatment execution data acquisition unit, and the data acquired by the imaging state data acquisition unit between two points specified in endoscopy based on at least one time use of each irradiation light, the number of uses of each irradiation light observation time of using each agent, the number of times of using each agent The endoscopy data recording system according to any one of claims 1 to 3, further comprising a data calculation unit that calculates at least one of the execution time of each treatment and the number of times each treatment is performed. An imaging distance data acquisition unit that acquires data indicating a distance between an organ surface in the patient's body imaged by the endoscope and the endoscope estimated from an image in the patient's body imaged by the endoscope Further comprising
The endoscopic examination data recording according to any one of claims 1 to 5, wherein the data recording unit records a transition of the data acquired by the imaging distance data acquiring unit in the inspection data holding unit. system. A magnification data acquisition unit for acquiring data relating to the magnification of the endoscope;
The endoscopic examination data recording system according to any one of claims 1 to 6, wherein the data recording unit records a transition of data acquired by the magnification data acquiring unit in the examination data holding unit. .   Part information addition for giving a plurality of endoscopic images taken in endoscopic examination and part information taken by each of the endoscopic images to endoscopic examination data recorded in the examination data holding unit The endoscope inspection data recording system according to claim 1, further comprising a unit.   A display control unit for displaying a transition of data respectively acquired by the irradiation light type data acquisition unit, the medicine distribution data acquisition unit, and the treatment execution data acquisition unit during an endoscopic examination; The endoscopy data recording system according to any one of claims 1 to 8, characterized in that: The irradiation light type data acquisition unit acquires time series data indicating the type of the irradiation light from the endoscope system,
The drug distribution data acquisition unit acquires time series data indicating a distribution state of the drug detected from one or more images obtained in time series by an image recognition unit that performs image analysis of an endoscopic image,
The treatment implementation data acquisition unit acquires time series data indicating the implementation status of the treatment detected from one or more images obtained in time series by the image recognition unit,
Whether the imaging state data acquisition unit is suitable for observing an organ surface, which is determined from one or more images obtained in time series by the image recognition unit and is captured by an endoscope Time-series data showing the results determined or classified for
The data recording unit, as it is or by processing the time series data respectively acquired by the irradiation light type data acquisition unit, the drug distribution data acquisition unit, the treatment execution data acquisition unit, and the imaging state data acquisition unit, The endoscopic inspection data recording system according to any one of claims 1 to 9, wherein recording is performed in the inspection data holding unit.