JP7420876B2 - Endoscope related business system - Google Patents

Description

The present invention relates to an endoscope-related business system that manages information related to endoscopes.

Conventionally, examinations and surgeries using endoscopes have been widespread in the medical field. In addition, devices or systems that manage information related to endoscopes include an image management device that manages endoscopic images (Patent Document 1), a diagnostic support device that supports diagnosis (Patent Document 2), and a report creation device. A report creation support system that supports (Patent Document 3) a cleaning management system that manages endoscope cleaning (Patent Document 4), or a repair information management system that manages information regarding endoscope repair (Patent Document 5) , etc. are known.

JP2014-053723A Japanese Patent Application Publication No. 2012-157384 JP2011-072663A Japanese Patent Application Publication No. 2015-195867 Japanese Patent Application Publication No. 2015-099503

When performing an examination or the like using an endoscope, various related tasks occur in addition to observing or photographing a subject. For example, before an inspection or the like, there is work related to preparation for carrying out an inspection that matches the order. During examinations, etc., we not only observe or photograph the subject for examination, but also collect specimens for biological tissue examinations (so-called biopsies), perform endoscopic surgery, etc. as necessary. There may be cases where Furthermore, after an examination or the like, a doctor has duties such as creating a report using endoscopic images. Physicians and other medical staff have duties such as attaching labels to containers for storing specimens after tests, etc., or cleaning endoscopes used for tests, etc.

The endoscopy and the work associated with the endoscopy described above are closely related to each other. Each task is performed using equipment suitable for each task. For example, an inspection using an endoscope is performed using an endoscope device including an endoscope, a light source device, and a processor device. On the other hand, for example, a report creation device other than the endoscope device is used to create a report. Similarly, a cleaning and disinfecting device separate from the endoscope device is used to clean the endoscope. The same applies to other related work.

For this reason, it is inconvenient to carry out each task if there is not close cooperation between devices, etc. that perform each task. Therefore, it is desirable that some or all of the devices, etc. that perform endoscopy and operations related to endoscopy closely cooperate.

The present invention provides an endoscopy-related work system that enables smooth execution of part or all of a series of work related to endoscopy by comprehensively managing information related to endoscopy. The purpose is to provide

The endoscope-related business system of the present invention includes a discrimination section that performs discrimination processing on at least an endoscopic image used for a report among a plurality of endoscopic images, and a report entry item using the discrimination result of the discrimination section. An item selection support section that automatically selects the object, a shooting position recognition section that recognizes the part of the subject that appears in the endoscopic image, and a shooting position recognition section that uses the recognition results of the shooting position recognition section to select items from among multiple endoscopic images. and an image selection support unit that automatically selects endoscopic images to be used in the report.

In addition, the endoscope-related business system of the present invention includes a classification section that performs classification processing on at least an endoscopic image used for a report among a plurality of endoscopic images, and a classification section that uses the classification results of the classification section to create a report. An item selection support section that automatically selects the items to be described, an imaging position recognition section that recognizes the body part of the subject in the endoscopic image, and a schema diagram to be used in the report using the recognition results of the imaging position recognition section. and an image selection support unit that automatically selects images.

The present invention preferably includes an endoscope device that acquires endoscopic images, and the endoscope device preferably includes some or all of a discrimination section, an item selection support section, a photographing position recognition section, and an image selection support section.

In addition, the endoscope-related business system of the present invention includes a classification section that performs classification processing on at least an endoscopic image used for a report among a plurality of endoscopic images, and a classification section that uses the classification results of the classification section to create a report. An item selection support unit that automatically selects items to be described, a treatment recognition unit that recognizes the treatment for the subject in endoscopic images, and a report from multiple endoscopic images using the recognition results of the treatment recognition unit. and an image selection support unit that automatically selects an endoscopic image to be used.

It is preferable that the endoscopic device includes an endoscopic device that acquires endoscopic images, and that the endoscopic device includes some or all of a discrimination section, an item selection support section, a treatment recognition section, and an image selection support section.

In addition, the endoscope-related business system of the present invention includes a classification section that performs classification processing on at least an endoscopic image used for a report among a plurality of endoscopic images, and a classification section that uses the classification results of the classification section to create a report. An item selection support unit that automatically selects items to be described, a lesion recognition unit that recognizes the presence or absence of lesions in endoscopic images, and a report from multiple endoscopic images using the recognition results of the lesion recognition unit. and an image selection support unit that automatically selects an endoscopic image to be used.

The present invention preferably includes an endoscopic device that acquires endoscopic images, and the endoscopic device preferably includes some or all of a discrimination section, an item selection support section, a lesion recognition section, and an image selection support section.

The present invention preferably includes a report creation device that creates a report regarding an endoscopy, and the report creation device preferably includes a report creation screen generation unit that provides a report creation screen.

Preferably, the image selection support unit automatically selects a portion of the endoscopic image that is predetermined to be used in the report from among the plurality of endoscopic images.

According to the endoscope-related work system of the present invention, part or all of a series of work related to endoscopy can be smoothly performed.

FIG. 1 is an explanatory diagram showing a medical system related to endoscopy. FIG. 2 is a perspective view of an endoscope device. FIG. 2 is a block diagram of a processor device. FIG. 3 is a block diagram of a first recognition processing section. FIG. 2 is a block diagram of a label printer. It is a perspective view of a cleaning disinfection device. It is a block diagram of a cleaning disinfection device. FIG. 2 is a block diagram of a report creation device. FIG. 1 is a block diagram showing the configuration of an endoscope information management system. It is a block diagram of an examination information management part. FIG. 3 is a block diagram of a cleaning information management section. FIG. 3 is a block diagram of a label output management section. FIG. 2 is a block diagram of a report creation support section. It is a flowchart of the preparation support operation which supports the preparation for endoscopy. This is a pre-examination screen displayed before the start of an endoscopy. It is a flowchart showing the operation for starting an endoscopy. It is a flowchart showing operations during endoscopy. This is an examination screen displayed during an endoscopy. This is the sample label. It is a flowchart which shows the operation|movement in the case of bedside washing. This is a cleaning information input screen displayed when performing bedside cleaning. It is a flowchart of main cleaning. This is a display screen of the cleaning/disinfecting device. 3 is a flowchart showing a report creation support operation. This is the report creation screen. This is a key image display section. This is an information input section.

[Endoscope-related business system]
As shown in FIG. 1, the endoscope-related business system 10 includes inspection, observation, surgery, etc. (hereinafter referred to as endoscopy) of a subject using an endoscope 42 (see FIG. 2), and This is a system used to perform tasks related to mirror inspection. Work related to endoscopy (hereinafter referred to as related work) is medical and other work other than endoscopy that is necessary during or before and after endoscopy. That is, related work is work that accompanies endoscopy; for example, printing labels to be attached to biopsy containers, cleaning and disinfecting the endoscope 42, and creating reports are related work. .

The endoscope-related business system 10 includes an endoscope device 21, a label printer 22, a cleaning and disinfecting device 23, a report creation device 24, an endoscope information management system 31, and the like. Among these, the label printer 22 , the cleaning/disinfecting device 23 , and the report creation device 24 are related business devices 26 . The related work device 26 can include devices for performing related work in addition to the label printer 22, the cleaning and disinfecting device 23, and the report creation device 24. Further, the related business device 26 may not include the label printer 22, the cleaning/disinfecting device 23, and/or the report creation device 24 if not necessary.

(1) Configuration of Endoscope Device As shown in FIG. 2, the endoscope device 21 includes an endoscope 42, a light source device 44, a processor device 46, a monitor 48, and a console 49. The endoscope 42 photographs a subject. The light source device 44 generates illumination light. The processor device 46 controls the endoscope device 21, performs image processing, and the like. The monitor 48 is a display unit that displays endoscopic images. The console 49 is an input device for inputting settings to the processor device 46 and the like. The console 49 stores information necessary for the endoscopy, such as the ID (identification) of the doctor who performs the endoscopy using the endoscope device 21 and the ID of the patient who is the subject of the endoscopy. Including inputting or reading devices. For example, if the doctor's ID and patient's ID are to be entered using barcodes, console 49 includes a barcode reader. When using a card equipped with an IC (integrated circuit) chip (so-called IC card), the console 49 includes a card reader.

The endoscope 42 includes an insertion section 42a to be inserted into the subject, an operation section 42b provided at the proximal end of the insertion section 42a, a curved section 42c provided at the distal end of the insertion section 42a, and a distal end 42d. , has. By operating the angle knob 42e of the operating section 42b, the bending section 42c is bent. As a result, the tip portion 42d faces in the desired direction. In addition to the angle knob 42e, the operation unit 42b includes buttons, dials, switches, etc. used for various operations such as switching observation modes, zooming, freezing, still image shooting, and air or water supply. be. In addition, the endoscope 42 has an insertion port 42f for a treatment instrument. The insertion port 42f communicates with a treatment instrument outlet (not shown) provided at the distal end portion 42d via a treatment instrument channel (not shown) provided inside the endoscope 42. Therefore, when the treatment instrument is inserted through the insertion port 42f, the distal end of the treatment instrument can protrude toward the subject from the treatment instrument outlet of the distal end portion 42d. The treatment tool is, for example, forceps (biopsy forceps), a snare, or a scalpel (high-frequency scalpel).

The light source device 44 includes a light source section (not shown) that emits illumination light, and a light source control section (not shown) that controls the operation of the light source section. The light source unit emits illumination light that illuminates a subject or excitation light that is used to emit illumination light. The light source section includes a light source such as a laser diode (hereinafter referred to as LD), an LED (Light Emitting Diode), a xenon lamp, or a halogen lamp, and emits at least white illumination light or white illumination light. The excitation light used for this purpose is emitted. White includes so-called pseudo white, which is substantially equivalent to white when photographing a subject using the endoscope 42. The light source section includes, as necessary, a phosphor that emits light upon irradiation with excitation light, or an optical filter that adjusts the wavelength band, spectrum, light amount, etc. of illumination light or excitation light. In addition, the light source unit can emit light having a specific wavelength band necessary for capturing an image used to calculate biological information such as the oxygen saturation level of hemoglobin included in the subject. The light source control section controls the timing of turning on, turning off, or shielding each light source constituting the light source section, the amount of light emitted, and the like. As a result, the light source section can emit multiple types of illumination light having different spectra. Further, the light source control section controls the light source section in accordance with the timing of photographing.

As shown in FIG. 3, the processor device 46 includes a connection detection section 51, an image acquisition section 52, an image processing section 53, a display control section 54, a notification section 55, a control section 56, and a communication section 57.

The connection detection unit 51 detects the connection of the endoscope 42 to the processor device 46 and/or the light source device 44. Further, the connection detection unit 51 not only detects that the endoscope 42 is connected, but also acquires identification information that identifies the connected endoscope 42. That is, the connection detection section 51 functions as an identification section that identifies the endoscope 42. Identification information for identifying the endoscope 42 is information for identifying the model of the endoscope 42 (model model number, etc.), and/or information for identifying the individual endoscope 42 when there are multiple endoscopes 42 of the same model. This is information (serial number, etc.) for identifying the In this embodiment, the connection of the endoscope 42 is detected and the identification information of the connected endoscope 42 is acquired by communicating with the endoscope 42 connected to the processor device 46 by wire or wirelessly. It is a sensor.

The image acquisition unit 52 acquires images (including signals used for image generation) from the endoscope 42 . The image acquisition unit 52 includes, for example, a DSP (Digital Signal Processor), a noise reduction unit, and a conversion unit (none of which are shown), and uses these to perform various processing on the acquired image as necessary. administer.

The DSP performs various processes such as defect correction processing, offset processing, gain correction processing, linear matrix processing, gamma conversion processing, demosaic processing, and YC conversion processing on the acquired image as necessary.

The defect correction process is a process of correcting the pixel value of a pixel corresponding to a defective pixel of the image sensor. Offset processing is processing that reduces dark current components from an image that has been subjected to defect correction processing and sets an accurate zero level. The gain correction process is a process of adjusting the signal level of each image by multiplying the offset-processed image by a gain. Linear matrix processing is a process that improves the color reproducibility of an image that has been subjected to offset processing, and gamma conversion processing is a process that adjusts the brightness and saturation of an image that has been subjected to linear matrix processing. Demosaic processing (also referred to as isotropic processing or simultaneous processing) is a process of interpolating pixel values of missing pixels, and is performed on an image after gamma conversion processing. A missing pixel is a pixel that has no pixel value due to the arrangement of color filters (because pixels of other colors are arranged in the image sensor). For example, in the demosaic process, the pixel value of the B pixel at the position of the G pixel and the R pixel is generated by interpolating using the pixel value of the B pixel. The same applies to other colors. The YC conversion process is a process of converting the demosaiced image into a luminance channel Y, a color difference channel Cb, and a color difference channel Cr.

The noise reduction unit performs noise reduction processing on the luminance channel Y, the color difference channel Cb, and the color difference channel Cr using, for example, a moving average method or a median filter method. The conversion unit reconverts the luminance channel Y, color difference channel Cb, and color difference channel Cr after the noise reduction processing into images of each color of BGR.

The image processing unit 53 uses the image acquired by the image acquisition unit 52 to generate an image to be displayed on the monitor 48 and/or an image to be used for diagnosis or the like. The image processing unit 53 may perform image processing on the image or endoscopic image acquired by the image acquisition unit 52 depending on settings such as the observation mode. Further, the image processing unit 53 may output the image acquired by the image acquisition unit 52 as it is without performing any image processing or the like. Note that the image acquired by the image acquisition unit 52 is an endoscopic image because it is an image photographed using the endoscope 42. The image generated by the image processing unit 53 is an image provided to the user by the endoscopic device 21, and is therefore a so-called endoscopic image. Therefore, hereinafter, unless otherwise specified, the image acquired by the image acquisition unit 52 and/or the image generated by the image processing unit 53 will be referred to as an endoscopic image. The endoscopic image is a moving image or a still image.

Further, the image processing section 53 includes a first recognition processing section 60. The first recognition processing unit 60 performs recognition processing using the endoscopic image. Specifically, as shown in FIG. 4, the first recognition processing section 60 includes various recognition processing sections such as a photographing position recognition section 61, a treatment recognition section 62, an image quality recognition section 63, and an unphotographed portion recognition section 64. Equipped with.

The photographing position recognition unit 61 recognizes the photographing position using one or more endoscopic images. The photographing position is a position within the subject photographed by the endoscope 42. For example, the photographing position recognition unit 61 recognizes at least a part of the subject using an endoscopic image as the photographing position. The region of the subject includes the esophagus, stomach, duodenum, etc. in the upper digestive tract. Furthermore, the photographing position recognition unit 61 can recognize a more detailed position. For example, when the observed region is the stomach, the photographing position recognition unit 61 recognizes the cardia, the foramen, the body of the stomach, the angle of the stomach, the antrum, the anterior pylorus, and/or the pylorus. I can do it. In this embodiment, the photographing position recognition unit 61 recognizes the body part of the subject, but does not recognize the detailed position. This is to perform recognition processing of the photographing position in real time.

The treatment recognition unit 62 recognizes a treatment for a subject using one or more endoscopic images. Recognition of treatment refers to recognizing the presence or absence of treatment and/or the type of treatment. Treatment of the subject refers to collection of specimens such as tissue for biological tissue examination (hereinafter referred to as biopsy), incision, excision, hemostasis, removal of residue, etc., or other operations on the subject. Recognition of the presence or absence of a treatment includes recognition of a state in which a treatment has already been performed, recognition of a state in which a treatment is being performed, and recognition of a state in which a treatment is to be performed. Recognizing the type of treatment means recognizing the treatment by distinguishing between biopsy, incision, excision, hemostasis, removal of residue, etc.

The treatment recognition unit 62 recognizes the treatment for the subject by recognizing the treatment instrument shown in the endoscopic image. Furthermore, the treatment recognition unit 62 can recognize the treatment for the subject by recognizing treatment marks, bleeding (or cessation of bleeding), etc. of the subject in the endoscopic image. In addition, the treatment recognition unit 62 can recognize the presence or absence of a treatment and/or the type of treatment using information other than 1 or an endoscopic image. For example, if the endoscope 42 has a mechanism for detecting insertion of a treatment instrument, the treatment can be recognized by using the detection result alone or in combination with an endoscopic image. In this embodiment, the treatment recognition unit 62 recognizes the presence or absence of a biopsy by recognizing forceps used for biopsy (biopsy forceps) using one or more endoscopic images. Therefore, the treatment recognition unit 62 in this embodiment functions as a biopsy recognition unit that recognizes the presence or absence of a biopsy.

Further, the treatment recognition unit 62 recognizes or counts the number of treatments. This is to distinguish each treatment when multiple treatments are recognized. Further, the treatment recognition unit 62 recognizes the position where the treatment was performed. The recognition result of the imaging position recognition unit 61 can be used to recognize the position where the treatment was performed. For example, when biopsies are performed at two locations, the treatment recognition unit 62 of this embodiment recognizes that the biopsies have been performed twice, and recognizes the locations and order in which each biopsy was performed.

The image quality recognition unit 63 recognizes the image quality of an endoscopic image using one or more endoscopic images. Recognizing image quality refers to recognizing the presence or absence of blur or cloudiness in an endoscopic image, and/or the presence or absence of factors that degrade the subject image, such as residue or residual fluid on the subject. The blurring or cloudiness of the endoscopic image is a factor on the endoscope 42 side (the side that is not the subject but the side that is photographing). The residue or residual liquid is a factor on the subject side (not on the endoscope 42 but on the subject side).

The unphotographed portion recognition unit 64 recognizes the unphotographed portion of the subject using one or more endoscopic images. The unphotographed portion refers to a portion of the subject that is not photographed depending on the position and orientation of the distal end portion 42d with respect to the subject and the timing of photographing. For example, unphotographed portions of the subject, such as a lumen, may occur due to the presence of folds caused by protrusions or peristaltic movements of the subject. The unphotographed portion in the endoscopic image can be recognized based on, for example, the global or local shape of the subject. In addition, the unphotographed portion recognition unit 64 is capable of tracking and recognizing unphotographed portions by recognizing each unphotographed portion of a plurality of endoscopic images. In other words, the unphotographed portion recognition unit 64 determines whether the unphotographed portion of a certain endoscopic image has not been photographed even once and the photographing position (the position of the distal end portion 42d with respect to the unphotographed portion) is properly aligned with the unphotographed portion. It is possible to recognize when the camera moves (is likely to move) to a position where it cannot be photographed. In this embodiment, the unphotographed portion recognition unit 64 recognizes the unphotographed portion and tracks the unphotographed portion.

The first recognition processing unit 60 and the above-mentioned units constituting the first recognition processing unit 60 are, for example, artificial intelligence (AI) having a learning function. Specifically, each part constituting the first recognition processing unit 60 includes a neural network (NN), a convolutional neural network (CNN), an adaboost, and a random forest. This is an AI that has been trained using machine learning algorithms such as In addition, since the first recognition processing unit 60 is trained to perform recognition processing using a specific image, even if recognition processing can be performed using other images, the accuracy of the recognition processing result is low. There are cases. "Having a learning function" refers to being able to learn, and includes having already learned. Note that some or all of the units constituting the first recognition processing unit 60 may be configured to calculate feature amounts from an image and perform detection etc. using the calculated feature amounts instead of being configured with AI. can.

In addition to the first recognition processing section 60, the image processing section 53 includes a biological information calculation section 71. The biological information calculation unit 71 calculates biological information using one or more endoscopic images. Biological information refers to the shape, color, or other characteristics of a living subject, such as oxygen saturation, blood vessel density, length, size (area or volume), or the number or range of parts with specific characteristics. Quantity based on The biological information calculation unit 71 is activated as necessary depending on the setting of the observation mode and the like.

The display control unit 54 converts the endoscopic image output by the image processing unit 53 into a format suitable for display, and outputs the converted image to the monitor 48. Thereby, the monitor 48 displays endoscopic images at least during endoscopic examination. In addition, the display control unit 54 is used before an endoscopy (before the start of the period for photographing the subject), during an endoscopy (the period for photographing the subject), and after the endoscopy (before the start of the period for photographing the subject). At each stage (after the end of the photographing period), a screen used for observation or operation is generated and displayed on the monitor 48. At that time, the display control section 54 can acquire information from the notification section 55 or the communication section 57 and display that information or information based on that information on the monitor 48. Specifically, before the endoscopy, the display control unit 54 displays a pre-examination screen 251 (see FIG. 15) acquired via the communication unit 57 on the monitor 48. During an endoscopic examination, the display control unit 54 displays, in addition to the endoscopic image, a warning message inputted by the notification unit 55, and/or information related to the examination acquired via the communication unit 57. It may be displayed on the monitor 48. For example, it is the screen 301 during inspection (see FIG. 18). After the endoscopic examination, the display control unit 54 displays, for example, a primary cleaning information input screen 401 (see FIG. 21) on the monitor 48.

The notification unit 55 reports notifications, warnings, and the like. The notification unit 55 includes, for example, a speaker 72, and can notify notifications, warnings, etc. by emitting sound or audio from the speaker 72. The notification unit 55 also controls the monitor 48 via the display control unit 54 by inputting a display instruction (including an instruction to change the display) such as a message representing a notification or warning etc. to the display control unit 54. Displays can be used to notify notifications, warnings, etc. In addition, the notification unit 55 may include a lamp or the like, and can notify a notification or a warning by turning on or off the lamp, or changing the color of the lamp.

Specifically, before an endoscopy, the notification unit 55 indicates whether the endoscope 42 whose connection has been detected by the connection detection unit 51 (hereinafter referred to as a connected endoscope) is the endoscope 42 scheduled to be used. If different, a warning to that effect will be issued. Furthermore, if the connected endoscope 42 has not been cleaned and disinfected and/or a predetermined time has passed since the cleaning and disinfection was completed, the notification unit 55 will notify you of this. Announce a warning. In addition, if the ID of the doctor and/or patient input from the console 49 is different from the doctor and/or patient scheduled to use the endoscope device 21, a warning to that effect is notified.

During the endoscopy, the notification unit 55 reports some or all of the information regarding contraindications (contraindication information) such as "biopsy prohibited". In this embodiment, the notification unit 55 reports contraindication information by displaying it on the monitor 48. Furthermore, during the endoscopic examination, the notification section 55 notifies you of a warning based on the results of various recognition processes in the first recognition processing section 60. Specifically, when the image quality recognition unit 63 recognizes a decrease in the image quality of the endoscopic image, the notification unit 55 issues a warning indicating that the image quality has decreased or a warning to urge improvement of the image quality (for example, the distal end 42d (display prompting cleaning). Furthermore, when the unphotographed portion recognition unit 64 recognizes the possibility that the unphotographed portion will not be photographed, it issues a warning to that effect.

After the endoscopic examination, the notification unit 55 issues a notification or warning indicating that the primary cleaning of the endoscope 42 performed at the bedside (so-called bedside cleaning) has not been completed or has not started, and/or the primary cleaning. A notification or warning may be issued to prompt you to do so.

The control unit 56 comprehensively controls each part of the processor device 46, as well as the endoscope 42 and the light source device 44. For example, the control unit 56 synchronizes the timing of illumination light emission and photographing. Further, the control unit 56 includes a clock unit 73 that measures various times (including time) related to the endoscopy. Therefore, the control unit 56 can measure the start time and end time of the endoscopic examination, and/or the arrival time to a specific region (for example, the time to reach the ileocecal region). The timer section 73 can measure various times related to the endoscopy based on information input using the console 49 or the like. Further, the timer section 73 can use various recognition results (for example, recognition results of imaging positions) in the first recognition processing section 60 to measure various times related to endoscopy.

The communication unit 57 communicates with the endoscope information management system 31 by wire or wirelessly, and transmits or receives information. In this embodiment, the communication section 57 includes an information acquisition section 74 and an information output section 75.

The information acquisition unit 74 acquires information that can be used in the endoscopic examination to be performed from the endoscope information management system 31. Specifically, before the endoscopy, the information acquisition unit 74 acquires information from the endoscopy information management system 31, including the results of the endoscopy performed in the past (including pathological tests, for example). Images acquired in endoscopy, etc., reports created in past endoscopy, etc., and/or information regarding the patient undergoing endoscopy (information regarding contraindications, etc.), etc. are acquired. The display control unit 54 acquires this information via the information acquisition unit 74 and displays it on the monitor 48 as necessary.

The information output unit 75 outputs, to at least the endoscope information management system 31, some or all of the information regarding the performed endoscopy (endoscopy in progress). The information outputted by the information output unit 75 includes, for example, an endoscopic image, a result of recognition processing performed by each part of the first recognition processing unit 60, biological information calculated by the biological information calculation unit 71, and/or a time measurement unit. 73 measured various times, etc. Endoscope images and the like output by the information output unit 75 are registered in the endoscope information management system 31.

The communication unit 57 communicates with the endoscope information management system 31, the endoscope 42 or the light source device 44 that constitutes the endoscope device 21, the related business device 26, and/or other devices. , can send or receive some or all of the above various information.

(2) Configuration of Label Printer In the endoscope-related business system 10, the label printer 22 is used as an identification label (hereinafter referred to as a biopsy label 350) to be attached to a container containing tissue (specimen) collected for biopsy. This printer is used for manufacturing (printing, etc.) (see FIG. 19). The label printer 22 is connected directly or indirectly to the endoscope information management system 31 by wire or wirelessly. As shown in FIG. 5, the label printer 22 includes a communication section 92, a biopsy information acquisition section 93, and an output section 94.

The communication unit 92 is an interface that connects directly or indirectly to the endoscope information management system 31 by wire or wirelessly. When a biopsy is performed during an endoscopy, the biopsy information acquisition unit 93 communicates with the endoscope information management system 31 using the communication unit 92 to update the endoscope information management system 31. (or directly from the processor device 46 or the like based on instructions from the endoscope information management system 31). Biopsy-related information refers to information related to the patient who underwent the biopsy (name and/or ID, etc.), information that identifies each biopsy in the case of multiple biopsies (numbers that identify the order, etc.) etc.), information regarding the location where the biopsy was performed (sampling site, etc.), etc.

The output unit 94 is a mechanism for printing on a label, and has a configuration similar to that of a general printer, for example. The output unit 94 automatically outputs a biopsy label 350 (see FIG. 19) by printing part or all of the biopsy information acquired by the biopsy information acquisition unit 93 in a predetermined arrangement. Biopsy label 350 is, for example, a sticker.

In this embodiment, the label printer 22 acquires information related to the biopsy via the endoscope information management system 31. In addition, acquisition of information regarding the biopsy and printing of the biopsy label are performed during the endoscopy. That is, when a biopsy is performed during an endoscopy, the label printer 22 automatically outputs the biopsy label 350 in real time.

(3) Configuration of cleaning and disinfecting device The cleaning and disinfecting device 23 is a device for cleaning and disinfecting the endoscope 42 used in endoscopy. Immediately after use, the endoscope 42 used in endoscopy is cleaned and/or cleaned at the bedside in order to prevent clogging of the ducts due to drying of the endoscope 42. Perform disinfection (so-called bedside cleaning). On the other hand, the cleaning and disinfecting performed by the cleaning and disinfecting device 23 is so-called secondary cleaning or main cleaning. The main cleaning performed by the cleaning and disinfecting device 23 is cleaning and disinfection for making the used endoscope 42 usable again for endoscopy.

As shown in FIG. 6, the cleaning and disinfecting device 23 includes a main body 111 having a cleaning tank 110, a lid 112 provided to the main body 111 so as to be openable and closable, and a pedal 113 for opening and closing the lid 112. It has a touch panel 115 that is a display and operation unit for inputting cleaning and/or disinfection settings, etc. Further, the main body 111 is provided with casters 116. Therefore, the cleaning and disinfecting device 23 is movable.

As shown in FIG. 7, the cleaning and disinfecting device 23 includes a cleaning tank 110 and a touch panel 115, as well as a communication section 121, an endoscope identification section 122, a washer identification section 123, and a control section 124.

The communication unit 121 connects directly or indirectly to the endoscope information management system 31 by wire or wirelessly, and transmits or receives necessary information. If the endoscope 42 has a communication function, the communication unit 121 can automatically connect to the endoscope 42 located near the cleaning/disinfecting device 23 (for example, at least within a communicable range). Furthermore, the communication unit 121 transmits information such as the cleaning and disinfection results, the identification information of the cleaned endoscope 42 and the identification information of the cleaning staff to the endoscope information management system 31.

The endoscope identification unit 122 acquires information that identifies the endoscope 42 that is the target of cleaning and disinfection (hereinafter referred to as cleaning target information). The endoscope identification unit 122 can automatically acquire cleaning target information from the endoscope 42 connected via the communication unit 121, for example. Furthermore, the endoscope identification unit 122 can acquire cleaning target information from information input using the touch panel 115. In this embodiment, the endoscope 42 has a function of automatically connecting to the communication unit 121 wirelessly in the vicinity of the cleaning disinfection device 23, and the endoscope identification unit 122 automatically acquires cleaning target information. . Then, instead of the user manually inputting information using the touch panel 115, the endoscope identification unit 122 automatically displays the acquired cleaning target information on the touch panel 115 in the corresponding item of the GUI (Graphical User Interface). input.

The cleaner identification unit 123 acquires information (hereinafter referred to as cleaner identification information) that identifies a staff member in charge of cleaning and disinfection (hereinafter referred to as cleaner). When the washer identification unit 123 inputs the ID of the washer using a barcode, the washer identification unit 123 is a barcode reader, and when the ID of the washer is input using an IC card, the washer identification unit 123 is a card reader. Be a leader. Further, the cleaning person identification unit 123 can acquire cleaning person information when the cleaning person inputs the cleaning person information using the touch panel 115. Note that if the cleaning person has a communication terminal or the like that automatically connects to the cleaning/disinfecting device 23 via the communication unit 121, the cleaning person identification unit 123 will communicate with the cleaning/disinfecting device 23 via the communication unit 121. Cleaner identification information can be automatically obtained from the terminal. In this embodiment, the washer identification unit 123 automatically acquires the washer information.

The control unit 124 controls the cleaning and disinfecting device 23 in an integrated manner. For example, when an instruction to start cleaning is input using the touch panel 115, the control unit 124 starts cleaning and disinfecting the endoscope 42 using the cleaning tank 110 according to the conditions input using the touch panel 115. .

(4) Configuration of report creation device The report creation device 24 is a so-called computer that connects to the endoscopy information management system 31 by wire or wirelessly, and provides the user with an interface for creating a report regarding endoscopy. . As shown in FIG. 8, the report creation device 24 includes a display 131 for displaying a report creation screen 510 (see FIG. 25), and an operation unit 132 for inputting operations to create a report using the report creation screen 510. , and a communication unit 133 for communicating with the endoscope information management system 31. The operation unit 132 is, for example, a pointing device such as a keyboard and a mouse. Further, the report creation device 24 may be a tablet terminal that integrates the display 131 and the operation section 132. Further, the report creation device 24 specifies the user and logs into the endoscope information management system 31 by automatically or manually inputting the ID of the doctor who is the user.

(5) Configuration of endoscope information management system The endoscope information management system 31 centrally manages a series of information related to endoscopy, and controls each device etc. that constitutes the endoscope-related business system 10. By appropriately transmitting or receiving part or all of a series of information related to endoscopy (including instructing transmission or reception), each device etc. that constitutes the endoscopy-related business system 10 can be smoothly operated. Work together. As shown in FIG. 9, the endoscope information management system 31 includes an examination information management section 151, a cleaning information management section 152, a label output management section 153, a report creation support section 154, a database 156, an operation section 157, a display 158, and a communication section 159.

(5a) Examination Information Management Department The examination information management department 151 manages various types of information (information about doctors and patients, endoscopic images, recognition results, etc.) exchanged by each part of the endoscope-related business system 10. In particular, it manages information used in endoscopy. Specifically, as shown in FIG. 10, an examination order acquisition section 171, an endoscope determination section 172, an insertion route information acquisition section 173, a contraindication information acquisition section 174, an image acquisition section 175, a report acquisition section 176, a pre-examination It includes a screen generation section 181, an endoscope connection monitoring section 182, a user monitoring section 183, and the like.

The examination order acquisition unit 171 acquires an examination order related to an endoscopy. The examination order is a request for an endoscopy, and includes, for example, information on when, by whom, and for what (which site and for what purpose) the endoscopy is to be performed. The examination order can be directly input into the endoscope information management system 31. In this case, the test order acquisition unit 171 obtains the test order based on input from a doctor or other staff. The test order acquisition unit 171 also acquires test orders from other medical work systems (for example, a system that manages test orders within a hospital including other departments) that cooperates with the endoscope-related work system 10. I can do it.

The endoscope determining unit 172 determines the endoscope device 21 to be used, particularly the endoscope 42 to be used, for the examination order. Determination of the endoscope device 21 to be used means, when there are multiple endoscope devices 21 in a hospital, which endoscope device 21 (processor device 46 and the light source device 44) to be used and manage reservations. When there is only one endoscopic device 21 in a hospital, this refers to determining the use of the endoscopic device 21 for that examination order and managing reservations. Reservation management refers to making reservations for use and managing to prevent duplicate reservations from occurring. Furthermore, determining the endoscope 42 to be used refers to the case where there are multiple endoscopes 42 or when there are multiple types of endoscopes 42 (for example, a transnasal endoscope, a transoral endoscope, and a transoral endoscope). , if there is an endoscope for the lower gastrointestinal tract, etc.), this refers to determining which endoscope to use and managing reservations for performing the endoscopy based on the examination order. When there is only one endoscope 42 (one type) in the hospital, this refers to determining the use of the endoscope 42 for that examination order and managing reservations.

The endoscope determination unit 172 identifies the patient, region, etc. to be subjected to endoscopy based on the examination order. Furthermore, the endoscope determining unit 172 determines the endoscope device 21 and/or endoscope 42 to be used based on the patient, the region to be examined, and the like. In particular, the endoscope determination unit 172 refers to information related to past endoscopy for the patient specified by the examination order, and determines whether the patient and site specified by the examination order are patients who have undergone endoscopy in the past. In the case where the endoscope 42 used in an endoscopy performed in the past is used, priority is given to use of the endoscope 42 used in the endoscopy performed in the past. If the endoscope 42 used in a past endoscopic examination is reserved and managed for another examination order, at least the endoscope 42 of the same model is determined to be used preferentially. For example, if a transnasal endoscope was used in the previous endoscopy, it is possible to reserve the use of an oral endoscope and a transnasal endoscope when ordering the second endoscopy. , preferring the use of nasal endoscopy. If there are multiple models of transnasal endoscopes, give priority to the model used in the previous endoscopy.

The insertion route information acquisition unit 173 refers to information related to past endoscopic examinations for the patient and site specified by the examination order, and determines when the patient and site specified by the examination order have undergone endoscopic examination in the past. Information regarding the insertion route of the endoscope 42 is acquired. Insertion routes include, for example, "nasal" and "oral" for endoscopy of the upper gastrointestinal tract, and "nasal (right)" when inserted through the right nostril for nasal insertion. and ``transnasal (left),'' which is when it is inserted through the left nostril.

The contraindication information acquisition unit 174 refers to information on tests, etc. that have already been performed (diagnosis or test results, reports, etc.) for the patient and/or site specified by the test order, and thereby obtains information on the patient specified by the test order. and/or information regarding contraindications (hereinafter referred to as contraindication information) for the site, etc. is acquired. The contraindication information includes, for example, information regarding allergies, information regarding whether or not biopsy is possible, and the like. In the present embodiment, the contraindication information acquisition unit 174 acquires at least information regarding whether or not biopsy is possible (particularly, biopsy is prohibited) for the patient or site.

The image acquisition unit 175 acquires images obtained from past endoscopic examinations and/or other examinations for the patient specified by the examination order, according to settings. For example, when displaying an image acquired in a past examination on the pre-examination screen 251 and/or the during-examination screen 301, the image acquisition unit 175 acquires this and displays it on the pre-examination screen 251 and/or the during-examination screen 301. insert. In addition, the image acquisition unit 175 acquires ultrasound images, radiographic images such as X-ray images, MRI (Magnetic Resonance Imaging) images, etc. by connecting to PACS (Picture Archiving and Communication Systems), and displays the screen during the examination. It can be inserted into 301 etc.

The report acquisition unit 176 acquires reports created by past endoscopic examinations and/or other examinations for the patient specified by the examination order, according to settings. For example, when displaying an image acquired in a past examination on the pre-examination screen 251 and/or the in-examination screen 301, the report acquisition unit 176 acquires this and Insert into 301.

The pre-examination screen generation unit 181 generates a pre-examination screen 251 to be displayed on the monitor 48 of the endoscopic device 21 before the endoscopic examination. The endoscope information management system 31 locks the endoscope device 21 scheduled to be used by displaying the pre-examination screen 251 generated by the pre-examination screen generation unit 181 on the monitor 48 of the endoscope device 21 scheduled to be used. (Use for other purposes prohibited). Note that the pre-test screen generation unit 181 can be provided in the processor device 46. In this case, the endoscope information management system 31 provides the processor device 46 with information necessary to generate the pre-examination screen 251.

The endoscope connection monitoring unit 182 monitors the connection of the endoscope 42 to the endoscope device 21 for which reservations are managed. Specifically, the endoscope connection monitoring unit 182 acquires the detection result of the connection detection unit 51 from the processor device 46. Then, when an endoscope 42 different from the endoscope 42 determined by the endoscope determining unit 172 is connected to the endoscope device 21 for which the reservation is managed, the notification unit 55 of the processor device 46 is used to A warning to that effect will be issued. This is to support preparation for endoscopic examination in accordance with the examination order.

The user monitoring unit 183 monitors doctors and patients who use the endoscope apparatus 21 whose reservations are managed by the endoscope information management system 31. Specifically, the user monitoring unit 183 obtains the IDs of the doctor and patient input from the console 49 via the communication unit 57 of the processor device 46, and determines whether the doctor and patient match the test order. Determine. If the doctor or patient is different, the user monitoring unit 183 uses the notification unit 55 of the processor device 46 to warn to that effect. This is to prevent misuse of the endoscope device 21 for which reservations are managed.

(5b) Cleaning Information Management Unit The cleaning information management unit 152 particularly manages information regarding cleaning of the endoscope 42, among various information exchanged by each unit configuring the endoscope-related business system 10. Specifically, as shown in FIG. 11, it includes a cleaning state monitoring section 191, a primary cleaning management section 192, and a main cleaning management section 193.

The cleaning state monitoring unit 191 monitors the cleaning state of the endoscope 42 connected to the endoscope device 21 whose reservation is managed by the endoscope information management system 31. Specifically, the cleaning state monitoring unit 191 acquires the detection result of the connection detection unit 51 of the processor device 46. The cleaning state monitoring unit 191 then monitors whether the connected endoscope 42 has been properly cleaned and whether it has been less than a predetermined time since the cleaning was completed. . If the connected endoscope 42 is an endoscope 42 that has been appropriately cleaned, such as uncleaned, or if a predetermined period of time or more has passed after cleaning is completed, the connected endoscope 42 may be cleaned again. is necessary. Therefore, the cleaning state monitoring section 191 uses the notification section 55 of the processor device 46 to issue a warning to that effect.

The primary cleaning management unit 192 manages the primary cleaning performed after the endoscopy. Specifically, the primary cleaning management unit 192 displays the primary cleaning information input screen 401 on the monitor 48 via the display control unit 54 after the endoscopic examination is completed. The primary cleaning management unit 192 uses the notification unit 55 of the processor device 46 to issue a notification or warning, or by displaying the primary cleaning information input screen 401 on the monitor 48, as necessary. , encourage implementation of primary cleaning. In addition, the primary cleaning management unit 192 inputs information related to the primary cleaning input from the primary cleaning information input screen 401 (identification information of the cleaning person, status information indicating whether or not cleaning has been completed normally, etc.). The information is acquired and registered in the database 156. Thereby, the primary cleaning management section 192 manages the primary cleaning. Information related to the primary cleaning includes identification information of the person who performed the primary cleaning (cleaner), date and time of the primary cleaning, and status information indicating whether the primary cleaning was successfully completed. It is. Registration in the database 156 includes not only creating a new record but also integrating (merging) information with an existing record.

The main cleaning management unit 193 manages the main cleaning performed after the endoscopy (more specifically, after the primary cleaning). Specifically, information related to main cleaning is acquired from the cleaning/disinfecting device 23 and registered in the database 156. Thereby, the main cleaning management section 193 manages the main cleaning. The information related to the main cleaning includes identification information of the person who performed the main cleaning (cleaner), the date and time when the main cleaning was performed, and status information indicating whether or not the main cleaning was completed normally.

(5c) Label Output Management Unit The label output management unit 153 particularly manages information related to the production of biopsy labels among various information exchanged by each unit configuring the endoscope-related business system 10. Specifically, as shown in FIG. 12, it includes a biopsy monitoring section 201 and a label printer control section 203.

The biopsy monitoring unit 201 communicates substantially in real time with the processor device 46 during the endoscopic examination to monitor the recognition results of the treatment recognition unit 62 (at least the recognition results related to biopsy among the recognition results of the treatment recognition unit 62). result). Thereby, the biopsy monitoring unit 201 uses the recognition result of the treatment recognition unit 62 to monitor the presence or absence of a biopsy. In addition, when the treatment recognition unit 62 recognizes a biopsy, the recognition result of the treatment recognition unit 62 includes, in addition to the fact that there was a biopsy, the number of biopsies, the site where the biopsy was performed, and the location where the biopsy was performed. This includes the order in which they were performed. Therefore, when the biopsy monitoring unit 201 detects that a biopsy has been performed using the recognition result of the treatment recognition unit 62, the biopsy monitoring unit 201 provides information regarding the performed biopsy (the number of biopsies, the location, and the order of the biopsies). etc.).

When the biopsy monitoring unit 201 detects that a biopsy has been performed during an endoscopy, the label printer control unit 203 automatically controls the label printer 22 to print the sample obtained by the biopsy. A biopsy label 350 is prepared to be attached to the container. Specifically, the label printer control unit 203 inputs the information related to the biopsy acquired by the biopsy monitoring unit 201 to the biopsy information acquisition unit 93 and uses the output unit 94 to produce the biopsy label 350. Thereby, by performing a biopsy during endoscopy, the label printer 22 automatically creates a biopsy label 350. Note that in this embodiment, when the biopsy monitoring unit 201 detects a biopsy, the label printer control unit 203 sequentially produces biopsy labels 350 related to the detected biopsy. can automatically create a biopsy label 350 related to one or more detected biopsies collectively after the endoscopy is completed. In either case, the physician or staff member can automatically obtain the biopsy label 350 after the endoscopy.

(5d) Report Creation Support Unit The report creation support unit 154 particularly manages information related to report creation among various information exchanged by each unit configuring the endoscope-related business system 10. Thereby, the report creation support unit 154 supports report creation. Specifically, as shown in FIG. 13, the report creation support unit 154 includes a report creation screen generation unit 220, a second recognition processing unit 222, an image selection support unit 223, a third recognition processing unit 224, and an item selection A support section 226 is provided.

The report creation screen generation unit 220 generates a report creation screen 510 in response to a request from the report creation device 24 connected to the endoscope information management system 31, and provides the report creation screen 510 to the report creation device 24. Specifically, when the report creation screen generation unit 220 receives a request for providing the report creation screen 510 from the report creation device 24, the report creation screen generation unit 220 generates information about a specific doctor, a specific patient, and a specific endoscopy (endoscopy). (mirror images and other information) and select and/or arrange them to generate and provide a report creation screen 510.

The second recognition processing unit 222 performs one or more recognition processes on the report creation screen 510 and/or the endoscopic image used in the report. Specifically, the second recognition processing section 222 includes an imaging position recognition section 231, a treatment recognition section 232, a lesion recognition section 233, and the like. The second recognition processing unit 222 and the above-mentioned units constituting the second recognition processing unit 222 are, for example, artificial intelligence (AI) having a learning function.

The photographing position recognition unit 231 recognizes at least the part of the subject appearing in the endoscopic image with respect to the endoscopic image acquired in one endoscopic examination. The photographing position recognition unit 231 can recognize a more detailed photographing position. For example, when the observed region is the stomach, the imaging position recognition unit 231 can recognize the cardia, the fornix, the body of the stomach, the angle of the stomach, the antrum, the anterior pylorus, and/or the pylorus. can. In the present embodiment, the photographing position recognition unit 231 recognizes a more detailed photographing position in addition to the body part of the subject. That is, while the imaging position recognition unit 61 in the first recognition processing unit 60 of the processor device 46 performs relatively simple body part recognition processing, the imaging position recognition unit 61 in the first recognition processing unit 60 of the processor device 46 performs body part recognition processing in a relatively simple manner. The recognition unit 231 performs relatively detailed recognition processing of the photographing position. Recognizing the imaging position during endoscopy requires quick and lightweight recognition processing (low calculation amount) in real time.On the other hand, when creating a report, the processing amount and/or processing time may be somewhat large. However, detailed recognition results are required. The photographing position recognition unit 231 can acquire and utilize the recognition result of the photographing position recognition unit 61 of the first recognition processing unit 60. In the present embodiment, the second recognition processing unit 222 obtains information regarding the imaging site as a recognition result of the imaging position recognition unit 61 of the first recognition processing unit 60 regarding the endoscopic image that is the target of recognition processing. be able to. For this reason, the second recognition processing section 222 narrows down the scope of the recognition processing for the part indicated by the recognition result of the imaging position recognition section 61 of the first recognition processing section 60, and performs recognition processing to specify the detailed imaging position. be able to. For example, if the imaging site is the stomach, the detailed imaging location is determined by focusing on the stomach (excluding the possibility of the esophagus or duodenum), and the detailed imaging location is determined (identifying that the imaging location is the cardia of the stomach, etc.). ) can be done. In this way, the photographing position recognizing section 231 can reduce the processing amount and/or the processing time by using the recognition result of the photographing position recognizing section 61 of the first recognition processing section 60.

The treatment recognition unit 232 recognizes a treatment for a subject in an endoscopic image acquired in one endoscopic examination. The details of the treatment that the treatment recognition unit 232 can recognize are the same as the treatment recognition unit 62 of the first recognition processing unit 60 . In this embodiment, the treatment recognition unit 62 of the first recognition processing unit 60 recognizes a biopsy, whereas the treatment recognition unit 232 also recognizes treatments other than biopsy. This is because recognition processing during an endoscopy is performed in real time, so it is preferable to keep the content to a minimum, whereas when creating a report, it is also necessary to recognize treatments other than biopsy. Note that the treatment recognition unit 232 can acquire and utilize the recognition result of the treatment recognition unit 62 of the first recognition processing unit 60. In this embodiment, since the treatment recognition unit 62 of the first recognition processing unit 60 recognizes a biopsy, the treatment recognition unit 232 of the first recognition processing unit 60 recognizes a biopsy. Use recognition results. Then, the treatment recognition unit 232 executes recognition processing for treatments other than biopsy. This is to eliminate duplicate recognition processing and reduce processing amount and processing time.

The lesion recognition unit 233 recognizes the presence or absence of a lesion in an endoscopic image acquired in one endoscopic examination. Recognizing the presence or absence of a lesion means not only recognizing the presence or absence of an area that is definitely a lesion, but also recognizing the presence or absence of an area that may have a lesion (benign tumor or dysplasia, etc.). and/or recognizing areas with characteristics (such as redness) that may be directly or indirectly related to the lesion.

The image selection support unit 223 uses the various recognition results of the second recognition processing unit 222 to select a report creation screen 510 and/or a report from among a series of multiple endoscopic images acquired in one endoscopic examination. automatically selects an endoscopic image (hereinafter referred to as a key image) to be used in the process. Specifically, the image selection support unit 223 uses the recognition result of the imaging position recognition unit 231 to select from among the plurality of endoscopic images acquired in the endoscopy examination, which are determined to be used at least in the report. Select the endoscopic image of the area shown as the key image. The portions that are prescribed for use in the report include portions that are substantially prescribed for use because they are common sites of lesions, etc. For example, in an endoscopy of the upper gastrointestinal tract, this is an endoscopic image of the pylorus. Further, when the treatment recognition unit 232 recognizes the treatment, the image selection support unit 223 selects some or all of the endoscopic images as key images from among the endoscopic images in which the treatment has been recognized. Similarly, when the lesion recognition unit 233 recognizes a lesion, the image selection support unit 223 selects some or all endoscopic images as key images from among the endoscopic images in which the lesion has been recognized. The reason why a portion of the endoscopic images in which the treatment or lesion has been recognized is selected is to minimize the number of images that can be used in the report creation screen 510 and/or the report. Note that the image selection support unit 223 uses the recognition result of the imaging position recognition unit 231 to select the schema diagram to be used in the report creation screen 510 and/or the report by specifying the region photographed in the endoscopy. do. For example, in the case of an endoscopy of the stomach, the image selection support unit 223 selects a schema diagram of the stomach. The report creation screen generation unit 220 generates and provides a report creation screen 510 in which the schema diagram and one or more key images selected by the image selection support unit 223 are automatically inserted.

The third recognition processing unit 224 performs discrimination processing on at least the endoscopic image used for the report. That is, the third recognition processing unit 224 performs a discrimination process on the key image selected by the image selection support unit 223. Differentiation processing refers to processing that recognizes the symptoms (type of lesion, degree of progression, etc.) of lesions etc. that appear in endoscopic images. For this reason, the third recognition processing section 224 includes one or more discrimination sections 236. The third recognition processing section 224 includes one discrimination section 236 for one key image. Note that when the doctor selects a key image regardless of the selection by the image selection support unit 223, the third recognition processing unit 224 performs discrimination processing on the key image selected by the doctor. Similarly, when the doctor manually reselects the key image selected by the image selection support unit 223, the third recognition processing unit 224 performs discrimination processing on the key image selected by the doctor. Note that the third recognition processing unit 224 and the above-mentioned units forming the third recognition processing unit 224 are, for example, artificial intelligence (AI) having a learning function.

The item selection support unit 226 uses at least the discrimination result of the third recognition processing unit 224 to automatically select items to be included in the report. The report creation screen generation unit 220 generates and provides a report creation screen 510 in which report entry items are automatically selected. Furthermore, the item selection support unit 226 can further select items to be included in the report using various recognition results of the second recognition processing unit 222.

(5e) Database etc. The database 156 included in the endoscope information management system 31 includes, for example, a cleaning information management database for managing information related to the cleaning state and history of the endoscope 42, and an internal database for managing endoscopic images. Endoscopy image database, patient information database that manages information related to patients, examination information management database that manages information related to each patient's examination, report management database that manages reports created for various examinations including endoscopy, Consists of etc. In this embodiment, the endoscope information management system 31 includes a database 156, but if some or all of the various databases are in an external environment connected to the endoscope-related business system 10, internal The endoscopic information management system 31 can use a database in an external environment instead of the built-in database 156 or in addition to the built-in database 156.

The operation unit 157 included in the endoscope information management system 31 is, for example, a keyboard, a mouse, and/or a touch panel, and the display 158 is a monitor, a touch panel, or the like. In this embodiment, the endoscope information management system 31 has an operation section 157 and a display 158, but an external terminal (such as a computer that accesses the endoscope information management system 31) is used as the operation section 157 and the display 158. In this case, the endoscope information management system 31 may be configured without the operation unit 157 and/or the display 158. The communication unit 159 is a communication interface that connects directly or indirectly to each unit constituting the endoscope-related business system 10 by wire or wirelessly. Each section of the endoscope information management system 31 communicates with each section of the endoscope-related business system 10 using the communication section 159, and sends and receives various information.

Hereinafter, the operation of the endoscope-related business system 10 configured as described above, particularly the operation related to the endoscope information management system 31, will be explained.

<Preparation for endoscopy>
As shown in FIG. 14, before an endoscopic examination, the endoscope information management system 31 uses the examination order acquisition unit 171 to acquire an examination order (step S101). When the examination order acquisition unit 171 acquires an examination order, the endoscope determination unit 172 selects the endoscope device 21 (processor device 46 and light source device 44) used in the endoscopy related to the examination order, and The mirror 42 is determined (step S102). Furthermore, the endoscope information management system 31 collects information such as contraindications regarding the patient (step S103). Specifically, the endoscope information management system 31 uses the insertion route information acquisition unit 173 to acquire information regarding the insertion route of the endoscope 42 in past examinations of the patient, and also uses the contraindication information acquisition unit 174 to obtain contraindication information for the patient. Thereafter, the endoscope information management system 31 generates a pre-examination screen 251 using the pre-examination screen generation unit 181 and displays it on the monitor 48 (step S104).

As shown in FIG. 15, the pre-examination screen 251 includes a first display section 252 that displays information about an endoscopic examination to be performed, and a second display section 253 that displays information about endoscopic examinations performed in the past. and has. The first display section 252 includes, for example, identification information 261 (model name "EGXXX" in FIG. 15) of the endoscope 42 to be used, patient name 262 ("Fuji Taro" in FIG. 15), and patient name 262 ("Fuji Taro" in FIG. 15). Based on the ID 263 (“1234567890” in FIG. 15), contraindication information 264 (in FIG. 15, “○×△” related to allergies and “biopsy prohibited” information related to whether biopsy is possible), and the past insertion route. The recommended insertion route 267 for the endoscope 42 (“transnasal (right)” in FIG. 15) for the endoscopy determined by the above is displayed. Further, the second display unit 253 displays, for example, a report 268 of an endoscopy performed on the patient in the past, and/or an endoscopic image.

As described above, in the endoscopy-related business system 10, the endoscope information management system 31 displays information necessary for endoscopy and preparation for the endoscopy on the monitor 48 using the pre-examination screen 251. . Therefore, a doctor or staff preparing for an endoscopy can smoothly prepare for an endoscopy without referring to other materials or data. Furthermore, when starting an endoscopy, the doctor can obtain a list of points to be noted during the endoscopy and/or information on past endoscopy from the pre-examination screen 251. Endoscopy can be started safely and smoothly.

As shown in FIG. 16, when the endoscope 42 is connected to the endoscope apparatus 21 in preparation for an endoscopy (step S201), the connection detection unit 51 detects this. Therefore, the endoscope connection monitoring unit 182 checks whether the connected endoscope 42 is different from the endoscope 42 scheduled to be used determined by the endoscope determining unit 172 (step S202). If the connected endoscope 42 is different from the endoscope 42 scheduled to be used, the endoscope connection monitoring unit 182 issues a warning to that effect using the notification unit 55 (step S210). Thereby, it is possible to prevent the endoscope 42 that is not scheduled for use from being used for endoscopy, and as a result, endoscopy can be performed safely.

Further, when the endoscope 42 is connected to the endoscope device 21 (step S201), the endoscope information management system 31 uses the cleaning state monitoring unit 191 to check the cleaning state of the connected endoscope 42. . If the cleaning of the connected endoscope 42 has not been completed normally (Step S203: NO), or if it has not been removed within a predetermined period of time after the cleaning is completed (Step S204: NO), the cleaning state monitoring unit 191 sends the notification unit 55 to issue a warning to that effect (step S210). Thereby, it is possible to prevent an endoscope 42 that is unclean or a potentially unclean endoscope 42 from being used for endoscopy, and as a result, endoscopy can be performed safely.

In preparation for an endoscopy, when information such as the identification information of a doctor and a patient is input (step S205), the endoscope information management system 31 uses the user monitoring unit 183 to Verify patient information. If the patient is not the doctor and patient scheduled for the examination (step S206), the user monitoring unit 183 uses the notification unit 55 to issue a warning to that effect (step S210). This can prevent an endoscopic examination by a different doctor or patient than the one scheduled to perform the endoscopic examination, and as a result, the endoscopic examination can be performed safely.

As described above, in the endoscope-related business system 10, after various checks are performed by the endoscope information management system 31, an endoscope examination can be started (step S211). Therefore, endoscopy can be started safely.

<Implementation of endoscopy>
As shown in FIG. 17, when an endoscopic examination is started, the endoscope apparatus 21 acquires an endoscopic image and displays the acquired endoscopic image on the monitor 48 using the examination-in-progress screen 301 (step S301). . As shown in FIG. 18, the examination-in-progress screen 301 includes, for example, an endoscopic image display section 311 that displays endoscopic images 321 acquired sequentially, and a mark 322 indicating "biopsy prohibited" for endoscopic examination. A contraindication information display section 312 that displays information related to the safety of implementation, and a reference section that displays reference information such as an endoscopic image 323 acquired in a past endoscopy and/or a report 324 of a past endoscopy. It has an information display section 313. An endoscopic image 323 acquired in a past endoscopic examination is acquired by the image acquisition unit 175 and inserted into the in-examination screen 301. Further, the report 324 of the past endoscopy is acquired by the report acquisition unit 176 and inserted into the examination-in-progress screen 301. On the other hand, the photographing position recognition unit 61 sequentially performs photographing position recognition processing on the endoscopic images 321 to be acquired and displayed (step S310). Therefore, when the imaging position changes (step S312: YES), the endoscope information management system 31 updates the reference information on the in-examination screen 301 as appropriate. For example, when displaying an endoscopic image 323 acquired in a past endoscopy on the reference information display section 313, depending on the recognized imaging position, The acquired endoscopic image 323 is updated. More specifically, a past endoscopic image 323 captured at a position corresponding to the captured endoscopic image 321 is displayed on the reference information display section 313. In this way, by recognizing the imaging position and automatically updating reference information, doctors can refer to appropriate reference information in real time, allowing doctors to smoothly perform endoscopic examinations.

Further, during an endoscopy, the treatment recognition unit 62 recognizes the presence or absence of a treatment, and the endoscopic information management system 31 uses the biopsy monitoring unit 201 to monitor the presence or absence of a biopsy. If the biopsy is correct (step S320: YES), the biopsy monitoring unit 201 acquires information related to the biopsy (step S321), and the label printer control unit 203 automatically prints the biopsy label 350 related to the biopsy. print. In conventional endoscopy, when a biopsy is performed, a doctor or staff inputs information related to the biopsy into the label printer 22 to create a biopsy label 350, but the endoscope-related business system 10 Since the biopsy label 350 is automatically created by performing a biopsy as described above, the biopsy label 350 can be created more smoothly than before, which is convenient.

As shown in FIG. 19, the biopsy label 350 includes, for example, a display of a title such as "specimen label" and a display of the order in which the biopsy was performed such as "(1)," "(2)," and "(3)." , Display of the name of the patient who performed the biopsy ("Taro Fuji" in FIG. 19), the patient's ID ("1234567890" in FIG. 19), and the sample collection site ("stomach" in FIG. 19); Including etc.

In addition, during an endoscopic examination, the image quality recognition section 63 recognizes the image quality of the acquired endoscopic image 321, and the unphotographed portion recognition section 64 recognizes the unphotographed portion of the subject. Then, if the image quality is not appropriate (step S330: NO) or if there is an oversight due to non-photography (step S340: NO), the notification unit 55 issues a warning to that effect and/or a notification urging improvement ( Step S350). Therefore, in the endoscope-related business system 10 equipped with the endoscope information management system 31, oversights are reduced and endoscopy with appropriate image quality is performed, compared to conventional endoscope devices that do not have these warnings. Mirror images are easily obtained. That is, smooth and reliable endoscopic examination can be performed.

Note that the endoscope-related business system 10 repeatedly executes the various steps described above as appropriate until the end of the examination (step S360: YES).

<Cleaning the endoscope>
As shown in FIG. 20, when performing primary cleaning of the endoscope 42 used at the bedside after an endoscopy, the endoscope information management system 31 uses the primary cleaning management unit 192 to Next cleaning information input screen 401 is displayed (step S401). Therefore, when the doctor or staff member who performs the primary cleaning of the endoscope 42 performs the primary cleaning of the endoscope 42, he or she can input necessary information such as information related to the primary cleaning on the spot ( Step S402). Further, when the input of the information related to the primary cleaning is completed, the primary cleaning management unit 192 acquires the information related to the primary cleaning, which is the input item on the primary cleaning information input screen 401 (step S403), and the database 156 (Step S404). In conventional endoscope devices, etc., information related to primary cleaning must be input separately using a device or system separate from the endoscope device 21, but the endoscope-related business system 10 Since the input and registration are completed at the point where the primary cleaning is performed, the work of inputting information related to the primary cleaning can be carried out more smoothly compared to conventional endoscope devices and the like.

As shown in FIG. 21, on the primary cleaning information input screen 401, the identification information 411 ("EGXXX" in FIG. 21) of the endoscope 42 that is the target of primary cleaning, Identification information 412 of a certain cleaning person (“Taro Yagi” in FIG. 21), cleaning implementation status 413 (“OK” icon indicating completed in FIG. 21), and installation status 414 of the waterproof cap (in FIG. The "OK" icon indicating completion), the water leakage check result 415 ("no abnormality" in FIG. 21), etc. are items to be input as information related to the primary cleaning. When the cleaning person presses the cleaning completion button 416, the primary cleaning management section 192 automatically registers this information in the database 156.

As shown in FIG. 22, when performing main cleaning using the cleaning and disinfecting device 23, the cleaning and disinfecting device 23 uses the endoscope identification unit 122 to automatically identify the identification information of the endoscope 42 that is the target of cleaning and disinfection. (step S451). Further, the cleaning/disinfecting device 23 uses the cleaning person identification unit 123 to acquire identification information of the cleaning person who performs the main cleaning (step S452). The cleaning/disinfecting device 23 then automatically inputs this information into the operation screen 460 displayed on the touch panel 115 (step S453).

As shown in FIG. 23, the operation screen 460 includes, for example, a status display 461 indicating the operating state of the cleaning disinfection device 23, a cleaning information input field 462 for inputting information related to main cleaning and primary cleaning, and a cleaning start field. Display buttons 465 and the like. In the cleaning information input field 462, there is no need to input the identification information 463 of the endoscope 42 that performs the main cleaning and the identification information 464 of the cleaner who performs the main cleaning. Further, the cleaning/disinfecting device 23 acquires information related to the primary cleaning from the endoscope information management system 31 using the communication unit 121, and automatically enters the input completion state. Therefore, the cleaner who performs the main cleaning only needs to confirm the input contents (step S454) and press the cleaning start button 465 (step S455) without inputting information related to the main cleaning and the primary cleaning. Therefore, according to the endoscope-related business system 10, main cleaning can be carried out more smoothly compared to conventional cleaning and disinfecting devices that require these inputs.

Note that when the cleaning person presses the cleaning start button 465 to start the main cleaning, or when the main cleaning is completed (including when it ends abnormally), the cleaning disinfection device 23 uses the communication unit 121 to start the main cleaning. Such information is automatically transmitted to the endoscope information management system 31 (step S456). As a result, the endoscope information management system 31 uses the main cleaning management unit 193 to automatically register the acquired information regarding the main cleaning in the database 156 (step S457). Therefore, according to the endoscope-related business system 10, main cleaning can be carried out more smoothly than in conventional management systems that require these inputs.

<Creating a report>
When creating a report after an endoscopy, as shown in FIG. 24, the doctor creating the report accesses the endoscopy information management system 31 using the report creation device 24 (step S501). When there is an access from the report creation device 24, the endoscope information management system 31 generates a report creation screen 510 using the report creation screen generation unit 220, and displays it on the display 131 of the report creation device 24 (step S502 ). At that time, the doctor specifies information that identifies the patient and/or the endoscopy (step S503). This is to receive an appropriate report creation screen 510 for a specific patient and endoscopy.

As shown in FIG. 25, the report creation screen 510 includes a patient information display section 511 that displays patient information, a key image display section 512 that displays key images, etc., a report list display section 513 that displays a list of reports, and , has an item input section 514 that functions as an operation section for inputting items to be included in the report. Note that display units or operation units related to report creation, such as the key image display unit 512, report list display unit 513, and item input unit 514, are displayed by pressing the report attachment button 516.

As shown in FIG. 26, the key image display section 512 has a schema diagram field 520 for displaying schema diagrams, and a plurality of endoscopic image display fields 521 to 527. The endoscope image displayed in the endoscope display field 521 is the key image. In conventional report creation devices, schema diagrams are manually input by doctors, but in the endoscopy-related business system 10, the endoscope information management system 31 uses the second recognition processing unit 222 and the image selection support unit 223. A schema diagram is automatically selected and automatically inserted into the schema diagram field 520 (step S504). Furthermore, in conventional report creation devices and the like, key images are manually input by a doctor, but in the endoscope-related business system 10, the endoscope information management system 31 includes the second recognition processing unit 222 and the image selection support unit 223. A key image is automatically selected using , and automatically inserted into the endoscopic image display fields 521 to 527 (step S504). Therefore, according to the endoscope-related work system 10, report creation work can be performed smoothly and quickly compared to conventional report creation devices.

As shown in FIG. 27, the item input section 514 of the report creation screen 510 includes, for example, a lesion site item input field 531 for inputting items related to the lesion site, a diagnostic item input field 532 for inputting items related to diagnosis, It has a findings input column 533 for inputting findings, and a treatment etc. input column 534 for inputting items related to treatment and/or specimens. Each of these item fields has an item name display section that displays the item name, and an item selection section that lists candidates for input items. The item name display section also functions as an operation section for switching between display and non-display of the item selection section.

For example, the lesion site item input field 531 includes an item name display section 540 representing "lesion site," a first item input field 541, a second item input field 542, a third item input field 543, and a fourth item input field 544. , a fifth item input field 545. The first item input field 541 is a lesion site input field for broadly selecting the imaging site; for example, the esophagus, stomach, duodenum, and small intestine are input candidates. The second item input field 542 is an input field for classifying the selected items in the first item input field 541, and the items to be listed change depending on the selected items in the first item input field 541. The third item input field 543 is an input field for items that further classify the selected items in the first item input field 541 or the second item input field 542, and the selection in the first item input field 541 or the second item input field 542 The items listed vary depending on the item. Further, the fourth item input field 544 is an input field for items that further classify the selected items in the first item input field 541, the second item input field 542, and/or the third item input field 543, and The items to be listed change depending on the selection items in the item input field 541, the second item input field 542, and/or the third item input field 543. The fifth item input field 545 is an input field for optionally inputting supplementary information regarding the lesion site. For example, the diagnosis item input field 532 includes an item name display section 550 representing "diagnosis," a first item input field 551, a second item input field 552, a third item input field 553, and a fourth item input field 554. Equipped with.

Input (selection) in the item input section 514 is a manual input by a doctor in conventional report creation devices and the like. In contrast, in the endoscope-related business system 10, when the endoscope information management system 31 automatically selects a key image using the image selection support section 223, the third recognition processing section 224 The discrimination unit 236 automatically performs discrimination processing on each key image (step S505). Then, the item selection support unit 226 automatically selects some or all of the input items in the item input unit 514 using the recognition results of the second recognition processing unit 222 and/or the discrimination results of the third recognition processing unit 224. A temporary input is made and the selected state is entered (step S506). That is, the endoscope-related business system 10 provides the report creation screen 510 in which some or all of the input items of the item input section 514 are automatically selected. Therefore, the doctor completes report creation by simply confirming the input contents (step S507) and pressing the confirm button 519 to confirm the input contents. Therefore, according to the endoscope-related business system 10, a report can be created smoothly and quickly compared to the case where input items in the item input section 514 are manually input. It is also possible to prevent forgetting to input items.

Note that when an approval operation is performed on the report creation screen 510, the endoscope information management system 31 automatically registers the approved report in the database 156 (step S508).

In the above embodiment, some or all of the components shown as components of the endoscope information management system 31 include the endoscope device 21 (particularly the processor device 46), the label printer 22, the cleaning and disinfecting device 23, Alternatively, it can be provided in the report creation device 24. In this case, the endoscope device 21 and the like are provided with various functions of the endoscope information management system 31. Therefore, a system including the endoscope apparatus 21 and the like having the functions of the endoscope information management system 31 constitutes the endoscope-related business system 10 of the above embodiment.

In the embodiment described above, the endoscope 42 is an insertion type, but instead of the insertion type endoscope 42, a capsule endoscope that is swallowed and used by the subject can be used.

The information related to the primary cleaning and/or the information related to the main cleaning can include information related to the usage history indicating who used the endoscope 42 (for which patient). Therefore, the cleaning state monitoring unit 191 can monitor not only the cleaning state of the endoscope 42 but also information related to the usage history.

In the embodiment described above, the hardware of a processing unit that executes various processes among the parts of the endoscope-related business system 10, such as each part of the processor device 46 and each part of the endoscope information management system 31, etc. The typical structures are various types of processors as shown below. Various processors include CPU (Central Processing Unit), GPU (Graphical Processing Unit), FPGA (Field Programmable Gate Array), etc., which are general-purpose processors that execute software (programs) and function as various processing units. This includes programmable logic devices (PLDs), which are processors whose circuit configuration can be changed after manufacturing, and dedicated electric circuits, which are processors with circuit configurations specifically designed to execute various processes. .

One processing unit may be configured with one of these various processors, or a combination of two or more processors of the same or different types (for example, multiple FPGAs, a combination of a CPU and an FPGA, or a combination of a CPU and an FPGA). (a combination of GPUs, etc.). Further, the plurality of processing units may be configured with one processor. As an example of configuring multiple processing units with one processor, first, as typified by computers such as clients and servers, one processor is configured with a combination of one or more CPUs and software, There is a form in which this processor functions as a plurality of processing units. Second, there are processors that use a single IC (Integrated Circuit) chip to implement the functions of an entire system including multiple processing units, as typified by System On Chip (SoC). be. In this way, various processing units are configured using one or more of the various processors described above as a hardware structure.

Furthermore, the hardware structure of these various processors is, more specifically, an electric circuit (circuitry) in the form of a combination of circuit elements such as semiconductor elements.

10 Endoscope related business system 21 Endoscope device 22 Label printer 23 Cleaning disinfection device 24 Report creation device 26 Related business device 31 Endoscope information management system 42 Endoscope 42a Insertion section 42b Operation section 42c Curved section 42d Tip section 42e Angle knob 42f Insertion port 44 Light source device 46 Processor device 48 Monitor 49 Console 51 Connection detection section 52 Image acquisition section 53 Image processing section 54 Display control section 55 Notification section 56 Control section 57 Communication section 60 First recognition processing section 61 Photographing position Recognition unit 62 Treatment recognition unit 63 Image quality recognition unit 64 Unphotographed portion recognition unit 71 Biological information calculation unit 72 Speaker 73 Time measurement unit 74 Information acquisition unit 75 Information output unit 92 Communication unit 93 Biopsy information acquisition unit 94 Output unit 110 Cleaning tank 111 Main body 112 Lid section 113 Pedal 115 Touch panel 116 Caster 121 Communication section 122 Endoscope identification section 123 Cleaner identification section 124 Control section 131 Display 132 Operation section 133 Communication section 151 Test information management section 152 Cleaning information management section 153 Label output management section 154 Report creation support section 156 Database 157 Operation section 158 Display 159 Communication section 171 Examination order acquisition section 172 Endoscope determination section 173 Insertion route information acquisition section 174 Contraindication information acquisition section 175 Image acquisition section 176 Report acquisition section 181 Pre-examination screen generation Sections 182 Endoscope connection monitoring section 183 User monitoring section 191 Cleaning state monitoring section 192 Primary cleaning management section 193 Main cleaning management section 201 Biopsy monitoring section 203 Label printer control section 220 Report creation screen generation section 222 Second recognition process Section 223 Image selection support section 224 Third recognition processing section 226 Item selection support section 231 Imaging position recognition section 232 Treatment recognition section 233 Lesion recognition section 236 Discrimination section 251 Pre-examination screen 252 First display section 253 Second display section 261 Identification information 262 Patient name 264 Contraindication information 267 Insertion route 268 Report 301 Examination screen 311 Endoscopic image display section 312 Contraindication information display section 313 Reference information display section 321 Endoscopic image 322 Biopsy prohibition mark 323 Endoscopic image 324 Report 350 Biopsy label 401 Primary cleaning information input screen 411 Identification information 412 Identification information 413 Cleaning implementation status 414 Waterproof cap installation status 415 Water leakage check result 416 Cleaning completion button 460 Operation screen 461 Status display 462 Cleaning information input field 463 Identification information 464 Identification information 465 Cleaning start button 510 Report creation screen 511 Patient information display section 512 Key image display section 513 Report list display section 514 Item input section 516 Report attachment button 519 Confirm button 520 Schema diagram section 521 to 527 Endoscope image display section 531 Lesion site item input field 532 Diagnosis item input field 533 Findings input field 534 Treatment etc. input field 540 Item name display section 541 1st item input field 542 2nd item input field 543 3rd item input field 544 4th item input field 545 5th item input field 550 Item name display area 551 1st item input field 552 2nd item input field 553 3rd item input field 554 4th item input field

Claims (9)

a discrimination unit that performs discrimination processing on at least an endoscopic image used for a report among the plurality of endoscopic images;
an item selection support unit that automatically selects items to be included in the report using the discrimination results of the discrimination unit;
a photographing position recognition unit that recognizes a part of the subject appearing in the endoscopic image;
an image selection support unit that automatically selects the endoscopic image to be used in the report from among the plurality of endoscopic images using the recognition result of the imaging position recognition unit;
An endoscopy-related business system equipped with a discrimination unit that performs discrimination processing on at least an endoscopic image used for a report among the plurality of endoscopic images;
an item selection support unit that automatically selects items to be included in the report using the discrimination results of the discrimination unit;
a photographing position recognition unit that recognizes a part of the subject appearing in the endoscopic image;
an image selection support unit that automatically selects a schema diagram to be used in a report using the recognition result of the photographing position recognition unit;
An endoscopy-related business system equipped with comprising an endoscope device that acquires the endoscopic image,
The endoscope-related business system according to claim 1 or 2, wherein the endoscope device includes a part or all of the discrimination section, the item selection support section, the photographing position recognition section, and the image selection support section. . a discrimination unit that performs discrimination processing on at least an endoscopic image used for a report among the plurality of endoscopic images;
an item selection support unit that automatically selects items to be included in the report using the discrimination results of the discrimination unit;
a treatment recognition unit that recognizes a treatment for the subject with respect to the endoscopic image;
an image selection support unit that automatically selects the endoscopic image to be used in the report from among the plurality of endoscopic images using the recognition result of the treatment recognition unit ;
An endoscopy-related business system equipped with comprising an endoscope device that acquires the endoscopic image,
The endoscope-related business system according to claim 4, wherein the endoscope apparatus includes a part or all of the discrimination section, the item selection support section, the treatment recognition section, and the image selection support section. a discrimination unit that performs discrimination processing on at least an endoscopic image used for a report among the plurality of endoscopic images;
an item selection support unit that automatically selects items to be included in the report using the discrimination results of the discrimination unit;
a lesion recognition unit that recognizes the presence or absence of a lesion in the endoscopic image;
an image selection support unit that automatically selects the endoscopic image to be used in the report from among the plurality of endoscopic images using the recognition result of the lesion recognition unit ;
An endoscopy-related business system equipped with comprising an endoscope device that acquires the endoscopic image,
7. The endoscope-related business system according to claim 6, wherein the endoscope apparatus includes a part or all of the discrimination section, the item selection support section, the lesion recognition section, and the image selection support section. comprising a report creation device that creates the report related to endoscopy,
The endoscope-related business system according to claim 1, wherein the report creation device includes a report creation screen generation unit that provides a report creation screen. Any one of claims 1 to 8, wherein the image selection support unit automatically selects a portion of the endoscopic image that is predetermined to be used in the report from among the plurality of endoscopic images. The endoscope-related business system described in Section 1.

Images