JP6602000B2 - Endoscope filing device, endoscope system, and image processing method - Google Patents

Description

  The present invention relates to an endoscope filing apparatus, an endoscope system, and an image processing method that extract a desired region from an image.

  2. Description of the Related Art An endoscope system that captures an image of a patient's body using an endoscope scope and records the obtained image is known. The endoscope system includes a filing device that records and manages obtained images. The filing device stores information such as an image and a shooting time, and creates a report using the image. Operations such as cutting out a desired area from an image used for report creation are not performed (Patent Document 1).

JP 2008-220839 A

  An endoscope system may include an endoscope processor that adds patient information or the like as an image to an image captured by an endoscope scope. In this case, the filing device stores an image including information added by the endoscope processor. When an image including this information is used for a report, an area for displaying information is pressed against an area of the image captured by the endoscope scope, and it becomes difficult for the user to visually recognize the image. On the other hand, it is troublesome for a user to delete an area for displaying information from an image including information.

  The present invention has been made in view of these problems, and obtains an endoscope filing device, an endoscope system, and an image processing method capable of easily obtaining only an image captured by an endoscope scope. With the goal.

  The endoscope filing device according to the first invention of the present application includes scope information indicating a type of an endoscope scope, processor information indicating a setting of an endoscope processor, scope images taken by the endoscope scope, and information on a procedure. A receiving unit that receives a processor image including an information image indicating the image, a trimming region that indicates the position and range of the scope image in the processor image, a storage unit that stores the scope information and the processor information in association with each other, and scope information And a processing unit that reads the trimming area from the storage unit using the processor information and cuts out the scope image from the processor image using the trimming area.

  The processing unit preferably creates a report using a cut-out scope image obtained by cutting out a scope image from a processor image. Reports can be created using only scope images.

  The storage unit stores the information area indicating the position and range of the information image in the processor image in association with the scope information and the processor information, and the processing unit reads the information area from the storage unit using the scope information and the processor information. Preferably, the information image is cut out from the processor image using the information area. The scope image can be accurately cut out from the processor image.

  The processing unit preferably creates a report using a cut-out scope image obtained by cutting out a scope image from a processor image and a cut-out information image obtained by cutting out an information image from the processor image. Reports can be created using only scope images. In addition, the scope image can be accurately cut out from the processor image.

  It is preferable to further include an input unit that inputs the scope information, the processor information, and the trimming area in association with each other, and the storage unit stores the scope information, the processor information, and the trimming area that are input by the input unit in association with each other. The scope image can be accurately cut out from the processor image.

  An endoscope system according to a second invention of the present application includes the endoscope scope, the endoscope processor, and the endoscope filing device.

  An image processing method according to a third invention of the present application includes a trimming region indicating a position and a range of a scope image in a processor image including a scope image captured by an endoscope scope and an information image indicating subject information, An image processing method executed by an endoscope filing device including a storage unit that associates and stores scope information indicating a type of a scope and processor information indicating a setting of an endoscope processor, the type of endoscope scope Receiving scope information representing processor information, processor information representing endoscope processor settings, a processor image comprising a scope image captured by the endoscope scope and an information image representing subject information, and scope Reading the trimming area from the storage unit using the information and the processor information, and using the trimming area Characterized in that it comprises the step of cutting the scope image from the processor image Te.

  According to the present invention, an endoscope filing device, an endoscope system, and an image processing method capable of easily obtaining only an image captured by an endoscope scope are obtained.

1 is a block diagram schematically showing an endoscope system having an endoscope filing device according to the present invention. FIG. It is the figure which showed the 1st processor image. It is the figure which showed the 2nd processor image. It is the figure which showed the 3rd processor image. It is the figure which showed the 4th processor image. It is the figure which showed the 5th processor image. It is the figure which showed the 6th processor image. It is the figure which showed the 7th processor image. It is the figure which showed the report. It is the flowchart which showed the information transmission process. It is the flowchart which showed the trimming area | region setting process. It is the figure which showed the state which sets a trimming area | region. It is the figure which showed the relationship between a trimming area | region, scope information, and processor information. It is the figure which showed the relationship between a trimming area | region, scope information, and processor information. It is the flowchart which showed the inspection process. It is the flowchart which showed report preparation processing.

  Hereinafter, an endoscope system 100 according to an embodiment of the present invention will be described. FIG. 1 is a diagram schematically showing an endoscope system 100. The endoscope system 100 is connected to an endoscope scope 131, an endoscope processor 132 connected to the endoscope scope 131, a filing device 110 connected to the endoscope processor 132, and a filing device 110. A monitor 133, a keyboard 135, and a mouse 136.

  The endoscope scope 131 mainly includes an image sensor, a scope CPU, and a scope memory (not shown). The imaging element is, for example, a CCD or a CMOS stored in the distal end portion of the endoscope scope 131, and is inserted into the patient's body to image the observation object. Then, the captured image is transmitted to the endoscope processor 132 as a scope image. Details of the scope image will be described later. The scope CPU operates the endoscope scope 131 by controlling each element included in the endoscope scope 131. The scope memory stores scope information indicating the type of the endoscope scope 131, firmware of the endoscope scope 131, various setting information, and the like.

  The endoscope processor 132 mainly includes a processor CPU (not shown) and an internal memory. The processor CPU is connected to the scope CPU and acquires information stored in the scope memory via the scope CPU. Further, the processor CPU receives a scope image from the endoscope scope 131, adds information about the procedure as an image, and outputs the obtained processor image. Details of the processor image will be described later. The internal memory stores processor information indicating settings of the endoscope processor 132, information related to the procedure, and the like. The processor CPU executes information transmission processing to be described later.

  The filing device 110 mainly includes a video capture 111 serving as a receiving unit, a filing CPU 112 serving as a processing unit, a memory 113, a hard disk 114 serving as a storage unit, a communication interface 115, a display interface 116, and a network interface 117.

  The video capture 111 is connected to the endoscope processor 132 and receives a processor image from the endoscope processor 132. The filing CPU 112 receives a processor image from the video capture 111, performs predetermined image processing while using the memory 113 as a temporary storage device, creates a display image, and transmits the display image to the display interface 116 and the hard disk 114. . Further, the filing CPU 112 executes a report creation process described later to create a report. The report summarizes the contents of the procedure by displaying images taken in the procedure and information on the procedure. Further, the filing CPU 112 executes a trimming area setting process and an inspection process to be described later.

  The communication interface 115 exchanges information between the endoscope processor 132 and the filing CPU 112. Information received from the endoscope processor 132 is scope information indicating the type of the endoscope scope 131 and processor information indicating settings of the endoscope processor 132, and is transmitted from the communication interface 115 to the hard disk 114 and the filing CPU 112. Is done.

  The hard disk 114 stores display images, scope information, and processor information.

  The network interface 117 connects the filing device 110 to a network such as Ethernet (registered trademark).

  The display interface 116 receives the display image from the filing CPU 112, converts the display image into a signal format suitable for the monitor 133, and transmits the display image to the monitor 133.

  The monitor 133 receives images from the display interface 116 and displays them.

The user operates the keyboard 135 and the mouse 136 to input desired information to the filing device 110. The keyboard 135 and the mouse 136 constitute an input unit.

  Next, the processor image will be described with reference to FIGS.

  FIG. 2 shows a first processor image. The first processor image is an image including a first scope image obtained by a procedure using the endoscope scope 131 of the first type and an information image indicating information related to the procedure. In the first processor image, the first scope image is displayed on the left side and the information image is displayed on the right side. The information image displays the name, age, and sex of the patient, the date and time when the procedure was performed, a comment, the name of the doctor who performed the procedure, and the like.

  FIG. 3 shows a second processor image. The second processor image is an image including a second scope image obtained by a procedure using the endoscope scope 131 of the second type and an information image indicating information related to the procedure. In the second processor image, the second scope image is displayed on the left side, and the information image is displayed on the right side. The information image displays the same content as the first processor image. The size of the second scope image in the second processor image is smaller than the size of the first scope image in the first processor image.

  FIG. 4 shows a third processor image. The third processor image is an image including a first scope image, a first special image obtained by performing special image processing on the first scope image, and an information image indicating information related to the procedure. Thus, the image is created by the processor CPU when the twin mode (simultaneous display mode) is turned on. Special image processing includes an image in which a part including a predetermined wavelength in the image is emphasized, an image in which an outline is emphasized, and the like. The information image displays the same content as the first processor image. In the third processor image, the first scope image is displayed on the left half, the first special image is displayed on the right half, and the information images are displayed on both upper and lower ends. The size of the first scope image is equal to the size of the first special image. Further, the sizes of the first scope image and the first special image in the third processor image are the sizes of the first scope image in the first processor image and the second scope image in the second processor image. Is smaller than the size of The positions of the first scope image and the first special image in the third processor image are exactly the same as the positions of the first scope image in the first processor image and the second scope image in the second processor image. Different.

  FIG. 5 shows a fourth processor image. The fourth processor image is an image created when the image enlargement function is turned on, and is a processor image obtained by enlarging and displaying the first scope image larger than the size displayed on the first processor image. It is. The size of the first scope image in the fourth processor image is larger than the size of the first scope image in the first processor image.

  FIG. 6 shows a fifth processor image. The fifth processor image is an image created when the image enlargement function is turned on, and is a processor image obtained by enlarging and displaying the second scope image larger than the size displayed on the second processor image. It is. The size of the second scope image in the fifth processor image is larger than the size of the second scope image in the second processor image.

  FIG. 7 shows a sixth processor image. The sixth processor image is an image created when the twin mode and the image enlargement function are turned on, and is a size that displays the first scope image and the first special image on the third processor image. It is the processor image which each expanded and displayed. The sizes of the first scope image and the first special image in the sixth processor image are larger than the sizes of the first scope image and the first special image in the third processor image.

  FIG. 8 shows a seventh processor image. The seventh processor image is an image created when the external input function is turned on, and includes an image including the first scope image and the external input image input from the outside to the endoscope processor 132. It is. In the first processor image, the first scope image is displayed on the left side, and the external input image is displayed on the right side. The position and size of the external input image change according to the type of the endoscope scope 131. An external input image is a type of information image.

  FIG. 9 is an image showing a report. The report is an image created after the procedure is completed, and displays only the scope image as an image and the procedure information. Therefore, the filing CPU 112 needs to cut out (trim) the scope image from the processor image stored in the hard disk 114. Therefore, the following processing is executed.

  Next, the information transmission process will be described with reference to FIG. The information transmission process is a process executed by the processor CPU in response to a request from the filing CPU 112, and is a process for acquiring scope information from the endoscope scope 131 and transmitting it to the filing CPU 112. The scope information is information representing the type of the endoscope scope 131.

  In the first step S51, the processor CPU communicates with the scope CPU and acquires scope information from the scope CPU.

  In the next step S52, the processor CPU transmits scope information to the filing device 110. Then, the process ends.

  As a result, the filing device 110 acquires the scope information.

  Next, the trimming area setting process will be described with reference to FIGS. The trimming area setting process is a process executed by the filing CPU 112 and is a process for determining a trimming area by a user operation and storing it in the hard disk 114. The trimming area is an area occupied by the scope image in the processor image, and is information representing the outer edge of the scope image in the processor image by coordinates. When the user performs a predetermined operation, trimming area setting processing is executed. The trimming area setting process can be executed even when the endoscope scope 131 and the endoscope processor 132 are not connected to the filing device 110.

  In the first step S 61, the user selects a desired endoscope scope 131 from the list of types of endoscope scope 131 displayed on the monitor 133 using the keyboard 135 and the mouse 136. Thereby, the scope information indicating the type of the endoscope scope 131 is determined.

  In the next step S62, the desired endoscope processor 132 and the operation mode information of the endoscope processor 132 are selected from the list of types of the endoscope processor 132 displayed on the monitor 133 using the keyboard 135 and the mouse 136. User selects. The operation mode information of the endoscope processor 132 is information indicating whether, for example, the twin mode, the image enlargement function, and the external input function are turned on. The type of the endoscope processor 132 and the operation mode information of the endoscope processor 132 are referred to as processor information. In step S62, processor information is determined.

  In the next step S <b> 63, the user designates a trimming area using the keyboard 135 and the mouse 136 with reference to the processor image displayed on the monitor 133. More specifically, first, a processor image as shown in FIG. 12 is displayed on the monitor 133. While referring to the processor image, the user operates the mouse 136 to move the position of the rectangular frame 1201 and adjusts the size of the frame 1201 to move the frame 1201 to the position and size of the scope image. Match. When the frame 1201 matches the position and size of the scope image, a command for determining the position and size is input to the filing device 110 using the keyboard 135 and the mouse 136. Thereby, a trimming area is designated.

  In the next step S64, the filing CPU 112 acquires the coordinates of the four corners of the frame 1201 determined in step S63, and uses them as the trimming area in association with the scope information acquired in step S61 and the processor information acquired in step S62. And stored in the hard disk 114. 13 and 14 show the relationship between the trimming area stored in the hard disk 114, scope information, and processor information.

  FIG. 13 is a diagram showing the relationship between the twin mode and the image enlargement function and the type of the endoscope processor 132.

  When the endoscope scope 131 according to the first type is connected to the endoscope processor 132, when the twin mode and the image enlargement function are on, a sixth processor image shown in FIG. 7 is obtained. Therefore, the trimming area A including the left and right images is stored in the hard disk 114.

  When the endoscope scope 131 according to the first type is connected to the endoscope processor 132, when the twin mode is on and the image enlargement function is off, the third processor image shown in FIG. can get. Therefore, the trimming area B including the left and right images is stored in the hard disk 114. The trimming area B is smaller than the trimming area A.

  When the endoscope scope 131 according to the first type is connected to the endoscope processor 132, when the twin mode is off and the image enlargement function is on, the fourth processor image shown in FIG. can get. Therefore, the trimming area C including the left scope image is stored in the hard disk 114. The shape, position, and size of the trimming area C are different from those of the trimming areas A and B.

  When the endoscope scope 131 according to the first type is connected to the endoscope processor 132, when the twin mode and the image enlargement function are off, the first processor image shown in FIG. 2 is obtained. Therefore, the trimming area D including the left scope image is stored in the hard disk 114. The size of the trimming region D is different from the trimming region C, and the shape, position, and size of the trimming region D are different from those of the trimming regions A and B.

  When the twin mode is on, the processor CPU appropriately adjusts the size of the scope image according to the size of the processor image. Therefore, the positions and sizes of the two scope images included in the processor image do not change according to the type of the endoscope scope 131. Therefore, when the endoscope scope 131 according to the second type is connected to the endoscope processor 132, when the twin mode and the image enlargement function are on, the same as the sixth processor image shown in FIG. An image is obtained. Therefore, the trimming area A including the left and right images is stored in the hard disk 114.

  Similarly, when the endoscope scope 131 of the second type is connected to the endoscope processor 132, when the twin mode is on and the image enlargement function is off, the third scope shown in FIG. An image similar to the processor image is obtained. Therefore, the trimming area B including the left and right images is stored in the hard disk 114.

  When the endoscope scope 131 according to the second type is connected to the endoscope processor 132, when the twin mode is off and the image enlargement function is on, the fifth processor image shown in FIG. can get. Therefore, the trimming area E including the left scope image is stored in the hard disk 114. The shape, position, and size of the trimming area E are different from those of the trimming areas A, B, and C.

  When the endoscope scope 131 according to the second type is connected to the endoscope processor 132, when the twin mode and the image enlargement function are off, the second processor image shown in FIG. 3 is obtained. Therefore, the trimming area F including the left scope image is stored in the hard disk 114. The size of the trimming area F is different from the trimming areas C and D, and the shape, position, and size of the trimming area F are different from those of the trimming areas A and B.

  Similarly, when the endoscope scope 131 of the third type is connected to the endoscope processor 132, the trimming areas A, B, G, and H are set and stored in the hard disk 114.

  FIG. 14 is a diagram showing the relationship between the external input function and the type of the endoscope processor 132.

  When the endoscope scope 131 according to the first type is connected to the endoscope processor 132, when the external input is on, a seventh processor image shown in FIG. 8 is obtained. Therefore, the trimming area A including the left scope image and the trimming area F including the right external input image are stored in the hard disk 114. On the other hand, when the external input is off, since the external input image is not included in the processor image, only the trimming area A including the left scope image is stored in the hard disk 114.

  When the endoscope scope 131 of the second type is connected to the endoscope processor 132 and the external input is on, the left scope is similar to the endoscope scope 131 of the first type. A trimming area C including an image and a trimming area F including a right external input image are stored in the hard disk 114. On the other hand, when the external input is off, since the external input image is not included in the processor image, only the trimming area C including the left scope image is stored in the hard disk 114.

  Similarly, also when the endoscope scope 131 according to the third type is connected to the endoscope processor 132, the trimming areas D and F are set and stored in the hard disk 114.

  By executing the trimming area setting process, the trimming area is associated with the scope information and the processor information and stored in the hard disk 114.

  Next, the inspection process will be described with reference to FIG. The inspection process is a process executed by the filing CPU 112 when the procedure is started, and stores the processor image in the hard disk 114 in association with the scope information and the processor information.

  In the first step S71, a signal indicating that the procedure has been started is received from the endoscope processor 132.

  In the next step S72, the filing CPU 112 causes the processor CPU to execute information transmission processing, and acquires scope information and processor information from the endoscope processor 132.

  In the next step S73, the filing CPU 112 receives an image capture command from the processor CPU, and the processor image received when the video capture 111 receives the command is stored in the hard disk 114 as a still image.

  In the next step S74, the inspection ends. Then, the process ends.

  By executing the inspection process, the processor image is stored in the hard disk 114. In step S71, the process is started by receiving a signal from the endoscope processor 132. However, the filing apparatus 110 may start the process by requesting a signal from the endoscope processor 132. .

  Next, the report creation process will be described with reference to FIG. The process is a process executed by the filing CPU 112 in accordance with a user instruction after the procedure is completed, and is a process of cutting out a scope image from a processor image using scope information and processor information and creating a report using the cut out image. is there.

  In the first step S81, the trimming area is read from the hard disk 114 based on the scope information and the processor information received in step S72 of the inspection process.

  In the next step S82, a scope image is cut out from the processor image stored in the hard disk 114 using the trimming area read out in step S81. Then, the extracted scope image is pasted on the report. Then, the process ends.

  By executing the report creation process, a report can be created using only a scope image that does not include an information image.

  According to the present embodiment, a report can be created using only a scope image. In addition, the scope image can be accurately cut out from the processor image.

  Further, since it is not necessary to store the scope image as an image used for the report in the hard disk 114 separately from the processor image, the storage capacity can be saved.

  Since the filing device 110 stores scope information and processor information, if a trimming area is set in advance, the filing device 110 can be filing even if the type of the endoscope scope 131 and the setting of the endoscope processor 132 are changed. There is no need to change the trimming area in the apparatus 110.

  The scope information and the processor information are not limited to those described above.

  Further, the processor information may indicate the type of the endoscope processor 132 instead of the above-described function on / off. In this case, the trimming area is stored according to the type of the endoscope processor 132.

  Note that, instead of the filing device 110, the endoscope processor 132 may store the relationship between the trimming area, the scope information, and the processor information.

  Further, the region cut out in the report creation process is not limited to the scope image, and may be an information image included in the processor image. At this time, a report may be created using an information image in addition to or instead of the scope image.

DESCRIPTION OF SYMBOLS 100 Endoscope system 110 Filing apparatus 111 Video capture 112 Filing CPU
113 Memory 114 Hard Disk 115 Communication Interface 116 Display Interface 117 Network Interface 131 Endoscope Scope 132 Endoscope Processor 133 Monitor 135 Keyboard 136 Mouse

Claims (7)

Scope information indicating the type of the endoscope scope, processor information indicating the setting of the endoscope processor, and a processor image including a scope image captured by the endoscope scope and an information image indicating information on the procedure A receiving unit for receiving;
A storage unit that associates and stores the trimming region indicating the position and range of the scope image in the processor image, the scope information, and the processor information;
A processing unit that reads out the trimming area from the storage unit using the scope information and the processor information, and cuts out the scope image from the processor image using the trimming area;
When the processor receives an image capture command from the endoscope processor, the processor receives the processor image received by the receiver as a still image in the storage,
An endoscope filing device in which the processing unit cuts out the scope image from the processor image stored in the storage unit using the trimming area .   The endoscope filing apparatus according to claim 1, wherein the processing unit creates a report using a cut-out scope image obtained by cutting out the scope image from the processor image. The storage unit stores an information area indicating a position and a range of the information image in the processor image, the scope information, and the processor information in association with each other.
3. The endoscope according to claim 1, wherein the processing unit reads the information area from the storage unit using the scope information and the processor information, and cuts out the information image from the processor image using the information area. Mirror filing device. Wherein the processing unit according to claim 3 to create a report with the cutout scope images obtained by cutting out the scope image from the processor image and the clipping information image obtained by cutting out the information image from the processor image The endoscope filing device described in 1.   The storage unit further includes an input unit that inputs the scope information, the processor information, and the trimming area while associating the scope information, the processor information, and the trimming area. The endoscope filing device according to any one of claims 1 to 4, wherein the endoscope filing device is stored.   An endoscope system comprising: the endoscope scope according to claim 1; the endoscope processor according to claim 1; and the endoscope filing device according to claim 1. A trimming region indicating a position and a range of the scope image in a processor image including a scope image captured by the endoscope scope and an information image indicating subject information; scope information indicating a type of the endoscope scope; An image processing method executed by an endoscope filing device including a storage unit that stores and stores processor information representing settings of the endoscope processor,
Scope information indicating the type of endoscope scope, processor information indicating settings of the endoscope processor, a processor image including a scope image captured by the endoscope scope and an information image indicating subject information; Receiving the step,
Storing the processor image received by the receiving unit in the storage unit as a still image when receiving an image capture command from the endoscope processor;
Reading the trimming region from the storage unit using the scope information and the processor information;
Cutting out the scope image from the processor image stored in the storage unit using the trimming region.

Images