JPWO2017026277A1 - Endoscope processor - Google Patents

Abstract

To provide a processing apparatus, a processing method, and a processing program capable of displaying character information necessary for image information when image information is displayed again after recording. The light source integrated processor 3 generates an image processing unit 33 that generates image information based on an imaging signal input from the imaging element 25, and character information generation that generates all character information related to the image information generated by the image processing unit 33. Control unit 34, image generation unit 35 capable of combining the image information and the character information, and generating display image information based on the image information and the character information; The image generation control unit 311, the display control unit 312 that displays the display image information on the first display device 5, and the recording instruction information that instructs the recording of the image information generated by the image processing unit 33 are input. A recording control unit 313 that adds all character information about the image information to the information and causes the recording unit 36 to record the information.

Description

  The present invention relates to a processing device, a processing method, and a processing program for processing an input signal.

  In the medical field, an endoscope system is used for examination inside a subject. In general, an endoscope system inserts a flexible insertion portion having an elongated shape into a subject such as a patient, illuminates illumination light from the distal end of the insertion portion, and reflects reflected light of the illumination light at the distal end of the insertion portion. The in-vivo images are sequentially captured by receiving light at the imaging unit. A series of in-vivo images captured in this way are displayed as moving image images (live images) on the display of the endoscope system in almost real time after predetermined image processing is performed by the processing device. Is done. A doctor or the like performs an examination while observing the inside of the living body through a live image displayed on the display. When a release switch provided in the operation unit of the endoscope is pressed by a doctor or the like, the processing device causes the still image information (release image information) of the live image displayed on the display at the timing when the release switch is pressed. And the generated release image information is recorded in a database or the like.

  2. Description of the Related Art Conventionally, an endoscope system has been proposed that can switch whether or not character information such as patient information is superimposed on a live image displayed on a display (see, for example, Patent Document 1). In the technique described in Patent Document 1, character information is recorded according to the output of the display.

JP 2008-035881 A

  However, in the technique described in Patent Document 1, when switching is performed so that character information is superimposed on a live image on a display, release image information on which character information is superimposed is recorded, whereas a live image on a display is displayed. When the character information is switched so as not to be superimposed, release image information with no character information superimposed is recorded. For this reason, when recording release image information without superimposition of character information corresponding to a live image on a display without superimposition of character information, when viewing the release image information after recording, the release image information is related to the release image information. Text information could not be confirmed. In addition, when recording release image information with character information superimposed corresponding to a live image on a display with character information superimposed, unnecessary character information is always required when using the release image information for preparing a medical certificate. In order to acquire only the image information, the operator has to process the release image information.

  The present invention has been made in view of the above, and is a processing device capable of displaying character information necessary for image information when the image information is displayed again after recording, regardless of the display mode at the time of recording. An object of the present invention is to provide a processing method and a processing program.

  In order to solve the above-described problems and achieve the object, a processing device according to the present invention includes an image information generation unit that generates image information based on an imaging signal input from an imaging device that images a subject, and the image Based on a character information generation unit that generates all character information related to the image information generated by the information generation unit, the image information generated by the image information generation unit, and the character information generated by the character information generation unit. A display image generation unit that generates display image information, an image generation control unit that controls the synthesis of the character information with the image information in the display image generation unit, and image information generated by the image information generation unit When recording instruction information for instructing recording is input from an input device, a recording image generating unit that generates information in which all character information relating to the image information is added to the image information , Characterized by comprising a.

  Further, the processing apparatus according to the present invention is characterized in that the recording image generation unit generates recording information in which the image information and all the character information related to the image information are associated with each other.

  Further, the processing apparatus according to the present invention is characterized in that the recording image generation unit generates recording composite image information obtained by combining the image information and all character information related to the image information.

  Further, in the processing device according to the present invention, the recording image generation unit includes, in the recording composite image information, an area occupied by the image information and an area occupied by all the character information in the recording composite image information. Recording information in which the respective layout information shown is associated is generated.

  In the processing device according to the present invention, the recording image generation unit generates a recording information in which the image information and all character information related to the image information are associated with each other; A second recording image generating unit that generates a combined image information for recording by combining the image information and all character information related to the image information, and when the recording instruction information is input, The image processing apparatus further includes a selection unit that selects either one of the recording image generation unit and the second recording image generation unit and generates information in which all character information related to the image information is added to the image information. And

  Further, the processing device according to the present invention, when the recording instruction information is input from the input device, the information in which all character information related to the image information generated by the recording image generation unit is added to the image information, The recording apparatus may further include a recording control unit that causes the recording apparatus instructed in the recording instruction information to perform recording.

  In the processing device according to the present invention, the imaging device is an endoscope device that is detachably attached to the processing device.

  The processing apparatus according to the present invention is a processing apparatus that processes image information and all character information related to the image information added to the image information, and is added to the image information and image information to be processed. A display image generation unit that generates display image information based on all the character information, and the display image corresponding to the display or non-display setting of characters during image display in the display image generation unit. An image generation control unit that generates information, and a display control unit that displays the display image information generated by the display image generation unit on a display device connected to the processing apparatus.

  Further, in the processing device according to the present invention, the image information to be processed and all the character information added to the image information are associated with the image information and all the character information related to the image information, When the display of characters at the time of image display is set, the image generation control unit causes the display image generation unit to generate a composite image obtained by combining all the character information with the image information as display image information. When non-display of characters at the time of image display is set, the display image generation unit generates the image information as display image information.

  Further, in the processing device according to the present invention, the image generation control unit displays a part of the character information on the display image generation unit when the partial display of the characters at the time of image display is set. A combined image obtained by combining the character information set with the image information is generated as display image information.

  Further, the processing apparatus according to the present invention provides a composite image for recording in which the image information to be processed and all character information added to the image information are combined with the image information and all character information related to the image information. The image generation control unit causes the display image generation unit to generate the recording composite image information to be processed as display image information when display of characters at the time of image display is set, When non-display of characters at the time of image display is set, a composite image in which a mask image is combined in an area occupied by all the character information of the composite image information for processing to be displayed is displayed on the display image generation unit It is generated as image information for use.

  In the processing apparatus according to the present invention, the recording composite image information corresponds to layout information indicating an area occupied by the image information and an area occupied by all the character information in the recording composite image information. The image generation control unit, in the case where non-display of characters at the time of image display is set, displays the layout information on the composite image information for recording to the display image generation unit. Display image information obtained by synthesizing a mask image in a region occupied by all the character information shown is generated.

  In the processing device according to the present invention, the image generation control unit may cause the display image generation unit to output the composite image information for recording when partial display of characters during image display is set. Generating display image information in which a mask image is combined with an area other than an area occupied by character information for which partial display is set among areas occupied by all the character information indicated by the layout information. And

  In the processing device according to the present invention, the image information to be processed and all character information added to the image information correspond to the first information in which the image information and all character information related to the image information are associated with each other. All the characters added to the image information to be processed and the image information, having the second form of the combined image information for recording in which the image information and all the character information related to the image information are combined A discriminating unit that discriminates whether the form of information is the first form or the second form, and the image generation control unit uses the discriminating unit to determine the image information and the image to be processed; When it is determined that the form of all the character information added to the information is the first form, and when the display of the character at the time of image display is set, the display image generating unit Text information The first image is generated as display image information, and when the non-display of characters at the time of image display is set, the display image generation unit generates the image information as display image information. When the generation control unit and the determination unit determine that the form of the image information to be processed and all the character information added to the image information are the second form, display of characters when displaying the image Is set, the display image generation unit generates the recording composite image information to be processed as display image information, and when non-display of characters during image display is set, the display image A second image generation control unit that causes the generation unit to generate, as display image information, a composite image in which a mask image is combined with an area occupied by all the character information of the recording composite image information to be processed; Characterized in that was.

  The processing apparatus according to the present invention is characterized in that the image information to be processed is image information based on an imaging signal imaged by an endoscope apparatus including an imaging element.

  The processing device according to the present invention includes an image information generation unit that generates image information based on an imaging signal input from an imaging device that images a subject, and all of the image information generated by the image information generation unit. When a character information generating unit that generates character information and recording instruction information for instructing recording of the image information generated by the image information generating unit are input from the input device, all the character information related to the image information is input to the image A recording image generation unit that generates information added to information, and the image information generated by the image information generation unit and the character information generated by the character information generation unit, or the recording image generation unit A display image generating unit that generates display image information based on information obtained by adding all character information related to the image information to the image information; Characterized by comprising an image generation control unit for controlling the generation of display image information.

  The processing method according to the present invention is a processing method executed by a processing device that processes an imaging signal input from an imaging device that images a subject, and the image information generation unit performs image information based on the imaging signal. The image information generation process for generating the image information, the character information generation unit for generating all the character information related to the image information generated in the image information generation process, and the image generation control unit for the image information For the display image generation unit that generates display image information based on the image information generated in the generation process and the character information generated in the character information generation process, the character information for the image information The image generation control process for controlling the composition and the recording instruction information for the recording image generation unit to instruct the recording of the image information generated in the image information generation process are input. When input from the device, characterized in that it comprises a and a recording image generation processing to generate all of the information character information added to the image information on the image information.

  The processing method according to the present invention is a processing method executed by a processing device that processes image information and all character information related to the image information added to the image information. Supports display / non-display setting of characters when displaying images for the display image generator that generates display image information based on the target image information and all character information added to the image information. The display image generation control process for generating the display image information and the display control unit display the display image information generated in the display image generation control process on the display device connected to the processing apparatus. Display control processing.

  In addition, the processing program according to the present invention includes an image information generation procedure in which an image information generation unit generates image information based on the imaging signal in a processing apparatus that processes an imaging signal input from an imaging apparatus that images a subject. And a character information generation procedure for generating all character information relating to the image information generated in the image information generation procedure, and an image generation control unit generated in the image information generation procedure. Image generation control for controlling the synthesis of the character information with the image information for a display image generating unit that generates display image information based on the image information and the character information generated in the character information generation procedure The recording instruction information for instructing the recording of the image information generated in the image information generation procedure by the recording image generation unit is input from the input device. Case, characterized in that to execute a recording image generating step of generating an information added to the image information of all the character information on the image information.

  The processing program according to the present invention includes a processing device that processes image information and all character information related to the image information added to the image information, and an image generation control unit includes the image information and the image to be processed. The display image information corresponding to the display or non-display setting of characters at the time of image display is displayed on the display image generation unit that generates display image information based on all the character information added to the information. A display image generation control procedure to be generated, and a display control unit to display the display image information generated in the display image generation control procedure on a display device connected to the processing device. It is characterized by making it.

  According to the present invention, when image information is displayed again after recording, character information necessary for the image information can be displayed regardless of the display mode at the time of recording.

FIG. 1 is a schematic diagram showing a schematic configuration of an endoscope system according to Embodiment 1 of the present invention. FIG. 2 is a schematic diagram illustrating a configuration of the endoscope and the light source integrated processor illustrated in FIG. 1. FIG. 3 is a schematic diagram showing a configuration of the image display apparatus shown in FIG. FIG. 4 is a flowchart illustrating a processing procedure of processing executed by the light source integrated processor illustrated in FIG. 1 on an imaging signal input from the endoscope. FIG. 5 is a flowchart showing a processing procedure of processing for causing the second display device to display the release image information instructed to display an image by the image display device shown in FIG. FIG. 6 is a diagram illustrating an example of a live image displayed on the first display device illustrated in FIG. 2. FIG. 7 is a diagram illustrating an example of the group information recorded in the recording unit illustrated in FIG. 2 and the display image information generated in the image display apparatus illustrated in FIG. 8 is a diagram illustrating an example of the set information recorded in the recording unit illustrated in FIG. 2 and the display image information generated in the image display apparatus illustrated in FIG. FIG. 9 is a diagram showing another example of a live image displayed on the first display device shown in FIG. FIG. 10 is a diagram illustrating an example of the set information recorded in the recording unit illustrated in FIG. 2 and the display image information generated in the image display apparatus illustrated in FIG. FIG. 11 is a diagram illustrating an example of the set information recorded in the recording unit illustrated in FIG. 2 and the display image information generated in the image display apparatus illustrated in FIG. FIG. 12 is a diagram illustrating an example of the set information recorded in the recording unit illustrated in FIG. 2 and the display image information generated in the image display apparatus illustrated in FIG. FIG. 13 is a schematic diagram illustrating a configuration of an endoscope and a light source integrated processor according to the second embodiment. FIG. 14 is a schematic diagram illustrating a configuration of the image display device according to the second embodiment. FIG. 15 is a flowchart illustrating a processing procedure of processing executed by the light source integrated processor illustrated in FIG. 13 on the imaging signal input from the endoscope. FIG. 16 is a diagram illustrating an example of the set information recorded in the recording unit illustrated in FIG. 13 and the display image information generated in the image display apparatus illustrated in FIG. FIG. 17 is a flowchart showing a processing procedure of processing for causing the image display apparatus shown in FIG. 14 to display image information instructed to display an image on the second display apparatus. FIG. 18 is a diagram illustrating an example of display image information generated in the image display apparatus illustrated in FIG. 14. FIG. 19 is a schematic diagram illustrating a configuration of an endoscope and a light source integrated processor according to the third embodiment. FIG. 20 is a schematic diagram illustrating a configuration of the image display apparatus according to the third embodiment. FIG. 21 is a flowchart illustrating a processing procedure of processing executed by the light source integrated processor illustrated in FIG. 19 on the imaging signal input from the endoscope. FIG. 22 is a flowchart illustrating a processing procedure of a process in which the image display apparatus illustrated in FIG. 20 displays image information instructed to display an image on the second display apparatus. FIG. 23 is a schematic diagram illustrating a configuration of an endoscope and a light source integrated processor according to the fourth embodiment. FIG. 24 is a schematic diagram illustrating a configuration of an endoscope and a light source integrated processor according to the first modification of the fourth embodiment. FIG. 25 is a schematic diagram illustrating a configuration of an endoscope and a light source integrated processor according to the second modification of the fourth embodiment.

  In the following description, a processing device (processor) of a light source integrated endoscope system will be described as a mode for carrying out the present invention (hereinafter referred to as “embodiment”). Moreover, this invention is not limited by this embodiment. Furthermore, the same code | symbol is attached | subjected to the same part in description of drawing.

(Embodiment 1)
FIG. 1 is a schematic diagram illustrating a schematic configuration of the endoscope system according to the first embodiment of the present invention. As shown in FIG. 1, an endoscope system 1 according to the first embodiment includes an endoscope 2, a light source integrated processor 3 (processing device), a first input device 4, a first display device 5, and an image display. A device 7, a second input device 8, and a second display device 9 are provided. The light source integrated processor 3 and the image display device 7 are communicably connected via the network 6.

  The endoscope 2 is introduced into a subject and images the inside of the subject to generate an imaging signal in the subject. The endoscope 2 includes an insertion part 21 to be inserted into a subject, an operation part 22 on the proximal end side of the insertion part 21 and held by an operator, and a flexible universal extending from the operation part 22. A code 23.

  The insertion portion 21 is realized using an illumination fiber (light guide cable), an electric cable, and the like. The insertion portion 21 includes a distal end portion 21a having an image sensor for imaging the inside of the subject, a bendable bending portion 21b configured by a plurality of bending pieces, and a flexible portion provided on the proximal end side of the bending portion 21b. Flexible tube portion 21c having the property. The distal end portion 21a includes an illumination unit that illuminates the inside of the subject via an illumination lens, an observation unit that images the inside of the subject, an opening 21d that communicates with the processing tool channel, and an air / water supply nozzle (not shown). ) Is provided.

  The operation unit 22 includes a bending knob 22a that bends the bending portion 21b in the vertical direction and the left-right direction, a treatment instrument insertion portion 22b in which a treatment instrument such as a biological forceps and a laser knife is inserted into the body cavity of the subject, and a light source integrated type. And a plurality of switch units 22c for operating peripheral devices such as the processor 3, the air supply device, the water supply device, and the gas supply device. The treatment instrument inserted from the treatment instrument insertion portion 22b is exposed from the opening 21d at the distal end of the insertion portion 21 via a treatment instrument channel provided inside. The switch unit 22c includes a release switch. When the release switch is pressed during endoscopy, release information (recording instruction information) is input to the control unit 31 of the light source integrated processor 3 described later. The release information is based on image information sequentially generated by an image processing unit 33 (image information generation unit) to be described later, and a still image corresponding to an image (live image) displayed on the first display device 5 when pressed. This is instruction information for generating image information (release image information) and instructing recording of the generated release image information. Note that the release information is not limited to the endoscope 2 and can also be input from the first input device 4.

  The universal cord 23 is configured using an illumination fiber and an electric cable. The universal cord 23 has a connector 20 that is detachable from the connector 30 of the light source integrated processor 3. The universal cord 23 transmits an image signal picked up by the image pickup device provided at the distal end portion 21 a to the light source integrated processor 3 via the connectors 20 and 30. The universal cord 23 propagates the illumination light emitted from the light source integrated processor 3 to the distal end portion 21a via the connectors 20 and 30, the operation portion 22, and the flexible tube portion 21c.

  The light source integrated processor 3 performs predetermined display image processing on an imaging signal output from the endoscope 2 with the endoscope 2 being detachably attached thereto. The light source integrated processor 3 performs predetermined display image processing on the imaging signal in the subject imaged by the imaging device at the distal end portion 21 a of the endoscope 2 input via the universal code 23. The light source integrated processor 3 controls each unit of the light source integrated processor 3 based on various instruction information transmitted from the switch unit 22 c in the operation unit 22 of the endoscope 2 via the universal cord 23. The light source integrated processor 3 includes a light source unit 32 (described later) configured using a light source, a condenser lens, and the like, and connects light emitted from the light source via the connectors 20 and 30 and the illumination fiber of the universal cord 23. Then, the light is supplied to the endoscope 2 as illumination light for illuminating the subject that is the subject. The light source integrated processor 3 records information obtained by adding all character information relating to image information to the image information in a recording unit 36 described later.

  The first input device 4 is connected to the light source integrated processor 3, receives input of various instruction information, and inputs the instruction information to the light source integrated processor 3. The first input device 4 receives input of various instruction information related to the examination by the endoscope 2. Specifically, the first input device 4 includes patient information (for example, ID, date of birth, name, etc.) related to the patient as the subject, identification information (for example, ID and examination corresponding items) of the endoscope 2, and examination contents. And input of various instruction information such as presence / absence of superimposition of character information on the live image. The first input device 4 is realized using an operation device such as a mouse, a keyboard, and a touch panel. The first input device 4 may input character information by operating a keyboard displayed on the touch panel. The first input device 4 may input instruction information by remote operation from a portable terminal such as a tablet PC. Of course, various instruction information may be input to the control unit 31 of the light source integrated processor 3 from a button provided on the front panel of the light source integrated processor 3 instead of from the first input device 4. 3 may be input to the control unit 31 of the light source integrated processor 3 by an operation on a touch panel provided on the front panel 3.

  The first display device 5 is connected to the light source integrated processor 3 and sequentially displays and outputs live images after image processing by the light source integrated processor 3. The first display device 5 displays various types of information including images corresponding to display image information that has been subjected to predetermined image processing by the light source integrated processor 3. Thereby, an operator such as a doctor determines the observation and properties of a desired position in the subject by operating the endoscope 2 while viewing the live image in the subject displayed on the first display device 5. can do. The 1st display apparatus 5 is comprised using the display etc. which used the liquid crystal or organic EL.

  The image display device 7 receives the information recorded in the recording unit 36 of the light source integrated processor 3 via the network 6 and generates display image information. The image display device 7 receives the image information and character information to be displayed, performs image processing corresponding to the instruction information input from the second input device 8, and then outputs the image information to the second display device 9.

  The second input device 8 is connected to the image display device 7, receives input of various instruction information, and inputs the instruction information to the image display device 7. The second input device 8 is realized by using an operation device such as a mouse, a keyboard, and a touch panel, and inputs various instruction information for displaying again image information by the endoscope 2 among information recorded in the recording unit 36. Accept. Specifically, the second input device 8 displays patient information (for example, ID, date of birth, name, etc.) related to a patient who is a subject for identifying image information to be displayed and image display instruction information indicating examination contents. And input of various information such as character display setting information for instructing the setting of character display or non-display at the time of image display.

  The second display device 9 is connected to the image display device 7 and displays and outputs the display image information generated by the image display device 7. The second display device 9 is configured using a display or the like using liquid crystal or organic EL.

  Next, the configuration of the endoscope 2 and the light source integrated processor 3 shown in FIG. 1 will be described. FIG. 2 is a schematic diagram showing a configuration of the endoscope 2 and the light source integrated processor 3 shown in FIG. In FIG. 2, the first input device 4 and the first display device 5 are also shown.

  As shown in FIG. 2, the endoscope 2 is introduced into a subject and images the inside of the subject to generate an imaging signal in the subject. The endoscope 2 is optically and electrically connected to the light source integrated processor 3 by connecting the connector 20 to the connector 30 of the light source integrated processor 3. The endoscope 2 includes an objective lens 24, an image sensor 25, a signal processing unit 26, an illumination lens 27, and a memory 28 at the distal end portion 21a, and an illumination fiber (light guide cable) extending from the distal end to the proximal connector 20. ) And electrical cables.

  The objective lens 24 is configured using one or a plurality of lenses, and is provided in each front stage of the image sensor 25. The objective lens 24 has an optical zoom function for changing the angle of view and a focus function for changing the focus.

  The image pickup device 25 is a CMOS image pickup device or a CCD image pickup device. A plurality of pixels that receive light from a subject irradiated with light on a light receiving surface and photoelectrically convert the received light to generate an image pickup signal are a matrix. Arranged.

  The signal processing unit 26 includes an analog processing unit that performs noise removal processing and clamping processing on an imaging signal (analog) output from the imaging element 25 and an A / D conversion unit that performs A / D conversion processing. Output signal (digital). When the endoscope 2 is attached to the light source integrated processor 3, the image pickup signal (digital) generated by the image pickup device 25 and processed by the signal processing unit 26 is transmitted through the electric cable and the connectors 20 and 30. It is output to the body shape processor 3. Note that there is a configuration in which the light source integrated processor 3 includes the signal processing unit 26.

  The illumination lens 27 is located at the tip of a light guide cable extending from the connector 20. When the endoscope 2 is attached to the light source integrated processor 3, light emitted from the light source unit 32 of the light source integrated processor 3, which will be described later, passes through the light guide cable and the distal end of the endoscope 2. The illumination lens 27 illuminates the subject.

  The memory 28 records the identification information of the endoscope 2, the model number, the type of the image sensor 25, and the like. The memory 28 may record various parameters for image processing on the image signal captured by the image sensor 25, such as a white balance (WB) adjustment parameter. When the endoscope 2 is attached to the light source integrated processor 3, various information recorded by the memory 28 is output to the control unit 31 of the light source integrated processor 3 through communication processing with the light source integrated processor 3. The

  The light source integrated processor 3 is detachably mounted with an endoscope 2 and performs predetermined image processing on an imaging signal transmitted from the mounted endoscope 2. The light source integrated processor 3 supplies illumination light to the endoscope 2 when the endoscope 2 is mounted via the connectors 20 and 30. The light source integrated processor 3 includes a connector 30, a control unit 31, a light source unit 32, an image processing unit 33, a character information generation unit 34, an image generation unit 35, a recording unit 36, and a communication unit 37.

  By fitting the connector 20 of the endoscope 2 into the connector 30, the endoscope 2 and the light source integrated processor 3 are electrically and optically connected.

  The control unit 31 is realized using a CPU or the like. The control unit 31 controls the processing operation of each part of the light source integrated processor 3 by transferring instruction information and data to each component of the light source integrated processor 3. When the endoscope 2 is attached to the light source integrated processor 3, the control unit 31 is connected to the imaging device 25, the signal processing unit 26, and the memory 28 of the endoscope 2 via each cable, It also controls the image sensor 25, the signal processing unit 26, and the memory 28. The control unit 31 includes an image generation control unit 311, a display control unit 312, a recording control unit 313, and a communication control unit 314.

  The image generation control unit 311 is based on instruction information for instructing whether or not to superimpose character information on the live image input from the first input device 4 and various instruction information such as release information input from the operation unit 22. The image generation process of the image generation unit 35 is controlled.

  The display control unit 312 converts the display image information generated by the image generation unit 35 into image information in a format that can be displayed and output by the first display device 5, and causes the first display device 5 to display the image information. The display control unit 312 includes a digital signal to analog signal converter (DAC) and an encoder, converts the image information input from the image generation unit 35 from, for example, a digital signal to an analog signal, and converts the converted analog signal. The image information is changed to a format such as a high-definition method and output to the first display device 5.

  When the release information is input to the control unit 31, the recording control unit 313 adds all of the release image information generated by the character information generation unit 34 to the release image information generated by the release image generation unit 352 described later. Information to which character information is added is generated, and recording of the generated information in the recording unit 36 is controlled. When the release information is input, the recording control unit 313 records group information (recording information) in which the release image information and all character information related to the release image information are associated with each other in the recording unit 36. Accordingly, in the recording unit 36, the release image information G1 and the release image information G1, which is a set of the release image information G1 and the character information group C1 including all character information related to the release image information G1, are captured. Recorded in the patient folder D1. Next, when the release information is input to the control unit 31, the recording control unit 313 releases the release image information G2 corresponding to the live image displayed on the first display device 5 when the release information is input. Group information P2 having a character information group C2 having all character information related to the release image information G2 is recorded in the folder D1. In this way, each time the release information is input, the light source integrated processor 3 releases the release image information corresponding to the live image displayed on the first display device 5 when the release information is input, and all of the release image information. The group information associated with the character information is recorded in the recording unit 36. The recording control unit 313 records information in which the release image information is associated with all the character information related to the release image information in an external recording device connected to the light source integrated processor 3 through the network 6. Also good.

  The communication control unit 314 controls communication processing in the communication unit 37 described later.

  The light source unit 32 includes a light source driver and a light source, and supplies illumination light to the endoscope 2 under the control of the control unit 31. The light source of the light source part 32 is comprised by white LED which emits white light, for example. In addition, the light source of the light source unit 32 uses a plurality of LEDs (for example, red LED, green LED, and blue LED) that emit light of different wavelength bands, and combines the light emitted from each LED to illuminate light of a desired color tone. May be obtained. Further, the light source unit 32 may employ a frame sequential configuration that emits light of different color components in time series. Further, the light source unit 32 may use a laser light source. The light source unit 32 may include a light source such as a xenon lamp or a halogen lamp, and a light source control component that controls each member of the optical filter, the diaphragm, and the light source unit 32.

  The image processing unit 33 generates image information based on the imaging signal input from the signal processing unit 26. The image processing unit 33 performs an optical black subtraction (OB) process, a demosaicing process, a white balance (WB) adjustment process, an electronic zoom process, an edge on the input image signal in accordance with the type of the image sensor 25 and the like. Image information generated by performing enhancement processing or the like is output.

  The character information generation unit 34 generates all character information related to the image information generated by the image processing unit 33 and outputs it to the control unit 31. The character information includes identification information of the endoscope 2 received from the memory 28 of the endoscope 2, patient information input by the first input device 4, examination date / time and examination contents, and various information read from the recording unit 36. Observation information about images (observation mode (NBI mode, etc.), enhancement level, brightness level), information about peripheral devices such as the first display device 5 to which the light source integrated processor 3 is connected, operation processing of the light source integrated processor 3 All the information related to the image information generated by the image processing unit 33, such as the instruction information selected for. The character information is acquired by the control unit 31 from the endoscope 2, the first input device 4, the recording unit 36 or an external device connected via the network 6, and is output to the character information generation unit 34.

  The image generation unit 35 includes a display image generation unit 351 and a release image generation unit 352.

  The display image generation unit 351 can synthesize the image information generated by the image processing unit 33 and the character information generated by the character information generation unit 34, and displays the display image information based on the image information and the character information. Generate. The display image generation unit 351 performs on-screen display (OSD) processing. Specifically, the display image generation unit 351, when instructed to superimpose characters on the live image, combines the character information instructed to superimpose into image information according to the control of the image generation control unit 311. Display image information is generated. Further, the display image generation unit 351 outputs only the image information as display image information according to the control of the image generation control unit 311 when the non-superimposition of characters on the live image is instructed.

  When the release information is input from the operation unit 22 to the control unit 31 by pressing the release switch, the release image generation unit 352 generates a release image from the image information generated by the image processing unit 33 based on the control of the recording control unit 313. Release image information corresponding to the live image displayed on the first display device 5 when the information is input is generated. The release image generation unit 352 generates recording information in which all character information related to the release image information generated by the character information generation unit 34 is added to the generated release image information. The release image generation unit 352 generates set information in which the release image information is associated with all character information related to the release image information. The release image generation unit 352 includes an image processing circuit including an encoding / decoding circuit.

  The recording unit 36 is realized using a volatile memory or a nonvolatile memory, and records various programs for operating the light source integrated processor 3. The recording unit 36 temporarily records information being processed by the light source integrated processor 3. The recording unit 36 records the imaging signal output from the endoscope 2. The recording unit 36 records the layout information 361 for the live image displayed on the first display device 5 according to the type of the endoscope 2, the type of the first display device 5, and the like. As described above, the recording unit 36 records set information in which release image information is associated with all character information related to the release image information. Further, the recording unit 36 may be configured using a memory card or the like attached from the outside of the light source integrated processor 3, which is separate from the light source integrated processor 3. Alternatively, the recording unit 36 may be configured by a recording device that is locally connected to the light source integrated processor 3 and not via the network 6.

  The communication unit 37 is a communication I / F that communicates with an external device via the network 6.

  Next, the configuration of the image display device 7 shown in FIG. 1 will be described. FIG. 3 is a schematic diagram showing a configuration of the image display device 7 shown in FIG. In FIG. 3, the recording unit 36, the second input device 8, and the second display device 9 are also shown.

  The image display device 7 processes the information read from the recording unit 36. The image display device 7 includes a communication unit 71, a control unit 72, a display image generation unit 73, and a recording unit 74.

  The communication unit 71 is a communication I / F that communicates with an external device via the network 6. The communication unit 71 records image information and all character information added to the image information from the recording unit 36 that records a plurality of pieces of image information and all character information related to the image information added to the image information. The set information including For example, when the instruction information for instructing the display of the release image information G1 in the folder D1 is input by the second input device 8, the communication unit 71 receives the set including the release image information G1 from the folder D1 in the recording unit 36. Read information P1. Therefore, the communication unit 71 receives all the character information group C1 associated with the release image information G1 together with the release image information G1 by receiving the set information P1.

  The control unit 72 is realized using a CPU or the like. The control unit 72 controls the processing operation of each part of the image display device 7 by transferring instruction information and data to each component of the image display device 7. The control unit 72 includes an image generation control unit 721 and a display control unit 722.

  The image generation control unit 721 sets the display or non-display of the character information when displaying the image according to the setting information instructing the display or non-display setting of the character information when displaying the image input from the second input device 8. Do. The image generation control unit 721 causes the display image generation unit 73 (to be described later) to generate display image information corresponding to the setting for displaying or not displaying characters during image display.

  The display control unit 722 converts the display image information generated by the display image generation unit 73 into image information in a format that can be displayed on the second display device 9 and causes the second display device 9 to display the image information. The display control unit 722 has the same configuration and function as the display control unit 312.

  The display image generation unit 73 can synthesize the image information in the set information read by the communication unit 71 and all the character information added to the image information, and can display the image information based on the set information. Display image information corresponding to the display or non-display setting of the character information is generated. When the display of characters at the time of image display is set, the image generation control unit 721 causes the display image generation unit 73 to generate a combined image in which all character information is combined with release image information as display image information. When non-display of characters at the time of image display is set, the display image generation unit 73 generates release image information as display image information.

  The recording unit 74 is realized using a volatile memory or a non-volatile memory, and records various programs for operating the image display device 7. The recording unit 74 temporarily records information being processed by the image display device 7.

  FIG. 4 is a flowchart illustrating a processing procedure of processing executed by the light source integrated processor 3 on the imaging signal input from the endoscope 2. As shown in FIG. 4, in the light source integrated processor 3, the control unit 31 determines whether or not an imaging signal is input from the endoscope 2 (step S1). When it is determined that the imaging signal is not input (step S1: No), the control unit 31 repeats the determination process of step S1 until the imaging signal is input.

  When the control unit 31 determines that an imaging signal has been input (step S1: Yes), the image processing unit 33 executes image information generation processing for generating image information based on the input imaging signal (step S2). ), The character information generation unit 34 executes a character information generation process for generating all character information related to the image information generated by the image processing unit 33 (step S3).

  The image generation control unit 311 determines whether or not a character display on the live image has been instructed based on the instruction information input from the first input device 4 (step S4). When the image generation control unit 311 determines that the character display on the live image has been instructed (step S4: Yes), the image generation unit 35 sends the display 2 to the endoscope 2 and the first display device 5 as display image information. A composite image generation process is executed to generate a composite image in which the character information instructed to be displayed is combined with the image information generated by the image processing unit 33 among the character information generated by the character information generation unit 34 with the corresponding layout. (Step S5). When the image generation control unit 311 determines that display of characters on the live image is not instructed (step S4: No), the image processing unit 33 generates image information for display from the image generation unit 35. The image information is converted into a layout corresponding to the endoscope 2 and the first display device 5 and output to the display control unit 312. The display control unit 312 performs display control processing for displaying the display image information generated by the image generation unit 35 on the first display device 5 (step S6).

  The recording control unit 313 determines whether release information has been input from the operation unit 22 (step S7). When the recording control unit 313 determines that the release information is not input (step S7: No), the process related to the imaging signal input from the endoscope 2 is terminated. When the recording control unit 313 determines that the release information has been input (step S7: Yes), the release image generation unit 352 controls the release from the image information generated by the image processing unit 33 under the control of the recording control unit 313. A release image generation process for generating release image information corresponding to the live image displayed on the first display device 5 when the information is input is performed (step S8). Subsequently, the release image generation unit 352 performs character information association processing by associating the generated release image information with all character information related to the release image information to form one set of information (step S9). The recording control unit 313 performs a recording control process for recording this set information in the recording unit 36 (step S10). As a result, regardless of whether or not the live image at the time of inspection displayed on the first display device 5 is superimposed, the recording unit 36 is instructed to record the release image information and all the characters related to the release image information. One set of information associated with the information is recorded.

  FIG. 5 is a flowchart illustrating a processing procedure of processing for causing the second display device 9 to display the release image information for which the image display device 7 has been instructed to display an image. As shown in FIG. 5, in the image display device 7, the control unit 72 determines whether or not an image display is instructed based on whether or not image display instruction information is input by the second input device 8 (step S <b> 11). . When it is determined that the image display instruction information is not input and the image display is not instructed (step S11: No), the control unit 72 repeats the determination process of step S11 until the image display instruction information is input.

  When the control unit 72 determines that image display has been instructed upon receiving input of image display instruction information (step S11: Yes), the communication unit 71 displays the release image information to be displayed and all of the release image information added to the release image information. An information reception process is performed for receiving the group information having the character information via the network 6 (step S12).

  Subsequently, the image generation control unit 721 performs display image generation control processing for causing the display image generation unit 73 to generate display image information corresponding to the display or non-display setting of character information at the time of image display. Do. Specifically, the image generation control unit 721, together with the release image information to be displayed, based on the setting information that instructs the display or non-display setting of the character information at the time of image display input from the second input device 8. It is determined whether or not to display character information (step S13). If it is determined that character information is to be displayed together with the release image information to be displayed (step S13: Yes), the display image generation unit 73 stores all the character information associated with the release image information to be displayed in the group information. Character synthesis control processing for generating a synthesized image synthesized with the release image information as display image information is performed (step S14). On the other hand, when the image generation control unit 721 determines not to display the character information together with the release image information to be displayed (step S13: No), the display image generation unit 73 instructs the display image generation unit 73 to release the release image information to be displayed. Character non-synthesis control processing is performed in which only the release image information to be displayed is output as display image information without synthesizing the character information associated with the image information (step S15). The display control unit 722 converts display image information generated by the display image generation unit 73 into image information in a format that can be displayed and output on the second display device 9, and causes the second display device 9 to display the display control process. Is performed (step S16).

  FIG. 6 is a diagram illustrating an example of a live image displayed on the first display device 5. As shown in FIG. 6, the live image Ed displayed on the first display device 5 displays an area E1 where the in-vivo image is displayed in real time and character information corresponding to the in-vivo image displayed in the area E1. And a layout having an area E2. In the live image Ed, for example, the text information indicated in the area E3 in the area E2 is not instructed to be superimposed, and thus the area E3 is blank.

  7 and 8 show group information recorded in the recording unit 36 in response to the release information input when the live image Ed is displayed by the light source integrated processor 3, and display image information generated in the image display device 7. It is a figure which shows an example. In the light source integrated processor 3, even when a live image on which all character information is not superimposed is displayed on the first display device 5 like the live image Ed (see FIG. 6), As shown in a) and FIG. 8A, the release image information G1 generated based on the in-vivo image displayed in the live image Ed, and the character information including all character information related to the release image information G1 The group information P1 associated with the group C1 is recorded in the recording unit 36. Therefore, in the image display device 7, when the image display of the release image information G1 is instructed, all the character information related to the release image information G1 is acquired together with the release image information G1 by reading the group information P1. be able to. When the display image generating unit 73 of the image display device 7 is set to display the character information together with the release image information to be displayed, as shown in FIG. 7B, the release image information is displayed. G1 is arranged in the area F1, and a composite image Fd1 is generated in which all character information of the character information group C1 is arranged in the area F2. By displaying the composite image Fd1 on the second display device 9, even when the operator confirms the live image in a state where the character information is not superimposed at the time of the inspection, the release image information G1 is newly displayed. When confirming, it is possible to confirm all character information related to the release image information G1 together with the release image information G1.

  When the display image generating unit 73 of the image display device 7 is set to display only the release image information to be displayed without displaying the character information, as shown in FIG. 8B, the release image information is displayed. The composite image Fd2 is generated in which the image information G1 is arranged in the region F1, and the region F2 is blank. By displaying the composite image Fd2 on the second display device 9, only the release image information G1 can be displayed on the screen.

  FIG. 9 is a diagram illustrating another example of a live image displayed on the first display device 5. As shown in the live image Hd in FIG. 9, in the layout in which the live image is displayed on the entire display area H <b> 1, the character information overlaps the live image when the character information is displayed in a superimposed manner. In many cases, non-display is set and only the live image is displayed on the first display device 5. FIGS. 10 and 11 show group information recorded in the recording unit 36 in response to the release information input when the live image Hd is displayed by the light source integrated processor 3, and display image information generated in the image display device 7. It is a figure which shows an example. In the light source integrated processor 3, even when only image information is displayed as in the live image Hd (see FIG. 9), the release image information G1 corresponding to the live image Hd and the character information group C1 are associated. In order to record the set information P1 (see (a) of FIG. 10 and (a) of FIG. 11) in the recording unit 36, the image display device 7 reads out the set information P1 and thereby releases the set information P1. The character information group C1 can be acquired.

  Similarly, when the display image generation unit 73 is set to display the character information together with the image information, as shown in FIG. 10B, the display image generation unit 73 displays the release image information G1 in the entire area J1. Then, the composite image Jd1 is generated by superimposing the character information on the area J2 on the release image information G1. When the non-display of the character information is set, the display image generating unit 73 does not superimpose the release image information G1 on the region J2 without superimposing the character information, as shown in FIG. By generating the composite image Jd2 arranged in the region J1, the release image information G1 is displayed on the full screen on the second display device 9.

  As described above, according to the first embodiment, the light source integrated processor 3 displays the release information when the release information is input, regardless of whether the live image at the time of inspection is superimposed or not. The set information in which the release image information corresponding to the live image and the character information related to the release image information are associated with each other is recorded in the recording unit 36. For this reason, since the image display device 7 can acquire all the character information related to the release image information together with the release image information to be displayed and display it on the second display device 9, an operator such as a doctor can When the release image information is browsed again after recording, all necessary character information can be confirmed. In addition, since the image display device 7 can be set to display or not display character information during image display, it is possible to flexibly select whether or not character information is superimposed on the release image information after recording. Therefore, according to the first embodiment, it is possible to display the character information necessary for the image information when the image information is displayed again after recording, regardless of the display mode at the time of recording, and the release after recording. Whether or not character information is superimposed on image information can be flexibly selected.

  In FIG. 7, the example in which the display image generation unit 73 of the image display device 7 generates the composite image Fd1 in which all the character information of the character information group C1 is arranged in the region F2 has been described. By operating the 2-input device 8, the character information to be arranged in the area F2 can be freely selected. FIG. 12 shows an example of the set information recorded in the recording unit 36 corresponding to the release information input when the live image Ed is displayed by the light source integrated processor 3 and the display image information generated in the image display device 7. FIG. The operator operates the second input device 8 to set the patient information C1a of the patient information C1a related to the patient and the observation information C1b related to the image observation in the character information group C1 of FIG. You can also In this case, the display image generation unit 73 of the image display device 7 arranges the release image information G1 in the region F1, and the observation information C1b in the character information group C1 in the region F2, as shown in FIG. Is generated and displayed on the second display device 9.

(Embodiment 2)
Next, a second embodiment will be described. The endoscope system according to the second embodiment has a schematic configuration similar to that of the endoscope system according to the first embodiment. FIG. 13 is a schematic diagram illustrating a configuration of the endoscope 2 and the light source integrated processor 203 according to the second embodiment. FIG. 13 also shows the first input device 4 and the first display device 5.

  As illustrated in FIG. 13, the light source integrated processor 203 includes a control unit 231 having a recording control unit 2313 and an image generation unit 235 having a recording composite image generation unit 2352. The control unit 231 has the same function as the control unit 31 shown in FIG.

  When the release information is input, the recording control unit 2313 causes the recording composite image generation unit 2352 to generate recording composite image information, and the recording composite image information generated by the recording composite image generation unit 2352 is recorded in the recording unit 36. To record. The recording control unit 2313 gives the recording composite image generation unit 2352 the layout information indicating the area occupied by the image information and the area occupied by all the character information in the recording composite image information. The associated set information (recording information) is generated. The recording control unit 2313 records this set information in the recording unit 36. Therefore, in the recording unit 36, the combined image information M1 for recording in which the image information (still image information) B1 instructed to be recorded and the character information group L1 including all the character information related to the image information B1 are combined, Group information Q1, which forms one set with the layout information A1 of the recording composite image information M1, is recorded in the folder D2 of the patient in which the image information B1 is captured. Next, when the release information is input to the control unit 231, the recording control unit 2313 causes the image information B2 corresponding to the live image displayed on the first display device 5 when the release information is input and the image information. A set of combination information Q2 is recorded in the folder D2 with the combined image information M2 for recording in which the character information group L2 having all the character information related to B2 is combined and the layout information A2 of the combined image information M2 for recording. The The recording unit 36 records a plurality of set information including the combined image information for recording and layout information obtained by combining the image information and all the character information related to the image information.

  The recording composite image generation unit 2352 generates recording composite image information obtained by combining the image information generated by the image processing unit 33 and all character information related to the image information generated by the character information generation unit 34. When the release information is input from the operation unit 22 to the control unit 231, the recording composite image generation unit 2352 is image information generated by the image processing unit 33 based on the control of the recording control unit 2313, and the release information The composite image information for recording is generated by synthesizing the image information corresponding to the live image displayed on the first display device 5 at the time of input and all the character information related to the image information generated by the character information generation unit 34. The recording composite image generation unit 2352 generates the recording composite image information with a layout corresponding to, for example, the endoscope 2 and the first display device 5. The recording composite image generation unit 2352 includes set information in which the recording composite image information is associated with layout information indicating the area occupied by the image information and the area occupied by all the character information in the recording composite image information. Generate.

  FIG. 14 is a schematic diagram illustrating a configuration of the image display device 207 according to the second embodiment. In FIG. 14, the recording unit 36, the second input device 8, and the second display device 9 are also shown. As illustrated in FIG. 14, the image display device 207 includes a control unit 272 that has the same function as the control unit 72 and includes an image generation control unit 2721. The communication unit 71 receives the set information including the composite image information to be processed among the information recorded in the recording unit 36 from the light source integrated processor 203, thereby the composite image information to be processed to be processed. At the same time, layout information associated with the recording composite image information is also read.

  When the display of character information at the time of image display is set, the image generation control unit 2721 causes the display image generation unit 73 to generate the composite image information for recording in the set information to be processed as display image information. When non-display of characters at the time of image display is set, the display image generation unit 73 displays a composite image in which a mask image is combined in an area occupied by all character information of the recording composite image information to be processed. Generate as image information. When the non-display of characters at the time of image display is set, the image generation control unit 2721 causes the display image generation unit 73 to include layout information included in the set information with respect to the recording composite image information to be processed. The display image information is generated by synthesizing the mask image in the area occupied by all the character information indicated by.

  FIG. 15 is a flowchart illustrating a processing procedure of processing executed by the light source integrated processor 203 on the imaging signal input from the endoscope 2. Steps S21 to S27 shown in FIG. 15 are steps S1 to S7 shown in FIG. When the recording control unit 2313 determines that the release information has been input (step S27: Yes), the recording composite image generation unit 2352 is the image information generated by the image processing unit 33 under the control of the recording control unit 2313. A composite image for recording in which the image information corresponding to the live image displayed on the first display device 5 when the release information is input and the character information generated by the character information generation unit 34 are combined. A recording composite image generation process for generating information is performed (step S28). Subsequently, the recording composite image generation unit 2352 performs layout information association processing by associating the generated recording composite image information with the layout information of the recording composite image information to form one set of information (step S29). ), The recording control unit 2313 performs a recording control process for recording the set information in the recording unit 36 (step S30). FIG. 16 is a diagram illustrating an example of the set information recorded in the recording unit 36 by the light source integrated processor 203 and the display image information generated in the image display device 207. As shown in (a) of FIG. 16, regardless of the presence or absence of character superimposition of the live image at the time of inspection displayed on the first display device 5, the recording unit 36 receives the image information B <b> 1 instructed to be recorded and A set of combination information is recorded in which recording composite image information M1 in which all the character information groups L1 related to the image information B1 are combined and layout information (not shown) of the recording composite image information M1 is associated. The

  FIG. 17 is a flowchart showing a processing procedure of processing for causing the second display device 9 to display image information for which the image display device 207 is instructed to display an image. Step S31 shown in FIG. 17 is step S11 shown in FIG. When the control unit 272 determines that an image display is instructed (step S31: Yes), the communication unit 71 performs an information reception process for receiving the set information corresponding to the image information to be displayed from the light source integrated processor 203. (Step S32). By receiving the group information from the recording unit 36, the communication unit 71 receives the layout information associated with the recording composite image information together with the recording composite image information to be processed. Step S33 shown in FIG. 17 is step S13 shown in FIG. If the image generation control unit 2721 determines to display the character information together with the image information to be displayed (step S33: Yes), the display image generation unit 73 does not synthesize the mask image with the character information portion, and the process is performed. Mask non-synthesizing control processing for generating the target recording composite image information as display image information as it is is performed (step S34). That is, the display image generation unit 73 outputs the recording composite image information M1 shown in FIG. 16A to the display control unit 722 as it is. For this reason, by the display control process by the display control unit 722 (step S36), the recording composite image information M1 is displayed on the second display device 9, and the operator visually recognizes the recording composite image information M1 to display the image. Together with the information B1, it is possible to confirm all the character information groups L1 related to the image information B1.

  On the other hand, when the image generation control unit 2721 determines not to display the character information together with the image information to be displayed (step S33: No), the image generation control unit 7321 causes the display image generation unit 73 to display the processing target recording composite image. Mask synthesis control processing is performed to generate a synthesized image obtained by synthesizing a mask image in an area occupied by all character information in the information as display image information (step S35). The area occupied by all the character information is shown in the layout information received together with the recording composite image information. Specifically, as shown in FIG. 16B, the display image generation unit 73 uses the background color of the same area as the area in which the character information group L1 is placed in the recording composite image information M1. A synthesized image Nd1 obtained by synthesizing the configured mask image K1 (see FIG. 16A) is generated as display image information. For this reason, the composite image Nd1 is displayed on the second display device 9 by the display control process by the display control unit 722 (step S36).

  As in the second embodiment, the combined light source processor 203 combines the still image information corresponding to the live image displayed at the time of inputting the release information and all the character information related to the image information. Even when the information is generated and recorded in the recording unit 36, as in the first embodiment, the image display device 207 also acquires all the character information related to the image information together with the image information to be displayed, and the second display device 9 Can be displayed. The image display device 207 can also cope with the setting of non-display of character information during image display by synthesizing the mask image. For this reason, also in Embodiment 2, there exists an effect similar to Embodiment 1. FIG.

  Note that the operator can freely select the character information to be displayed by operating the second input device 8. FIG. 18 is a diagram illustrating an example of display image information generated in the image display device 207. When display of information other than the brightness information in the character information group L1 is instructed by the operation of the second input device 8 by the operator, the image generation control unit 2721 displays the information as shown in FIG. The composite image Nd2 in which only the brightness information portion that is an area other than the area instructed to be displayed in the character information is masked with the mask image K2 may be generated by the image generation unit 73.

(Embodiment 3)
Next, a third embodiment will be described. The endoscope system according to the third embodiment has a schematic configuration similar to that of the endoscope system according to the first embodiment. FIG. 19 is a schematic diagram illustrating a configuration of the endoscope 2 and the light source integrated processor 303 according to the third embodiment. FIG. 19 also shows the first input device 4 and the first display device 5.

  As illustrated in FIG. 19, the light source integrated processor 303 has a function similar to that of the control unit 31 as compared with the light source integrated processor 3, and includes a control unit 331 including a recording control unit 3313 and a selection unit 3315, and an image. A generation unit 335 is provided. The image generation unit 335 includes a recording composite image generation unit 2352 (second recording image generation unit) together with a display image generation unit 351 and a release image generation unit 352 (first recording image generation unit).

  When release information is input, the selection unit 3315 selects either the release image generation unit 352 or the recording composite image generation unit 2352, and adds information on all the character information related to the image information to the image information. Generate. When the selection unit 3315 selects the release image generation unit 352, the release image generation unit 352 generates the release image information G1, the generated release image information G1, and all character information related to the release image information G1. The group information P1 in a form (first form) in which the character information group C1 having “” is associated is generated. The set information P1 is recorded in the folder D1 by the recording control unit 3313. On the other hand, when the selection unit 3315 selects the recording composite image generation unit 2352, the character information group L1 including the image information B1 and all character information related to the image information B1 is combined with the recording composite image generation unit 2352. The recorded composite image information M1 is generated, and the combined information of the form (second form) that forms one set of the generated recorded composite image information M1 and the layout information A1 of the recorded composite image information M1 Q1 is generated. The group information Q1 is recorded in the folder D2 by the recording control unit 3313.

  FIG. 20 is a schematic diagram illustrating a configuration of the image display device 307 according to the third embodiment. In FIG. 20, the recording unit 36, the second input device 8, and the second display device 9 are also shown. As illustrated in FIG. 20, the image display device 307 has the same function as the control unit 72 and includes a determination unit 3720, a first image generation control unit 3721A, a second image generation control unit 3721B, and a display control unit 722. A control unit 372 is included. The first image generation control unit 3721A has the same function as the image generation control unit 721 shown in FIG. 3, and the second image generation control unit 3721B has the same function as the image generation control unit 2721 shown in FIG. .

  The recording unit 36 includes, as the image information and all character information related to the image information, first set of set information (for example, set information P1) in which the image information and all the character information related to the image information are associated, or Then, the combination information (for example, combination information Q1) in the second form in which the combined image information for recording obtained by combining the image information and all the character information related to the image information and the layout information is recorded. The discriminating unit 3720 has the form of the processing target image information received by the communication unit 71 from the recording unit 36 and all the character information added to the image information, that is, the combination information corresponding to the processing target image information. It is determined whether the first form or the second form.

  The first image generation control unit 3721A, when the determination unit 3720 determines that the form information of the group to be processed is the first form, the display image generation when the character display at the time of image display is set When the composite image obtained by synthesizing all the character information with the image information is generated as display image information, and character non-display at the time of image display is set, the display image generation unit 73 receives the image information. It is generated as display image information.

  The second image generation control unit 3721B generates a display image when the display of characters at the time of image display is set when the determination unit 3720 determines that the group information to be processed is in the second form. When the display-use composite image information for processing is generated as display image information in the unit 73 and non-display of characters at the time of display is set, the display-image generation unit 73 displays the composite image for processing to be processed. A synthesized image obtained by synthesizing the mask image in an area occupied by all the character information of the information is generated as display image information.

  FIG. 21 is a flowchart illustrating a processing procedure of processing executed by the light source integrated processor 303 on the imaging signal input from the endoscope 2. Steps S41 to S47 shown in FIG. 21 are steps S1 to S7 shown in FIG. When the control unit 331 determines that the release information is input (step S47: Yes), the selection unit 3315 generates the release image generated by the release image generation unit 352 as a recording method of the image information to be recorded and the character information. A first recording method for recording the first form of set information P1 including the information G1, or a second form of set information Q1 including the recording composite image information n1 generated by the recording composite image generating unit 2352 is recorded. Recording method selection processing for selecting the second recording method to be performed is performed (step S48). For example, when the character information is superimposed and displayed in the layout in which the release image information G1 is displayed on the entire display area H1 as in the live image Hd shown in FIG. 9, the character information is superimposed on the release image information G1. . In this case, the selection unit 3315 sets a first recording method for recording character information separately from image information.

  The selection unit 3315 determines which of the first recording method and the second recording method has been selected (step S49). If the selection unit 3315 determines that the first recording method has been selected (step S49: first recording method), the release image generation unit 352 performs a release image generation process (step S50) and a character information association process (step S49). S51) is executed, and the recording control unit 3313 performs a recording control process of recording in the recording unit 36 the group information of the first form generated by the release image generating unit 352 (step S52). Steps S50 to S52 are steps S8 to S10 shown in FIG.

  If the selection unit 3315 determines that the second recording method has been selected (step S49: second recording method), the recording composite image generation unit 2352 sends a recording composite image generation process (step S53) and layout information. The association processing (step S54) is executed, and the recording control unit 3313 performs the recording control processing for recording the second type of combination information generated by the recording composite image generation unit 2352 in the recording unit 36 (step S55). . Steps S53 to S55 are steps S28 to S30 shown in FIG.

  FIG. 22 is a flowchart illustrating a processing procedure of a process in which the image display device 307 displays image information instructed to display an image on the second display device 9. Steps S61 and S62 shown in FIG. 22 are steps S11 and S12 shown in FIG. The determination unit 3720 determines whether the form of the group information received by the communication unit 71 in step S62 is the first form or the second form (step S63).

  When the determination unit 3720 determines that the form of the group information to be processed is the first form (step S63: first form), the first image generation control unit 3721A controls the display image generation unit 73. Do. Specifically, first image generation control unit 3721A determines whether or not to display character information together with the release image information to be displayed (step S64). If the first image generation control unit 3721A determines that the character information is to be displayed (step S64: Yes), the display image generation unit 73 instructs the display image generation unit 73 to display all the information associated with the display target image information. Character synthesis control processing is performed to generate a synthesized image obtained by synthesizing character information with release image information as display image information (step S65). On the other hand, when the first image generation control unit 3721A determines not to display the character information (step S64: No), the display image generation unit 73 sets only the release image information to be displayed as display image information. Character non-synthesis control processing to be output is performed (step S66).

  When the determination unit 3720 determines that the form of the set information to be processed is the second form (step S63: second form), the second image generation control unit 3721B controls the display image generation unit 73. Do. Specifically, the second image generation control unit 3721B determines whether or not to display character information together with image information to be displayed (step S67). If the second image generation control unit 3721B determines that character information is to be displayed (step S67: Yes), the processing-target recording composite image information is directly output as display image information to the display image generation unit 73. A mask non-synthesis control process to be performed is performed (step S68). When the second image generation control unit 3721B determines not to display the character information (step S67: No), the display image generation unit 73 occupies all the character information of the processing-target recording composite image information. Mask synthesis control processing is performed to generate a synthesized image obtained by synthesizing the mask image in the area as display image information (step S69). Step S70 is step S16 shown in FIG.

  As in the third embodiment, the light source integrated processor 303 uses either the first recording method described in the first embodiment or the second recording method described in the second embodiment. The image information and the character information may be recorded by a more appropriate method. In this case, the image display device 307 can also display the image in the display state desired by the operator by controlling the generation processing of the display image information in accordance with the form of the read set information.

(Embodiment 4)
Next, a fourth embodiment will be described. FIG. 23 is a schematic diagram illustrating a configuration of the endoscope 2 and the light source integrated processor 403 according to the fourth embodiment.

  The light source integrated processor 403 shown in FIG. 23 has both the recording control function of the light source integrated processor 3 in the first embodiment and the image display function of the image display device 7. Compared with the light source integrated processor 3 shown in FIG. 2, the light source integrated processor 403 has a control unit 431 having the same function as the control unit 31 shown in FIG. 2 and an image generation unit having a display image generation unit 4351. 435. The control unit 431 includes an image generation control unit 4311 having the function of the image generation control unit 311 shown in FIG. 2 and the function of the image generation control unit 721 shown in FIG. The display image generation unit 4351 has the functions of the display image generation unit 351 shown in FIG. 2 and the display image generation unit 73 shown in FIG. In the light source integrated processor 403, when the control unit 431 is instructed to display the image information based on the imaging element 25 input from the endoscope 2 by the instruction information from the first input device 4 or the like, the control unit 431 in FIG. Each unit is controlled to perform a processing procedure similar to the processing procedure shown. Further, when instructed to display the image information recorded by the recording unit 36, the control unit 431 controls each unit to perform the same processing procedure as the processing procedure shown in FIG.

  As in the fourth embodiment, a recording function for recording image information and character information as set information in the recording unit 36 and a display function for reading and displaying the set information from the recording unit 36 are included in the same light source integrated processor. Can also be provided.

(Modification 1 of Embodiment 4)
FIG. 24 is a schematic diagram illustrating a configuration of the endoscope 2 and the light source integrated processor 503 according to the first modification of the fourth embodiment.

  A light source integrated processor 503 shown in FIG. 24 has both the recording control function of the light source integrated processor 203 in the second embodiment and the image display function of the image display device 207. Compared with the light source integrated processor 203 shown in FIG. 13, the light source integrated processor 503 has a control unit 531 having the same function as the control unit 231 shown in FIG. 13 and an image generation unit including a display image generation unit 4351. 535. The control unit 531 includes an image generation control unit 5311 having the function of the image generation control unit 311 shown in FIG. 13 and the function of the image generation control unit 2721 shown in FIG. When instructed to display and record image information based on the image sensor 25 input from the endoscope 2, the control unit 531 controls each unit to perform the same processing procedure as the processing procedure illustrated in FIG. 15. To do. Further, when instructed to display the image information recorded by the recording unit 36, the control unit 531 controls each unit to perform the same processing procedure as the processing procedure shown in FIG. As described above, the recording function for recording the image information and the character information described in the second embodiment as set information in the recording unit 36 and the display function for reading the set information from the recording unit 36 and displaying the same are combined with the same light source integrated type. It can also be provided in the processor.

(Modification 2 of Embodiment 4)
FIG. 25 is a schematic diagram illustrating a configuration of the endoscope 2 and the light source integrated processor 603 according to the second modification of the fourth embodiment.

  A light source integrated processor 603 shown in FIG. 25 has both the recording control function of the light source integrated processor 303 in the third embodiment and the image display function of the image display device 307. The light source integrated processor 603 has a control unit 631 having the same function as the control unit 331 shown in FIG. 19 and an image generation unit 635 having a display image generation unit 4351 as compared with the light source integrated processor 303 shown in FIG. With. The control unit 631 has the function of the image generation control unit 311 shown in FIG. 19, the function of the first image generation control unit 3721A shown in FIG. 20, and the function of the second image generation control unit 3721B. Have When instructed to display and record image information based on the image sensor 25 input from the endoscope 2, the control unit 631 controls each unit to perform the same processing procedure as the processing procedure illustrated in FIG. 21. To do. Further, when instructed to display the image information recorded by the recording unit 36, the control unit 631 controls each unit to perform the same processing procedure as the processing procedure shown in FIG. As described above, the recording function for recording the image information and the character information described in the third embodiment on the recording unit 36 as set information, and the display function for reading out and displaying the set information from the recording unit 36 are the same light source integrated type. It can also be provided in the processor.

  In the light source integrated processors 3 to 603 according to the first to fourth embodiments, the release image information, that is, the still image information and the character information are recorded in association with each other. Information may be recorded in association with each other. In this case, it is not necessary to associate character information with all of the image information, and the amount of information to be recorded may be suppressed by associating the character information with only the top image information when the character information is changed. In the first to fourth embodiments, the light source integrated processor 3 to 603 in which the imaging element 25 of the endoscope 2 that is detachably attached to the light source integrated processor 3 to 603 processes the imaging signal has been described. Of course, the imaging signal to be processed is not limited to the one captured by the imaging element 25 of the endoscope 2 but may be an imaging signal captured by the imaging element of the capsule endoscope.

  In the first to fourth embodiments, the light source integrated processor in which the light sources are integrated has been described as an example. Of course, the present invention can be similarly applied to a case where the processor and the light source device are separate.

  In the first to fourth embodiments, signals transmitted and received between the endoscope 2 and the light source integrated processors 3 to 603 are not limited to electrical signals, and may be optical signals obtained by converting electrical signals. . In this case, an optical signal is transmitted between the endoscope 2 and the light source integrated processors 3 to 603 using an optical signal transmission path such as an optical fiber. Of course, signals may be transmitted and received between the endoscope 2 and the light source integrated processors 3 to 603 using not only wired communication but also wireless communication.

  In the first to fourth embodiments, an endoscope system to which an endoscope having a flexible insertion portion is applied has been described. Of course, even an endoscope system to which an endoscope having a rigid insertion portion is applied is used. Good. Further, an endoscope functioning as an imaging device may have a light source and a control function for controlling the imaging element and the light source. In this case, the light source may be a semiconductor light source provided at the distal end of the insertion portion of the endoscope. Further, the configuration is not limited to the configuration in which the imaging element is provided at the distal end of the insertion portion of the endoscope. For example, the configuration may be such that an eyepiece camera head of an optical endoscope such as a fiberscope or an optical endoscope is connected. .

  The execution program for each process executed by the light source integrated processor, the single processor, and other components according to the present embodiment is a CD-ROM, flexible file in an installable or executable format file. It may be configured to be recorded on a computer-readable recording medium such as a disk, CD-R, DVD, etc., stored on a computer connected to a network such as the Internet, and downloaded via the network. You may comprise so that it may provide. Further, it may be configured to be provided or distributed via a network such as the Internet.

DESCRIPTION OF SYMBOLS 1 Endoscope system 2 Endoscope 3,203,303,403,503,603 Integrating light source processor 4 First input device 5 First display device 6 Network 7,207,307 Image display device 8 Second input device 9 2nd display device 20,30 Connector 21 Insertion part 21a Tip part 21b Bending part 21c Flexible tube part 21d Opening part 22 Operation part 22a Curving knob 22b Treatment instrument insertion part 22c Switch part 23 Universal code 24 Objective lens 25 Imaging element 26 Signal Processing unit 27 Illumination lens 28 Memory 31, 72, 231, 272, 331, 372, 431, 531, 631 Control unit 32 Light source unit 33 Image processing unit 34 Character information generation unit 35, 235, 335, 435, 535, 635 Image Generation unit 36, 74 Recording unit 37, 71 Communication unit 73 Display image Configuration unit 311,721,2721,4311,5311,6311 Image generation control unit 312,722 Display control unit 313,2313,3313 Recording control unit 314 Communication control unit 351,4351 Display image generation unit 352 Release image generation unit 361 Layout Information 2352 Recording composite image generation unit 3315 Selection unit 3720 Discrimination unit 3721A First image generation control unit 3721B Second image generation control unit

Claims (20)

An image information generation unit that generates image information based on an imaging signal input from an imaging device that images a subject;
A character information generation unit that generates all character information related to the image information generated by the image information generation unit;
A display image generation unit that generates display image information based on the image information generated by the image information generation unit and the character information generated by the character information generation unit;
An image generation control unit that controls synthesis of the character information with respect to the image information in the display image generation unit;
When recording instruction information for instructing recording of image information generated by the image information generation unit is input from an input device, an image for recording that generates information in which all character information related to the image information is added to the image information A generator,
A processing apparatus comprising:   The processing apparatus according to claim 1, wherein the recording image generation unit generates recording information in which the image information and all the character information related to the image information are associated with each other.   The processing apparatus according to claim 1, wherein the recording image generation unit generates combined image information for recording by combining the image information and all character information related to the image information.   The recording image generation unit is a recording in which the recording composite image information is associated with layout information indicating the area occupied by the image information and the area occupied by all the character information in the recording composite image information. The processing apparatus according to claim 3, wherein the processing information is generated. The recording image generation unit
A first recording image generating unit that generates recording information in which the image information is associated with all character information related to the image information;
A second recording image generating unit that generates recording composite image information by combining the image information and all character information related to the image information;
Have
When the recording instruction information is input, any one of the first recording image generation unit and the second recording image generation unit is selected and all character information relating to the image information is added to the image information. The processing apparatus according to claim 1, further comprising a selection unit that generates information.   When the recording instruction information is input from the input device, the recording device instructed in the recording instruction information is information in which all character information related to the image information generated by the recording image generation unit is added to the image information. The processing apparatus according to claim 1, further comprising a recording control unit that causes the recording to be performed.   The processing apparatus according to claim 1, wherein the imaging apparatus is an endoscope apparatus that is detachably attached to the processing apparatus. A processing device that processes image information and all character information related to the image information added to the image information,
A display image generating unit that generates display image information based on the image information to be processed and all character information added to the image information;
An image generation control unit that causes the display image generation unit to generate the display image information corresponding to the display or non-display setting of characters during image display;
A display control unit for displaying the display image information generated by the display image generation unit on a display device connected to the processing device;
A processing apparatus comprising: The image information to be processed and all character information added to the image information are associated with the image information and all character information related to the image information,
When the display of characters at the time of image display is set, the image generation control unit causes the display image generation unit to generate a composite image obtained by combining all the character information with the image information as display image information. 9. The processing apparatus according to claim 8, wherein, when non-display of characters at the time of image display is set, the display image generation unit generates the image information as display image information.   When the partial display of characters at the time of image display is set, the image generation control unit displays character information set to display among the all character information to the display image generation unit. The processing apparatus according to claim 9, wherein the combined image is generated as display image information. The image information to be processed and all character information added to the image information are composite image information for recording in which the image information and all character information related to the image information are combined,
When the display of characters at the time of image display is set, the image generation control unit causes the display image generation unit to generate the recording composite image information to be processed as display image information. When non-display of characters is set, the display image generation unit displays, as display image information, a composite image in which a mask image is combined with an area occupied by all the character information of the recording composite image information to be processed. The processing apparatus according to claim 8, wherein the processing apparatus is generated. The recording composite image information is associated with layout information indicating the area occupied by the image information and the area occupied by all the character information in the recording composite image information,
When the non-display of characters at the time of image display is set, the image generation control unit instructs the display image generation unit to display all of the composite image information for recording indicated by the layout information. 12. The processing apparatus according to claim 11, wherein display image information is generated by combining a mask image in an area occupied by the character information.   When the partial display of characters at the time of image display is set, the image generation control unit causes the display image generation unit to display the composite image information for recording in the layout information. 13. The processing apparatus according to claim 12, wherein display image information in which a mask image is synthesized in an area other than an area occupied by character information for which partial display is set out of an area occupied by all character information is generated. . The image information to be processed and all the character information added to the image information are the first form in which the image information and all the character information related to the image information are associated with each other, or the image information and the image A second form of composite image information for recording that combines all character information relating to the information;
A discriminator for discriminating whether the form of the image information to be processed and all character information added to the image information is the first form or the second form;
The image generation control unit
When it is determined that the form of the image information to be processed and all the character information added to the image information is the first form by the determination unit, and the display of characters during image display is set When the display image generation unit is configured to generate a composite image obtained by combining all the character information with the image information as display image information, and character non-display at the time of image display is set, the display image A first image generation control unit that causes the generation unit to generate the image information as display image information;
When it is determined that the form of the image information to be processed and all the character information added to the image information is the second form by the determination unit, and the display of characters at the time of image display is set The display image generation unit generates the processing-target recording composite image information as display image information, and when non-display of characters at the time of image display is set, the display image generation unit A second image generation control unit for generating, as display image information, a composite image obtained by combining a mask image in an area occupied by all the character information of the recording composite image information to be processed;
The processing apparatus according to claim 8, further comprising:   The processing apparatus according to claim 8, wherein the image information to be processed is image information based on an imaging signal imaged by an endoscope apparatus including an imaging element. An image information generation unit that generates image information based on an imaging signal input from an imaging device that images a subject;
A character information generation unit that generates all character information related to the image information generated by the image information generation unit;
When recording instruction information for instructing recording of image information generated by the image information generation unit is input from an input device, an image for recording that generates information in which all character information related to the image information is added to the image information A generator,
Information in which the image information generated by the image information generation unit and the character information generated by the character information generation unit, or all character information related to the image information generated by the recording image generation unit are added to the image information , Based on the display image generation unit for generating the display image information,
An image generation control unit that controls generation of the display image information in the display image generation unit;
A processing apparatus comprising: A processing method executed by a processing device that processes an imaging signal input from an imaging device that images a subject,
An image information generation unit that generates image information based on the imaging signal; and
A character information generation unit that generates all character information related to the image information generated in the image information generation process;
An image generation control unit generates a display image information based on the image information generated in the image information generation process and the character information generated in the character information generation process. An image generation control process for controlling synthesis of the character information with respect to the image information;
When recording instruction information for instructing recording of the image information generated in the image information generation process is input from the input device, the recording image generation unit adds all character information related to the image information to the image information. Recording image generation processing for generating the information,
The processing method characterized by including. A processing method executed by a processing device that processes image information and all character information related to the image information added to the image information,
The image generation control unit displays characters at the time of image display to the display image generation unit that generates display image information based on the image information to be processed and all character information added to the image information. Alternatively, a display image generation control process for generating the display image information corresponding to the non-display setting,
A display control unit that causes the display device connected to the processing device to display the display image information generated in the display image generation control processing;
The processing method characterized by including. In a processing device that processes an imaging signal input from an imaging device that images a subject,
An image information generation unit for generating image information based on the imaging signal;
A character information generation unit for generating all character information related to the image information generated in the image information generation procedure;
An image generation control unit generates a display image information based on the image information generated in the image information generation procedure and the character information generated in the character information generation procedure. An image generation control procedure for controlling synthesis of the character information with respect to the image information;
When recording instruction information for instructing recording of the image information generated in the image information generation procedure is input from the input device, the recording image generation unit adds all character information relating to the image information to the image information. Recording image generation procedure for generating the recorded information;
A processing program characterized by causing A processing device that processes image information and all character information related to the image information added to the image information.
The image generation control unit displays characters at the time of image display to the display image generation unit that generates display image information based on the image information to be processed and all character information added to the image information. Alternatively, a display image generation control procedure for generating the display image information corresponding to the non-display setting,
A display control procedure for causing the display control unit to display the display image information generated in the display image generation control procedure on the display device connected to the processing device;
A processing program characterized by causing

Images