JP5730177B2 - Electronic endoscope system - Google Patents

Description

  The present invention relates to an electronic endoscope system.

Conventional electronic endoscope systems are generally connected to an electronic endoscope via an electronic endoscope having an imaging unit and a cable (universal tube) provided in the electronic endoscope. And a processor that supplies image light and generates image data based on a signal transmitted from the imaging unit, and a display that displays an image based on the image data generated by the processor.
However, since the electronic endoscope and the processor are connected via a cable, the operation (for example, movement) of the electronic endoscope is easily limited (operability is poor), and the entire system becomes large.

On the other hand, since a portable endoscope having a light source inside itself does not require a cable for connecting to an external device such as a processor, the operation of the endoscope is not restricted (operability is good). Yes) and the overall configuration is compact.
However, since the portable endoscope observes the affected part through an eyepiece provided in the operation part, the number of observers who can visually recognize the affected part is limited to only one (operator only). It is also difficult to record an observation image.
If a digital add-on camera (attached camera) is provided on the eyepiece of the portable endoscope, a person other than the operator can view the observed image. However, since the add-on camera needs to be connected to an external device such as a monitor separately, the compactness of the portable endoscope is lost. In addition, in order to see the add-on camera, the operator needs to change his / her posture, which hinders operation. Furthermore, in view of the size of the screen and the viewing angle, it is actually difficult for a person other than the surgeon to visually recognize a clear image.

  Furthermore, there are some endoscopes that have not only an image observation function (imaging function) but also an observation image storage function. However, there is no endoscope that has the function of creating electronic medical record data of a patient by adding voice information and / or text information to the stored observation image data. Conventionally, after observing the observation image data, Electronic chart data had to be created by transferring audio information and / or text information to observation image data on the side of the external device after transferring the image from the endoscope to the external device.

JP 60-48011 A JP 2001-286439 A JP 2005-334678 A

  The present invention has been completed on the basis of the above problem awareness, has good operability and compactness, allows a plurality of observers to easily view an observation image at the same time, and performs audio during endoscopy. It is an object of the present invention to obtain an electronic endoscope system capable of easily creating an electronic medical record to which information and / or character information is added in real time.

  An electronic endoscope system of the present invention includes an electronic endoscope having an imaging unit that captures an observation image of an observation object; and input means capable of inputting voice information and / or character information to the electronic endoscope And an external device having a display unit that is separate from the electronic endoscope, and the electronic endoscope includes an observation image captured by the imaging unit, audio information input by the input unit, and A generation unit that generates electronic medical record data including character information; a holding unit that holds the electronic medical record data generated by the generation unit; and wireless transmission of the electronic medical record data held by the holding unit to the external device And a wireless transmission unit.

  The electronic endoscope includes a wireless reception unit that wirelessly receives an electronic medical record data update instruction signal from the external device, and an electronic medical record that the holding unit holds in accordance with the electronic medical record data update instruction signal wirelessly received by the wireless reception unit. It is preferable to further include an update unit that updates data.

  The input means can be provided in both or one of the electronic endoscope and the external device.

  The external device may include an electronic endoscope terminal, a head mounted display unit, and a stationary terminal, and the electronic endoscope terminal, the head mounted display unit, and the stationary terminal may be provided with the input unit.

  The electronic medical record data includes observation date / time, patient information, medical doctor information, elapsed time, serial number, endoscope identification information (for example, serial number), endoscope operator, and facility information (for example, hospital name and department) ID information having at least one of (name) can be included.

  It is preferable that the electronic endoscope system according to the present invention further includes a voice analysis unit that performs voice analysis on the voice information input by the input unit and converts the voice information into character information.

The speech analysis unit analyzes the speech information input by the input unit and extracts a feature parameter, and stores the correspondence between the probability of the sound of the feature parameter and the phonetic symbol as an acoustic model. An acoustic model storage unit, a dictionary that stores and recognizes words to be recognized, a language model that represents a word appearance probability and a word appearance probability that follows a specific word, and a rule grammar that defines a word range Based on the feature parameters extracted by the feature parameter extraction unit, based on the acoustic information and language information of the acoustic model holding unit, dictionary, language model, and rule grammar, the voice information input by the input unit is analyzed by voice analysis It is practical to have a recognition decoder that converts it into character information.

  The electronic endoscope may include a battery unit that supplies driving power for the electronic endoscope, and a communication socket that charges the battery unit with a supply voltage from the external device.

  The electronic endoscope further includes an external power socket for receiving a supply voltage to the electronic endoscope from an external power source different from the external device, and the external power socket receives the external power source from the external power source. The battery unit can be charged by both a supply voltage and a supply voltage from the external device via the communication socket. In this case, rapid charging may be performed by setting a supply voltage from the external power supply received by the external power socket higher than a supply voltage from the external device via the communication socket.

  An electronic endoscope system according to the present invention includes an insertion support portion that inserts and supports the electronic endoscope, and wirelessly transmits a battery unit of the electronic endoscope in a state in which the electronic endoscope is inserted and supported in the insertion support portion. You may further have an electronic endoscope hanger provided with the wireless charging part to charge.

  The electronic endoscope system of the present invention includes a server that holds a 3D image of the observation object, and a navigation unit that generates a virtual endoscope image from the 3D image of the observation object held by the server. It may be.

  The electronic endoscope system of the present invention further includes position information detection means for detecting position information inside the observation object of the electronic endoscope, and the navigation unit adds the generated virtual endoscope image to the generated virtual endoscope image. A bronchial care plan may be generated by combining the position information of the electronic endoscope detected by the position information detecting means.

  According to the present invention, an electronic medical chart that has good operability and compactness, that allows a plurality of observers to easily view an observation image at the same time, and that adds voice information and / or text information during endoscopy. An electronic endoscope system that can be easily created in real time is obtained.

It is a figure showing the whole electronic endoscope system composition concerning one embodiment of the present invention. It is a simple block diagram which shows the internal structure of an electronic endoscope. It is a figure which shows an example of electronic medical chart data. It is a figure which shows the typical display method of electronic medical chart data. It is a figure which shows the search area | region of electronic medical record data. It is a figure which shows the audio | voice information area | region of electronic medical chart data. It is a figure which shows the structure of an audio | voice conversion means and an audio | voice analysis means. It is a figure which shows the structure of an audio | voice analysis means. It is a 1st figure which shows the audio | voice analysis process by an audio | voice analysis means. It is a 2nd figure which shows the audio | voice analysis process by an audio | voice analysis means. FIG. 11A is a perspective view showing a state in which the waterproof cap is not fitted to the gripping operation unit, and FIG. 11B is a perspective view without closing the state in which the waterproof cap is fitted to the gripping operation unit. FIG. 12A is a diagram showing a gripping operation unit with a built-in battery unit, and FIG. 12B is a diagram showing a gripping operation unit in which a battery pack type battery unit can be attached and detached. FIG. 5 is a diagram illustrating a gripping operation unit including a battery unit capable of wireless charging. It is a charging circuit block diagram for charging a battery unit. It is a figure which shows another embodiment for charging a battery unit. It is a charging circuit block diagram corresponding to FIG. 13 for charging a battery unit. It is a figure which shows the external appearance structure of an electronic endoscope terminal (external device). It is a simple block diagram which shows the internal structure of an electronic endoscope terminal (external device). FIG. 18A is a block diagram showing an internal configuration of a built-in or removable battery pack type battery unit, and FIG. 18B is a block diagram showing an internal configuration of a wireless charging type battery unit. It is a figure which shows the structure of a head mounted display unit (external device). It is a figure which shows the external appearance structure of a stationary terminal (processor). It is a simple block diagram which shows the internal structure of a stationary terminal (processor). It is a figure which shows the structure of an external display. It is a figure which shows the structure of an auxiliary input device. It is a figure which shows an example of the operation screen by an auxiliary input device. FIG. 25A is a diagram showing a gripping operation unit equipped with an expansion controller (input unit) having buttons and a joystick, and FIG. 25B is a diagram showing an expansion controller (input unit) having a touch panel type input unit. It is a figure which shows a holding | grip operation part. It is a figure which shows the structure of an electronic endoscope hanger. FIG. 27A is a perspective view showing a configuration of an electronic endoscope having a joining pin, and FIG. 27B shows a state in which the joining pin of the electronic endoscope and the joined portion of the electronic endoscope terminal are joined. It is a perspective view. It is a block diagram which shows the internal structure of the electronic endoscope for performing power line communication, and an electronic endoscope terminal. It is a figure which shows the modification of the junction part of an electronic endoscope and an electronic endoscope terminal. It is a simple block diagram which shows the modification of the internal structure of an electronic endoscope. It is a figure which shows the modification of the whole structure of the electronic endoscope system of FIG. It is a figure which shows another modification of the whole structure of the electronic endoscope system of FIG. It is a 1st block diagram which shows the whole structure of a virtual endoscope system. It is a 2nd block diagram which shows the whole structure of a virtual endoscope system. It is a figure which shows a mode that the virtual endoscopic image and the bronchial care plan are displayed.

  An electronic endoscope system 1 according to an embodiment of the present invention will be described with reference to FIGS. As shown in FIG. 1, an electronic endoscope system 1 includes an electronic endoscope 100, an electronic endoscope terminal (external device) 200, a head mounted display unit (external device) 300, a stationary terminal (processor) 400, an external A display 500 and an electronic medical chart system 600 are provided. The electronic endoscope 100, the electronic endoscope terminal 200, the head mounted display unit 300, and the stationary terminal 400 can wirelessly communicate with each other various input information, stored data, operation signals, and the like. In this specification, “wireless communication” means electric communication having no transmission path, and is used in a wide concept including optical communication and acoustic wave communication in addition to radio wave communication.

  First, the electronic endoscope 100 will be described. FIG. 2 is a simplified block diagram showing the internal configuration of the electronic endoscope 100. The electronic endoscope 100 is a portable endoscope having a grip operation unit 110 gripped by an operator and a flexible insertion unit 130 extending from the grip operation unit 110. The electronic endoscope 100 includes a control circuit (a generation unit, an update unit, and a tag addition unit) 111 that controls the overall operation of the electronic endoscope 100 inside the grip operation unit 110.

The gripping operation unit 110 includes an input device (input means) 112, a communication socket 113, an external power socket 114, a battery unit 115, an indicator lamp 116, an electronic medical record data holding unit (holding unit) 117, and a communication antenna. (Radio transmission unit, radio reception unit) 118.
The input device (input means) 112 includes buttons, a jog dial, a joystick, a cross key, a microphone, and the like provided on the case of the grip operation unit 110, and inputs voice information and character information by an operator's input operation. . The input device 112 outputs the input voice information and character information to the control circuit 111.
The communication socket 113 is an insertion port (for example, a USB connector, a memory card slot, etc.) for performing wired communication with the electronic endoscope terminal 200 and other external devices via the control circuit 111.
The external power supply socket 114 is an insertion port for receiving a supply voltage from an external power supply, and supplies driving power for the electronic endoscope 100 via the control circuit 111.
The battery unit 115 supplies driving power for the electronic endoscope 100 via the control circuit 111, and includes a built-in battery 115a and a charging current control circuit 115b. The built-in battery 115a is, for example, a secondary battery such as a lithium ion battery or a nickel metal hydride battery, a capacitor, a primary battery, a fuel cell, or a combination of these. The charging current control circuit 115b controls the charging current of the built-in battery 115a via the control circuit 111. The battery unit 115 includes a strain gauge, a voltage monitor, a timer circuit, a temperature sensor, and the like in order to detect deterioration of the built-in battery 115a. The battery unit 115 may be detachably provided outside the grip operation unit 110 (portable standby power supply). The number of built-in batteries 115a is not limited to one, and may be two or more.
Under the control of the control circuit 111, the indicator lamp 116 displays information such as a decrease in the supply voltage (drive power) to the electronic endoscope 100, the state of charge (full charge or out of charge), the deterioration of the battery unit 115, and the like. indicate.
The electronic medical record data holding unit 117 holds electronic medical record data that is a medical record of a patient generated or updated by the control circuit 111.
The communication antenna 118 is connected to the electronic endoscope terminal 200, the head mounted display unit 300, and the stationary terminal 400 under the control of the control circuit 111. Wireless communication of various operation signals (for example, an electronic medical record data update instruction signal, an image processing instruction signal such as freeze or enhance).

The insertion unit 130 is provided with an objective lens 131 exposed on the distal end surface thereof, and a CCD unit (imaging unit) 132 that is located behind the objective lens 131 and images a subject light beam (observation image) incident through the objective lens 131. And have. The CCD unit 132 transmits the taken observation image data to the control circuit 111.
The insertion portion 130 has a light distribution lens 133 exposed on the tip surface thereof, and an LED 134 positioned behind the light distribution lens 133. The LED 134 emits illumination light by the power supplied via the control circuit 111, and this illumination light is emitted outside the electronic endoscope 100 by the light distribution lens 133.

The control circuit (generation unit) 111 generates electronic medical record data obtained by synthesizing the observation image data transmitted from the CCD unit 132 and the voice information and character information input from the input device 112. The control circuit 111 holds the generated electronic medical record data in the electronic medical record data holding unit 117.
When an electronic medical record data update instruction signal is input from the electronic endoscope terminal 200, the head mounted display unit 300, or the stationary terminal 400 via the communication antenna 118, the control circuit (update unit) 111 receives the electronic medical record data update instruction signal. Accordingly, the electronic medical record data held by the electronic medical record data holding unit 117 is updated.

FIG. 3 shows an example of electronic medical record data. This electronic medical record data includes ID information EC1, moving image information EC2, audio information EC3, text information EC4, and still image information EC5. These pieces of information EC1 to EC5 are displayed on a display device 208 (described later) of the electronic endoscope terminal 200 or an observation window 303 (described later) of the head mounted display unit 300, and are desired to be viewed on the display device 208 or the observation window 303. The information can be browsed by placing the cursor on and clicking the item (by using the input device 112 or the like).
The ID information EC1 includes observation date / time, patient information, doctor in charge (DR) information, elapsed time, reference number, endoscope identification information (for example, serial number), endoscope operator, and facility information (for example, hospital name and medical treatment). Name). The moving image information EC2 and the still image information EC5 are intraoperative photographic images transmitted from the CCD unit 132, and ID information EC1 may be incorporated in the header thereof. The voice information EC3 is voice information input from the input device 112, and includes, for example, findings regarding a lesioned part that is voice-input during endoscopy. The text information EC4 is text information obtained by text analysis of text information or voice information EC3 input from the input device 112. For example, a finding about a lesion that is voiced or text-input during endoscopy including.

FIG. 4 shows a typical display method of electronic medical record data. In this display method, a plurality of data such as a current endoscopic image, electronic medical record data, and other data are simultaneously displayed on one screen. In the display method of FIG. 4, the basic information area AR1, the endoscope image area AR2, the sub-screen area AR3, the search area AR4, and the audio information area AR5 are simultaneously displayed on one screen.
In the basic information area AR1, the observation date and time, patient information, doctor in charge (DR) information, elapsed time, reference number, and the like are displayed. In the endoscopic image area AR2, a moving image or a still image of an intraoperative photographed image transmitted from the CCD unit 132 is displayed. Nothing is normally displayed in the sub screen area AR3. For example, when a freeze operation is performed, a still image is displayed in the endoscope image area AR2, and a moving image is displayed in the sub screen area AR3. Alternatively, a usage mode in which a moving image or an X-ray fluoroscopic image recorded during the operation is displayed in the endoscopic image area AR2 and the current endoscopic image is displayed in the sub-screen area AR3 is also possible. When the images displayed in the endoscope image area AR2 and the sub screen area AR3 are moving images, fast forward and rewind are also possible.
Further, an X-ray fluoroscopic image may be displayed in the sub screen area AR3.
As shown in FIG. 5, the search area AR4 includes an input field AR4-1 and a search button AR4-2. A part corresponding to the search character in the electronic medical record data can be extracted by inputting the search character into the input field AR4-1 by the input device 112, placing the cursor on the search button AR4-2, and clicking. For example, when “lesion” is input to the input field AR4-1 by the input device 112, “byouhenbu” as voice information or “lesion” as character information is input from the observation image data in the electronic medical record data. Observation images for a predetermined time (for example, 1 minute and 2 minutes) before and after the point in time can be extracted and viewed in the endoscope image area AR2. Further, the character information input from the input device 112 at this predetermined time may be extracted so that it can be viewed in the endoscope image area AR2 together with the observation image.
In the voice information area AR5, character information obtained by converting voice information input from the input device 112 into text by voice analysis is displayed. At that time, as shown in FIG. 6, the voice information input at a predetermined time extracted by operating the search area AR4 is converted into character information in a time series together with the seek bar AR5-1 and the elapsed time (time stamp) AR5-2. It is converted and displayed in the content column AR5-3. By operating the seek bar AR5-1 with the pointer AR5-4, the electronic medical record data of the past contents can be browsed. By operating the input device 112 while aligning the position of the caret AR5-5 with the pointer AR5-4, the character information of the electronic medical record data displayed in the content column AR5-3 can be edited. The character information being input (or being edited) may be displayed in the content column AR5-3 in a larger font than other information. The character information displayed in the content column AR5-3 may be changed in color depending on the elapsed time or its content. For example, when the content of the character information is correct (not erroneous conversion), it is displayed in white, when the content of the character information is incorrect (incorrect conversion), it is displayed in red, and it is currently being edited and is not yet confirmed. Sometimes it may be displayed in yellow.

FIG. 7 shows the configuration of the voice conversion means 119 and the voice analysis means 120 of this embodiment provided in the grip operation unit 110. The voice conversion means 119 and the voice analysis means 120 are provided as part of the control circuit 111 in the simplified block diagram of FIG.
The voice conversion unit 119 performs voice compression processing on the voice information input from the input device 112 and outputs the voice information to the control circuit 111.
The voice analysis unit 120 converts voice information input from the input device 112 into text information converted into text by voice analysis and outputs the text information to the control circuit 111. The voice analysis means 120 can be switched on and off by operating the input means 112.

FIG. 8 shows the configuration of the voice analysis means 120. The voice analysis unit 120 includes a feature parameter extraction unit 120a, an acoustic model holding unit 120b, a dictionary 120c, a language model 120d, a rule grammar 120e, and a recognition decoder 120f.
The feature parameter extraction unit 120a analyzes the input voice information and extracts “feature parameters”. The acoustic model holding unit 120b stores the correspondence between the probability of the sound of the “feature parameter” and the phonetic symbol as “acoustic model”. The dictionary 120c stores and recognizes words to be recognized (in this embodiment, widely include medical terms related to the electronic endoscope system). The language model 120d represents the appearance probability of a word itself and the appearance probability of a word that comes (connected) after a specific word. The rule grammar 120e defines a range of words. The recognition decoder 120f comprehensively determines the acoustic information and language information of the acoustic model holding unit 120b, the dictionary 120c, the language model 120d, and the rule grammar 120e based on the “feature parameters” extracted by the feature parameter extraction unit 120a. Thus, the voice information input from the input device 112 is converted into text information converted into text by voice analysis. Specifically, in the recognition decoder 120f, the “feature parameter” extracted by the feature parameter extraction unit 120a is the same as or exists in the acoustic information and language information of the acoustic model holding unit 120b, the dictionary 120c, the language model 120d, and the rule grammar 120e. When it is close to a certain level, the status of the character information determined by the “characteristic parameter” is automatically determined. For example, if the feature parameter extracted by the feature parameter extraction unit 120a is “Byouhenbu”, “Gyouhenbu”, or “Byoheng”, the recognition decoder 120f converts the character information status into “Byouhenbu”. When the recognition decoder 120f converts the textual character information into Kanji characters, the recognition decoder 120f determines the interval between a word and phrase candidate that has been determined in the past most frequently and a word and phrase candidate that has been determined elsewhere. If there is a certain difference or more, the most frequently determined candidate is selected and converted to Kanji.

  As shown in FIG. 9, the character information converted by the voice analysis unit 120 is displayed and stored in association with one elapsed time or a predetermined non-input period (blank) with one sentence of character information associated therewith. Character information of one sentence is divided into clauses, and the correct / incorrect information acceptance status for each clause (that is, the clause can be confirmed when the clause content is correct, and the clause can be corrected when the clause content is incorrect) State). The text information of one sentence at each elapsed time is determined by inputting correct / incorrect information or by not inputting correct / incorrect information even after a predetermined time. The correct / incorrect information may be input in real time by the endoscopist via the input device 112 of the electronic endoscope 100, or by the assistant via an external input device such as a dedicated input device or a foot switch. Or in real time.

  The correct / incorrect input process in the correct / incorrect information acceptance state will be described with reference to FIGS. As shown in FIGS. 9 and 10, the voice analysis unit 120 is configured to input the input device 112 of the electronic endoscope 100 (or the input device 203 of the electronic endoscope terminal 200 described later and the microphone of the head mounted display unit 300). 301, voice information input from the input device 402) of the stationary terminal 400 is converted to character information in a time series (text is generated in real time). The converted character information is displayed on the display device 208 of the electronic endoscope terminal 200 or the observation window 303 of the head mounted display unit 300. At that time, the latest clause automatically enters the correct / incorrect information acceptance state, and the caret position is aligned with the correct / incorrect information acceptance state clause, or the character information of the correct / incorrect information acceptance state clause is reversed from light and dark to the background Highlighted by flashing in state. Then, by operating the input device 112 or the external input device of the electronic endoscope 100, the correct input state, the incorrect input state, and the unconfirmed state of the sentence in the correct / incorrect information reception state are sequentially processed. In other words, the phrase in the correct input state is confirmed as it is, and for the phrase in the incorrect input state or the unconfirmed state, re-conversion of Kanji characters, additional input or deletion of characters, any character string included in the phrase or clause, It is determined after performing re-conversion such as changing the break of a specific word (hereinafter referred to as “sentence etc.”). At this time, for example, when the content of the confirmed character information is correct (not erroneous conversion), the clause is displayed in white, and when the content of the confirmed character information is incorrect (incorrect conversion), the clause is displayed. The text is displayed in red, and the text is displayed in yellow when the text information is being edited and is not confirmed.

The control circuit (tag assignment unit) 111 operates a tag assignment button (not shown) to input voice information input at a specific time (current or past), character information obtained by converting the voice information (phrase etc.), and An identification mark (tag) on the time axis is assigned to image information (endoscopic image or X-ray image) taken at a specific time.
For example, the control circuit (tag giving unit) 111 gives an identification mark (tag) to the sound information by increasing the volume, and gives an underline (underline) to the character information (sentence etc.). The identification mark (tag) is given by performing such highlighting, and the image information (endoscopic image or X-ray image) is highlighted so as to include a mark for calling attention in the image. An identification mark (tag) is given by performing. Of course, the aspect which provides an identification mark (tag) is not limited to this.
As a result, the operator selects a specific time point (current or past) on the time axis in real time, and audio information, character information (sentence, etc.) and image information (endoscopic image or X-ray) at the specific time point. An identification mark can be given collectively to (image).
After the inspection, the identification mark (tag) is searched backward on the time axis, so that the audio information, character information (sentence, etc.) and image information (endoscope) at a specific point in time when the identification mark (tag) is given. Image and X-ray image) can be reproduced from the electronic medical record data. At that time, for example, audio information, character information (sentences, etc.) and image information (endoscopic image or X) for a predetermined time (for example, before and after 20 seconds) including a specific time point when an identification mark (tag) is given. (Line image) may be reproduced from the electronic medical record data.

  On the other hand, all the time codes on the time axis (including the current and past as well as future time codes) can be arbitrarily identified (tag) without the operator selecting a specific time point on the time axis. Is also possible to automatically link audio information, character information (sentence, etc.) and image information (endoscopic image or X-ray image) corresponding to the time code. Thereby, since the operator can add an identification mark (tag) to the time code on the time axis without any input operation, the convenience of the electronic endoscope system can be greatly improved. Further, the identification mark (tag) given to the time code on the time axis and the information linked thereto can be confirmed by displaying one or more pieces of information on a dedicated screen on a time code basis. Moreover, a tag can be given to arbitrary information and linked with other information having the same time code.

  The control circuit 111 may have a function of extracting an identification mark (tag) from the character information converted and fixed by the voice analysis unit 120. Moreover, it is preferable that this extraction function can also perform an ambiguous search. With this extraction function, the frequency of registered character strings in the character information can be known, and the proportion of the presence of a disease such as a lesion can be grasped.

  A plurality of identification marks (tags) can be set by changing not only one but also the mark form. For example, when adding an identification mark (tag) to character information (sentence, etc.), it is possible to correspond to a plurality of identification marks (tags) by changing the underline to a bar line, dotted line, wavy line, or thick line.

As shown in FIG. 11, the case of the grasping operation unit 110 of the electronic endoscope 100 includes an angle knob 122 and a suction valve 123 in addition to the communication socket 113, the indicator lamp 116 and the communication antenna 118 shown in FIG. 2. And four remote buttons 124 and a waterproof cap 125 are provided.
The angle knob 122 changes the bending state of a partial region near the distal end of the insertion portion 130 according to the turning operation. A suction means (not shown) can be attached to and removed from the suction valve 123, and when the suction means is operated, a suction nozzle (not shown) provided with a negative pressure at the distal end portion of the insertion portion 130 from the internal conduit of the electronic endoscope 100. The body fluid of the subject is sucked through this suction nozzle. The remote button 124 is a control button for electronic image processing, an operation for pressing (freezing) the screen on the television monitor by a pressing operation, a switching operation for a photometric pattern (average photometry or peak photometry), and a switching operation for image processing. Then, an operation for recording a still image or a moving image on an image recording medium such as a video or a magneto-optical disk is performed. The waterproof cap 125 can be attached to and detached from the case of the grip operation unit 110, and prevents water from adhering to the communication socket 113 by being attached to the case. A lock switch 125a is slidably provided on the waterproof cap 125 (FIG. 11B). When the lock switch 125a is positioned at the lock position, the mounting state of the waterproof cap 125 to the case is maintained by the lock pin 125b (FIG. 11A) provided in the vicinity of the communication socket 113 of the grip operation unit 110. When the 125a is slid to the unlock position, the lock by the lock pin 125b is released and the waterproof cap 125 can be removed from the case.

  12A to 12C show the grip operation unit 110 and the battery unit 115. FIG. As shown in FIG. 12A, a battery unit 115 including a built-in battery 115a and a charging current control circuit 115b is built in the grip operation unit 110 of the electronic endoscope 100. The battery unit 115 can also be implemented in the modes of FIGS. 12B and 12C. FIG. 12B shows an example in which a battery pack type battery unit 115 is detachably attached to the grip operation unit 110 of the electronic endoscope 100. FIG. 12C shows a battery pack system including an electric transmission antenna 115c for performing wireless charging on the grasping operation unit 110 of the electronic endoscope 100 in addition to the built-in battery 115a and the charging current control circuit 115b. This is an example in which the battery unit 115 is detachably attached.

  FIG. 13 is a block diagram of a charging circuit for charging the battery unit 115 shown in FIGS. As shown in FIG. 13, the built-in battery 115a of the battery unit 115 includes an input power source (1) 113a (the electronic endoscope terminal 200 and other external devices) connected to the communication socket 113 via the charging current control circuit 115b. It is charged by the supply voltage from. The state of charge of the battery unit 115 is indicated by an indicator lamp 116.

  FIG. 14 shows another embodiment for charging the battery unit 115 of FIG. In this other embodiment, a plug of a cable connected to the input power source (2) 114a (external power source such as an outlet) is connected to the external power socket 114 of the electronic endoscope 100, and the input power source (2) 114a. The supply voltage to the electronic endoscope 100 is received.

FIG. 15 is a block diagram of a charging circuit for charging the battery unit 115 of FIG. As shown in FIG. 15, the built-in battery 115a of the battery unit 115 includes the power supplied from the input power source (1) 113a via the communication socket 113 (and the charging current control circuit 115b), the external power socket 114 (and the charging current). It is charged by the supply voltage from the input power source (2) 114a via the control circuit 115b). The state of charge of the battery unit 115 is indicated by an indicator lamp 116.
A predetermined voltage difference may be set between the supply voltage from the input power supply (1) 113a and the supply voltage received from the input power supply (2) 114a. For example, by making the latter supply voltage higher than the former supply voltage, the built-in battery 115a of the battery unit 115 can be rapidly charged. At the time of this quick charging, it is preferable to prevent the observation image from being captured by the electronic endoscope 100 (not clinically usable) for safety.

  Next, the electronic endoscope terminal (external device) 200 will be described. 16 and 17 show the configuration of the electronic endoscope terminal 200. FIG. As shown in FIG. 17, the electronic endoscope terminal 200 supplies a control circuit 201 that controls the overall operation of the electronic endoscope terminal 200, and the driving power of the electronic endoscope terminal 200 via the control circuit 201. And a battery unit 202 to be operated. As shown in FIG. 18A, the battery unit 202 includes a built-in battery 202a and a charging current control circuit 202b in a built-in or removable battery pack system. As shown in FIG. 18B, the battery unit 202 includes an electric transmission antenna 202c for performing wireless charging in addition to the built-in battery 202a and the charging current control circuit 202b, as shown in FIG. Yes. The number of built-in batteries 202a is not limited to one and may be two or more.

As shown in FIGS. 16 and 17, an electronic endoscope terminal 200 includes an input device (input means) 203, a communication socket 204, an external power socket 205, an indicator lamp 206, a communication antenna (wireless communication unit, A wireless reception unit) 207 and a display device (display unit) 208.
The input device 203 includes buttons, a jog dial, a cross key, a microphone, and the like provided on the surface of the electronic endoscope terminal 200, and inputs voice information and character information by an operator's input operation. The input device 203 outputs the input voice information and character information to the control circuit 201.
The communication socket 204 is an insertion port (for example, a USB connector, a memory card slot, etc.) for performing wired communication between the electronic endoscope 100 and other external devices.
The external power socket 205 is an insertion port for receiving a supply voltage from an external power supply, and supplies driving power for the electronic endoscope terminal 200. The external power socket 2005 can be provided with the function of the communication socket 204 by, for example, a USB connector shape.
Under the control of the control circuit 201, the indicator lamp 206 is information such as a decrease in the supply voltage (drive power) to the electronic endoscope terminal 200, the state of charge (full charge or out of charge), the deterioration of the battery unit 202, and the like. Is displayed.
The communication antenna 207 controls various data and operation signals (for example, image processing instructions such as freeze and enhancement) between the electronic endoscope 100, the head mounted display unit 300, and the stationary terminal 400 under the control of the control circuit 201. Signal) wireless communication. Specifically, the communication antenna 207 wirelessly receives the electronic medical record data held by the electronic medical record data holding unit 117 of the electronic endoscope 100 via the communication antenna 118 of the electronic endoscope 100, or the electronic endoscope 100. The voice information and the character information input by the input device 203 are wirelessly transmitted toward the control unit (generation unit) 111, and the electronic medical record data update instruction signal is transmitted to the control unit (update unit) 111 of the electronic endoscope 100. Is transmitted wirelessly. The communication antenna 207 further wirelessly communicates the wirelessly received electronic medical record data to the head mounted display unit 300 and the stationary terminal 400 under the control of the control circuit 201.
The display device 208 is, for example, a liquid crystal display, an organic EL display, or a CRT display. If the display device 208 is a touch panel system, the display device 208 can have the function of the input device 203. A plurality of display devices 208 may be provided instead of one so that the output destination can be selected.

  When the electronic medical record data held by the electronic medical record data holding unit 117 of the electronic endoscope 100 is wirelessly received through the communication antenna 207, the control circuit 201 performs image processing on the observation image data included in the electronic medical record data, and displays it. It is displayed on the device 208. That is, the electronic medical chart data as shown in FIGS. 3 and 4 is actually displayed on the display device 208, and the endoscopic operator and a plurality of assistant observers can view the electronic medical chart data simultaneously. The control circuit 201 may receive power from either the battery unit 202 or an external power source connected to the external power socket 205.

Next, the head mounted display unit (external device) 300 will be described. FIG. 19 shows the configuration of the head mounted display unit 300. The head mounted display unit 300 is a headphone type unit that is worn on the heads of an operator and an assistant. The head mounted display 300 includes a microphone (input means) 301, a communication antenna (wireless transmission unit, wireless reception unit) 302, an observation window (display unit) 303, and a pair of ear pads 304.
The microphone 301 is positioned near the wearer's mouth when the head mounted display unit 300 is worn on the head, and inputs (receives) voice information generated by the wearer.
The communication antenna 302 performs wireless communication of various data and operation signals (for example, image processing instruction signals such as freeze and enhancement) with the electronic endoscope 100, the electronic endoscope terminal 200, and the stationary terminal 400. Specifically, the communication antenna 302 wirelessly receives the electronic medical record data held by the electronic medical record data holding unit 117 of the electronic endoscope 100 via the communication antenna 118 of the electronic endoscope 100, or the electronic endoscope 100. The voice information input by the microphone 301 is wirelessly transmitted to the control unit (generation unit) 111 of the electronic medical record, or the electronic medical record data update instruction signal is wirelessly transmitted to the control unit (update unit) 111 of the electronic endoscope 100. . The communication antenna 302 further wirelessly communicates the wirelessly received electronic medical record data to the electronic endoscope terminal 200 and the stationary terminal 400.
The observation window 303 is, for example, a display unit, a liquid crystal display, an organic EL display, or a CRT positioned immediately before the wearer's right eye when the head mounted display unit 300 is worn on the head. The observation window 303 may be a projection display device such as a liquid crystal projector and a screen thereof (desirably, the back side of the observation window can be seen), or a retina display that projects directly onto the retina. When the communication antenna 302 wirelessly receives electronic medical record data held by the electronic medical record data holding unit 117 of the electronic endoscope 100, the observation window 303 displays the electronic medical record data. That is, the electronic medical chart data as shown in FIGS. 3 and 4 is actually displayed on the observation window 303 so that the wearer of the head mounted display unit 300 can visually recognize the electronic medical chart data. Display contents and operation of the observation window 303 (for example, position adjustment such as vertical movement) are controlled in accordance with instruction signals from the electronic endoscope 100, the electronic endoscope terminal 200, and the stationary terminal 400. Further, position adjustment such as vertical movement of the observation window 303 may be performed by pressing down a foot switch (not shown) installed at the foot. Thereby, even when both hands of the operator are blocked during the operation, the observation window 303 can be easily moved up and down to be adjusted to the operator's desired position.
The ear pad 304 is applied to the left and right ears of the wearer when the head mounted display unit 300 is worn on the head. The ear pad 304 outputs, for example, audio information input from the input device 112 of the electronic endoscope 100 or the input device 203 of the electronic endoscope terminal 200, and the wearer can listen to the output audio information.

Next, the stationary terminal (processor) 400 will be described. 20 and 21 show the configuration of the stationary terminal 400. FIG. 20 and 21, the stationary terminal 400 includes a control circuit 401, an input device (input means) 402, a communication socket 403, an external power socket 404, an indicator lamp 405, a communication antenna 406, And a communication / processing unit 407.
The control circuit 401 controls the overall operation of the stationary terminal 400.
The input device 402 is a touch panel or a microphone provided on the surface of the stationary terminal 400 (FIG. 20), and inputs voice information and character information by an operator's input operation. The input device 402 outputs the input voice information and character information to the control circuit 401.
The communication socket 403 is an insertion port (for example, a USB connector, a memory card slot, etc.) for performing wired communication with an external device, and is directly connected to an external display device or an external input device such as a keyboard. Connect or connect an external recording device.
The external power socket 404 is an insertion port for receiving a supply voltage from the external power supply, and supplies driving power for the stationary terminal 400 via the control circuit 401.
The indicator lamp 405 displays information such as a decrease in supply voltage (drive power) to the stationary terminal 400 under the control of the control circuit 401.
The communication antenna 406 communicates with the electronic endoscope 100, the electronic endoscope terminal 200, and the head mounted display unit 300 under the control of the control circuit 401, and various data and operation signals (for example, freeze, enhancement, etc.). (Image processing instruction signal) wireless communication. Specifically, the communication antenna 406 wirelessly receives the electronic medical record data held by the electronic medical record data holding unit 117 of the electronic endoscope 100 via the communication antenna 118 of the electronic endoscope 100, or the electronic endoscope 100. The voice information and the character information input by the input device 402 are wirelessly transmitted to the control unit (generation unit) 111 of the electronic endoscope, or the electronic medical record data update instruction signal is transmitted to the control unit (update unit) 111 of the electronic endoscope 100. Is transmitted wirelessly. In addition, the communication antenna 406 wirelessly communicates wirelessly received electronic medical chart data to the electronic endoscope terminal 200 and the head mounted display unit 300 under the control of the control circuit 401.
The communication / processing unit 407 functions as an interface with the electronic medical chart system 600 connected to the stationary terminal 400 by wire or wirelessly. The communication / processing unit 407 has a calculation function in image processing and a communication function with an external device.

A stationary terminal 400 shown in FIG. 1 (FIG. 20) is connected to an external display 500 via a receiving adapter 501 shown in FIG. The external display 500 is, for example, a liquid crystal display, an organic EL display, or a CRT display.
When wirelessly receiving the electronic medical record data held by the electronic medical record data holding unit 117 of the electronic endoscope 100 through the communication antenna 406, the control circuit 401 of the stationary terminal 400 performs image processing on the observation image data included in the electronic medical record data. And displayed on the external display 500. That is, the electronic medical chart data as shown in FIGS. 3 and 4 is actually displayed on the external display 500, and the endoscopic operator and a plurality of assistant observers can view the electronic medical chart data simultaneously.

  Here, the electronic medical record data search process, voice analysis process, and correct / incorrect input process as shown in FIGS. 5 to 10 are performed not only by the input device 112 of the electronic endoscope 100 but also by the input of the electronic endoscope terminal 200. It can also be performed using the device 203 (the touch panel display device 208) or the input device 402 of the stationary terminal 400. In any case, while viewing the electronic medical record data displayed on the display device 208 of the electronic endoscope terminal 200, the observation window 303 of the head mounted display unit 300 or the external display 500, the input device 112 of the electronic endoscope 100, The input device 203 (touch panel display device 208) of the electronic endoscope terminal 200 or the input device 402 of the stationary terminal 400 is operated to perform search processing, voice analysis processing, and correct / incorrect input processing.

As shown in FIG. 23, the electronic endoscope system 1 of the present invention includes an auxiliary input device (input means) 700 capable of inputting character information as an additional component. The auxiliary input device 700 can be operated with the operator holding it with one hand, and can be rotated and pushed, two jog dials 701, a multi-directional joystick 702, four buttons 703, and a trigger 704. And a communication antenna 705. The communication antenna 705 wirelessly transmits the input character information to the electronic endoscope 100, the electronic endoscope terminal 200, the head mounted display unit 300, and the stationary terminal 400. The auxiliary input device 700 may include a voice input unit such as a microphone.
When character information is input using the auxiliary input device 700, a screen as shown in FIG. 24 is displayed on, for example, the display device 208 of the electronic endoscope terminal 200 or the external display 500, and the caret is aligned with the “character input field”. By turning the two jog dials 701, a kana character is selected and a word is input, and by pushing the jog dial 701, the word (kana character) is determined. In FIG. 24, “JD1” indicates the direction (the vertical direction in the figure) in which the kana character to be selected shifts when one jog dial 701 is turned, and the kana character to be selected when the other jog dial 701 is turned. The direction (left and right direction in the figure) in which the shift is indicated by “JD2”. Further, after confirming the word, the joystick 702 is tilted and converted (kanji conversion, katakana conversion) to display the prediction conversion candidate word in the “prediction conversion candidate display field”, and the joystick 702 is pushed or the trigger 704 is pulled. determine. At this time, for example, normal conversion is performed when the joystick 702 is tilted upward, and predictive conversion is performed based on the past conversion history when the joystick 702 is tilted downward. Further, the caret can be moved by tilting the joystick 702 left or right. A button 703 is used to change the backspace or character type.

  As an additional component, the electronic endoscope system 1 of the present invention is attached to the communication socket 113 of the grip operation unit 110 of the electronic endoscope 100 as shown in FIG. A controller (input means) 710 is provided. An extended controller 710 in FIG. 25A includes six buttons 711 and a joystick 712. An extended controller 710 in FIG. 25B includes a touch panel type input unit 713. The electronic endoscope terminal 200, the head mounted display unit 300, and the stationary terminal 400 may be operable by the expansion controller 710.

As shown in FIG. 26, the electronic endoscope system 1 of the present invention includes an electronic endoscope hanger 720 with a charging function as an additional component. The electronic endoscope hanger 720 includes a pole 721 extending in the vertical direction, a caster plate 722 having three or four legs connected to a lower end portion of the pole 721, and a leg portion of the caster plate 722. And a caster 723 with a lock mechanism connected to the lower surface. In FIG. 26, only two legs of the caster plate 722 and two casters 723 are depicted. The electronic endoscope hanger 720 can travel freely by a caster 723.
An elevating holder 724 having a short cylindrical shape is fitted on the outer periphery of the pole 721 so as to be coaxial with the pole 721. The elevating holder 724 is rotatable and axially movable with respect to the pole 721. A holder fixing screw 725 is screwed into the elevating holder 724 in a screw hole penetrating in the radial direction. When the holder fixing screw 725 is tightened, the tip end surface of the holder fixing screw 725 is pressed against the pole 721, so that the lifting holder 724 can be fixed to the pole 721 in a desired position and direction. On the other hand, when the holder fixing screw 725 is loosened, the tip end surface of the holder fixing screw 725 is separated from the pole 721, so that the lifting holder 724 can rotate and move in the axial direction with respect to the pole 721.
An endoscope support arm 726 is coupled to the lifting holder 724, and an insertion support portion 727 for inserting and supporting the electronic endoscope 100 is provided on the endoscope support arm 726. A power supply circuit (wireless charging unit) 729 and an electric transmission antenna (wireless charging unit) 730 connected to the electric plug 728 are provided in the vicinity of the insertion support unit 727 of the endoscope support arm 726. Accordingly, the battery unit 115 of the electronic endoscope 100 can be wirelessly charged in a state where the electronic endoscope 100 is inserted and supported by the insertion support portion 727 and attached to the electronic endoscope hanger 720. The power supply circuit 729 has a function of automatically charging the battery unit 115 of the electronic endoscope 100 in a time zone with a low usage frequency by recording and analyzing the daily usage time by incorporating an internal clock. It may be.

As described above, the electronic endoscope system 1 according to the present embodiment includes the electronic endoscope 100 including the imaging unit 132 that captures an observation image of the observation target, and audio information and / or the electronic endoscope 100. An external device (200, 300) having a display unit (208, 303) that is separate from the input means (112, 203, 301, 402, 700, 710) capable of inputting character information and the electronic endoscope 100 The electronic endoscope 100 includes an observation image captured by the imaging unit 132 and voice information and / or character information input by the input unit (112, 203, 301, 402, 700, 710). A generation unit 111 that generates electronic medical record data, a holding unit 117 that holds the electronic medical record data generated by the generation unit 111, and an electronic medical record data held by the holding unit 117 are stored in an external device (20 And a wireless transmission unit 118 for wirelessly transmitting 300).
According to this configuration, since the cables connecting the electronic endoscope 100 and the external devices (200, 300) are omitted, the operability of the electronic endoscope 100 is good, and the electronic endoscope system 1 The whole can be made compact.
Also, electronic medical record data including an observation image captured by the imaging unit 132 and voice information and / or character information input by the input means (112, 203, 301, 402, 700, 710) in the electronic endoscope 100. Since the generation unit 111 that generates the data and the holding unit 117 that stores the electronic medical record data generated by the generation unit 111 are provided, the electronic medical record data is generated in real time on the electronic endoscope 100 side during the endoscopy. Can be held. Thereby, since the electronic medical record data is completed during the endoscopy, the time can be shortened, and the electronic medical record data can be confirmed later. In addition, since electronic medical record data can be filed by the electronic endoscope 100, the handling of the data is easy, and it is particularly convenient when the electronic endoscope 100 is used by visiting a patient's home.
Further, the electronic medical chart data held by the holding unit 117 of the electronic endoscope 100 is wirelessly transmitted to the external device (200, 300) by the wireless transmission unit 118, and the display unit (208, 303) of the external device (200, 300). Since the electronic medical record data is displayed, a plurality of observers including an operator and an assistant can view the electronic medical record data (observation image) at the same time.

  27A and 27B show modifications in which the electronic endoscope 100 and the electronic endoscope terminal 200 are joined to enable wired communication. In this modification, a joining pin 126 is provided in the grip operation part 110 of the electronic endoscope 100, a joining part 209 is provided in the electronic endoscope terminal 200, and the joining pin 126 and the joining part 209 are joined so as to be rotatable. Thus, the electronic endoscope 100 and the electronic endoscope terminal 200 are joined so as to be capable of wired communication. A band-shaped terminal portion is formed on the outer periphery of the joining pin 126, and even when the electronic endoscope 100 and the electronic endoscope terminal 200 are relatively rotated, wired communication between the two is maintained. As a wired communication format, for example, a USB communication format, a serial communication format such as IEEE1394 format, and other various formats can be used. In particular, by adopting a power line communication format in which a communication high frequency is superimposed on a power line, the number of exposed terminals can be reduced, and the number of components can be reduced. In this wired communication system, to increase the amount of communication by using multiple wired communication systems, to provide a shield to prevent radio wave leakage, to provide a ground terminal, to prevent click feeling, positioning, and displacement A ball plunger may be provided.

  In this power line communication system, as shown in FIG. 28, the electronic endoscope 100 includes a power line carrier frequency circuit 127 including a modulation / demodulation circuit 127a and a converter 127b, and the electronic endoscope terminal 200 includes a modulation / demodulation circuit. A power line carrier circuit 210 comprising a 210a and a converter 210b is provided. Driving power is supplied from the control circuit 111 (201) to the converter 127b (210b) of the electronic endoscope 100 (electronic endoscope terminal 200) from the control circuit 111 (201). Information such as electronic medical record data and various operation signals is input from the control circuit 111 (201) to the modulation / demodulation circuit 127a (210a) of the electronic endoscope 100 (electronic endoscope terminal 200) through the information signal line. .

  FIG. 29 shows a modification of the joint portion between the electronic endoscope 100 and the electronic endoscope terminal 200. In this modification, the electronic endoscope terminal 200 is provided with a mount portion 211 having a joint portion, and the joint pin 126 (FIGS. 27A and 27B) of the electronic endoscope 100 is attached to the mount portion 211. By joining so that rotation is possible, the electronic endoscope 100 and the electronic endoscope terminal 200 are joined so that wired communication is possible. The mount unit 211 includes a communication connector and a signal line that relay the power line and the signal line of the electronic endoscope 100 and the electronic endoscope terminal 200.

  FIG. 30 shows a modification in which the grip operation unit 110 and the insertion unit 130 are detachable in the electronic endoscope 100 of FIG. In this modification, the CCD unit 132 and the LED 134 are provided inside the gripping operation unit 110, and the image transmission fiber / image transmission lens array 135 and the light guide fiber 136 are provided inside the insertion unit 130. The objective lens 131 and the CCD unit 132 are connected via an image transmission fiber / image transmission lens array 135, and the light distribution lens 133 and the LED 134 are connected via a light guide fiber 136.

  FIG. 31 shows a modification of the overall configuration of the electronic endoscope system 1. In this modification, two head mounted display units (external devices) 300 having the same configuration are provided, and electronic medical record data and various operation signals can be wirelessly communicated between the two head mounted display units 300. Of course, the number of head-mounted display units 300 is not limited to two, and may be three or more. By increasing the number of head mounted display units 300, it is possible to cope with a case where the number of surgeons and assistants is large, and the convenience of the electronic endoscope system 1 can be enhanced. Further, when a plurality of head mounted display units 300 are used, the number of people who can input voice information may be limited. For example, when a surgeon and an assistant use the head mounted display unit 300, only the voice of the surgeon may be input from the two persons. This makes it possible to record the voice of a specific person (surgeon) from the voices of a plurality of persons (surgeon and assistant), and facilitates extraction of voice information. As a method for identifying a person who can input voice information, for example, acoustic features based on the voice of a specific person (operator) are stored in a database in advance, and the input voice information is stored in this database. A method of matching and identifying can be used.

  FIG. 32 shows another modification of the overall configuration of the electronic endoscope system 1. In this modification, instead of the head-mounted display unit 300, a microphone (voice input device) 740 that exclusively acquires voice information and outputs it to the electronic endoscope 100 and the electronic endoscope terminal 200 is provided. The configuration of the endoscope system 1 is simplified.

  Finally, a virtual electronic endoscope system 800 for improving the convenience of the electronic endoscope system 1 of the present invention will be described with reference to FIGS. 33 to 35. The virtual electronic endoscope system 800 displays images in conjunction with other image devices, measurement devices, and electronic medical records, exchanges data, and operates other devices in addition to the conventional processor function. is there.

In the virtual electronic endoscope system 800 of FIG. 33, the server 810 is connected to the position information detection means 830, the processor (endoscope center) 840, and the navigation unit 850 via the LAN 820. The operation of the virtual electronic endoscope system 800 is performed by various input devices such as a keyboard, a mouse, and a touch pad connected to the processor 840 or the input device 112 of the electronic endoscope 100 and the input of the electronic endoscope terminal 200 described above. This can be done by the device 203 or the input device 402 of the stationary terminal 400.
The server 810 holds an image of an observation object captured in advance by a CT apparatus, an MRI apparatus, or the like (not shown) and a 3D image reconstructed three-dimensionally from the image of the observation object. The navigation unit 850 accesses the server 810 and generates a virtual endoscopic image from the 3D image of the observation object held by the server 810.
The position information detection unit 830 detects position information inside the observation object of the electronic endoscope 100. In the first example, the position information detection unit 830 receives a magnetic field generated by a magnetic coil attached to the electronic endoscope 100 with an antenna outside the body, and detects the shape, tip position, and posture of the electronic endoscope 100. It is the structure to do. In the second example, the position information detection unit 830 is configured to calculate and detect the tip position and posture of the electronic endoscope 100 from a three-dimensional acceleration sensor attached to the tip portion of the electronic endoscope 100. In the third example, the position information detection means 830 is an X-ray image or CT image obtained from an X-ray imaging apparatus, CT imaging apparatus, or MRI apparatus (not shown) by a flat panel detector (FPD) or the like. In this configuration, the MRI image is analyzed to detect the shape, tip position, and posture of the electronic endoscope 100. In the fourth example, the position information detection means 830 detects the position and posture of the electronic endoscope 100 by sensing a magnetic field distribution generated by an MR device provided outside the body with a coil attached to the electronic endoscope 100. It is the structure to do.
The navigation unit 850 generates a bronchial care plan (path plan) by combining the virtual endoscope image generated by the navigation unit 850 and the position information of the electronic endoscope 100 detected by the position information detection unit 830. According to this bronchial medical care plan, it is possible to easily know the traveling direction at the branch of the bronchus during the endoscopic operation.

  FIG. 34 shows a modification of the virtual electronic endoscope system 800. In this modification, the server 810 is connected to the processor 840 via the LAN 820, and the position information detecting means 830 and the navigation unit 850 are connected to the processor 840, respectively. There are various connection types of these components such as an intranet, a LAN (wired or wireless) network type, a direct connection type to a socket provided in the processor 840, or a mixed type of these types. Can be changed.

  As shown in FIG. 35, the virtual endoscopic image and the bronchial care plan generated by the navigation unit 850 are displayed on the external display 500 described above, for example. In FIG. 35, a virtual endoscopic image 851 is displayed at the lower right of the screen of the external display 500, and the destination mark and the current position of the electronic endoscope 100 can be viewed on the virtual endoscopic image 851 at the upper right of the screen. A plan 852 is displayed. Further, an observation image (main image) 853 by the electronic endoscope 100, a preoperative X-ray image 854, an intraoperative X-ray image 855, and a virtual tomographic image 856 are displayed on the external display 500. The virtual tomographic image 856 is a tomographic image of the virtual endoscopic image 851. The virtual tomographic image 856 may follow the movement of the tip of the electronic endoscope 100.

  The virtual electronic endoscope system 800 configured as described above includes a server 810 that holds a 3D image of an observation object, position information detection means 830 that detects position information inside the observation object of the electronic endoscope 100, and A virtual endoscopic image is generated from the 3D image of the observation object held by the server 810, or the position information of the electronic endoscope 100 detected by the position information detecting unit 830 is combined with the generated virtual endoscopic image. Since a navigation unit 850 for generating a bronchial medical care plan (path plan) is provided, more advanced and accurate endoscopy and findings can be recorded.

DESCRIPTION OF SYMBOLS 1 Electronic endoscope system 100 Electronic endoscope 110 Grasping operation part 111 Control circuit (a production | generation part, an update part, a tag provision part)
112 Input device (input means)
113 Communication socket 113a Input power supply (1)
114 External power supply socket 114a Input power supply (2) (Charging plug)
115 Battery unit 115a Built-in battery 115b Charging current control circuit 115c Electric transmission antenna 116 Indicator lamp 117 Electronic medical record data holding unit (holding unit)
118 Communication antenna (wireless transmitter, wireless receiver)
119 Voice conversion means 120 Voice analysis means 120a Feature parameter extraction section 120b Acoustic model holding section 120c Dictionary 120d Language model 120e Rule grammar 120f Recognition decoder 122 Angle knob 123 Suction valve 124 Remote button 125 Waterproof cap 125a Lock switch 125b Lock pin 126 Join pin 127 Power line carrier transmission circuit 127a Modulation / demodulation circuit 127b Converter 130 Insertion unit 131 Objective lens 132 CCD unit (imaging unit)
133 Light distribution lens 134 LED
135 Image transmission fiber / Image transmission lens array 136 Light guide fiber 200 Electronic endoscope terminal (external device)
201 control circuit 202 battery unit 202a built-in battery 202b charge current control circuit 202c electric transmission antenna 203 input device (input means)
204 Communication socket 205 External power socket 206 Indicator lamp 207 Communication antenna (wireless transmitter, wireless receiver)
208 Display device (display unit)
209 Junction part 210 Power line carrier transmission circuit 210a Modulation / demodulation circuit 210b Converter 211 Mount part 300 Head mounted display unit (external device)
301 Microphone (input means)
302 Communication antenna (wireless transmitter, wireless receiver)
303 Observation window (display unit)
304 Earpad 400 Deferred terminal (processor)
401 Control circuit 402 Input device (input means)
403 Communication socket 404 External power supply socket 405 Indicator lamp 406 Communication antenna (wireless transmitter, wireless receiver)
407 Communication / Processing Unit 500 External Display 501 Reception Adapter 600 Electronic Medical Record System 700 Auxiliary Input Device (Input Means)
701 Jog dial 702 Joystick 703 Button 704 Trigger 705 Communication antenna 710 Expansion controller (input means)
711 Button 712 Joystick 713 Touch panel type input unit 720 Electronic endoscope hanger 721 Pole 722 Caster plate 723 Caster 724 Lifting holder 725 Holder fixing screw 726 Endoscope support arm 727 Insertion support unit 728 Power plug 729 Power supply circuit (wireless charging unit)
730 Electric transmission antenna (wireless charging unit)
740 Microphone (voice input device)
800 Virtual electronic endoscope system 810 Server 820 LAN
830 Position information detection means 840 Processor (endoscope center)
850 Navigation unit 851 Virtual endoscopic image 852 Bronchial care plan (path plan)
853 Observation image (main image)
854 Preoperative X-ray image 855 Intraoperative X-ray image 856 Virtual tomographic image

Claims (15)

An electronic endoscope having an imaging unit that captures an observation image of the observation object;
Input means capable of inputting voice information and / or text information to the electronic endoscope;
An external device that is separate from the electronic endoscope and has a display unit;
The electronic endoscope is:
A generation unit that generates electronic medical record data including an observation image captured by the imaging unit and voice information and / or character information input by the input unit;
A holding unit for holding electronic medical chart data generated by the generating unit;
A wireless transmission unit that wirelessly transmits the electronic medical record data held by the holding unit to the external device;
An electronic endoscope system comprising: The electronic endoscope system according to claim 1, wherein
The electronic endoscope includes a wireless reception unit that wirelessly receives an electronic medical record data update instruction signal from the external device, and an electronic medical record that the holding unit holds in accordance with the electronic medical record data update instruction signal wirelessly received by the wireless reception unit. An electronic endoscope system further comprising an update unit for updating data. The electronic endoscope system according to claim 1 or 2,
The input means is an electronic endoscope system provided in both or one of the electronic endoscope and the external device. The electronic endoscope system according to any one of claims 1 to 3,
The electronic endoscope system, wherein the external device includes an electronic endoscope terminal, and the electronic endoscope terminal includes the input unit. The electronic endoscope system according to any one of claims 1 to 4,
The electronic endoscope system, wherein the external device includes a head mounted display unit, and the input means is provided in the head mounted display unit. The electronic endoscope system according to any one of claims 1 to 5,
The electronic endoscope system, wherein the external device includes a stationary terminal, and the input means is provided in the stationary terminal. The electronic endoscope system according to any one of claims 1 to 6,
The electronic medical record data includes electronic information including ID information including at least one of observation date and time, patient information, medical doctor information, elapsed time, serial number, endoscope specifying information, endoscope operator, and facility information. Mirror system. The electronic endoscope system according to any one of claims 1 to 7,
An electronic endoscope system further comprising voice analysis means for analyzing voice information input by the input means and converting it into character information. The electronic endoscope system according to claim 8, wherein
The voice analysis means includes
A feature parameter extraction unit that analyzes voice information input by the input unit and extracts a feature parameter;
An acoustic model holding unit for storing the correspondence between the probability of the sound of the feature parameter and the phonetic symbol as an acoustic model;
A dictionary that stores the words to be recognized as data,
A language model representing the occurrence probability of a word and the appearance probability of a word connected to a specific word;
A rule grammar that defines the range of words;
Based on the acoustic parameters and the language information possessed by the acoustic model holding unit, the dictionary, the language model, and the rule grammar based on the feature parameters extracted by the feature parameter extraction unit, the voice information input by the input unit is analyzed by voice. A recognition decoder that converts character information into
An electronic endoscope system. The electronic endoscope system according to any one of claims 1 to 9,
The electronic endoscope is:
A battery unit for supplying driving power for the electronic endoscope;
A communication socket for charging the battery unit by a supply voltage from the external device;
An electronic endoscope system. The electronic endoscope system according to claim 10, wherein
The electronic endoscope further includes an external power socket for receiving a supply voltage to the electronic endoscope from an external power source different from the external device, and the external power socket receives the external power source from the external power source. An electronic endoscope system that charges the battery unit with both a supply voltage and a supply voltage from the external device via the communication socket. The electronic endoscope system according to claim 11, wherein
An electronic endoscope system in which a supply voltage from the external power supply received by the external power socket is higher than a supply voltage from the external device by the communication socket. The electronic endoscope system according to any one of claims 1 to 12,
An electronic device comprising: an insertion support portion for inserting and supporting the electronic endoscope; and a wireless charging portion for wirelessly charging the battery unit of the electronic endoscope in a state where the electronic endoscope is inserted and supported in the insertion support portion. An electronic endoscope system further comprising an endoscope hanger. The electronic endoscope system according to any one of claims 1 to 13,
A server that holds a 3D image of the observation object;
A navigation unit that generates a virtual endoscopic image from a 3D image of the observation object held by the server;
An electronic endoscope system. The electronic endoscope system according to claim 14, wherein
Further comprising position information detection means for detecting position information inside the observation object of the electronic endoscope,
The navigation unit is an electronic endoscope system that generates a bronchial care plan by combining position information of the electronic endoscope detected by the position information detection unit with the generated virtual endoscope image.

Images