JP2002177214A - Endoscope image filing device for electronic endoscope device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an endoscope image filing device capable of quickly retrieving endoscope image data in an endoscope image data base and having data bases capable of providing retrieval results with high reliability, in the endoscope image filing device combined with an electronic endoscope device. SOLUTION: This endoscope image filing device 18 is provided with the endoscope image data base for preserving each endoscope image data as stationary image data in a prescribed address and a feature extraction data base for preserving feature extraction data extracting the feature of the endoscope image data in a corresponding address linked with the preserving address of the endoscope image data in the endoscope image data base.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

The present invention relates to an endoscope image filing apparatus incorporated in an electronic endoscope apparatus.

[0002]

2. Description of the Related Art As is well known, an electronic endoscope apparatus includes a scope (endoscope), an image sensor provided at a distal end of the scope, and a detachably connected proximal end of the scope. And a TV monitor connected to the image signal processing unit. The pixel signal of the endoscope image obtained by the imaging sensor of the scope is output as a video signal from the image signal processing unit after being appropriately processed, and the endoscope image is reproduced and displayed on the TV monitor based on the video signal. . Of course, the electronic endoscope device is used for observing the inside of an organ, for example, the inside of the lung through the bronchi or the inside of the stomach through the esophagus.

In recent years, an electronic endoscope apparatus has been combined with an image filing apparatus, and the image filing apparatus includes an image processing computer. During operation of the electronic endoscope apparatus, the endoscope image is fetched from the video signal as a still image to the image processing computer as needed, and stored as endoscope image data in the endoscope image database constructed on the hard disk. You.

On the other hand, the hard disk of the image processing computer has keywords / keywords corresponding to the endoscope image database.
A database is also constructed, and the keyword database stores keyword information data corresponding to individual endoscope image data. Such keyword information data includes various information data such as patient name, patient ID number, examination / diagnosis date and time, examination / diagnosis site name, disease state or symptom name, doctor name, and the like. Used to search for endoscope image data in the endoscope image database.

[0005] When a certain part inside the internal organ is observed using the scope of the electronic endoscope apparatus, the observed part is compared with the past endoscopic image data of the similar part stored in the endoscope image database. It is often desirable to make a comparison, in which case an image filing device is utilized. For example, when a certain part in the bronchus is observed by the scope, the keyword information data corresponding to the observed part is input to the image filing device via the keyboard, whereby the similar part in the endoscope image database is input. Endoscope image data is searched, and the endoscope image is displayed on a TV monitor of the image filing apparatus. The doctor operating the scope compares the endoscope image during observation, which is reproduced and displayed on the TV monitor of the electronic endoscope device, with the endoscope image projected on the TV monitor of the image filing device, and compares the endoscope image during observation. It is possible to make an accurate diagnosis for the part.

As described above, in the conventional image filing apparatus, the search for the endoscope image data in the endoscope image database involves input of keyword information data using a keyboard. The problem is that the search cannot always be performed quickly. This is because, in order to be able to efficiently search for endoscopic image data, it is necessary to enrich the keyword information data, but since it takes a lot of time and money, This is because it is difficult to obtain sufficient keyword information data.

As a result, if desired keyword information data cannot be used to search for desired endoscopic image data, it is necessary to input the next keyword information data. You cannot do it quickly. In addition, as a result of several attempts to enter the keyword information data, the corresponding endoscope image data may not be saved, during which time the examination with the scope will be interrupted, and the patient will be forced to uselessly. Become.

Further, input of the keyword information data using the keyboard involves an input error, which also becomes a factor that makes it difficult to quickly search for endoscopic image data. For example, when the operator of the scope (doctor) wants to obtain specific endoscope image data related to the current observation region from the endoscope image database, the operator stores the patient name of the specific endoscope image data. If so, the patient name would be entered as a keyword, but if the memory is incorrect, a search for specific endoscopic image data cannot be obtained. In short, the retrieval of endoscopic image data by keyword information data lacks reliability. Conventionally, even if an endoscope image filing device is incorporated in an electronic endoscope device, its use is low. It has become.

[0009]

SUMMARY OF THE INVENTION Accordingly, an object of the present invention is to provide an endoscope image filing apparatus to be combined with an electronic endoscope apparatus, and to quickly search for endoscope image data in the endoscope image database. An object of the present invention is to provide an endoscope image filing apparatus having a database that can perform not only practicable but also highly reliable search results.

[0010]

An endoscope image filing apparatus according to the present invention is used in combination with an electronic endoscope apparatus, and stores individual endoscope image data at a predetermined address as still image data. And a feature extraction database storing feature extraction data obtained by extracting features of the endoscope image data at a corresponding address linked to a storage address of the endoscope image data in the endoscope image database. It consists of

According to a first aspect of the present invention, the endoscope image filing apparatus further includes a video signal output from the electronic endoscope apparatus when receiving an image capture command signal from the electronic endoscope apparatus. Image capturing means for capturing endoscopic image data as still image data from the endoscope, endoscope image data writing means for writing and storing the endoscope image data at a predetermined address of an endoscope image database, and the endoscope image A feature extraction image processing means for extracting features from the data to create feature extraction data; and storing the feature extraction data in a corresponding address linked to a storage address of the endoscope image data in an endoscope image database. And a feature extraction data writing unit for performing the operation.

According to a second aspect of the present invention, the endoscope image filing apparatus further includes a video signal output from the electronic endoscope apparatus when receiving an image search command signal from the electronic endoscope apparatus. Image capturing means for capturing endoscopic image data as still image data from the camera, feature extraction image processing means for extracting features from the endoscope image data to create search target feature extraction data, and the inspection feature Feature extraction data determining means for determining whether or not the extracted data matches individual feature extraction data stored in the feature extraction database within a predetermined matching degree allowable range; and a result obtained by the feature extraction data determining means. Display means for displaying.

Preferably, the endoscopic image filing apparatus according to the second aspect of the present invention further comprises the step of determining that the inspection target feature extraction data matches the specific feature extraction data stored in the feature extraction database by the feature extraction data determining means. When it is determined, the endoscope image data reading means for reading the endoscope image data from the corresponding address of the endoscope image database linked to the address where the specific feature extraction data is stored in the feature extraction database, An endoscope image based on the endoscope image data is displayed by the display means. In this case, the display means may also display an endoscope image based on the endoscope image data captured by the image capturing means from the video signal output from the electronic endoscope apparatus.

Preferably, the endoscope image filing apparatus according to the second aspect of the present invention further includes a setting change unit for changing the setting of the allowable range of coincidence, and the setting of the allowable range of coincidence by the setting changing unit. Setting change determining means for determining whether or not a change has been made. When the setting change determining means determines that the setting of the allowable range of coincidence has been changed, the determination by the feature extraction data determining means is repeated. It is.

[0015]

DESCRIPTION OF THE PREFERRED EMBODIMENTS Next, an embodiment of the endoscopic image filing apparatus according to the present invention will be described with reference to the accompanying drawings.

Referring to FIG. 1, an electronic endoscope apparatus incorporating the endoscope image filing apparatus according to the present invention is schematically shown as a block diagram. The electronic endoscope apparatus includes a scope (endoscope) 10, an image signal processing unit (a so-called processor) 12 configured to detachably connect the scope 10, and an analog connected to the image signal processing unit 12. And a color TV monitor 14. In the present embodiment, an analog video printer 16 is also connected to the image signal processing unit 12.

The scope 10 is an image signal processing unit 12
It is designed to be detachably connected to
This is because there are various types of scopes 10 for each observation site. For example, alternatives to the scope 10 include a bronchial scope, an upper digestive tract scope, a large intestine scope, and the like. In short, the image signal processing unit 12 is shared by various types of scopes.

An endoscopic image filing device according to the present invention is indicated generally by the reference numeral 18, which is also connected to the image signal processing unit 12. The image filing device 18 includes an image processing computer 20, to which a keyboard 22, a mouse 24 and a card reader 26 are connected as input means. The image filing device 18 includes a digital video printer 28 and a high-resolution TV monitor 30.
Is provided.

The scope 10 has an image sensor 32 mounted on a distal end thereof, and the image sensor 32 comprises a solid-state image sensor, for example, a CCD (charge-coupled device) image sensor. In the present embodiment, the image sensor 32 is turned on.
Consists of a CCD with a chip color filter,
An endoscope image can be captured as a full-color image. CCD driver signal line 3 from the image sensor 32
4 and the image signal readout line 36 extend to extend the scope 10
It is made to penetrate inside. An illumination light guide cable 38 composed of an optical fiber bundle is inserted into the scope 10. The light guide cable 18 extends to the distal end face of the scope 10 to illuminate the front of the image sensor 32. A rigid light guide rod 89 is connected to the proximal end of 18.

A system controller 40 is provided in the image signal processing unit 12, and the system controller 40 is composed of, for example, a microcomputer. That is, the system controller 40 controls the central processing unit (C
PU), programs for executing various routines,
A read-only memory (ROM) for storing constants and the like, and a writable / readable memory (R) for temporarily storing data and the like.
AM), an input / output interface (I / O),
It controls the overall operation of the electronic endoscope device. Further, a timing controller 42 is provided in the image signal processing unit 12, and the timing controller 42 is operated under the control of the system controller 40. Control clock pulses of various frequencies are output from the timing controller 42, and various operation timings in the electronic endoscope apparatus are controlled according to these control clock pulses as described later.

The image signal processing unit 12 includes an image signal processing circuit. The image signal processing circuit includes a pre-stage signal processing circuit 44, an image memory 46, and a post-stage video signal processing circuit 4.
8 is included. Pre-stage signal processing circuit 44, image memory 46
The respective operation timings of the subsequent video signal processing circuit 48 are controlled in accordance with a control clock pulse output from the timing controller 42. The image signal processing unit 12 further includes a light source device 50.
0 includes a halogen lamp and a lamp power supply circuit as a white light source lamp, and the lamp power supply circuit is operated under the control of the system controller 40.

A front panel 52 is mounted on a front outer wall of a housing of the image signal processing unit 12, and various switches, indicator lights, and the like are provided on the front panel 52.
For example, on the front panel 52, a main power switch of the image signal processing unit 12 itself and a lamp lighting switch for turning on / off a white light source lamp of the light source device 50 are provided. In addition, switches particularly relevant to the present invention include:
Image capture switch and image search switch,
The functions of these switches will be described later in detail.

The scope 10 is an image signal processing unit 12
When connected, the CCD driver signal line 34 is connected to the timing controller 42, and the image signal readout line 36 is connected to the preceding signal processing circuit 44. On the other hand, the light guide rod 39 is optically connected to the white light source lamp of the light source device 50, whereby the white light from the white light source lamp is transmitted to the light guide rod 39 and the light guide cable 3
8 and fired from the distal end face of the scope 10. When the front of the image sensor 32 is illuminated by the light emitted from the distal end surface of the scope 10, a subject image, that is, an endoscope image is formed on the light receiving surface of the image sensor 32. By 32, photoelectric conversion into pixel signals of three primary colors for one frame is performed.

When a series of control clock pulses are output from the timing controller 42 to the image sensor 32 via the CCD driver signal line 34 as image read signals, pixel signals of three primary colors for one frame are output from the image sensor 32 in accordance with the image read signal. Image signal readout line 3
6 are sequentially read. The three primary color pixel signals read from the image sensor 32 are sent to the pre-stage signal processing circuit 44, where they are subjected to predetermined image processing, for example, gamma correction and white balance processing, and then converted into three primary color digital pixel signals. The image signal processing in the pre-stage signal processing circuit 44 is performed in accordance with a control clock pulse output from the timing controller 42, whereby the image sensor 32
And the timing of processing the pixel signals in the pre-stage signal processing circuit 44 are synchronized with each other.

The digital pixel signals of the three primary colors output from the pre-stage signal processing circuit 44 are once written in the image memory 46. In the image memory 46, a write memory area for each of the three primary colors is defined, and a digital pixel signal for each color is written to the write memory area for the corresponding color. While the three primary color digital pixel signals are being written to the three primary color write memory areas of the image memory 46, the three primary color digital pixel signals related to each other are simultaneously read from the three primary color write memory areas at a predetermined timing. It is output as an image signal component of three primary colors of the digital component video signal.

The writing of the digital pixel signal into each writing memory area of the image memory 46 is performed in accordance with the writing clock pulse output from the timing controller 42, and the conversion of the three primary color pixel signals from the three primary color writing memory areas of the image memory 46 is performed. Reading is also performed from the timing component 42 in accordance with the output reading clock pulse.

The digital data output from the image memory 46
The three primary color image signal components of the component video signal are sent to the downstream video signal processing circuit 48, where the three primary color image signal components are converted into three primary color analog image signal components. On the other hand, in the timing controller 42, a composite synchronizing signal component of the component video signal is formed, and this composite synchronizing signal component is generated by the subsequent video signal processing circuit 48.
, So that the subsequent video signal processing circuit 4
At 8, an analog component video signal is obtained.

The analog component video signal obtained by the second-stage video signal processing circuit 48 is subjected to high-frequency noise removal processing, amplification processing, etc., and then to the analog TV monitor 1
4 where the endoscope image captured by the image sensor 32 is reproduced and displayed. As is well known, in the electronic endoscope apparatus, the analog TV monitor 14 also displays, in addition to the endoscope image, character information data such as a patient name, a patient ID number, an examination date and time, a doctor's name, and comments on examination results. Is done. In order to display such character information, a character signal generating circuit is provided in the subsequent video signal processing circuit 48, and a character pattern signal output from the character signal generating circuit is superimposed on a video signal, thereby providing an analog TV. The display of the character information on the monitor 14 is performed.

More specifically, the character signal generating circuit is a video R
It consists of AM and character generator. In order to display the predetermined character information on the analog TV monitor 14, the character code data corresponding to the predetermined character information is displayed on the video RA.
M is written at a predetermined address. At this time, a character generator generates a character pattern signal corresponding to the character code data, and the character pattern signal is output from the character signal generation circuit and superimposed on the video signal. Desired character information is displayed on the analog TV monitor 14. The display position of the character information on the display screen of the analog TV monitor 14 corresponds to the address of the character code data written in the video RAM.

The character information to be displayed on the analog TV monitor 14 includes fixed character information and variable character information. Fixed character code data corresponding to the fixed character information is stored in the ROM of the system controller 40 in advance. Reference numeral 40 reads out the fixed character code data from the ROM as needed and reads out the video RA of the character signal generation circuit.
Write to a predetermined address of M. On the other hand, the fixed character code data corresponding to the variable character information is stored in the system controller 4.
The input character code data is input by a keyboard (not shown) connected to the address 0, and is written to a predetermined address of the video RAM of the character signal generating circuit under the control of the system controller 40.

The rear-stage video signal processing circuit 48 is provided with a color encoder, and the color encoder generates a composite video signal or an S-video signal from an analog component video signal. It is sent to peripheral equipment of the endoscope apparatus.
For example, in the illustrated example, the composite video signal or S-video signal is sent to an analog video printer 16 where the endoscope image is output as a hard copy as needed.

As shown in FIG. 1, the analog component video signal output from the downstream video signal processing circuit 48 is also sent to the endoscope image filing device 18 according to the present invention, and the analog component video signal is output to the analog component filing device 18 according to the present invention. -Endoscope image data can be captured as still image data from a video signal.

Referring to FIG. 2, the image processing computer 20 of the image filing device 18 is shown as a block diagram.

The image processing computer 20 has a central processing unit (CPU) 20A, a read-only memory (R) for storing programs for executing various routines, constants and the like.
OM) 20B, a writable / readable memory (RAM) 20C for temporarily storing data and the like, and an input / output interface (I / O) 20D. The image processing computer 20 is connected to a keyboard 22, a mouse 24, a card reader 26, a digital video printer 28 and a high-resolution TV monitor 30 via an input / output interface 20D, and an image signal processing unit via the input / output interface 20D. 12 system controllers 40
Also connected.

The image processing computer 20 is provided with a hard disk 54 functioning as a storage medium, and a hard disk driver 56 for driving the hard disk 54 to write data and read data. Further, the image processing controller 20 is provided with an interface circuit 58 and a frame memory 60. The interface circuit 58 is connected to the subsequent video signal processing circuit 48 of the image signal processing unit 12, and fetches an analog component video signal therefrom. The data is converted into a digital video signal and written into the frame memory 60.

During the operation of the electronic endoscope apparatus, the interface circuit 58 always receives the video signal output from the video signal processing circuit 48 at the subsequent stage of the image signal processing unit 12, and converts the video signal into a digital video signal. The data is sequentially written to the frame memory 60. In short, the frame memory 60 holds a video signal corresponding to the endoscopic image displayed on the analog TV monitor 14.

When the image capture switch on the front panel 52 is turned on, the ON signal is sent to the image processing computer 20 via the system controller 40 as an image capture command signal. When the image processing computer 20 receives the image capture command signal, the frame memory 60
The writing of digital video signals to the
At this time, the digital video signal is read from the frame memory 60 as endoscope image data (still image data). Next, the endoscope image data read from the frame memory 60 is written and stored by the hard disk driver 56 at a predetermined address of the endoscope image database constructed on the hard disk 54. Note that the endoscope image data includes the character information data described above, and such character information data is also stored in the endoscope image database.

On the other hand, the endoscope image data is subjected to feature extraction image processing for extracting features of the endoscope image, and is converted into feature extraction data. Such feature extraction data is written and stored at a predetermined address of a feature extraction database constructed on the hard disk 54 by the hard disk driver 56.

The address of the endoscope image database and the address of the feature extraction database correspond to each other, and the address of the feature extraction database in which the feature extraction data is stored stores the original endoscope image data. Linked to the address of the endoscope image database.

Referring to FIG. 3, an example of the feature extraction image processing is shown. The endoscopic image indicated by reference numeral A1 is based on the original image data read from the frame 60, and the endoscopic image is an image of a tracheal bifurcation in the lungs. The endoscope image A1 is subjected to a two-gradation process based on a predetermined threshold to be a two-gradation image A2, and then the two-gradation image A2 is subjected to a contour edge extraction process to be an edge extraction image A3. That is, in the present embodiment, the edge extraction image A3 is treated as a feature extraction image. Subsequently, the edge extraction image, that is, the feature extraction image A3 is subjected to a normalization process and is normalized to an image A4 of a predetermined size.

As described above, various types of scopes are connected to the image signal processing unit 12. In this case, the size of the endoscope image obtained according to the type of scope may differ. , And therefore feature extraction image A
Normalization is required for the size of 3. Of course, if the edge extraction image A3 obtained by the contour edge extraction processing matches the normalized size, the normalization processing is not required.

In general, since an endoscope image is an image of the inside of a human body, the endoscope image is entirely reddish due to blood circulating in blood vessels inside the body tissue surface layer. Therefore, the binarization process and the edge extraction process may be performed after extracting only the red image from the original image A1. Further, the edge extraction processing may be performed after performing the outline emphasis processing instead of the two-gradation processing.

Thus, every time the image capture switch on the front panel 52 is turned on, the endoscope image data is stored in the endoscope image database, and the feature extraction data is also stored in the feature extraction database. .

When the operator (physician) of the scope 10 wants to refer to a past endoscopic image of a similar part in the organ currently being observed, the image search switch on the front panel 52 is turned on. By doing so, it is searched whether or not the endoscope image data to be referred to exists in the endoscope image database.

More specifically, the ON signal of the image search switch is sent to the image processing computer 20 via the system controller 40 as an image search command signal. When the image processing computer 20 receives the image search command signal, the frame memory 6 receives the image search command signal in the same manner as when receiving the image capture command signal.
Writing of the digital video signal to 0 is temporarily interrupted. At this time, the digital video signal is read from the frame memory 60 as endoscope image data (still image data). Next, an endoscope image based on the endoscope image data read from the frame memory 60 is displayed on the high resolution TV monitor 3.
0 is displayed as a still image in a part of the display screen, for example, a left half area thereof.

On the other hand, the endoscope image data is subjected to feature extraction image processing as described with reference to FIG. 3, and the feature extraction data is compared with individual feature extraction data stored in the feature extraction database by pattern matching processing. Then, it is determined whether or not both feature extraction data match. In the pattern matching process, for example, a structural analysis is performed to determine how much the adjacencies or branch points of a plurality of line segments in the feature extraction image based on both the feature extraction data match. It is determined whether they match. A predetermined allowable range is set for the degree of coincidence between both feature extraction data, and preferably, such an allowable range can be adjusted.

For convenience of explanation, in the following description, feature extraction data to be searched is defined as feature extraction data to be searched, and feature extraction data stored in the feature extraction database is defined as feature extraction data to be searched. Define.

When there is search target feature extraction data that matches search target feature extraction data, the number of search feature extraction data that matches search target feature extraction data, the so-called hit count, is displayed on the display screen of the high-resolution TV monitor 30. Is displayed at an appropriate place. On the other hand, the endoscope image data linked to the search target feature extraction data that matches the search target feature extraction data is read from the endoscope image database, and the endoscope image based on the endoscope image data is displayed on the high-resolution TV monitor 30. For example, it is displayed in the right half area of the screen. When there are a plurality of endoscope images displayed in the right half area of the display screen of the high-resolution TV monitor 30, when one of the endoscope images is clicked by operating the mouse 24, the endoscope image is displayed. It is displayed on the entire right half area of the display screen.

Of course, since both the analog color TV monitor 14 and the high-resolution TV monitor 30 are installed at a place where the operator of the scope 10, ie, a doctor, can observe them,
The doctor can make an accurate diagnosis of a site in the organ currently being observed while referring to an endoscopic image of a similar site in the past.

On the other hand, if there is no search target feature extraction data that matches the search target feature extraction data, the fact that the number of hits is zero is displayed at an appropriate position on the display screen of the high-resolution TV monitor 30. Therefore, if there is no feature extraction data to be referred to in the feature extraction database, the doctor can immediately proceed to the next step, and the burden on the patient can be reduced.

Referring to FIG. 4, there is shown a flowchart of an image capturing routine executed by the image processing computer 20. Note that this image capture routine is executed when the image processing computer 20 receives an image capture command signal from the system controller 40 of the image signal processing unit 12 as an ON signal of the image capture switch.

In step 401, the frame memory 60
The writing of the digital video signal to the memory is temporarily interrupted. Next, in step 402, the frame memory 60
, A digital video signal is read out as endoscope image data (still image data), and the endoscope image data is read from the RAM.
20C. Subsequently, in step 403, the writing of the data video signal to the frame memory 60 is restarted.

In step 404, the endoscope image data once stored in the RAM 20C is stored in a hard disk at a predetermined address of the endoscope image database constructed on the hard disk 54.
Written and stored by the disk driver 56.

In step 405, the above-described feature extraction image processing image is applied to the endoscope image data stored in the RAM 20C in order to extract the features of the endoscope image, and the resulting feature is obtained. The extracted data is written and stored by the hard disk driver 56 at a predetermined address of the feature extraction database constructed on the hard disk 54. Of course, as described above, the predetermined address where the feature extraction data is to be stored is linked to the address of the endoscope image database in which the original endoscope image data is stored.

By turning on the image capture switch as needed during the operation of the electronic endoscope apparatus, the endoscope image database and the feature extraction database of the hard disk 54 of the image processing computer 20 are stored in the endoscope image data. And feature extraction data.

Referring to FIGS. 5 and 6, there is shown a flowchart of an image search routine executed by the image processing computer 20. This image search routine is executed when the image processing computer 20 receives an image search command signal from the system controller 40 of the image signal processing unit 12 as an ON signal of the image search switch.

In step 501, the frame memory 60
The writing of the digital video signal to the memory is temporarily interrupted. Next, at step 502, the frame memory 60
, A digital video signal is read out as endoscope image data (still image data), and the endoscope image data is temporarily stored in the RAM 20C as search target endoscope data.
Subsequently, in step 503, the writing of the data video signal to the frame memory 60 is restarted.

In step 504, the endoscope image is displayed on the left half of the display screen of the high-resolution TV monitor 30 based on the endoscope image data once stored in the RAM 20C. Next, in step 505, the above-described feature extraction image processing image is applied to the endoscope image data stored in the RAM 20C to extract the feature of the endoscope image, and the resulting feature extraction image is obtained. The data is stored in the RAM 20C as search target feature extraction data.

In step 506, the hard disk 54
One of the feature extraction data stored in the feature extraction database constructed in step (1) is read out as search target feature extraction data. Then, in step 507, the search target feature extraction data and the search target feature extraction data have a predetermined matching degree tolerance. It is determined whether they match within the range. The allowable range of the matching degree between the search target feature extraction data and the search target feature extraction data is determined in advance by an input operation of the keyboard 22 or a click operation of the toolbar on the display screen of the high-resolution TV monitor 30 with the mouse 24. The initial value (default) can be set arbitrarily. In the present embodiment, for example, 80% is set as the initial value of the matching degree allowable range.
Is set.

If it is determined in step 507 that the extracted feature data matches the extracted feature data, the process proceeds to step 508, where the count value of the counter C is incremented by "1", and then to step 509. move on. On the other hand, if it is determined in step 507 that the search target feature extraction data does not match the search target feature extraction data, step 508 is skipped and step 5 is skipped.
Go to 09.

In any case, in step 509, it is determined whether the comparison of the search target feature extraction data with all the search target feature extraction data in the feature extraction database is completed. If the comparison of the search target feature extraction data with respect to all the search target feature extraction data has not been completed, the process returns to step 506. That is, the routine consisting of steps 506 to 509 is repeated until the comparison of the search target feature extracted data with respect to all the searched feature extracted data is completed. When the comparison of the search target feature extraction data to all the search target feature extraction data is completed, step 50 is performed.
From 9, the process proceeds to step 510, where the counter number of the counter C, that is, the hit number, is displayed at an appropriate position on the display screen of the high-resolution TV monitor 30.

At step 511, it is determined whether or not the counter number (hit number) of the counter C is other than zero.
If C (0), that is, if there is searched feature extraction data that matches the search target extraction data, step 5
In step 12, the endoscope image data linked to the searched feature extraction data is read from the endoscope image database, and an endoscope image based on the read endoscope image data is displayed on the display screen of the high-resolution TV monitor 30. Is displayed in the right half area of Since the endoscope image displayed on the high-resolution TV monitor 30 includes the character information data as described above,
The details as well as the details of the endoscopic image can be readily understood. Next, after the counter C is reset to zero in step 513, the process proceeds to step 514. On the other hand, if C
(If it is 0, that is, if there is no searched feature extraction data that matches the search target extraction data, step 512
And 513 are skipped and the routine proceeds to step 514.

In any case, in step 514, a message prompting the user to change the setting of the matching degree allowable range, for example, "Change of the matching degree allowable range?" Is displayed at an appropriate place on the display screen of the high-resolution TV monitor 30. For example, if the number of hits is too large, the matching tolerance may be set to 80% or more. Conversely, if the number of hits is zero or small, the matching tolerance may be set to 80% or less. You can fix it. Such resetting of the allowable range of the matching degree is performed by an input operation of the keyboard 22 or a click operation of the toolbar on the display screen of the high-resolution TV monitor 30 with the mouse 24.

In step 515, it is monitored whether the execution key on the keyboard 22 has been operated. In other words, in step 514, for example, the message prompting the user to change the setting of the allowable range of the matching degree is “change of the allowable range of the matching degree?
After being displayed on the V-monitor 30, the system is in a standby state until an execution key on the keyboard 22 is operated. During this standby state, if it is necessary to reset the matching degree allowable range, this is performed. When the operation of the execution key is confirmed in step 515, it is determined whether or not the setting of the allowable range of the matching degree has been changed. If the setting of the acceptable range of the degree of coincidence has been changed, the process returns to step 506, and the comparison of the search target feature extraction data with all the search target feature extraction data is performed again. on the other hand,
If the setting of the matching degree allowable range has not been changed, the process proceeds to step 517, where a display change routine is executed.

The display change routine is a routine for changing the state of the display screen of the high-resolution TV monitor 30 by operating the keyboard 22 or clicking the mouse 24 as necessary. For example, when one of a plurality of endoscope images displayed in the right half area of the display screen is clicked during the display change routine, the image is enlarged to the entire right half area, Is returned to the endoscope image display.

Once the execution of the display change routine has been completed in step 517, the process proceeds to step 518, where it is determined whether an end key (for example, the Esc key) on the keyboard 22 has been operated. Until the operation of the end key is confirmed, the execution of the display change routine is repeated in step 517.

When the operation of the end key is confirmed in step 518, the process proceeds to step 519, where the display screen of the high resolution TV monitor 30 is returned to the initial display screen, and the image search routine ends.

For the digital video printer 28 of the image filing device 18, the high-resolution TV monitor 3
It can be used to record the search target endoscope image and the searched endoscope image displayed at 0 as a hard copy as necessary. The card reader 26 of the image filing device 18 may be used to record the above-mentioned endoscope image to be searched and the endoscope image to be searched on an appropriate memory card, or may be used by another electronic endoscope device. The obtained endoscope image is temporarily recorded on a memory card, the endoscope image data is read from the memory card by a card reader 26, added to an endoscope image database, and the above-described feature extraction image processing is performed on the endoscope image data. Or to add the feature extraction data to a feature extraction database.

Of course, also in the endoscope image filing apparatus according to the present invention, the keyword data base similar to the conventional one is constructed on the hard disk 54, and the image filing apparatus according to the present invention is independent of the electronic endoscope apparatus. When activated, the keyword database can be used to retrieve the desired endoscopic image.

In the above embodiment, the image capture switch and the image search switch are provided on the front panel 52. However, similar switches may be provided on the operation unit of the scope 10. In this case, the operator (doctor) of the scope 10 can perform the operation of the image capture switch and the image search switch without the assistance of an assistant such as a nurse.

[0071]

As is apparent from the above description, according to the endoscope image filing apparatus according to the present invention, the endoscope image related to the endoscope image obtained during the operation of the electronic endoscope apparatus is endoscoped. When searching in the mirror image database, it is performed based on the feature extraction data of the endoscopic image, so that not only the search result can be obtained quickly, but also the effect that the reliability of the search result is extremely high can be obtained. The burden on patients undergoing endoscopy may also be reduced.

[Brief description of the drawings]

FIG. 1 is a schematic block diagram of an endoscope image filing apparatus and an electronic endoscope apparatus according to the present invention.

FIG. 2 is a schematic block diagram of an image processing computer of the endoscope image filing apparatus according to the present invention.

FIG. 3 is an explanatory diagram conceptually showing a process of processing an endoscope image when performing feature extraction image processing on endoscope image data in the endoscope image filing apparatus according to the present invention.

FIG. 4 is a flowchart of an image capturing routine executed by the image processing computer of the endoscopic image filing apparatus according to the present invention.

FIG. 5 is a part of a flowchart of an image search routine executed by the image processing computer of the endoscopic image filing apparatus according to the present invention.

FIG. 6 is the remaining part of the flowchart of the image search routine executed by the image processing computer of the endoscopic image filing apparatus according to the present invention.

[Explanation of symbols]

 Reference Signs List 10 scope 12 image signal processing unit 14 analog color TV monitor 16 analog video printer 18 endoscope image filing device 20 image processing computer 22 keyboard 24 mouse 26 card reader 28 digital video printer 30 high-resolution TV monitor 32 imaging sensor 40 System controller 42 Timing controller 50 Light source device 52 Front panel 54 Hard disk 56 Hard disk driver 58 Interface circuit 60 Frame memory

──────────────────────────────────────────────────続 き Continued on the front page (51) Int.Cl. ⁷ Identification symbol FI Theme coat ゛ (Reference) H04N 7/18 H04N 7/18 U F term (Reference) 4C061 CC06 SS21 VV04 WW01 YY12 YY18 5B050 AA02 BA01 EA02 EA06 EA12 FA19 GA08 5B075 KK13 KK33 ND08 NK07 PP02 PP03 PP12 PP13 PP28 PQ02 PQ12 UU29 5C054 AA01 CC07 FC11 FE17 GB02 GB11 GB18 GD09 HA12

Claims (6)

[Claims] 1. An endoscope image filing apparatus incorporated in an electronic endoscope apparatus, comprising: an endoscope image database storing individual endoscope image data at a predetermined address as still image data; An endoscope image filing apparatus comprising: a feature extraction database that stores feature extraction data from which features have been extracted at a corresponding address linked to a storage address of the endoscope image data in the endoscope image database. 2. The endoscope image filing apparatus according to claim 1, further comprising: a video signal output from the electronic endoscope apparatus when an image capture command signal is received from the electronic endoscope apparatus. An image capturing means for capturing endoscope image data as still image data from an endoscope image data writing means for writing and storing the endoscope image data at a predetermined address of the endoscope image database; Feature extraction image processing means for extracting features from the mirror image data to create feature extraction data; and writing the feature extraction data to a corresponding address in the endoscope image database linked to a storage address of the endoscope image data. An endoscope image filing apparatus, comprising: a feature extraction data writing unit for storing the image data in the endoscope. 3. The endoscope image filing apparatus according to claim 1, further comprising: a video signal output from the electronic endoscope apparatus when receiving an image search command signal from the electronic endoscope apparatus. Image capturing means for capturing endoscopic image data as still image data from the apparatus; feature extraction image processing means for extracting features from the endoscope image data to create search target feature extraction data; A feature extraction data determining unit for determining whether the extracted data matches individual feature extraction data stored in the feature extraction database within a predetermined matching degree allowable range, and a result of the feature extraction data determining unit Endoscope image filing apparatus, comprising: display means for displaying an image. 4. The endoscope image filing apparatus according to claim 3, further comprising: a specific feature extraction data in which the inspection target feature extraction data is stored in the feature extraction database by the feature extraction data determination unit. When it is determined that they match, the endoscope image data reading means for reading the endoscope image data from the address of the endoscope image database linked to the specific address where the specific feature extraction data is stored in the feature extraction database. An endoscope image filing apparatus, wherein an endoscope image based on the endoscope image data is displayed by the display means. 5. The endoscope image filing apparatus according to claim 4, wherein the display means is based on endoscope image data captured by the image capturing means from a video signal output from the electronic endoscope apparatus. An endoscope image filing apparatus, wherein an endoscope image is also displayed. 6. The endoscope image filing apparatus according to claim 3, further comprising: a setting change unit configured to change a setting of the allowable range of the coincidence degree; and the setting change. Setting change determining means for determining whether or not the setting of the matching degree allowable range has been changed by the means, when the setting change determining means determines that the setting change of the matching degree allowable range has been performed. An endoscope image filing apparatus, wherein the determination by the feature extraction data determining means is repeated.