JP2005218584A - Display processor of image information and its display processing method and display processing program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a display processor, a display processing method and display processing program of image information, capable of easily recognizing many pieces of the image information and easily searching the image information in which a desired position or a lesion or the like to be paid attention to is imaged from many pieces of the image information. <P>SOLUTION: An image acquired by continuous imaging according to a time axis by using an encapsulated endoscope is correlated with the imaging position and made into a database. The left side of a display screen 38 of a monitor device 21 displays an in-examiner model 26, a passing track 37 of the encapsulated endoscope 3, and a position mark 39 indicating the imaging position. An image 42 corresponding to the position of the position mark 39 is displayed at an image display area 41 at the right side. When the position mark 39 on the passing track 37 is specified by a mouse, a corresponding image 42 is displayed. It is also possible to specify a section and display the image 42 corresponding to the position mark 39 only for the section or to specify the position mark 39 where a special image is picked up. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to an image information display processing device that displays a plurality of pieces of image information obtained by moving within a subject autonomously or otherwise and taking images over time, such as a capsule endoscope. The present invention relates to a display processing method and a display processing program.

In recent years, in the field of endoscopes, so-called capsule endoscopes that are swallowing type endoscopes have appeared (for example, see Patent Document 1).
This capsule endoscope has an imaging function and a wireless communication function, and after being swallowed from the patient's mouth for observation or examination, an observation period until it is naturally discharged from the human body, the stomach, An organ such as the small intestine is sequentially imaged, and image information (electronic data representing the image) obtained by the imaging is sequentially wirelessly transmitted.

The image information wirelessly transmitted in this manner is received by a receiver provided outside the patient's body and stored in a predetermined memory. Thereafter, the image information is read out as necessary and displayed on a display. Thus, it can be used for doctor's diagnosis and the like.
US Patent Application Publication No. 2002 / 0177779A1

  However, in such capsule endoscopes, unlike normal endoscopes, the period from swallowing from the patient's mouth to the natural discharge is the observation and examination period. However, it may take a long time such as 10 hours or more, and the number of image information obtained by imaging during this period is enormous.

  For this reason, it is not easy to grasp such an enormous amount of image information in a short period of time at the stage of diagnosis or the like, and an image of a desired part to be noted from the enormous amount of image information It is not an easy task to find out only information, more specifically, only image information of an organ desired to be diagnosed or image information related to an image of a diseased part.

  In view of the above-described conventional situation, the present invention can easily grasp a large number of pieces of image information, and can easily obtain image information obtained by photographing a desired position to be noticed, a diseased part, etc. from among a large number of pieces of image information. It is an object of the present invention to provide an image information display processing apparatus, a display processing method, and a display processing program that can be searched for.

  In the present invention, first, a display unit displays a plurality of pieces of image information obtained by imaging with time at a plurality of positions in the subject by the imaging device introduced into the subject of the first invention. A display processing device, wherein each of the image information acquisition means for acquiring the plurality of pieces of image information, and each position in the subject that is associated with each of the plurality of pieces of image information and is imaged by the imaging device over time Position information acquisition means for acquiring a plurality of position information regarding the position on the subject taken by the imaging device over time based on the plurality of position information on the display means as at least a one-dimensional diagram Position information display means to be displayed; attention position information instruction means for instructing at least one of the plurality of position information as attention position information; and the plurality of positions displayed as the diagram Of distribution configured to have an image display unit for the image information associated with positional information designated as the target position information displayed on the display means.

The image information display processing device displays a predetermined mark at a position corresponding to the target position information in the diagram among the plurality of position information displayed as the diagram by the position information display unit, for example. It further comprises position mark display means.
The image information display processing device further includes, for example, a storage unit that stores the plurality of pieces of image information and the plurality of pieces of position information, and the image display unit includes the position information designated as the target position information. The image information associated with is read from the storage means and displayed on the display means.

The attention position information instruction means is, for example, a designated position input means for designating any position information on the diagram as the attention position information from the plurality of position information displayed as the diagram by the position information display means. And further configured.
The image information display processing apparatus further includes, for example, feature image detection means for extracting image information having a predetermined feature portion from the plurality of image special information, and the attention position information instruction means includes the feature information. Position information related to the image information having the predetermined feature extracted by the image detection means is designated as the attention position information.

  Next, in the present invention, the image information display processing method of the second invention displays a plurality of pieces of image information obtained by imaging at a plurality of positions in a subject over time on a display screen of a monitor device. A display processing method for acquiring a plurality of image information, and a plurality of image information acquisition steps associated with each of the plurality of image information and related to each position imaged over time in the subject. A position information acquisition step for acquiring the position information of the subject, a position information display step for displaying, as the at least one-dimensional diagram, the positions imaged over time in the subject based on the plurality of position information, Of the position information indicating step of indicating at least one of the position information as the position information of interest, and indicating the position information of interest among the plurality of position information displayed as the diagram Configured to include an image display step, the displaying the image information associated with position information.

This image information display processing method displays, for example, a predetermined mark at a position corresponding to the target position information in the diagram among the plurality of position information displayed as the diagram in the position information display step. It further includes a position mark display step.
The image information display processing method further includes, for example, a storage step of storing the plurality of image information and the plurality of position information, and the image display step includes the position information instructed as the position-of-interest information. The image information associated with is read from the storage step and displayed on the display step.

The attention position information instruction step is, for example, a designated position input step of designating arbitrary position information as the attention position information on the diagram from the plurality of position information displayed as the diagram by the position information display step. And further configured.
The image information display processing method further includes, for example, a feature image detection step of extracting image information having a predetermined feature portion from the plurality of image special information, and the attention position information instruction step includes the feature information Position information related to the image information having the predetermined feature extracted in the image detection step is indicated as the attention position information.

  Furthermore, in the present invention, the image information display processing program of the third invention displays a plurality of image information obtained by imaging at a plurality of positions in a subject over time on a display screen of a monitor device by a computer. The display processing program is associated with each of the image information acquisition processing for acquiring the plurality of image information and the plurality of image information, and is imaged over time in the subject. A position information acquisition process for acquiring a plurality of pieces of position information relating to the respective positions, and a position for displaying at least a one-dimensional diagram of the positions imaged over time in the subject based on the plurality of pieces of position information Information display processing, attention position information instruction processing for instructing at least one of the plurality of position information as attention position information, and the diagram The plurality of among the position information, and an image display processing for displaying the image information associated with positional information designated as the target position information, a so as to execute the computer.

  The image information display processing program displays, for example, a predetermined mark at a position corresponding to the position-of-interest information in the diagram among the plurality of pieces of position information displayed as the diagram by the position information display processing. The computer is configured to further execute the position mark display process.

  The image information display processing program further includes, for example, a storage process for storing the plurality of image information and the plurality of position information, and the image display process includes the position information designated as the attention position information. The computer is configured to read out the image information associated with the image data from the storage process and display the image information on the display process.

The attention position information instruction processing is, for example, designated position input processing for designating arbitrary position information as the attention position information on the diagram from the plurality of position information displayed as the diagram by the position information display processing. Is further included.
The image information display processing program further includes, for example, a feature image detection process for extracting image information having a predetermined feature portion from the plurality of image special bulletins. The computer is configured to instruct the position information associated with the image information having the predetermined feature extracted by the image detection process as the attention position information.

  According to the present invention, it is possible to easily grasp a large amount of image information, and it is possible to easily find out image information obtained by photographing a desired position to be noticed, a diseased part, etc. from among a large number of image information. become.

Embodiments of the present invention will be described below with reference to the drawings.
In the following description, the subject is, for example, the examinee 4, the imaging device is, for example, the capsule endoscope 3, the display means is, for example, the monitor device 21, and the display processing described above. The apparatus is, for example, a workstation 7, the image information is, for example, image data, the image information acquisition unit is, for example, an antenna 11, and the position information is, for example, a passage locus 37 or position data, The position information acquisition means is, for example, the antenna 11 for acquiring position data for constructing the passage locus 37, and the position information display means is, for example, the monitor device 21, the object model 27 displayed on the monitor device 21, the passage locus 37, and the like. The position mark 39, the second position mark 44, etc., and the attention position information is, for example, specific position information in the position information. The position information instruction means is, for example, the position mark 39, the image display means, the position mark display means is, for example, the monitor device 21, the storage means is, for example, the database 9, and the above diagram is, for example, For example, the specified position input means is the keyboard 22 and the mouse 23, and the characteristic image detection means is the workstation 7, for example.

  FIG. 1 is a diagram showing a schematic configuration of a capsule endoscope system according to the present invention and a capsule endoscope image filing system included in the capsule endoscope system. As shown in the figure, the capsule endoscope system 1 of the present example includes a capsule endoscope 3 housed in a package 2 and a patient taking a capsule endoscope 3 taken out from the package 2, that is, a subject to be examined. A person 4, a jacket 5 to be worn by the examinee 4, and a receiver 6 detachably attached to the jacket 5.

  The capsule endoscope image filing system 20 is connected to a workstation 7 that stores and edits image data received by the receiver 6, and is connected to the workstation 7 via a network 8. It consists of a database 9. The database 9 may be built in the workstation 7.

  An imaging unit, a radio unit, and a power source are provided inside the capsule endoscope 3. The capsule endoscope 3 is used for imaging or esophagus, stomach, small intestine, large intestine, etc. during a period until it is swallowed from the mouth of the examinee 4 for observation or examination and discharged from the body. Image data obtained by sequentially imaging the inside of the digestive tract over time is wirelessly transmitted as radio waves from the wireless unit to the outside.

  A plurality of (four in the illustrated example) antennas 11 (11 a and 11 b) that capture transmission waves of image data transmitted from the wireless unit of the capsule endoscope 3 are attached to the jacket 5 worn by the examinee 4. 11c, 11d). These antennas 11 can perform wireless or wired communication with the receiver 6. Note that the number of antennas 11 is not particularly limited to four, and may be any appropriate number. In short, it is sufficient if the number of arrangements is such that the transmitted radio wave according to the position accompanying the movement of the capsule endoscope 3 can be received well.

The receiver 6 is externally provided with an antenna 12 used when receiving image data from the jacket 5 through the antenna 11 via radio waves, a display unit 13 for displaying information necessary for observation or inspection, and observation. Or the input part 14 which inputs information required for a test | inspection is provided.
A power supply unit 15 is provided below the receiver 6 so that power can be supplied even when the receiver 6 is carried. The power supply unit 15 is composed of, for example, a dry battery, a Li ion secondary battery, a Ni hydrogen battery, or the like (of course, other types of batteries may be used).

  Further, a signal processing / control unit 16 for performing processing necessary for observation or inspection is provided inside the receiver 6, and a CF (Compact Flash (registered trademark)) memory 17 for storing received image data. Is attached detachably as shown by a double arrow a in the figure.

  The workstation 7 includes a main body device 19, a monitor device 21 connected to the main body device 19, a keyboard 22, a mouse 23, and the like. In addition to the interface for connecting to the network 8, various interfaces are provided. In addition to the receiver 6 described above, a printer 24 and a CF memory reader / writer 25 are connected via these interfaces. The workstation 7 has an image processing function that allows a doctor or nurse to display an image in the digestive tract of the person to be inspected 4 captured by the capsule endoscope 3 on the monitor device 21 for diagnosis and the like. Yes.

  The doctor or nurse performs an input operation using the keyboard 22 or the mouse 23 to the man-machine interface displayed on the monitor device 21 of the workstation 7, and is transmitted from the capsule endoscope 3 to the receiver 6. It is possible to instruct to take in the image data in the body lumen of the examinee 4 received from the receiver 6.

When the image data is captured from the receiver 6, the image data can be directly captured from the receiver 6 in a wired manner, and the CF memory 17 is attached to the CF memory reader / writer 25 as indicated by an arrow b in FIG. It is also possible to capture image data from the CF memory 17.
Furthermore, the doctor or nurse calls the image data stored in the database 9 by instructing to store the imaging screen data captured from the receiver 6 as described above on the database 9, and will be described later on the display screen of the monitor device 21. An instruction to display an image related to the image data, an instruction to record a medical examination result based on the observation of the image in the database 9, an instruction to print a medical record or the like by the printer 24, and the like can be given.

In the embodiment of the present invention, the capsule endoscope system and the capsule endoscope image filing system will be described specifically, but it is needless to say that the present invention is not necessarily limited thereto.
<First Embodiment>

  2 (a) to 2 (d) show the inspected objects displayed on the same display screen 38 of the monitor device 21 of the workstation 7 in the capsule endoscope image filing system according to the present invention in the first embodiment. FIG. 4A is a diagram showing an example of an in-subject model 26 and an image 42 of the person 4, and FIG. 5A is a diagram showing an in-subject model of the subject 4 displayed on the display screen of the monitor device 21; FIGS. (B) to (d) are diagrams showing examples of images displayed on the same display screen of the monitor device 21 together with the intra-subject model. In FIGS. 4B to 4D, the intra-subject model shown in FIG. 4A is simply shown for convenience of explanation.

  As shown in FIG. 5A, the subject model 27 and the digestive tract model 28 of the subject 4 are displayed as a schematic two-dimensional diagram as the in-subject model 26 of the subject 4. . In the digestive tract model 28, digestive tracts such as the esophagus 31, the stomach 32, the duodenum 33, the small intestine 34, the large intestine 35, and the rectum 36 are displayed in a schematic diagram. In the gastrointestinal tract model 28, a passage trajectory 37 is displayed as position information relating to the position where the capsule endoscope 3 passes and is imaged. Here, the above diagram is not limited to two dimensions.

  Further, as shown in FIGS. 7B to 7D, the above-mentioned intra-subject model 26 is displayed on the left side of the display screen 38 of the monitor device 21 on the same screen, and the capsule-type internal view is displayed. A position mark 39 is superimposed and displayed on the passage locus 37 of the mirror 3 as a predetermined mark for indicating a position corresponding to the imaging position in the specimen. In the image display area 41 on the right side where the in-subject model 26 is displayed, a position in the subject corresponding to a position mark 39 or a position on the passage locus 37 corresponding to processing to be described later in detail. The image 42 imaged in is displayed.

  FIG. 7B shows an example in which a pointing arrow 43 is displayed by operating the mouse 23 as a designated position input means for pointing the position mark 39. FIG. An example is shown in which the first and next two pointing arrows 43 (43-1, 43-2) for designating a section by operation are displayed.

Next, the processing operation in the first embodiment regarding the image processing in the capsule endoscope image filing system will be described.
FIG. 3 is a flowchart for explaining the image processing operation in the first embodiment. This image processing is performed by a control device (hereinafter simply referred to as a CPU) built in the main body device 19 based on an instruction input from the keyboard 22 or mouse 23 of the workstation 7 shown in FIG. 1 by a doctor or nurse. ).

  Prior to this process, the following work is performed. That is, the capsule endoscope 3 is taken out of the package 2 by the examinee 4, and the power supply built in the capsule endoscope 3 is turned on. The capsule endoscope 3 is inspected by the imaging unit of the capsule endoscope 3 during the period from when the capsule endoscope 3 is swallowed by the examinee 4 until the capsule endoscope 3 is moved by the peristaltic movement of the digestive tract and discharged from the body. The inside of the digestive tract of the person 4 is continuously imaged, and a plurality of image data continuous over time is obtained.

The captured image data is transmitted on a radio signal and transmitted from the wireless unit of the capsule endoscope 3, and this signal is received by the antenna 11 (11a, 11b, 11c, 11d) of the jacket 5. This received signal is transferred to the receiver 6.
The receiver 6 circulates and switches the reception from each antenna 11 sequentially at a predetermined time interval, and sets the signal intensity of the received signal and the signal content (image data) at each antenna 11 as a set of signals for one frame. Are generated sequentially. That is, when there are four antennas for one piece of image data, signals for four frames are generated. The generated signals for four frames are sequentially stored in the CF memory 17. The processing on the receiver 6 side is repeated for each imaging operation during the imaging period of the capsule endoscope 3.

In FIG. 3, the CPU first reads image data and position data (S1).
In this process, the CPU directly outputs a signal recorded in the CF memory 17 directly from the receiver 6 by wire or from the CF memory 17 taken out from the receiver 6 and attached to the CF memory reader / writer 25. Read every frame. Then, the image data is read from the received signals for these four frames, and further, the transmission position of the radio wave including the image data is calculated from the signal intensity at each antenna, and the position data relating to the calculated imaging position is acquired. Here, the antenna having the highest signal strength of the received signal may be regarded as the position data without calculating the transmission position.

Subsequently, the CPU associates and stores the image data and the position data acquired as described above (S2).
This process is a process of registering in the database 9 as a record in which image data and position data related to each other are made one set.

Next, the CPU displays position information (S3).
This process is performed on the display screen of the monitor device 21 of the workstation 7 on the digestive tract model 28 of the intra-subject model 26 as shown in FIGS. 2 (a) to 2 (d). This is a process of displaying position information corresponding to the position in the subject through which the capsule endoscope 3 has passed, that is, the passage trajectory 37, from the data. That is, the temporal change in the position information indicates the passage locus 37 of the capsule endoscope 3 in the intra-subject model 26.

Following the above, the CPU displays attention position information (S4).
This processing is performed by superimposing the position information on the display screen of the monitor device 21, that is, on the display of the passage trajectory 37, so that it is a site to be noticed at the time of diagnosis by the doctor or nurse, that is, the position information of interest. This is processing for displaying a position mark 39 (see FIGS. 2B to 2D) indicating that there is. In the initial setting of this process, the position mark 39 is positioned at a position on the display of the passage locus 37 indicating the position information at the time when the capsule endoscope 3 starts imaging after the capsule endoscope 3 starts imaging. It is displayed.

Subsequently, the CPU displays an image corresponding to the attention position information (S5).
In this process, the CPU also stores image data that is paired with position data corresponding to position information at a position on the passage locus 37 specified as the position-of-interest information from the database 9 as data in one record. Based on the data of this one record, an image 42 obtained from the image data corresponding to the position on the passage locus 37 on which the position mark 39 is displayed is displayed, for example, as shown in FIG. The image is displayed in the image display area 41 on the right side of the screen 38.

Subsequently, the CPU determines whether or not a new attention position is designated (S6).
In this process, as shown in FIG. 2 (c), the mouse 23 of the workstation 7 is operated by a doctor or a nurse on the passing locus 37 displayed on the in-subject model 26 being displayed. This is a process for determining whether or not a desired position to be noted in the diagnosis or the like is designated by the pointing arrow 43.

  If the position is specified by the pointing arrow 43 (S6 is Yes), the process returns to the process S4 and the process of the process S4 is executed. In other words, the position mark 39 indicating that it has been instructed as attention position information is superimposed and displayed at a position on the passing locus 37 where the position to be noticed is designated by the pointing arrow 43.

  In this process, the CPU searches the database 9, reads a record having position data corresponding to the position on the passage locus 37 for which the attention position is designated by the pointing arrow 43 from the database 9, and receives the attention position information. As shown in FIG. 2C, a position mark 39 is superimposed and displayed on the position on the passage locus 37 indicated by (1), that is, the position on the passage locus 37 designated by the pointing arrow 43.

Then, the subsequent processes S5 and S6 are repeated.
In addition, when the position is not specified by the pointing arrow 43 in the processing S6 (S6 is No), it is determined whether or not the application is terminated (S7), and the application is terminated. If so (S7 is Yes), the process is terminated. If the application is not terminated (S7 is No), the process returns to the process S6 and the determination process of the process S6 is repeated.

In the above-described process of designating the position by the doctor or nurse, for example, the doctor or nurse designates an arbitrary position on the passage locus 37 with the pointing arrow 43 and left-clicks the mouse 23, whereby the position mark 39 is displayed. It is displayed on the passage locus 37.
For the position mark 39 displayed on the passing trajectory 37, a corresponding image is automatically displayed immediately, or is displayed by left-clicking the mouse 23 again. The processing mode may be set in advance before starting the processing.

Further, the process for terminating the application is executed by, for example, preparing a menu item (not shown) on the display screen 38 and selecting the “end” item in the menu item with the mouse 23.
As a result, the doctor or the nurse moves the pointing arrow 43 by operating the mouse 23 while looking at the display screen toward the monitor device 21 of the workstation 7, and makes any desired desired on the passage locus 37 of the intra-subject model 26. When a position is designated, a position mark 39 is superimposed and displayed at the designated position, and an image corresponding to the position is displayed in the left area on the same display screen.
<Second to fifth embodiments>
4 (a) to 4 (d) are displayed on the same display screen 38 of the monitor device 21 of the workstation 7 in the capsule endoscope image filing system according to the present invention in the second to fifth embodiments. It is a figure which shows the example of the model 26 and the image 42 of the to-be-inspected person 4 to be examined.

  If there is a special image that has a predetermined characteristic part indicating a certain symptom specified by a doctor or a nurse (for example, a part showing a bleeding site, a polyp, etc.), FIG. The image data forming the special image having the predetermined characteristic portion is searched and extracted on the database 9 by the instruction input to be displayed, and the position in the subject where the extracted image data is imaged An example is shown in which a second position mark 44 is displayed as an image processing result indicating position data associated with image data having a predetermined characteristic portion at a display position of the passage locus 37 corresponding to Yes.

The image 42 displayed in the image display area 41 on the right side is the first image displayed as it is.
In addition, the second position mark 44 is displayed only at one place in FIG. 4A, but in the actual display, images of all the image data extracted by the search are captured. A second position mark 44 is displayed at a position on the passing trajectory 37.

  Next, FIG. 5B shows a second position mark at a certain position among the second position marks 44 of all image data including the designated special image displayed on the passage locus 37. 44 is designated by the pointing arrow 43, and the image 42 based on the image data corresponding to the position where the designated second position mark 44 is displayed (the position on the display of the passage locus 37, the same applies hereinafter) is displayed on the right side. The example displayed in the image display area 41 is shown.

In FIG. 5B, the second position mark 44 is displayed only at one place, but it is needless to say that the display is not necessarily limited to only one place.
Further, FIG. 4C shows that the image 42 is extracted from the database 9 so as to be superimposed on the image 42 displayed in the right image display area 41 corresponding to the designated second position mark 44. The example in which the characteristic part 45 which became a factor is displayed is shown.

  FIG. 4D shows that all the second position marks 44 are displayed, and the first and next two pointing arrows 43 (43-1, 43-2) for designating an arbitrary section. Shows an example (referred to as section mode). Here, the section refers to the position information corresponding to each of two different positions on the display of the passage locus 37.

  Also in this case, in the display of the display screen 38 of the monitor device 21 of FIGS. 4A to 4D, although not particularly shown, the menu button displayed on the task bar includes a pull-down menu. Task menus such as “next”, “return”, “section designation”, and “end” are displayed. Needless to say, the display is not limited to the menu display, and “next”, “return”, “section designation”, and “end” buttons that are always displayed in an appropriate display area in the display screen may be used.

Next, processing operations in the second embodiment regarding image processing in the capsule endoscope image filing system will be described.
FIG. 5 is a flowchart for explaining the operation of image processing in the second embodiment. This image processing is also processing performed by the CPU of the main body device 19 based on an instruction input from the keyboard 22 or mouse 23 of the workstation 7 shown in FIG. 1 by a doctor or nurse. Also in this case, the work described in the first embodiment is performed prior to this processing.

In FIG. 5, the processes S1 to S3, S4, and S5 are the same as the processes S1 to S3, S4, and S5 described in the flowchart of FIG. 3 in the first embodiment. In this example, the process S31 is performed between the process S3 and the process S4.
That is, following the process of displaying the position information (S3), prior to this process, the doctor or nurse designates extraction of image data forming a special image in advance. Based on this designation input, for example, the second position mark 44 as shown in FIG. 4A is sequentially displayed on the passage locus 37 (S31).

Subsequently, following the display of the attention position information (S4) and the image display corresponding to the attention position information (S5), in this example, it is determined whether or not the section mode is instructed (S21).
In the determination process of whether or not the section mode is instructed, for example, the pointing arrow 43 indicates a position other than the display of the passage locus 37 on the display area 46 for the doctor or nurse to display each model. The section mode setting can be instructed by left-clicking the mouse 23. The determination process is a process for determining whether or not the left click operation of the mouse 23 is performed at such a predetermined position. Here, the section mode is a mode in which all position information included in an arbitrary section is regarded as position information of interest.

If the section mode setting instruction is input (Y in S21), the CPU then waits until the first position of the in-subject model 26 is designated (S22, and the determination is NO). ).
In this process, for example, as indicated by the first pointing arrow 43-1 for designating the section shown in FIG. 4D, the first position for designating the section on the display of the passage locus 37 of the intra-subject model 26 is the pointing. In this process, it is determined whether or not it is designated by an arrow 43, and if not designated, the discrimination is repeated until designated.

  When the first position is designated (S22 is Y), the CPU stores the information of the designated first position of the in-subject model 26 in a predetermined storage area of the built-in memory, and next Then, the process waits until the second position on the intra-subject model 26 is designated (S23 and determination is NO).

  This process is performed by, for example, specifying a section on the display of the passage locus 37 of the intra-subject model 26 as indicated by a second pointing arrow 43-2 that specifies the section shown in FIG. This is a process of determining whether or not the second position on the in-subject model 26 is designated by the pointing arrow 43 as the position, and if not designated, the discrimination is repeated until it is designated.

  When the second position on the in-subject model 26 is designated as the second position (Y in S23), the CPU stores information on the second position on the designated in-subject model 26. Is stored in another predetermined storage area of the built-in memory, and then the processes S4 and S5 that are the same as the processes S4 and S5 following the above-described process 31 are performed, and then whether or not the designated section has ended is determined. A determination is made (S24).

In this process, the processes of the above-described processes S4 and S5 are performed up to the position corresponding to the second position information on the designated in-subject model 26 stored in another predetermined storage area of the built-in memory. This is a process for determining whether or not it has been received.
If the designated section has not ended (N in S24), it is further determined whether or not a process interruption is instructed (S25).

  In this process, for example, a doctor or a nurse indicates a position other than the display of the passage locus 37 on the model display area 46 with the pointing arrow 43 and right-clicks the mouse 23 to instruct to interrupt the process. The above determination processing is processing for determining whether or not a right click operation of the mouse 23 is performed at such a position.

If no interruption of the process is instructed (NO in S25), the process returns to the process S4, and the processes S4, S5, S24, and S25 are repeated.
On the other hand, if the interruption of the process is instructed (S25 is YES), the process of exiting the section mode is performed (S26), and the process proceeds to the process S7.

In the process S26, the information on the first position and the second position on the designated in-subject model 26 stored in the predetermined storage area and the other predetermined storage area of the built-in memory is deleted. This is the process of canceling the section mode setting.
Further, when the specified section is completed in the determination process of the above process S24 (S24 is YES), the process immediately proceeds to the process of the above process S26.

  In the section mode determination process of process S21, when the setting of the section mode is not instructed (S21 is NO), the CPU subsequently performs the determination process of process S6 similar to the process S6 shown in FIG. . Also in this case, if the position is designated (S6 is YES), the process returns to the process S4, and the processes after the process S4 are executed.

  On the other hand, when the position is not designated in the determination process of process S6 (S6 is NO), the process proceeds to the end determination process of the application in the same process S7 as the process S7 shown in FIG. Then, when the end of the application is not instructed, the process returns to step S21, and the processes after the step S21 are performed. When the end of the application is instructed, the application is ended.

  As a result, the doctor or the nurse moves the pointing arrow 43 by operating the mouse 23 while viewing the display screen toward the monitor device 21 of the workstation 7, and performs arbitrary two on the passage locus 37 of the intra-subject model 26. When a position is specified, unless the process is instructed to be interrupted, the position mark 39 is sequentially superimposed on the position where the image is captured from the beginning to the end of the section indicated by the two specified positions, and the position is corresponded. The image to be displayed is displayed in the left area on the same display screen.

  At this time, a special image with a characteristic portion 45 can be confirmed as an image 42 in the image display area 41.

  FIG. 6 is a flowchart for explaining the image processing operation of the capsule endoscope image filing system according to the present invention in the third embodiment. This image processing is also processing performed by the CPU of the main body device 19 based on an instruction input from the keyboard 22 or mouse 23 of the workstation 7 shown in FIG. 1 by a doctor or nurse. Also in this case, the work described in the first embodiment is performed prior to this processing.

  In FIG. 6, processes S1 to S3 and S4 to S7 are the same as the processes S1 to S7 described in the flowchart of FIG. 3 in the first embodiment. In this example, the process S31 similar to that shown in FIG. 5 is performed between the processes S3 and S4 in the flowchart of FIG.

  That is, on the basis of the designation of the extraction of image data forming a special image, which is an image having a characteristic part, by the doctor or nurse prior to this processing, following the processing of displaying position information (S3). For example, the second position mark 44 as shown in FIG. 4A is sequentially displayed on the passage locus 37 (S31).

  Thereby, the doctor or nurse who is operating the display screen sequentially specifies the position mark 39 and changes the image 42 displayed in the image display area 41, while the position mark 39 before and after the second position mark 44 is changed. Can be designated to observe the image 42 at positions before and after the second position mark 44.

FIG. 7 is a flowchart illustrating another example of the image processing operation according to the third embodiment. In this process, processes S32 and S33 are performed instead of the process S6 shown in FIG.
That is, it is determined whether or not the first position of the attention position information is designated following the initial display of the attention position information (S4) and the image display corresponding to the attention position information (S5). S32).

  This process corresponds to the fact that the “section designation” menu or “section designation” button is input in advance by the operation of the mouse 23 by the doctor or nurse, and the intra-subject model 26 is operated by the subsequent operation of the mouse 23. This is a process for determining whether or not any position on the display of the passage trajectory 37 is designated as the first position to be noted in the section designation, that is, the first position.

If the first position, which is the position to be noted at the beginning of the section, is not designated (S32 is N), the process returns to the process S4 in the determination of the process S7, and the processes of the processes S4, S5, and S32 are repeated.
When the first position, which is the position to be noticed at the beginning of the section, is designated (S32 is Y), the CPU next determines whether the second position of the noticed position information is designated. A determination is made (S33).

  In this process as well, for example, as shown by the second pointing arrow 43-2 for designating the section shown in FIG. This is processing for determining whether or not the third position is designated by the pointing arrow 43.

  And when the 2nd position of attention position information which is the last position of a section is not specified (S33 is N), it waits until it is specified, and when the 2nd position of attention position information is specified (S33 is Y), the process returns to step S4 to display the position mark 39 (attention position information display) at the first position designated as the first position, and in step S5, the passage locus 37 is displayed. After the image 42 is displayed with the image data corresponding to the first position of the designated section on the display, it is determined whether or not it is within the designated section by the determination in steps S32 and S33. Returning to S4, the position mark 39 and the image 42 are displayed by processing S4 and processing S5.

  When returning to the process S4 for the first time, all the position marks 39 in the designated section are displayed, and in the process S5, the images 42 corresponding to all the position marks 39 are sequentially displayed at regular time intervals or pointing arrows. In accordance with the designation by 43, an image 42 at a position corresponding to the designated position mark 39 may be displayed.

  Thereby, the doctor or the nurse can know the position of the special image having the target characteristic portion in the desired arbitrary section on the display of the trajectory 37 of the intra-subject model 26, and the special image. The images before and after the image can be observed within an arbitrary section.

Next, the processing operation in the fourth embodiment regarding image processing in this capsule endoscope image filing system will be described.
FIG. 8 is a flowchart for explaining the operation of image processing in the fourth embodiment. This image processing is also processing performed by the CPU of the main body device 19 based on an instruction input from the keyboard 22 or mouse 23 of the workstation 7 shown in FIG. 1 by a doctor or nurse. Also in this case, the work described in the first embodiment is performed prior to this processing.

  In FIG. 8, the processes S1 to S3, S31, S4, S5, S6, and S7 are the same as the processes S1 to S3, S31, and S4 to S7 described in the flowchart of FIG. 6 in the third embodiment. It is. In this example, processes S41 and S42 are performed between the processes S5 and S6 in the flowchart of FIG.

  In other words, at the stage of initial attention position information display (S4), all the display of the second position mark 44 displayed in the process S31 and the display of the position mark 39 in the process S4 are the intra-subject model 26. The image 42 corresponding to the position mark 39 is displayed in the right image display area 41 in step S5.

Here, the CPU determines whether or not the display position of the position mark 39 matches the display position of the second mark on the intra-subject model 26 (S41).
In this process, the display position where the position mark 39 is to be displayed is the second position mark 44 displayed on the model in the process S31 (as described with reference to FIGS. 4A and 4B). As shown in the figure, the display of the position mark 44 is not limited to a single place, and usually a plurality of cases are expected. In actual display, all of the plurality of second position marks 44 are displayed on the display of the passage locus 37. Is a process of determining whether or not to superimpose on any display position.

  If it is not superimposed on the display position of the second position mark 44 (NO in S41), the process proceeds to the process S6, but if it is superimposed on the display position of any of the second position marks 44 ( After the display of the image 42 having the characteristic portion (S42), the process proceeds to the process S6.

  In the processing 42 described above, the image 42 at the position indicated by the second position mark 44 superimposed on the display position of the position mark 39 is displayed in the image display area 41, for example, as shown in FIG. Further, as shown in FIG. 4C, the feature portion 45 that causes the image 42 to be extracted from the database 9 is displayed so as to be superimposed on the displayed image 42.

Subsequent processes S6 and S7 are the same as those in FIGS. 3, 5, and 6.
As a result, the doctor or nurse designates the second position mark 44 at an arbitrary position from the second position marks 44 indicating the imaging positions of the special images displayed on the display of the passage locus 37. Thus, the entire special image (image 42 in FIG. 4B) and the position in the special state (characteristic portion 45 in FIG. 4C) can be quickly known and observed.

Next, processing operations in the fifth embodiment regarding image processing in the capsule endoscope image filing system will be described.
FIG. 9 is a flowchart for explaining the image processing operation in the fifth embodiment. This image processing is also processing performed by the CPU of the main body device 19 based on an instruction input from the keyboard 22 or mouse 23 of the workstation 7 shown in FIG. 1 by a doctor or nurse. Also in this case, the work described in the first embodiment is performed prior to this processing.

  9, the processes S1 to S3, S31, S4, S5, S41, S42, S6, and S7 are the same as the processes S1 to S3, S31, S4, S5, described in the flowchart of FIG. 8 in the fourth embodiment. The processes of S41, S42, S6, and S7 are the same. In this example, unlike the case of FIG. 8, the processes from S21 to S26 (including processes S4, S5, S41, and S42 in the middle) are performed immediately before the process S6.

  In the processes of S21 to S26, the processes in S21 to S23, S4, and S5 are the same as the processes of S21 to S23, S4, and S5 shown in FIG. The subsequent processes S41 and S42 are the same as the processes S41 and S42 shown in FIG. 8, and the subsequent processes S24, S25 and S26 are the processes S24, S25 and S26 shown in FIG. Is the same.

  As a result, the doctor or nurse designates the state of the known lesion according to the symptom (for example, the state of the bleeding site or the state of the polyp), and on the display of the passage locus 37 of the intra-subject model 26. A desired arbitrary section is designated, and an image 42 forming a special image, which is an image corresponding to the position of the second position mark 44 in the section, is displayed, and a characteristic portion in a special state on the image 45 can be observed and the extent of the symptom spread, the severity of the symptom, and the like can be quickly determined.

  Thus, according to the image processing apparatus and the image processing method of the capsule endoscope image filing system of the present invention, it is possible to observe both the image and the imaging position on the same display screen while associating the image with the imaging position. Furthermore, it is possible to quickly observe an image at a desired arbitrary position by a simple operation with a mouse.

  Furthermore, for the symptom that is noticeable, the color state on observation in the digestive tract that is specific to the symptom that is known in advance is designated by color information that has been prepared in advance, and is the same or similar to the color state. Since only the image in the state can be detected and the image and the imaging position can be observed, an accurate and quick judgment can be made.

  In the above-described example, the display of the passage trajectory 37 of the capsule endoscope 3 as the position information is displayed three-dimensionally according to the actual shape of the digestive tract (it looks two-dimensional in the figure). However, the position information is not limited to this and may be displayed in a two-dimensional plane, for example, a one-dimensional display. That is, it may be expressed by a straight line. In the case of a one-dimensional case, if a section corresponding to the esophagus 31, stomach 32, duodenum 33, small intestine 34, large intestine 35, rectum 36, etc. shown in FIG. good.

1 is a diagram showing a schematic configuration of a capsule endoscope image filing system according to the present invention. (a) to (d) are subjects to be examined displayed on the same display screen of the monitor device of the workstation in the capsule endoscope image filing system of the present invention in the first and second embodiments. It is a figure which shows the example of an inner model and an image. It is a flowchart explaining the operation | movement of the image processing of the capsule type endoscope image filing system concerning this invention in 1st Embodiment. (a) to (d) are the digests of the examinee displayed on the same display screen of the monitor device of the workstation in the capsule endoscope image filing system according to the present invention in the second to fifth embodiments. It is a figure which shows the example of a pipe model and an image. It is a flowchart explaining operation | movement of the image processing of the capsule type endoscope image filing system concerning 2nd Embodiment in this invention. It is a flowchart explaining the operation | movement of the image processing of the capsule type endoscope image filing system concerning this invention in 3rd Embodiment. 14 is a flowchart for explaining another example of the image processing operation in the third embodiment. It is a flowchart explaining the operation | movement of the image processing of the capsule type endoscope image filing system concerning this invention in 4th Embodiment. It is a flowchart explaining the operation | movement of the image processing of the capsule type endoscope image filing system concerning this invention in 5th Embodiment.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Capsule type | mold endoscope system 2 Package 3 Capsule type | mold endoscope 4 Inspected person 5 Jacket 6 Receiver 7 Workstation 8 Network 9 Database 11 (11a, 11b, 11c, 11d) Antenna 12 Antenna 13 Display part 14 Input part DESCRIPTION OF SYMBOLS 15 Power supply part 16 Signal processing / control part 17 CF (compact flash (registered trademark)) memory 18 Mounting part 19 Main body apparatus 20 Capsule type endoscope image filing system 21 Monitor apparatus 22 Keyboard 23 Mouse 24 Printer 25 CF memory reader / writer 26 In-subject model 27 Subject model 28 Gastrointestinal model 31 Esophagus 32 Stomach 33 Duodenum 34 Small intestine 35 Large intestine 36 Rectal 37 Passing track 38 Display screen 39 Position mark 41 Image display area 42 Image 43 (43, 43- 1, 43-2) Pointing arrow 44 Second position mark 45 Characteristic portion 46 Model display area

Claims (15)

A display processing device for causing a display means to display a plurality of pieces of image information obtained by imaging over time at a plurality of positions in the subject by an imaging device introduced into the subject,
Image information acquisition means for acquiring the plurality of image information;
Position information acquisition means associated with each of the plurality of pieces of image information, for acquiring a plurality of pieces of position information relating to respective positions in the subject imaged by the imaging device over time;
Position information display means for causing the display means to display the position in the subject imaged by the imaging device over time based on the plurality of position information as an at least one-dimensional diagram;
Attention position information instruction means for instructing at least one of the plurality of position information as attention position information;
Image display means for causing the display means to display image information associated with position information instructed as the position information of interest among the plurality of position information displayed as the diagram;
A display processing apparatus for image information, comprising:   It further comprises position mark display means for displaying a predetermined mark at a position corresponding to the target position information in the diagram among the plurality of position information displayed as the diagram by the position information display means. The image information display processing apparatus according to claim 1. A storage unit for storing the plurality of image information and the plurality of position information;
3. The image information according to claim 1, wherein the image display unit reads image information associated with the position information designated as the attention position information from the storage unit and displays the image information on the display unit. Display processing device.   The attention position information instruction means includes designated position input means for designating arbitrary position information as the attention position information on the diagram out of the plurality of position information displayed as the diagram by the position information display means. The image information display processing device according to claim 1, further comprising: A feature image detecting means for extracting image information having a predetermined feature portion from the plurality of image special information;
The point-of-interest position information instruction unit instructs position information associated with image information having the predetermined feature extracted by the feature image detection unit as the point-of-interest information. Or a display processing apparatus for image information according to 3. A display processing method for displaying a plurality of pieces of image information obtained by imaging at a plurality of positions in a subject over time on a display screen of a monitor device,
An image information acquisition step of acquiring the plurality of image information;
A position information acquisition step for acquiring a plurality of position information associated with each of the plurality of image information and related to each position imaged in the subject over time;
A position information display step of displaying, as at least a one-dimensional diagram, positions imaged over time in the subject based on the plurality of position information;
Attention position information instruction step for instructing at least one of the plurality of position information as attention position information;
An image display step for displaying image information associated with the position information instructed as the position information of interest among the plurality of position information displayed as the diagram;
A display processing method for image information, comprising:   A position mark display step of displaying a predetermined mark at a position corresponding to the target position information in the diagram among the plurality of position information displayed as the diagram by the position information display step. The image information display processing method according to claim 6. A storage step of storing the plurality of image information and the plurality of position information;
8. The image information according to claim 6, wherein the image display step reads image information associated with the position information designated as the attention position information from the storage step and displays the image information on the display step. Display processing method.   The attention position information instruction step includes a designated position input step for designating arbitrary position information as the attention position information on the diagram from among the plurality of position information displayed as the diagram by the position information display step. The image information display processing method according to claim 6, 7 or 8, further comprising: A feature image detecting step of extracting image information having a predetermined feature portion from the plurality of image special bulletins,
8. The attention position information instruction step indicates position information associated with image information having the predetermined feature extracted in the feature image detection step as the attention position information. Or the display processing method of the image information of 8. A display processing program for causing a computer to display a plurality of image information obtained by imaging over time at a plurality of positions in a subject on a display screen of a monitor device,
The display processing program
Image information acquisition processing for acquiring the plurality of image information;
A positional information acquisition process for acquiring a plurality of positional information related to each of the plurality of pieces of image information and associated with the respective positions imaged in the subject over time;
A position information display process for displaying a position imaged in the subject over time based on the plurality of position information as at least a one-dimensional diagram;
Attention position information instruction processing for instructing at least one of the plurality of position information as attention position information;
Image display processing for displaying image information associated with the position information instructed as the position information of interest among the plurality of position information displayed as the diagram;
The computer program executes an image information display processing program.   A position mark display process for displaying a predetermined mark at a position corresponding to the target position information in the diagram among the plurality of position information displayed as the diagram by the position information display process. The image information display processing program according to claim 11. A storage process for storing the plurality of pieces of image information and the plurality of pieces of position information;
The image information according to claim 11 or 12, wherein the image display process reads image information associated with position information designated as the position information of interest from the storage process and displays the image information on the display process. Display processing program.   The attention position information instruction processing includes designated position input processing for designating arbitrary position information as the attention position information on the diagram from the plurality of position information displayed as the diagram by the position information display processing. 14. The image information display processing program according to claim 11, 12 or 13, further comprising: A feature image detection process for extracting image information having a predetermined feature portion from the plurality of image special information;
13. The attention position information instruction process instructs position information associated with image information having the predetermined feature extracted in the feature image detection process as the attention position information. Or the display processing program of the image information of 13.

Images