JP2015112431A - Image display apparatus, image display method, and image display program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image display apparatus, etc. which enables a user to easily grasp the correspondence between each image group which is obtained from its respective examination of plural times of examinations conducted on the same subject.SOLUTION: The image display apparatus comprises: an examination determination unit 561 for determining current examinations of which examination results are displayed from plural times of examinations conducted on the same subject and past examinations of which examination results are compared with those of the current examinations; an index setting unit 562 for setting the indexes to be used when comparing the examination results of the current examinations and past examinations; a corresponding image setting unit 563 for associating the images in the image groups obtained by the current examinations with the images in the image groups obtained by the past examinations, on the basis of the indexes; an average color bar creation unit 564 for creating an average color bar representing an outline of the current examination results and an average color bar representing an outline of the past examination results, on the basis of the indexes and information of each of the images associated by the corresponding image setting unit; and a display control unit 565 for displaying the average color bars side by side on a display unit 55.

Description

  The present invention relates to an image display device, an image display method, and an image display program for displaying an image acquired by a capsule endoscope that is introduced into a subject and images the inside of the subject.

  In recent years, in the field of endoscopes, examination using a capsule endoscope that is introduced into a subject such as a patient and images the inside of the subject is known. A capsule endoscope is a device that incorporates an imaging function, a wireless communication function, etc. in a capsule-shaped casing that is sized to be introduced into the digestive tract of a subject, and images the inside of the subject. The image data generated by the above is sequentially wirelessly transmitted outside the subject. A series of image data wirelessly transmitted from the capsule endoscope is temporarily stored in a receiving device provided outside the subject, transferred (downloaded) from the receiving device to an image display device such as a workstation, and the image display device. Various image processing is performed in. As a result, an image group showing an organ or the like in the subject is generated and displayed on the screen. The medical staff (doctor) diagnoses the subject by sequentially observing the images displayed on the screen and selecting an image having an abnormality.

  The examination using such a capsule endoscope takes about 8 hours at a time, and about 60,000 images are acquired during that time. For this reason, it takes a very long time to observe all of these images, and concentration is required. Therefore, the image display device has various functions for assisting observation work, such as an abnormal part extraction function for automatically extracting an image considered to be medically abnormal, and a summarization function for detecting and thinning out similar images. A function is provided. For example, in Patent Document 1, an average color bar in which the average colors of each image are arranged along the time axis is displayed on the screen so that the user (image observer) can visually grasp the overall characteristics of the image group at a glance. The technique to display is disclosed.

JP 2009-5866 A

  By the way, the image group obtained by the examination using the capsule endoscope is used to identify the position and state of the lesion at the time of the examination, and to compare with the result of the examination performed on the same subject in the past. Therefore, there is a possibility that it can be used to evaluate changes in the state of the lesion, changes in the function of the digestive tract, and the like.

  However, when the image groups acquired by the latest inspection and the past inspection are compared, the following problem occurs. That is, since the capsule endoscope moves due to the peristaltic movement of the digestive tract, the movement of the capsule endoscope depends on the state of pretreatment applied to the subject, the posture of the subject at the time of examination, the state of the digestive tract It varies greatly depending on the environment (good, bad, etc.). For this reason, even if the elapsed time from the start of the examination of the images acquired by the latest examination and the past examination is the same, the same location in the subject is not necessarily shown in both images. . For example, when the intestinal tract is excised by surgery, the length of the digestive tract itself may change. Furthermore, findings that the user has noticed in the past examination may disappear with the passage of time, and on the contrary, findings that were not seen in the past examination may newly appear in the current examination. For these reasons, conventionally, it has been very difficult to grasp and observe the correspondence between images acquired in the latest inspection and past inspections.

  The present invention has been made in view of the above, and allows a user to easily grasp the correspondence between image groups obtained by a plurality of examinations performed on the same subject. An object is to provide an image display device, an image display method, and an image display program.

  In order to solve the above-described problems and achieve the object, an image display device according to the present invention is an image acquired by an examination using a capsule endoscope that is introduced into a specimen and images the inside of the specimen. An image display device for displaying a group on a display unit, wherein a first test for displaying a test result from a plurality of tests on the same subject and a second test for comparing the first test and the test result Acquired by the first inspection based on the index, an inspection setting unit for determining the inspection, an index setting unit for setting an index for comparing the inspection results of the first and second inspections, A correspondence image setting unit that associates an image in the first image group with an image in the second image group acquired by the second examination, the index, and the correspondence image setting unit. Information about the images in the first and second image groups; In addition, a summary information creating unit that creates first summary information that represents a summary of the result of the first examination and second summary information that represents a summary of the result of the second examination, and the first And a display control unit that displays the second summary information side by side on the display unit.

  In the image display device, the first and second summary information includes first and second information in which the average colors of the images in the first and second image groups are arranged in time series order or image order, respectively. 2 average color bars.

  In the image display device, the index is an elapsed time from when an image in each of the first and second image groups is captured from an arbitrary timing, or an arbitrary one in the first and second image groups. The number of images counted from the reference image in the order in which the images are arranged, and the corresponding image setting unit supports a pair of images having common characteristics between the first and second image groups. The summary information creation unit creates the first and second average color bars having a common scale, and the display control unit creates the first and second average colors corresponding to the one set of images. The first and second average color bars are arranged with their positions on the bar aligned.

  In the above image display device, the corresponding image setting unit may include the leading images extracted from the first and second image groups, the trailing images, the images showing a common organ boundary, or the anatomy. It is characterized by associating images with characteristic features.

  In the image display device, the index is an image having a feature extracted from each of the first and second image groups, and the corresponding image setting unit is between the first and second image groups. A plurality of sets of images having a common feature are associated with each other, and the summary information creation unit is arranged on the first and second average color bars corresponding to the plurality of sets of images associated by the corresponding image setting unit. The scale of one of the first and second average color bars is set for each of the sections so that the length of the section divided by the positions of the first and second average color bars is equal to each other. It is characterized by expanding and contracting.

  In the above image display device, the corresponding image setting unit anatomically analyzes the first images extracted from the first and second image groups, the last images, and images showing a common organ boundary. Associating at least two sets of images with characteristic images, images with the same type of lesion detected, images with treatment marks or surgical excision marks, images with ink marks, and images at pH change points It is characterized by that.

  In the above image display device, the display control unit displays a plurality of types of the second average color bars having different indexes on the first average color bar and displays the second average color bars on the display unit.

  In the image display device, the display control unit includes an image showing an organ boundary, an image in which a lesion is detected, an image in which a treatment mark or a surgical excision mark is shown, and an image in which ink is printed on the display unit. And a mark is displayed at a position on the first and second average color bars corresponding to at least one of the images at the change point of pH.

  The image display device further includes an input unit that inputs a signal according to an operation from the outside, and the display control unit is configured to display the mark on the display unit based on the signal input from the input unit. It is characterized by switching between a non-display state.

  The image display device includes: an input unit that inputs a signal according to an operation from the outside; and a signal that selects a region on the second average color bar is input from the input unit. A region on the first average color bar is determined based on the arrangement on the second average color bar, and the first image corresponding to the determined region on the first average color bar A corresponding image extracting unit for extracting at least one image in the group and at least one image in the second image group corresponding to the selected area on the second average color bar; and the corresponding image The image processing apparatus further includes a comparison screen creation unit that creates a screen for comparing the images in the first image group extracted by the extraction unit with the images in the second image group.

  In the image display device, when the corresponding image extraction unit extracts a plurality of images from the first or second image group, the corresponding image extraction unit extracts one or more representative images based on the similarity between the plurality of images. The selection and comparison screen creation unit arranges the one or more representative images on the screen.

  The image display device further includes an input unit that inputs a signal according to an external operation, and the display control unit is configured to use the second average color in the display unit based on a signal input from the input unit. It is characterized by switching the display state and non-display state of the bar.

  The image display method according to the present invention is executed by an image display device that displays on a display unit an image group acquired by an examination using a capsule endoscope that is introduced into a subject and images the inside of the subject. An image display method for determining a first test for displaying a test result and a second test for comparing the first test with a test result from a plurality of tests on the same subject. An index setting step for setting an index for comparing the inspection results of the first and second inspections, and the first image group acquired by the first inspection based on the index A corresponding image setting step that associates an image with an image in the second image group acquired by the second examination, the index, and the first and second associated with each other in the corresponding image setting step. Information about images in the image group Based on the above, a summary information creating step for creating first summary information representing a summary of the result of the first examination and second summary information representing a summary of the result of the second examination, A display control step of displaying the first and second summary information side by side on the display unit.

  An image display program according to the present invention causes an image display device that displays on a display unit an image group acquired by an examination using a capsule endoscope that is introduced into a subject and images the inside of the subject. An image display program for determining a first test for displaying a test result and a second test for comparing the first test and the test result from a plurality of tests on the same subject. An index setting step for setting an index for comparing the inspection results of the first and second inspections, and the first image group acquired by the first inspection based on the index A corresponding image setting step that associates an image with an image in the second image group acquired by the second examination, the index, and the first and second associated with each other in the corresponding image setting step. In the image group Summary information creation for creating first summary information representing a summary of the result of the first examination and second summary information representing a summary of the result of the second examination based on information about the image And a display control step of displaying the first and second summary information side by side on the display unit.

  According to the present invention, the first summary information representing the summary of the result of the first examination performed on the same subject and the second summary information representing the summary of the result of the second examination are set as an index. This is created on the basis of the index set by the unit and the information related to the images in both image groups associated by the corresponding image setting unit, and the summary information is displayed side by side. The correspondence between the obtained image groups can be easily grasped.

FIG. 1 is a schematic diagram showing a schematic configuration of a capsule endoscope system including an image display device according to Embodiment 1 of the present invention. FIG. 2 is a diagram illustrating a schematic configuration of the capsule endoscope and the receiving device illustrated in FIG. 1. FIG. 3 is a block diagram showing a schematic configuration of the image display apparatus shown in FIG. FIG. 4 is a flowchart showing the operation of the image display device when accumulating an image group acquired by inspection. FIG. 5 is a schematic diagram for explaining the operation of the image display device when displaying an image group acquired by inspection. FIG. 6 is a schematic diagram illustrating an example of a screen for causing the user to select an examination for displaying an image group. FIG. 7 is a schematic diagram illustrating an example of a screen for allowing the user to select an inspection for comparing inspection results. FIG. 8 is a schematic diagram illustrating an example of a screen that allows a user to check an inspection for displaying an image group and an inspection for comparing inspection results. FIG. 9 is a schematic diagram illustrating an example of a screen for allowing the user to select an index. FIG. 10 is a schematic diagram illustrating an example of a screen for allowing the user to select an image to be associated between the current examination and the past examination. FIG. 11 is a schematic diagram illustrating an example of image association between the image group of the current examination and the image group of the past examination. FIG. 12 is a schematic diagram illustrating an example of creating average color bars representing the current examination and the past examination (when the head positions are aligned). FIG. 13 is a schematic diagram showing an example of creating average color bars representing the current examination and the past examination (when the boundary position between the stomach and the small intestine is aligned). FIG. 14 is a schematic diagram illustrating an example of an observation screen of an image group acquired by the current examination. FIG. 15 is a schematic diagram illustrating an example of creating an average color bar when two past examinations are set in Modification 1-2 of Embodiment 1 of the present invention. FIG. 16 is a schematic diagram illustrating an example of creating an average color bar when two past examinations are set in Modification 1-2 of Embodiment 1 of the present invention. FIG. 17 is a schematic diagram illustrating a display example of an observation screen when two past examinations are set in Modification 1-2 of Embodiment 1 of the present invention. FIG. 18 is a schematic diagram illustrating an example of a screen that allows the user to select a landmark to be associated with the current image and the past image in the second embodiment of the present invention. FIG. 19 is a schematic diagram illustrating an example of creating an average color bar when a landmark is set as an index. FIG. 20 is a schematic diagram illustrating an example of creating an average color bar when two past examinations are set in the modified example 2-1 of the second embodiment of the present invention. FIG. 21 is a flowchart showing an average color bar creation process in the image display apparatus according to Embodiment 3 of the present invention. FIG. 22 is a schematic diagram showing an example of creating an average color bar in the third embodiment of the present invention. FIG. 23 is a schematic diagram illustrating an example of creating an average color bar when two past examinations are set in Modification 3-2 of Embodiment 3 of the present invention. FIG. 24 is a flowchart showing an average color bar creation process in the image display apparatus according to Modification 3-3 of Embodiment 3 of the present invention. FIG. 25 is a schematic diagram showing an example of creating an average color bar in Modification 3-3 of Embodiment 3 of the present invention. FIG. 26 is a schematic diagram illustrating an example of creating an average color bar in the case of setting two past inspections for comparing the inspection results with respect to the current inspection in Modification 3-3 of Embodiment 3 of the present invention. is there. FIG. 27 is a schematic diagram showing an example of creating an average color bar in the fourth embodiment of the present invention. FIG. 28 is a schematic diagram illustrating an example of creating an average color bar when two past inspections for comparing inspection results are set with respect to the current inspection in the fourth embodiment of the present invention. FIG. 29 is a schematic diagram showing an example of creating an average color bar in the fourth modification of the fourth embodiment of the present invention. FIG. 30 is a schematic diagram illustrating an example of creating an average color bar in the case of setting two past inspections for comparing the inspection results with the current inspection in the fourth modification of the fourth embodiment of the present invention. FIG. 31 is a schematic diagram showing an example of creating an average color bar in the fifth embodiment of the present invention. FIG. 32 is a schematic diagram illustrating an example of creating an average color bar when two past inspections for comparing inspection results with respect to the current inspection are set in the fifth embodiment of the present invention. FIG. 33 is a schematic diagram illustrating a creation example of a screen for allowing the user to select a landmark to be mapped. FIG. 34 is a schematic diagram showing an example in which the average color bar shown in FIG. 29 is mapped. FIG. 35 is a schematic diagram illustrating an example of creating an average color bar when two past inspections for comparing inspection results are set with respect to the current inspection in the sixth embodiment of the present invention. FIG. 36 is a schematic diagram showing a display example of an average color bar in Modification 6 of Embodiment 5 of the present invention. FIG. 37 is a schematic diagram showing a display example of an average color bar when two past inspections for comparing inspection results with respect to the current inspection are set in Modification 6 of Embodiment 6 of the present invention. FIG. 38 is a block diagram showing a configuration of an image display apparatus according to Embodiment 7 of the present invention. FIG. 39 is a schematic diagram showing a display example of an average color bar in the seventh embodiment. FIG. 40 is a schematic diagram illustrating an example of a screen created by the comparison screen creation unit illustrated in FIG. FIG. 41 is a schematic diagram showing an example of creating an average color bar in Modification 7-2 of Embodiment 7 of the present invention. FIG. 42 is a schematic diagram illustrating an example of a screen created by the comparison screen creation unit in Modification 7-2 of Embodiment 7 of the present invention. FIG. 43 is a schematic diagram showing a display example of an average color bar in Modification 7-3 of Embodiment 7 of the present invention. FIG. 44 is a schematic diagram showing an example of a screen created by the comparison screen creation unit in Modification 7-3 of Embodiment 7 of the present invention. FIG. 45 is a schematic diagram showing an example of creating an average color bar in Modification 7-4 of Embodiment 7 of the present invention. FIG. 46 is a schematic diagram showing an example of a screen created by the comparison screen creation unit in Modification 7-4 of Embodiment 7 of the present invention. FIG. 47 is a schematic diagram showing another example of a screen created by the comparison screen creation unit in Modification 7-4 of Embodiment 7 of the present invention. FIG. 48 is a schematic diagram showing an example of creating an average color bar in the eighth embodiment of the present invention. FIG. 49 is a schematic diagram showing an example of creating an average color bar in the eighth embodiment of the present invention.

  Hereinafter, an image display device, an image display method, and an image display program according to embodiments of the present invention will be described with reference to the drawings. Note that the present invention is not limited to these embodiments. Moreover, in description of each drawing, the same code | symbol is attached | subjected and shown to the same part.

(Embodiment 1)
FIG. 1 is a schematic diagram showing a schematic configuration of a capsule endoscope system including an image display device according to Embodiment 1 of the present invention. A capsule endoscope system 1 shown in FIG. 1 is introduced into a subject 10 and images the inside of the subject 10 to generate image data, which is superimposed on a radio signal and transmitted. 2, a receiving device 3 that receives a radio signal transmitted from the capsule endoscope 2 via a receiving antenna unit 4 attached to the subject 10, and acquires image data from the receiving device 3 to obtain a predetermined signal An image display device 5 that performs image processing and displays an image is provided.

FIG. 2 is a block diagram illustrating a schematic configuration of the capsule endoscope 2 and the receiving device 3.
The capsule endoscope 2 is a device in which various components such as an image sensor are incorporated in a capsule-shaped housing that is sized to allow the subject 10 to swallow. The capsule endoscope 2 includes an imaging unit 21 that images the inside of the subject 10, and a subject. An illumination unit 22 that illuminates the inside of the sample 10, a signal processing unit 23, a pH sensor 24 that detects a hydrogen ion index (pH) in the subject 10, a memory 25, a transmission unit 26, an antenna 27, and a battery 28. With.

  For example, the imaging unit 21 generates an imaging signal representing the inside of the subject 10 from an optical image formed on the light receiving surface and outputs the image pickup device such as a CCD or CMOS, and is disposed on the light receiving surface side of the imaging device. And an optical system such as an objective lens. The illumination unit 22 is realized by an LED (Light Emitting Diode) or the like that emits light toward the subject 10 during imaging. The capsule endoscope 2 has a built-in circuit board (not shown) on which drive circuits and the like for driving the imaging unit 21 and the illumination unit 22 are formed. The imaging unit 21 and the illumination unit 22 include The capsule endoscope 2 is fixed to the circuit board in a state where the visual field is directed outward from one end of the capsule endoscope 2.

  The signal processing unit 23 controls each unit in the capsule endoscope 2 and A / D converts the imaging signal output from the imaging unit 21 to generate digital image data, and further performs predetermined signal processing. Apply.

The pH sensor 24 detects the hydrogen ion index in the subject 10 and outputs a detection signal. The output detection signal is stored in association with the image data generated at that time.
The memory 25 temporarily stores various operations executed by the signal processing unit 23 and image data subjected to signal processing in the signal processing unit 23.
The transmission unit 26 and the antenna 27 superimpose image data stored in the memory 25 together with related information on a radio signal and transmit the image data to the outside.

  The battery 28 supplies power to each part in the capsule endoscope 2. The battery 28 includes a power supply circuit that boosts the power supplied from a primary battery such as a button battery or a secondary battery.

  After the capsule endoscope 2 is swallowed by the subject 10, the capsule endoscope 2 moves through the digestive tract of the subject 10 by peristaltic movement of the organ, etc., and moves a living body part (esophagus, stomach, small intestine, large intestine, etc.) Images are taken sequentially at time intervals (for example, 0.5 second intervals). Then, the image data and related information generated by the imaging operation are sequentially wirelessly transmitted to the receiving device 3. The related information includes identification information (for example, a serial number) assigned to identify the individual capsule endoscope 2.

  The receiving device 3 receives image data and related information wirelessly transmitted from the capsule endoscope 2 via the receiving antenna unit 4 having a plurality of (eight in FIG. 1) receiving antennas 4a to 4h. Each of the receiving antennas 4a to 4h is realized by using, for example, a loop antenna, and corresponds to a predetermined position on the external surface of the subject 10 (for example, each organ in the subject 10 that is a passage route of the capsule endoscope 2). Arranged).

  As illustrated in FIG. 2, the reception device 3 includes a reception unit 31, a signal processing unit 32, a memory 33, a data transmission unit 34, an operation unit 35, a display unit 36, a control unit 37, and a battery 38. With.

The receiving unit 31 receives image data wirelessly transmitted from the capsule endoscope 2 via the receiving antennas 4a to 4h.
The signal processing unit 32 performs predetermined signal processing on the image data received by the receiving unit 31.
The memory 33 stores the image data subjected to signal processing in the signal processing unit 32 and related information.

The data transmission unit 34 is an interface that can be connected to a communication line such as a USB, wired LAN, or wireless LAN. Under the control of the control unit 37, the image transmission unit 34 displays image data and related information stored in the memory 33. Send to 5.
The operation unit 35 is used when the user inputs various setting information.

The display unit 36 displays registration information (examination information, patient information, etc.) related to the examination, various setting information input by the user, and the like.
The control unit 37 controls the operation of each unit in the receiving device 3.
The battery 38 supplies power to each unit in the receiving device 3.

  While the capsule endoscope 2 is imaging (for example, after the capsule endoscope 2 is swallowed by the subject 10, the receiving device 3 passes through the digestive tract and is discharged). And is carried on the subject 10. During this time, the reception device 3 further adds related information such as reception intensity information and reception time information at the reception antennas 4a to 4h to the image data received via the reception antenna unit 4, and the image data and the related information. Is stored in the memory 33. After the imaging by the capsule endoscope 2 is completed, the receiving device 3 is detached from the subject 10 and this time connected to the image display device 5, and the image data and related information stored in the memory 33 are stored in the image display device 5. Forward to. In FIG. 1, the receiver 3 and the image display device 5 are connected by connecting the cradle 3a to the USB port of the image display device 5 and setting the receiver 3 in the cradle 3a.

  The image display device 5 is configured using, for example, a workstation or a personal computer. The image display device 5 performs predetermined image processing on the image in the subject 10 acquired via the receiving device 3, generates a predetermined format observation screen, and causes the display unit 55 to display it.

  FIG. 3 is a block diagram illustrating a schematic configuration of the image display device 5. As illustrated in FIG. 3, the image display device 5 includes an input unit 51, an image data acquisition unit 52, an image processing unit 53, a storage unit 54, a display unit 55, and a control unit 56.

  The input unit 51 is realized by an input device such as a keyboard, a mouse, a touch panel, and various switches. The input unit 51 inputs a signal according to an external operation by the user to the control unit 56.

  The image data acquisition unit 52 is an interface that can be connected to a communication line such as USB, wired LAN, or wireless LAN, and includes a USB port, a LAN port, and the like. In the first embodiment, the image data acquisition unit 52 functions as a data acquisition unit that acquires image data and related information from the reception device 3 via an external device such as the cradle 3a connected to the USB port or various communication lines. To do.

  The image processing unit 53 performs white balance processing, demosaicing, color conversion, density conversion (gamma conversion, etc.), smoothing (noise removal, etc.), sharpening (edge enhancement) on the image data acquired by the image data acquisition unit 52. Etc.) and the like (hereinafter also referred to as display image processing), image data for display is generated.

  The image processing unit 53 also calculates an average color calculation process for calculating an average color of each image based on display image data, a lesion detection process for detecting a lesion from each image, and a region in which red is strong from each image. Image processing such as a red detection process for detecting an image, an organ detection process for detecting an organ shown in each image, and other predetermined feature detection processes, and the results of these image processes (features such as calculated average colors, A flag indicating a lesion, a flag indicating an organ or an organ boundary, and the like) are associated with image data and stored in the storage unit 54 described later.

  Further, the image processing unit 53 executes summarization processing for extracting images with high similarity from the image group and performing thinning or changing the arrangement order based on the display image data. Also good.

  The storage unit 54 includes a semiconductor memory such as a flash memory, a RAM, and a ROM, a recording medium such as an HDD, an MO, a CD-R, and a DVD-R, and a writing / reading device that writes and reads information on the recording medium. It is realized by. The storage unit 54 stores a program for executing various functions by operating the image display device 5 and a program storage unit 541 for storing various information, and image data acquired by capsule endoscopy. An image data storage unit 542. Among these, the image data storage unit 542 creates a storage area for each patient who is the subject 10, and the image data obtained by the examination performed on the patient together with the examination information and the patient information for each examination. To remember.

  The display unit 55 is realized by a display device such as a CRT display, a liquid crystal display, or an EL display. The display unit 55 displays an image observation screen and other screens on the screen in a predetermined format under the control of the control unit 56.

  The control unit 56 is realized by hardware such as a CPU, and reads various programs stored in the storage unit 54 to obtain signals input from the input unit 51, image data acquired by the image data acquisition unit 52, and the like. Based on this, instructions to each unit constituting the image display device 5 and data transfer are performed, and the overall operation of the image display device 5 is comprehensively controlled.

More specifically, the control unit 56 includes an examination determination unit 561, an index setting unit 562, a corresponding image setting unit 563, an average color bar creation unit 564, and a display control unit 565.
Based on the signal input from the input unit 51, the inspection determination unit 561 determines an inspection for displaying the image group obtained as the inspection result on the display unit 55 and an inspection for comparing the inspection and the inspection result.

  The index setting unit 562 sets an index for comparing image groups between examinations determined by the examination determining unit 561. The index candidates include the imaging time of each image in the image group, the number of images to be captured (or simply referred to as the number of images), and images having features extracted from the image group (hereinafter referred to as landmark images). Say).

  Here, in the present application, the image capturing time is an elapsed time from when an image is captured from an arbitrary timing such as when an examination starts or when a specific image (for example, the first image of the image group) is captured. Say. The number of images taken is the number of images counted in the order of image arrangement from an arbitrary reference image (for example, the first image in the image group) in the image group, and is usually the first image in the image group. Is counted as the first sheet. The imaging time and the number of images to be captured are stored as related information of image data of each image.

  In addition, the landmark image includes an image at the beginning or end of the image, an image showing an organ boundary, an image having an anatomical characteristic, an image in which a lesion is detected, an image in which a treatment mark or a surgical excision mark is shown. , An image in which ink is printed, an image at a pH change point, and the like. The landmark image is identified based on information stored in association with the image data (such as feature amounts and flags acquired by image processing). Alternatively, the landmark image may be identified based on a label added manually by the user while observing the image.

  The corresponding image setting unit 563 refers to the related information of the image data based on the index set by the index setting unit 562, and between the image groups respectively acquired by the examination determined by the examination determining unit 561. The images are associated with each other.

  The average color bar creating unit 564 creates an average color bar of the image group acquired by each examination based on the information regarding the images associated with the corresponding image setting unit 563. Here, the average color bar is an average color of each image included in the image group, which is arranged in a band-like region in time-series order or image-arrangement order, and is an overview that visually represents an overview of the result of the inspection. Information.

  The display control unit 565 creates an observation screen on which the average color bars created by the average color bar creation unit 564 are displayed side by side, and other various screens, and displays them on the display unit 55.

  Next, the operation of the image display device 5 will be described. FIG. 4 is a flowchart showing the operation of the image display device 5 when accumulating an image group acquired by examination using the capsule endoscope 2. As shown in FIG. 1, by setting the receiving device 3 in the cradle 3 a connected to the image display device 5, transfer of image data from the receiving device 3 to the image display device 5 is started. Alternatively, the image data may be transferred via various communication lines.

  In step S <b> 10, the image data acquisition unit 52 acquires image data of an image group acquired by an examination using the capsule endoscope 2.

  In subsequent step S11, the image processing unit 53 performs image processing such as white balance processing, demosaicing, color conversion, density conversion, smoothing, and sharpening on each image corresponding to the image data acquired by the image data acquisition unit 52. By performing processing, image data for display is created.

  In subsequent step S12, the image processing unit 53 performs, for each image, an average color calculation process, a lesion detection process, a red detection process, an organ detection process, and other predetermined feature detection based on the display image data. Image processing such as processing is performed. At this time, the image processing unit 53 may perform summarization processing on the image group based on the display image data.

In subsequent step S13, the image processing unit 53 displays the image data for display subjected to the image processing in step S11 together with the patient information and the examination information regarding the subject 10 for each patient and for each examination. Remember me. At this time, the image processing unit 53 associates the image data of each image with information such as an average color, a lesion detection result, a red detection result, and an organ detection result obtained by various image processes, and stores image data. The data is stored in the unit 542.
Thereafter, the operation of the image display device 5 ends.

FIG. 5 is a flowchart showing the operation of the image display device 5 when displaying an image group acquired by examination using the capsule endoscope 2.
First, in step S20, the control unit 56 determines an inspection for displaying an image group obtained as an inspection result and an inspection for comparing the inspection and the inspection result. More specifically, as illustrated in FIG. 6, the display control unit 565 causes the display unit 55 to display a screen M1 for allowing the user to select an examination for which an image is to be observed. This screen M1 includes a list m10 of a plurality of examinations performed on a subject (patient) 10 at different times, and a text message m11 that prompts the user to select an examination to display an image. A signal indicating the selected examination is input to the control unit 56 by a predetermined pointer operation (for example, a click operation on a desired examination date column) using the input unit 51 for the list m10. The examination determining unit 561 determines the selected examination as an examination for displaying the image group according to the input signal.
Note that when the subject 10 for image observation is selected, the latest examination performed on the subject 10 may be automatically determined as an examination for displaying an image group.

  Subsequently, as illustrated in FIG. 7, the display control unit 565 causes the display unit 55 to display a screen M <b> 2 for allowing the user to select a test for comparing the test result with respect to the test for displaying the image group. This screen M2 includes a text message m12 that prompts the user to select a test to be compared, in addition to the test list m10. In response to a predetermined pointer operation using the input unit 51 for the list m10, a signal indicating the selected examination is input to the control unit 56. The inspection determination unit 561 determines the selected inspection as an inspection for comparing inspection results according to the input signal. A plurality of inspections for comparing inspection results can be set according to the user's selection.

  In step S <b> 21, the inspection determination unit 561 sets one of two inspections set as the inspection for displaying the image group and the inspection for comparing the inspection results, as a comparison reference inspection (reference inspection). The inspection determining unit 561 normally sets an inspection for displaying an image group as a reference inspection, but may set an inspection for comparing inspection results as a reference inspection in accordance with a user designation. For example, as illustrated in FIG. 8, a screen M <b> 3 that allows the user to confirm the inspection for displaying the image group and the inspection for comparing the inspection result may be displayed on the display unit 55 and the user may select the reference inspection. . That is, when a predetermined pointer operation is performed on the OK button m13 on the screen M3, the inspection determining unit 561 sets a predetermined inspection (inspection for displaying an image group) as a reference inspection. On the other hand, when a pointer operation is performed on the reference inspection change button m14, the inspection determining unit 561 changes the reference inspection and sets the inspection for comparing the inspection results as the reference inspection.

  In the following, among the tests performed on the same subject 10, the latest test (hereinafter referred to as this test) is set as a test for displaying an image group and a standard test, and 1 performed in the past. A description will be given assuming that two inspections (hereinafter referred to as past inspections) are set as inspections for comparing inspection results.

  In step S22, the control unit 56 sets an index for comparing the image groups between the current examination and the past examination. More specifically, the display control unit 565 causes the display unit 55 to display a screen M4 for allowing the user to select an index, as illustrated in FIG. This screen M4 includes a text message m15 that prompts the user to select an index, a list of selectable index displays m16, a radio button m17 attached to each index display m16, and an OK button m18. . Examples of selectable indexes include imaging time, the number of images to be captured, and landmarks. The user can select an index by checking a radio button m17 attached to a desired index display m16 by a predetermined pointer operation using the input unit 51, and further pressing an OK button m18. . In response to this pointer operation, a signal indicating the selected index is input to the control unit 56. The index setting unit 562 sets the selected index as an index for comparing the current examination and the past examination according to the input signal.

  Here, when the imaging time is set as an index, the imaging time (1 hour later, 2 hours later,...) Based on a predetermined image (for example, the first image) is equal between the current examination and the past examination. The images are contrasted. In addition, when the number of images to be captured is set as an index, images with the same number of images (10,000th image, 20,000th image,...) Based on a predetermined image (same as above) between the current examination and the past examination. They are contrasted. When image summarization processing is performed in step S12 (see FIG. 4), comparison is performed with the number of captured images after the summarization processing.

Further, when a landmark is set as an index, between the current examination and the past examination, the same kind of landmark images extracted from each image group (for example, the head images, the boundary images of a specific organ, The images of the treatment marks are compared.
In the first embodiment, a case where an imaging time is set as an index will be described.

  In step S23, the control unit 56 sets the image group obtained by the current examination (hereinafter also simply referred to as the current examination image group) and the image group obtained by the past examination (hereinafter simply referred to as the past examination image group). The image to be associated is set.

  In the first embodiment, as illustrated in FIG. 10, the display control unit 565 causes the display unit 55 to display a screen M5 for allowing the user to select an image to be associated between the current examination and past examination image groups. This screen M5 displays a text message m19 that prompts the user to select an image to be associated, a list of displays m20 indicating the characteristics of selectable images, a radio button m21 attached to each display m20, and an OK button m22. Including.

  In addition to the images at the beginning and end of the image group, the images to be associated include organ boundaries (esophageal and stomach boundaries, stomach and small intestine boundaries, small and large intestine boundaries) automatically detected by organ detection processing. Images and anatomically characteristic images (duodenal papilla, lymphoid follicle, etc.) can be mentioned. The user can select an image by checking a radio button m21 attached to a desired display m20 by a predetermined pointer operation using the input unit 51 and pressing an OK button m22. In response to this pointer operation, a signal indicating the selected image is input to the control unit 56. The corresponding image setting unit 563 sets the selected image as an image to be associated according to the input signal.

  In step S24, the correspondence image setting unit 563 associates the images set in step S23 with each other between the current examination and the past examination image groups.

FIG. 11 is a schematic diagram illustrating an example of correspondence between image groups of the current examination and the past examination. For example, when the top image of the image group is set in step S23, in step S24, the top images (image I (A) _top and image I (B) _top between the image groups of the current examination and the past examination are _displayed. ) Are associated. When the last image of the image group is set, the last images (images I (A) _last , I (B) _last ) are associated between the image groups of the current examination and the past examination.

Further, when an image of an organ boundary is set in step S23, in step S24, based on information associated with the image data of each image, the image of the esophagus and stomach between the current examination and the previous examination image group. Boundary images (images I (A) _bor1 , I (B) _bor1 ), stomach and small intestine boundary images (images I (A) _bor2 , I (B) _bor2 ), or small intestine and large intestine boundary images ( Image I (A) _bor3 , I (B) _bor3 ).

  In step S25 subsequent to step S24, the average color bar creating unit 564 creates average color bars each representing an outline of the results of the current examination and the past examination. More specifically, the average color bar creating unit 564 acquires the average color associated with the image data of each image, and arranges the average color in a band-like region along the image arrangement order. At this time, as the average color bar scale (axis in the band length direction), the imaging time axis is set in the first embodiment in accordance with the index set in step S22.

Subsequently, the average color bar creating unit 564 aligns the positions on the average color bar where the average colors of the images associated in step S23 are displayed, and arranges the average color bars of the current examination and the past examination. 12 and 13 are schematic diagrams illustrating an example of creating an average color bar for the current examination and the past examination. For example, when the top images (images I (A) _top , I (B) _top ) are associated between the current examination and the past examination image groups, as shown in FIG. The average color bar b11 of the current inspection and the average color bar b12 of the past inspection are arranged with the left ends arranged. Further, for example, when the boundary images of the stomach and small intestine (images I (A) _bor2 , I (B) _bor2 ) are associated between the image groups of the current examination and the past examination, as shown in FIG. The average color bars b <b> 13 and b <b> 14 are arranged so that the positions where the average colors of these boundary images are displayed are aligned.

  In step S26 following step S25, the display control unit 565 creates an image observation screen including the average color bar created in step S25, and displays the image on the display unit 55.

  FIG. 14 is a schematic diagram illustrating an example of an observation screen of an image group acquired by the current examination. As shown in FIG. 14, the observation screen M6 has a test information display field m30 in which test information such as a test ID and a test date is displayed, and a patient in which patient information such as a patient ID, a patient name, and a birth date is displayed. Information display field m31, main display area m32 in which images acquired by the current examination are sequentially displayed as pseudo moving images, and reproduction used when the user operates the reproduction operation of images sequentially displayed in the main display area m32. Operation button group m33, capture button m34 used when a user inputs an instruction to capture an image displayed in the main display area m32, and the display format of the image group of the current examination from a pseudo moving image format to a still image list display And an overview button m35 used when the user inputs an instruction to switch to the format.

  Below the main display area m32, an average color bar display area m36 in which the average color bar created in step S25 is displayed is provided. FIG. 14 shows a state where average color bars b11 and b12 are displayed in this average color bar display area m36, with the imaging time as an index and the left end position corresponding to the top image of the image group aligned (see FIG. 12). Is shown.

  In addition, the average color bar b11 of the current examination is provided with a slider m37 indicating the imaging time of the image I being displayed in the main display area m32. By referring to the position of the slider m37, the user can generally grasp the position in the subject 10 of the image being displayed in the main display area m32. Further, the image displayed in the main display area m32 can be changed by moving the slider m37 along the average color bar b11 by a predetermined pointer operation using the input unit 51.

  Also, below the main display area m32, a label box m38 is provided in which an icon m39 displaying text such as lesions, bleeding, treatment marks and the like is arranged. The user can add a label to the image being displayed in the main display area m32 by selecting a desired icon m39 by a predetermined pointer operation using the input unit 51.

  The image display device 5 displays such an observation screen M6 on the display unit 55, causes the user to observe, and then ends the operation.

  As described above, according to the first embodiment, an examination that displays an image group from among a plurality of examinations performed on the same subject 10, and an examination that compares the examination and the examination result. Since the average color bar representing the outline of the image group acquired by each inspection is displayed on the image observation screen in comparison with the user, the user can easily compare the results of the inspections with different execution times. The image displayed on the observation screen can be efficiently observed with reference to the result of the comparison.

  Further, when the index for associating the image group of the current examination and the past examination is set to the imaging time and the length of the average color bar per unit time is made constant, the user can use the capsule endoscope 2 as the digestive tract. The time required to pass through the whole or each organ can be intuitively grasped. In addition, by displaying the average color bars of the current examination and the past examination at the position of the user-desired image, the capsule endoscope 2 passes based on the position between the current examination and the past examination. Time changes can be displayed more clearly. Such a change in the passage time of the capsule endoscope 2 represents a change in the motility function of the digestive tract of the subject 10 (whether or not the peristaltic movement is active or the like). The change in the state of the digestive tract in can be easily grasped.

(Modification 1-1)
Next, Modification 1-1 of Embodiment 1 of the present invention will be described.
When summarization processing has been performed on the current examination and past examination image groups (see step S12 in FIG. 4), it is preferable to set the index to the number of captured images in step S22 shown in FIG. In the summarization process, similar images obtained by the capsule endoscope 2 repeatedly imaging the same portion in the digestive tract are thinned out, or the capsule endoscope 2 reciprocates in a certain section in the digestive tract. This is because the processing is performed such that the images obtained by imaging are rearranged in the order corresponding to the imaging positions, and thus the arrangement order of the images after the summarization processing does not necessarily correspond to the imaging time. Rather, since the order of the images after the summarization process corresponds to the position in the length direction of the digestive tract, by setting the index as the number of captured images, the user can set each index in the digestive tract in the current examination and the past examination. It is possible to grasp the correspondence between the positions more accurately.

  Note that the processing when the index is set to the number of captured images is the same as that of Embodiment 1 except that the scale of the average color bar is the number of captured images axis.

(Modification 1-2)
Next, a modified example 1-2 of the first embodiment of the present invention will be described.
In the first embodiment, one past examination is set for comparing the examination result with the current examination, but a plurality of past examinations may be set. In this case, the correspondence image setting unit 563 associates images between the current examination image group and each past examination image group. The average color bar creation unit 564 aligns the positions where the average colors of the associated images are displayed, and arranges the average color bar for the current examination and the average color bar for each past examination.

  FIG. 15 and FIG. 16 are schematic diagrams illustrating an example of creating an average color bar when two past inspections for comparing inspection results with respect to the current inspection are set. Average color bars b11, b12, and b12 'shown in FIGS. 15 and 16 correspond to the current examination, the past examination (1), and the past examination (2) performed before the past examination (1), respectively.

For example, the first images (images I (A) _top , I (B) _top , I (C) _top ) between the current examination image group and the two previous examination (1) and (2) image groups. , The average color bar creating unit 564 aligns the left end where the average color of the top image is displayed as shown in FIG. 15, and averages the average color bar b11 of the current examination and the average of the two past examinations. Color bars b12 and b12 ′ are arranged.

  At this time, of the two past inspections (1) and (2), the average color bar b12 of the past inspection (1) whose inspection time is closest to the current inspection may be arranged in the immediate vicinity of the average color bar b11 of the current inspection. . This makes it easier for the user to grasp changes in the digestive tract in time series. In addition, when three or more past examination image groups are set for comparing the examination results with respect to the current examination, from the one closer to the average color bar b11 of the current examination, the examination time is changed from new to old. The average color bars of past examinations may be arranged in order.

Further, for example, the boundary images of the stomach and the small intestine (images I (A) _bor2 , I (B) _bor2 , I (C) _bor2 ) are associated between the current examination and the two previous examination image groups. In this case, the average color bar creating unit 564 aligns the positions where the average colors of these boundary images are displayed as shown in FIG. 16, and the average color bar b13 of the current image and the average color bar b14 of the two past examinations. , B14 ′. The arrangement order of the average color bars b14 and b14 ′ of the past examination is the same as that in FIG.

  As described above, when a plurality of past examinations for comparing examination results with respect to the current examination are set, the average color bar of each past examination is displayed on the observation screen of the image group acquired by the current examination. FIG. 17 is a schematic diagram illustrating a display example of an observation screen when two past examinations are set. In the observation screen M7 shown in FIG. 17, the average color bar b11 of the current image and the two average color bars b12 and b12 'of the past examination are arranged in the average color bar display area m36. The display contents in the area other than the average color bar display area m36 are the same as those in FIG.

(Embodiment 2)
Next, a second embodiment of the present invention will be described.
In the second embodiment, a case where a landmark is set as an index in step S22 shown in FIG. 5 will be described. The configuration and operation of the image display apparatus according to the second embodiment are the same as those of the first embodiment as a whole.

  In this case, in the subsequent step S23, the display control unit 565 causes the display unit 55 to display a screen M8 that allows the user to select a landmark to be associated as illustrated in FIG.

  The screen M8 includes a text message m40 prompting the user to select a landmark, a list of displayable landmarks m41, a radio button m42 attached to each landmark display m41, and an OK button m43. It is out. Examples of landmarks include the beginning and end of an image group, organ boundaries, anatomically characteristic images (duodenal papilla, lymphoid follicle, etc.), lesions, surgical excision marks, ink marks, pH change points, and the like. Among these, the organ boundaries include the esophagus and stomach boundary, the stomach and small intestine boundary, and the small and large intestine boundary, and the user can select these boundaries individually, It is also possible to select the boundaries of all at once. The selectable landmark may represent a feature that can be automatically detected by image processing, or a label that can be manually added by the user by operating the icon m39 in the label box m38 (see FIG. 14). It may correspond to.

  The user checks a radio button m42 attached to a desired landmark display m41 by a predetermined pointer operation using the input unit 51, and further presses an OK button m43 to thereby obtain a desired plurality of landmarks. Can be selected. In response to this pointer operation, a signal indicating the selected landmark is input to the control unit 56. Corresponding image setting section 563 sets a plurality of selected landmark images as images to be associated in accordance with the input signal.

In step S24, the correspondence image setting unit 563 associates the images set in step S23 with each other between the current examination and the past examination image groups.
For example, when the top and bottom images of the image group are set in step S23, as shown in FIG. 11, the top images (images I (A) _top and I (B) _top ) and end images ( Images I (A) _last , I (B) _last ) are associated with each other. An example in which another landmark image is set in step S23 will be described later.

  In step S <b> 25, the average color bar creating unit 564 creates average color bars each representing an outline of the results of the current examination and the past examination. When the landmark is set as the index, the average color bar creating unit 564 creates the average color bar for the current examination and the past examination so that the intervals between the positions of the landmark images associated in step S24 are equal. .

  FIG. 19 is a schematic diagram illustrating an example of creating an average color bar when a landmark is set as an index. For example, when the first image and the last image of the image group of the current examination and the past examination are associated with each other, the average color bar creating unit 564, as shown in FIG. The length of the average color bar b16 on the past examination side so that the left ends where the average colors of the first image are arranged and the right ends where the average colors of the last image are arranged are arranged between the average color bars b16 of Is expanded and contracted according to the current inspection set as the standard inspection. Note that the scale of the average color bars b15 and b16 may be an imaging time axis or an imaging number axis.

  In step S26, the display control unit 565 creates an observation screen for the current examination (see FIG. 14) and places the average color bars b15 and b16 created in step S25 in the average color bar display area m36.

  As described above, according to the second embodiment, the scale of the average color bar b16 on the past inspection side is expanded and contracted so that the entire lengths of the average color bars b15 and b16 are uniform between the current inspection and the past inspection. Therefore, the user can easily grasp the entire contents of the two average color bars b15 and b16.

(Modification 2-1)
Next, a second modification of the second embodiment of the present invention will be described.
In the second embodiment, one past examination is set for comparing the examination result with the current examination, but a plurality of past examinations may be set. In this case, the corresponding image setting unit 563 associates the images of the selected landmarks between the image group of the current examination and the image group of each past examination. The average color bar creation unit 564 aligns the positions where the average colors of the associated images are displayed, and arranges the average color bar for the current examination and the average color bar for each past examination.

  FIG. 20 is a schematic diagram illustrating an example of creating an average color bar in the case where two past inspections for comparing inspection results with respect to the current inspection are set. The average color bars b15, b16, and b16 'shown in FIG. 20 correspond to the current examination, the past examination (1), and the past examination (2) performed before the past examination (1), respectively.

For example, the top images (images I (A) _top , I (B) _top , I (C) _top ) between the image group of the current examination and the two past examinations (1) and (2) When the end images (images I (A) _last , I (B) _last , I (C) _last ) are associated with each other, the average color bar creation unit 564 displays the average color bar b15 of the current inspection and each past inspection. Past inspections (1), (2) so that the left ends where the average color of the first image is arranged and the right ends where the average color of the last image are arranged are aligned with the average color bars b16, b16 ′. ) Of the average color bars b16 and b16 ′ is expanded or contracted in accordance with the current inspection set as the reference inspection.

  In the present modification 2-1, the scale of the average color bars b15, b16, b16 'may be the imaging time axis or the imaging number axis. In addition, when two or more past inspections for comparing the inspection results are set with respect to the current inspection as in the case of the modified example 2-1, the inspection time is closer to the average color bar b15 of the current inspection. The average color bars of past examinations should be arranged in order from new to old. This makes it easier for the user to grasp changes in the digestive tract in time series.

(Embodiment 3)
Next, a third embodiment of the present invention will be described.
In the third embodiment, another example when a landmark is set as an index in step S22 shown in FIG. 5 will be described. The configuration and operation of the image display apparatus according to the third embodiment are the same as those of the first embodiment as a whole.

  When observing the image group of the examination this time, the user may want to observe a specific section (for example, the small intestine section) in particular in contrast to the past examination. In such a case, the user selects two landmarks (for example, stomach and small intestine) that define a desired section on the landmark selection screen (see screen M8 shown in FIG. 18) displayed in step S23 of FIG. The boundary and the boundary between the small and large intestines) may be selected. The corresponding image setting unit 563 sets the selected landmark image as an image to be associated in accordance with the signal input from the input unit 51.

In this case, in the subsequent step S24, the corresponding image setting unit 563 extracts and associates the landmark image set in step S23 from the current examination and past examination image groups. For example, when the boundary between the stomach and the small intestine and the boundary between the small intestine and the large intestine are set in step S23, the corresponding image setting unit 563 sets the boundary images between the stomach and the small intestine (images I (A) _bor2 , I (B) _bor2 ) and the border images of the small and large intestines (images I (A) _bor3 and I (B) _bor3 shown in FIG. 11) are associated with each other.

  In subsequent step S25, the average color bar creating unit 564 creates an average color bar based on the associated landmark image. The scale of the average color bar may be an imaging time axis or an imaging number axis. FIG. 21 is a flowchart showing an average color bar creation process.

  First, in step S250, the average color bar creation unit 564, for each of the current examination and the past examination, average color bars in which the average color of each image in the image group is evenly arranged along the imaging time axis or the imaging number axis. Create

  In subsequent step S251, the average color bar creating unit 564 determines a corresponding section (corresponding section) between the average color bars of the current examination and the past examination based on the landmark image associated in step S24. . For example, when the boundary image between the stomach and the small intestine and the boundary image between the small intestine and the large intestine are associated with each other, the average color bar has a section between the boundary between the stomach and the small intestine and the boundary between the small intestine and the large intestine (that is, the small intestine section), And the section before and after that (the section to the boundary between the stomach and the small intestine and the section after the boundary between the small intestine and the large intestine) is the corresponding section.

  Subsequently, the average color bar creation unit 564 executes the process of Loop A for each corresponding section. First, in step S252, the average color bar creating unit 564 determines whether or not the corresponding section to be processed is a closed section. Here, the closed section is a section in which images at the start point and images at the end point of the corresponding section are associated with each other.

For example, in this example, since the image is not associated before the boundary between the stomach and the small intestine, the section before the boundary between the stomach and the small intestine is not a closed section (hereinafter, this section is referred to as an open section). Step S252: No). In this case, the average color bar creating unit 564 arranges only the positions of one end where the images are associated with each other, and arranges the average color bars of the current examination and the past examination (step S253). Specifically, as shown in FIG. 22, the position of the boundary between the stomach and the small intestine (images I (A) _bor2 , I (B) _bor2 ) is aligned, and the average color b17 of the current examination and the average color of the previous examination Bar b18 is arranged.

The next processing target corresponding section (small intestine section) is a closed section because the boundary images between the stomach and the small intestine and the boundary images between the small intestine and the large intestine are associated with each other (step S252: Yes). In this case, the average color bar creation unit 564 expands / contracts the scale on the past inspection side (one that is not the reference inspection) so that the lengths of the corresponding sections are equal between the average color bars of the current inspection and the past inspection (step S1). S254). Specifically, in the average color bars b17 and b18, the lengths of the small intestine sections (images I (A) _{bor2 to} I (A) _bor3 , I (B) _{bor2 to} I (B) _bor3 ) are equal to each other. Scale the scale of the section on the past inspection side.

The corresponding section to be processed next is an open section where no image is associated after the boundary between the small intestine and the large intestine (step S252: No). Therefore, the average color bar creating unit 564 aligns the positions of the boundaries of the small intestine and the large intestine (images I (A) _bor3 , I (B) _bor3 ) where the _images are associated, and average color bars b17 and b18. Are arranged (step S253).
After the process for all corresponding sections is completed, the process returns to the main routine.

  In step S26 following step S25, the display control unit 565 creates an image observation screen (see FIG. 14), and arranges the average color bars b17 and b18 created in step S25 in the average color bar display area m36. It is displayed on the display unit 55.

  As described above, according to the third embodiment, the average color bars of the current examination and the past examination are displayed with the lengths of the sections arbitrarily selected by the user being displayed. It is possible to easily grasp the corresponding relationship between the sections. Therefore, the user diagnoses the progress of how the lesion detected in the past from the desired section has changed due to the treatment, or how the lesion detected this time was in the past. Can be easily performed.

(Modification 3-1)
Next, a modified example 3-1 of the third embodiment of the present invention will be described.
In Embodiment 3 described above, the scale of the open section remains unchanged, but the scale may be changed for the open section. For example, in the case of the average color bar b18 of the past examination shown in FIG. 22, a section from the image I (B) _top to the image I (B) _{bor2 and} a section from the image I (B) _bor3 to the image I (B) _last . Also, the scale may be _expanded or contracted in accordance with the scale of the section of the image I (B) _bor2 to image I (B) _bor3 whose scale has been _expanded or contracted. In this case, since the scale is constant throughout the average color bar b18, the user can compare the lengths of the small intestine section and other sections in the average color bar b18.

(Modification 3-2)
Next, Modification 3-2 of Embodiment 3 of the present invention will be described.
In the above-described third embodiment, one past inspection for comparing the inspection result with respect to the current inspection is set, but a plurality of past inspections may be set. In this case, the corresponding image setting unit 563 associates the images of the selected landmarks between the image group of the current examination and the image group of each past examination.

  FIG. 23 is a schematic diagram illustrating an example of creating an average color bar when two past inspections for comparing inspection results with respect to the current inspection are set. The average color bars b17, b18, and b18 'shown in FIG. 23 correspond to the current examination, the past examination (1), and the past examination (2) performed before the past examination (1), respectively.

For example, between the image group of the current examination and the two previous examinations (1) and (2), the boundary images of the stomach and small intestine (images I (A) _bor2 , I (B) _bor2 , I ( C) _bor2 ) and the border images of the small and large intestines (images I (A) _bor3 , I (B) _bor3 , I (C) _bor3 ) are associated with each other, the average color bar creating unit 564 In the bars b17, b18, b18 ′, the corresponding section which is a closed section, that is, the small intestine section (images I (A) _{bor2 to} I (A) _bor3 , I (B) _{bor2 to} I (B) _bor3 , I (C) The scales of the corresponding sections of the average color bars b18 and b18 ′ of the previous examinations (1) and (2) are expanded and contracted so that the lengths of _{bor2 to} I (C) _bor3 ) are equal.

  Further, as in the present modified example 3-2, when two or more past inspections for comparing the inspection results with respect to the current inspection are set, the inspection time is closer to the average color bar b17 of the current inspection. The average color bars of past examinations should be arranged in order from new to old. This makes it easier for the user to grasp changes in the digestive tract in time series.

(Modification 3-3)
Next, a modification 3-3 of the third embodiment of the present invention will be described.
In Embodiment 3 described above, the lengths of both sections are aligned only when the corresponding section is a closed section between the average color bars of the current inspection and the past inspection. You may arrange the length of a corresponding section.

  FIG. 24 is a flowchart illustrating another example of the process of the average color bar creating unit 564 in step S25. Note that the processes in steps S250 to S252 and S254 shown in FIG. 24 are the same as those in the third embodiment.

The average color bar creating unit 564 executes the process of loop B for each corresponding section determined in step S251.
In step S252, when the corresponding section to be processed is not a closed section (step S252: No), the average color bar creating unit 564 sets the beginning or end of the image group as the start point or end point of the corresponding section (step S255).

  In subsequent step S254, the average color bar creating unit 564 expands / contracts the scale of the corresponding section on the past inspection side so that the lengths of the corresponding sections are equal between the average color bars of the current inspection and the past inspection.

For example, as shown in FIG. 25, for the section before the boundary between the stomach and the small intestine (images I (A) _bor2 , I (B) _bor2 ), the top of the image group (images I (A) _top , I (B) _top ) is set as the start point of the corresponding section (see step S255). Therefore, the average color bar creating unit 564 makes the past so that the lengths of these sections (images I (A) _{top to} I (A) _bor2 , images I (B) _{top to} I (B) _bor2 ) are equal. The scale of the section of the average color bar b20 on the inspection side is expanded or contracted.

For the section after the boundary between the stomach and the small intestine (images I (A) _bor3 , I (B) _bor3 ), the end of the image group (image I (A) _last , I (B) _last ) is the end point of the corresponding section (See step S255). Therefore, the average color bar creating unit 564 makes the past so that the lengths of these sections (images I (A) _{bor3 to} I (A) _last , images I (B) _{bor3 to} I (B) _last ) are equal. The scale of the section of the average color bar b20 for inspection is expanded or contracted.

  FIG. 26 is a schematic diagram illustrating an example of creating an average color bar when two past inspections for comparing inspection results with respect to the current inspection are set in the modification 3-3. The average color bars b19, b20, and b20 'shown in FIG. 26 correspond to the current examination, the past examination (1), and the past examination (2) performed before the past examination (1), respectively.

For example, between the image group of the current examination and the two previous examinations (1) and (2), the boundary images of the stomach and small intestine (images I (A) _bor2 , I (B) _bor2 , I ( C) _bor2 ) and the border images of the small and large intestines (images I (A) _bor3 , I (B) _bor3 , I (C) _bor3 ) are associated with each other, the average color bar creating unit 564 In the bars b19, b20, b21 ′, the corresponding sections (images I (A) _{top to} I (A) _bor2 , images I (B) _{top to} I (B) _bor2 , images I (C) _{top to} I ( C) _bor2 ), small intestine section (images I (A) _{bor2 to} I (A) _bor3 , I (B) _{bor2 to} I (B) _bor3 , I (C) _{bor2 to} I (C) _bor3 ), and after the small intestine Corresponding _lengths (images I (A) _{bor3 to} I (A) _last , images I (B) _{bor3 to} I (B) _last , images I (C) _{bor3 to} I (C) _last ), etc. The scales of the average color bars b20 and b20 ′ of the past examinations (1) and (2) are expanded and contracted for each corresponding section so as to be more appropriate.

  In addition, when two or more past examinations for comparing the examination results with respect to the current examination are set, the past examinations are started from the one closer to the average color bar b19 of the current examination, from the newest to the oldest. The average color bars should be arranged in order. This makes it easier for the user to grasp changes in the digestive tract in time series.

(Embodiment 4)
Next, a fourth embodiment of the present invention will be described.
In the fourth embodiment, still another example in the case where a landmark is set as an index in step S22 shown in FIG. 5 will be described. The configuration and operation of the image display device according to the fourth embodiment are the same as those of the first embodiment as a whole.

In observing the image group of the examination this time, the user may want to observe the section of each organ in comparison with the past examination. In such a case, the user may select all organ boundaries on the landmark selection screen (see screen M8 shown in FIG. 18) displayed in step S23 of FIG. In this case, the corresponding image setting unit 563 extracts the boundary image of the organ from the image group of the current examination and the past examination (see FIG. 11), and the boundary images of the esophagus and stomach (images I (A) _bor1 , I (B ) _Bor1 ), boundary images of the stomach and small intestine (images I (A) _bor2 and I (B) _bor2 ), and boundary images of the small and large intestine (images I (A) _bor3 and I (B) _bor3 ), respectively. Correlate (step S24).

In the subsequent step S25, the average color bar creation unit 564 creates an average color bar according to the flowchart shown in FIG. 21 based on the associated organ boundary image.
Here, when only the boundary images of the organs are associated with each other, among the sections divided by the boundary images, the boundary between the esophagus and the stomach to the boundary between the stomach and the small intestine (the stomach section), and the boundary between the stomach and the small intestine to the small intestine The border of the large intestine (small intestine section) is a closed section. Accordingly, the average color bar creating unit 564 expands and contracts the scale on the past inspection side so that the lengths of the corresponding sections are equal between the average color bars of the current inspection and the past inspection (step S254). Specifically, as shown in FIG. 27, the stomach section (images I (A) _{bor1 to} I (A) _bor2 ) and the small intestine section (images I (A) _{bor2 to} I (A) in the average color bar b21 of this examination are shown. ) _Bor3 ) The stomach section (image I (B) _{bor1 to} I (B) _bor2 ) and small intestine section (image I (B) _{bor2 to} I (B) _bor3 ) in the average color bar b22 of the previous examination according to the length of _bor3 ) ) Scale each.

On the other hand, among the sections divided by the boundary image, the beginning of the image group to the boundary between the esophagus and the stomach (esophageal section) and the boundary between the small intestine and the large intestine to the end of the image group (large intestine section) are open sections. Therefore, the average color bar creating unit 564 includes the boundary between the esophagus and the stomach (images I (A) _bor1 , I (B) _bor1 ), and the small intestine where the images are associated between the average color bars b21 and _b22 . And only the positions of the borders of the large intestine (images I (A) _bor3 , I (B) _bor3 ) are arranged (step S253).
The subsequent steps are the same as in the third embodiment.

  As described above, according to the fourth embodiment, the lengths of the organ sections other than the end portions are displayed in a uniform manner between the average color bars of the current examination and the past examination. It is possible to intuitively and easily grasp the correspondence between the organ sections in the examination.

  FIG. 28 is a schematic diagram illustrating an example of creating an average color bar when two past inspections for comparing inspection results with respect to the current inspection are set in the fourth embodiment. The average color bars b21, b22, b22 'shown in FIG. 28 correspond to the current examination, the past examination (1), and the past examination (2) performed before the past examination (1), respectively.

For example, between the image group of the current examination and the two previous examinations (1) and (2), the boundary images of each organ, that is, the boundary images of the esophagus and the stomach (image I (A) _bor1 , I (B) _bor1 , I (C) _bor1 ), border images of stomach and small intestine (images I (A) _bor2 , I (B) _bor2 , I (C) _bor2 ), and border images of small intestine and large intestine When (images I (A) _bor3 , I (B) _bor3 , I (C) _bor3 ) are associated, the average color bar creation unit 564 is a closed section in the average color bars b21, b22, and 22 ′. Stomach segment (image I (A) _{bor1 to} I (A) _bor2 , image I (B) _{bor1 to} I (B) _bor2 , image I (C) _{bor1 to} I (C) _bor2 ) and small intestine segment (image I (A) ) _{Bor2 to} I (A) _bor3 , image I (B) _{bor2 to} I (B) _bor3 , image I (C) _{bor2 to} I (C) _bor3 ) The scale of the average color bars b22 and b22 ′ of the past inspection is expanded and contracted for each corresponding section.

  In addition, when two or more past inspections for comparing the inspection results with respect to the current inspection are set, the past inspection from the closest to the average color bar b21 of the current inspection to the oldest inspection time is started. The average color bars should be arranged in order. This makes it easier for the user to grasp changes in the digestive tract in time series.

(Modification 4)
Next, a fourth modification of the fourth embodiment of the present invention is described.
In Embodiment 4 described above, the lengths of both sections are aligned only when the corresponding section is a closed section between the average color bars of the current inspection and the past inspection, but also when the corresponding section is an open section. You may arrange the length of a corresponding section.

In this case, in step S25, the average color bar creating unit 564 creates an average color bar according to the flowchart shown in FIG. 24 based on the boundary image of the associated organ. Accordingly, as shown in FIG. 29, in this examination and the past examination, esophageal sections (images I (A) _{top to} I (A) _bor1 , I (B) _{top to} I (B) _bor1 ), stomach sections (Images I (A) _{bor1 to} I (A) _bor2 , I (B) _{bor1 to} I (B) _bor2 ), small intestine sections (images I (A) _{bor2 to} I (A) _bor3 , I (B) _{bor2 ˜I} (B) _bor3 ) and the colorectal segments (images I (A) _{bor3 ˜I} (A) _last , I (B) _{bor3 ˜I} (B) _last ) are equal in average color bar b23, b24, respectively. Is created.

  According to the fourth modification example, the lengths of all corresponding organ sections are displayed for each section between the average color bars of the current examination and the past examination. The correspondence between organ sections can be grasped intuitively and easily. Accordingly, it is possible to easily diagnose the progress of a lesion or the like in each organ section.

  FIG. 30 is a schematic diagram illustrating a creation example of an average color bar when two past inspections are set for comparing the inspection results with the current inspection in the fourth modification. The average color bars b23, b24, and b24 'shown in FIG. 30 correspond to the current examination, the past examination (1), and the past examination (2) performed before the past examination (1), respectively.

In this case, in this examination and past examinations (1) and (2), esophageal segments (images I (A) _{top to} I (A) _bor1 , I (B) _{top to} I (B) _bor1 , I (C ) _{Top to} I (C) _bor1 ), stomach sections (images I (A) _{bor1 to} I (A) _bor2 , I (B) _{bor1 to} I (B) _bor2 , I (C) _{bor1 to} I (C) _bor2 ), Small intestine sections (images I (A) _{bor2 to} I (A) _bor3 , I (B) _{bor2 to} I (B) _bor3 , I (C) _{bor2 to} I (C) _bor3 ), and large intestine sections (images) I (A) _{bor3 to} I (A) _last , I (B) _{bor3 to} I (B) _last , I (C) _{bor3 to} I (C) _last ) are equal in length, and the average color bar b23 , B24, b24 ′ are created.

  In addition, when two or more past inspections for comparing the inspection results with respect to the current inspection are set, the past inspection is performed from the closest to the average color bar b23 of the current inspection to the oldest inspection time. The average color bars should be arranged in order. This makes it easier for the user to grasp changes in the digestive tract in time series.

(Embodiment 5)
Next, a fifth embodiment of the present invention will be described.
In the fifth embodiment, another example in the case where a landmark is set as an index in step S22 shown in FIG. 5 will be described. The configuration and operation of the image display apparatus according to the fifth embodiment are the same as those in the first embodiment as a whole.

  In observing the image group of the current examination, the user changes how the lesion detected in the previous examination has changed in the current examination, or what state the lesion detected in the current examination has changed in the previous examination. Sometimes you want to know what it was. In such a case, the user may select a lesion in addition to the organ boundary on the landmark selection screen (see screen M8 shown in FIG. 18) displayed in step S23 of FIG. In addition, landmarks such as surgical excision marks and ink marks may be selected.

  In this case, the corresponding image setting unit 563 extracts a selected landmark image such as a lesion image from each image group of the current examination and the past examination (see FIG. 11), and images between the current examination and the past examination. Are associated (step S24).

  In the subsequent step S25, the average color bar creation unit 564 creates an average color bar according to the flowchart shown in FIG. 21 or FIG. 24 based on the associated landmark image. Thereby, the average color bar b25 of the current inspection and the average color bar b26 of the past inspection illustrated in FIG. 31 are created. Note that the average color bars b25 and b26 shown in FIG. 31 are created according to the flowchart shown in FIG. 24, and the scales are also expanded and contracted in the corresponding sections (open sections) at both ends.

In the average color bar b25, b26, this inspection and the detected lesions interval between the last inspection (image _{I (A) mark1 ~I (A} ) mark2, I (B) mark1 ~I (B) mark2), lesion The small intestine sections before the section (images I (A) _{bor2 to} I (A) _mark1 , I (B) _{bor2 to} I (B) _mark1 ), and the small intestine sections after the lesion section (image I ( for even _{a) mark2 ~I (a) bor3} , I (B) mark2 ~I (B) bor3), so that the length of the corresponding section are equal respectively, thereby stretching the scale.

  As described above, in the present fifth embodiment, the organ section including the lesion section is standardized before and after the lesion section between the average color bars b25 and b26 of the current examination and the past examination. Therefore, the user can intuitively and easily grasp not only the correspondence between the lesion sections in the current examination and the past examination but also the correspondence between the organ sections before and after the lesion section.

  FIG. 32 is a schematic diagram illustrating an example of creating an average color bar when two past inspections for comparing inspection results with respect to the current inspection are set in the fifth embodiment. The average color bars b25, b26, and b26 'shown in FIG. 32 correspond to the current examination, the past examination (1), and the past examination (2) performed before the past examination (1), respectively.

In this case, this inspection and the past inspection (1), in the (2), the lesion section (image _{I (A) mark1 ~I (A} ) mark2, I (B) mark1 ~I (B) mark2, I (C) _MARK1 When ~I (C) _mark2) is detected, the disease small intestine section with each other before the variable interval (image _{I (a) bor2 ~I (a} ) mark1, I (B) bor2 ~I (B) mark1, _{I (C) bor2 ~I (C} ) mark1), and the disease small intestine section with each other after the variable section (image _{I (a) mark2 ~I (a} ) bor3, I (B) mark2 ~I (B) bor3, _{I (C) mark2 ~I (C} ) average color length was stretch the scale to equal each _Bor3) bar b25, b26, b26 'is created.

  In addition, when two or more past inspections for comparing the inspection results with respect to the current inspection are set, the past inspection is performed from the closest to the average color bar b25 of the current inspection to the oldest inspection time. The average color bars should be arranged in order. This makes it easier for the user to grasp changes in the digestive tract in time series.

(Embodiment 6)
Next, a sixth embodiment of the present invention will be described.
In the first to fifth embodiments, the average color bar of the current examination and the past examination is displayed with the position of the associated image or the length of the corresponding section aligned. Further, landmarks desired by the user may be mapped to the bars.

  In this case, the display control unit 565 causes the display unit 55 to display a screen M9 for allowing the user to select a landmark to be mapped, for example, as illustrated in FIG. This screen M9 displays a text message m45 prompting the user to select a landmark to be mapped, a list of displayable landmarks m46, radio buttons m47 attached to each landmark display m46, and mapping display. An ON / OFF button m48 for selecting the presence or absence of the button, and an OK button m49. Among these, selectable landmarks may represent features that can be automatically detected by image processing, or can be manually added by the user by operating the icon m39 in the label box m38 (see FIG. 14). It may correspond to a label.

  The user checks the radio button m47 attached to the desired landmark display m46 by a predetermined pointer operation using the input unit 51, selects ON of the mapping ON / OFF button m48, and then OKs. A landmark can be selected by pressing the button m49. In response to this pointer operation, a signal indicating the selected landmark is input to the control unit 56.

  The corresponding image setting unit 563 extracts a landmark image corresponding to the selected landmark from the past examination image group according to the input signal.

  The average color bar creating unit 564 creates an average color bar for the current examination and the past examination (see step S25 shown in FIG. 5), and also has the imaging time or number of images of the landmark image extracted by the corresponding image setting unit 563. In addition, the landmark is mapped on the average color bar of the past inspection. Further, the average color bar creating unit 564 estimates a position corresponding to the landmark mapped to the average color bar of the previous examination, and performs mapping on the average color bar of the current examination.

FIG. 34 is a schematic diagram showing an example of creating an average color bar in the sixth embodiment, and shows an example in which landmark mapping is performed on the average color bars b23 and b24 shown in FIG. As shown in FIG. 34, the average color bar b24 of the past examination includes a mark c1 indicating the position of the lesion image I (B) _mark3 detected from the past examination image group, and a section of the lesion image (image I (B ) _{Mark4 to} I (B) _mark5 ) are displayed. In addition, marks c1 ′ and c2 ′ are located at positions on the average color bar b23 of the current examination that have the same positional relationship as the marks c1 and c2 on the average color bar b24 (for example, positions at the same distance from the left end of the average color bar). Is displayed. These marks c1 ′ and c2 ′ indicate the positions in the image group of the current examination where it is estimated that the same lesion as the lesion detected from the image group of the previous examination exists.

  These marks c1, c2, c1 ′, and c2 ′ are hidden by selecting the mapping ON / OFF button m48 OFF on the screen M9 shown in FIG. 33 and then pressing the OK button m49. You can also.

  As described above, according to the sixth embodiment, based on the positional relationship on the average color bar, the position of the image corresponding to the landmark image extracted from the past examination image group in the current examination image group. Can be easily estimated. Therefore, the user can efficiently observe the image group of the current examination based on the examination result of the past examination.

  FIG. 35 is a schematic diagram illustrating an example of creating an average color bar when two past inspections for comparing inspection results with respect to the current inspection are set in the sixth embodiment. The average color bars b23, b24, and b24 'shown in FIG. 35 correspond to the current examination, the past examination (1), and the past examination (2) performed before the past examination (1), respectively.

When lesion images I (B) _{mark 3} and I (B) _{mark 4 to} I (B) _{mark 5} are detected from the image group of the past examination (1), the average color bar b24 of the past examination (1) shows the lesion image. A mark c1 indicating the position of I (B) _mark3 and a mark c2 indicating a section of the lesion image (images I (B) _{mark4 to} I (B) _mark5 ) are displayed. When lesion images I (C) _{mark4 to} I (C) _mark5 are detected from the image group of the past examination (2), the average color bar b24 ′ of the past examination (2) includes a section of the lesion image. A mark c ₀ 2 is displayed. In addition, when the images I (B) _{mark4 to} I (B) _mark5 of the past examination (1) and the images I (C) _{mark4 to} I (C) _{mark5 of} the past examination (2) are associated with each other, the average The display may be performed so that the positions and lengths of the sections of these lesion images are aligned in the color bars b24 and b24 ′. Further, the average color bar b23 has a mark in the same positional relationship as the mark c1 on the average color bar b24 and the mark c2 on the average color bar 24b (that is, the mark c ₀ 2 on the average color bar b24 ′). c1 ′ and c2 ′ are displayed. These marks c1 ′ and c2 ′ indicate the positions in the image group of the current examination where it is estimated that the same lesion as the lesion detected from the image group of the previous examination exists.

  Thus, by displaying the position and section of the lesion image detected from the image groups of the past examinations (1) and (2) on the average color bars b24 and b24 ′, the user starts to appear the lesion. Can be estimated.

  Even when two or more past tests comparing the test results are set for the current test, the average of the past tests from the closest to the average color bar b24 of the current test to the old test time Arrange the color bars in order. Thereby, the user can easily grasp time-series changes in the appearance state of the lesion.

(Modification 6)
Next, Modification 6 of Embodiment 6 of the present invention will be described.
In the sixth modification, the display and non-display of the average color bar of the past examination displayed on the image observation screen (see FIG. 14) can be switched.

  FIG. 36 is a schematic diagram illustrating a display example of an average color bar in the sixth modification. The average color bar display area m36 ′ shown in FIG. 36 has a switching button m50 for switching the presence / absence of display of information related to past examinations (hereinafter also simply referred to as past information) in the average color bar display area m36 shown in FIG. It is added.

  As shown in FIG. 36A, when ON is selected by a pointer operation using the input unit 51 for the switching button m50, the average color bars of the current examination and the past examination are displayed in association with each other. Note that FIG. 36A shows an example in which lesions and the like are mapped to the average color bars b23 and b24 as described in the sixth embodiment.

  On the other hand, as shown in FIG. 36 (b), when OFF is selected by a pointer operation using the input unit 51 for the switching button m50, the average color bar b24 of the past examination is hidden and the average of the current examination is displayed. The marks c1 ′ and c2 ′ displayed on the color bar b23 are also deleted.

  Thus, by enabling the display and non-display of past information on the image observation screen, the user can observe the image group of the current examination in a desired manner.

  FIG. 37 is a schematic diagram illustrating a display example of an average color bar when two past inspections for comparing inspection results with respect to the current inspection are set in Modification 6. In this case, as shown in FIG. 37A, the average color bars b23, b24, and b24 ′ of the current examination and the two past examinations (1) and (2) are displayed in the average color bar display area m36 ′. The As shown in FIG. 37 (b), when OFF is selected with the switching button m50, the average color bars b24 and b24 ′ of the two past examinations (1) and (2) are both hidden, and this time The marks c1 ′ and c2 ′ displayed on the average color bar b23 of the inspection are also deleted.

(Embodiment 7)
Next, a seventh embodiment of the present invention will be described.
FIG. 38 is a block diagram illustrating a configuration of an image display apparatus according to the seventh embodiment. As shown in FIG. 38, the image display device 6 according to the seventh embodiment includes a control unit 61 instead of the control unit 56 in the image display device 5 shown in FIG. The configuration and operation of each unit other than the control unit 61 of the image display device 6 are the same as those in the first to sixth embodiments. The configuration of the entire capsule endoscope system including the image display device 6 is the same as that shown in FIG.

  The control unit 61 further includes a corresponding image extraction unit 611 and a comparison screen creation unit 612 with respect to the control unit 61 shown in FIG. When the user-desired point or section is selected on the average color bar of the past examination displayed on the image observation screen (see FIG. 14), the corresponding image extraction unit 611 performs past examination on the image at the point or section. Are extracted from the image group of the current examination, and an image presumed to include a part in the digestive tract that is the same as or close to the image of the past examination is extracted from the image group of the current examination. The comparison screen creation unit 612 creates a screen for comparing and displaying the images of the current examination and the past examination extracted by the corresponding image extraction unit 611. In addition, the structure of each part of the control part 61 other than the corresponding image extraction part 611 and the comparison screen creation part 612 is the same as that of Embodiments 1-6.

  FIG. 39 is a schematic diagram showing a display example of the average color bar in the seventh embodiment, and shows a case where a point is selected with respect to the average color bar b24 of the past examination shown in FIG. As shown in FIG. 39, when the position of the user desired point c3 is selected by a predetermined pointer operation using the input unit 51 for the average color bar b24, a signal indicating the position of the point c3 is sent to the control unit 61. Entered. The corresponding image extraction unit 611 corresponds to a position on the average color bar b23 of the current examination corresponding to the position of the point c3 in the average color bar b24 (for example, a position where the distance from the left end of the bar is equal) according to the input signal. Mark point c3 '. Further, in consideration of an error in the imaging time (or the number of images to be captured), a section d1 that is extended by a predetermined length around the corresponding point c3 'is marked. This section d1 is a section on the average color bar b23 estimated to correspond to the point c3 selected by the user on the average color bar b24.

  Subsequently, the corresponding image extraction unit 611 extracts the image at the imaging time (or the number of images) indicated by the point c3 on the average color bar b24 from the image group of the past examination, and the section d1 on the average color bar b23 indicates. One or more representative images are selected by extracting an image at the imaging time (or the number of images) from the image group of the current examination and judging the similarity between the extracted images.

The comparison screen creation unit 612 creates a screen in which an image extracted from the previous examination image group and a representative image selected from the current examination image group are arranged in comparison. FIG. 40 is a schematic diagram illustrating an example of a screen created by the comparison screen creation unit 612. In the screen M10 shown in FIG. 40, the image I (B) _T of the past examination at the point c3 selected by the user and the part in the digestive tract corresponding to or near the image I (B) _T are shown. ) And the representative image group of the current examination (images I (A) _i , i = 1, 2,...) Estimated side by side.

  In FIG. 39, the average color bar b24 of the past image is simply displayed for the sake of simplification. However, as shown in FIG. 34, the average color bar b24 to which the lesion image or the like is mapped is displayed on the user. You may make it select a point. In this case, the user can more easily select a desired point indicating a lesion or the like.

  In this way, by associating the average color bar of the previous examination with the average color bar of the current examination, it is also possible to display the images corresponding to the past examination image and the current examination image in comparison with each other. become. Therefore, the user can easily confirm how the location of interest in the past examination has changed in the current examination. Further, by selecting a representative image, the user can perform comparative observation of images of the current examination and the past examination in a short time.

(Modification 7-1)
In Embodiment 7 described above, the image of the current examination corresponding to the point selected by the user in the past examination is extracted. Conversely, the image of the past examination corresponding to the point selected by the user in the current examination is selected. It is good also as extracting and contrast-displaying. In this case, the user can easily confirm the past state of the part of interest in the current examination.

(Modification 7-2)
Next, a modified example 7-2 of the seventh embodiment of the present invention will be described.
In Embodiment 7 described above, an example has been described in which one past test for comparing the test results is set for the current test, but two or more past tests may be set.

  FIG. 41 is a schematic diagram illustrating an example of creating an average color bar in the case where two past inspections for comparing inspection results with respect to the current inspection are set. The average color bars b23, b24, and b24 'shown in FIG. 41 correspond to the current examination, the past examination (1), and the past examination (2) performed before the past examination (1), respectively.

  In this case, the user can perform a pointer operation on each of the average color bars b24 and b24 'corresponding to the two past examinations (1) and (2). For example, when the position of the point c4 is selected by a pointer operation on the average color bar b24 ′ of the past inspection (2), the average color bar b24 of the past inspection (1) corresponding to the position of the point c4 and the current inspection Corresponding points c4 ′ and c4 ″ are respectively marked at positions on the average color bar b23. Further, a section d2 centered on the corresponding point c4 ″ is marked on the average color bar b23 of the current examination. This section d2 is a section on the average color bar b24 estimated to correspond to the point c4 selected by the user on the average color bar b24 '.

In addition, the comparison screen creation unit 612 performs the current examination according to the image extracted from the image group of the past examination (2) and the past examination (1) according to the positions of the points c4 and c4 ′ and the position of the section d2. A screen in which the representative images selected from the image group are arranged in comparison with each other is created. FIG. 42 is a schematic diagram illustrating an example of a screen created by the comparison screen creation unit 612. In the screen M11 shown in FIG. 42, the image I (C) _T of the past examination (2) at the point c4 selected by the user and the point corresponding to the point c4 ′ (that is, the same as or close to the image I (C) _T are displayed. Representative image group (image I (A)) of the current examination corresponding to the image I (B) _T in which the portion in the digestive tract is shown) and the section d2 (that is, estimated to correspond to the image I (C) _T ) _i , i = 1, 2,...) are displayed side by side. When three or more past examinations for comparing the examination results are set for this examination, a comparison screen is created in the same manner.

(Modification 7-3)
In the seventh embodiment, one image selected by the user in the past examination is displayed in comparison with a plurality of images estimated to correspond to this image. However, the plurality of images are compared with each other. May be displayed.

  FIG. 43 is a schematic diagram showing a display example of the average color bar in the modified example 7-3, and shows a case where a section is selected for the average color bar b24 of the past examination shown in FIG. As shown in FIG. 43, when a user-desired section d3 is selected by a predetermined pointer operation using the input section 51 for the average color bar b24, a signal indicating the position of the section d3 is input to the control section 61. The The corresponding image extraction unit 611 sets the section d3 ′ to a position on the average color bar b23 corresponding to the position of the section d3 in the average color bar b24 (for example, a region where the distance from the left end of the bar is equal) according to the input signal. Mark.

  Subsequently, the corresponding image extraction unit 611 extracts the image at the imaging time (or the number of images) indicated by the section d3 on the average color bar b24 from the image group of the past examination, and determines the similarity between the extracted images. Thus, one or more representative images are selected. Also, the corresponding image extraction unit 611 extracts an image at the imaging time (or the number of images) indicated by the section d3 ′ on the average color bar b23 from the current image group, and determines the similarity between the extracted images. One or more representative images are selected.

The comparison screen creation unit 612 creates a screen that displays the representative image selected from the past examination image group and the representative image selected from the current examination image group. FIG. 44 is a schematic diagram illustrating an example of a screen created by the comparison screen creation unit 612. On the screen M12 shown in FIG. 44, the representative image group (image I (B) _j , j = 1, 2,...) In the section d3 selected by the user and the representative image group in the current examination in the section d3 ′. (Image I (A) _k , k = 1, 2,...), That is, the representative image of the current examination that is estimated to include the same or nearby portion in the digestive tract as the representative image group in the section d3 of the previous examination. Groups are displayed side by side.

  Thus, by displaying the representative image groups side by side in the current examination and the past examination, the user can efficiently perform comparative observation of images in a short time.

(Modification 7-4)
Next, a modification 7-4 of the seventh embodiment of the present invention will be described.
In the modified example 7-3, the example in which one past test for comparing the test result with respect to the current test has been described, but two or more past tests may be set.

  FIG. 45 is a schematic diagram illustrating an example of creating an average color bar in the case where two past inspections for comparing inspection results with respect to the current inspection are set. The average color bars b23, b24, and b24 'shown in FIG. 45 correspond to the current inspection, the past inspection (1), and the past inspection (2) performed before the past inspection (1), respectively.

  In this case, the user can perform a pointer operation on each of the average color bars b24 and b24 'corresponding to the two past examinations (1) and (2). For example, when a section d4 is selected by a pointer operation on the average color bar b24 ′ of the past examination (2), the average color bar b24 of the past examination (1) corresponding to the position of the section d4 and the average color of the current examination The sections d4 ′ and d4 ″ are marked at positions on the bar b23 (for example, positions where the distance from the left end of the bar is equal). Three or more past examinations for comparing the examination results are set for the current examination. The same applies to the case.

Further, the comparison screen creation unit 612 compares representative images selected from the image groups of the past examination (2), the past examination (1), and the current examination according to the positions of the sections d4, d4 ′, and d4 ″. 46 is a schematic diagram showing an example of a screen created by the comparison screen creation unit 612. The screen M13 shown in FIG. ) Representative image group (image I (C) _x , x = 1, 2,...) And the past image group (image I (B) _y , y = 1, 2,. ...) and the representative image group (image I (A) _z , z = 1, 2,...) Of the current examination in the section d4 ″, that is, the same as or close to the representative image group in the section d4 of the past examination (2). The representative image group of this examination, which is estimated to be a part of the digestive tract, is displayed on the screen. They are displayed in chronological order from the side. By referring to such a screen, the user can easily grasp a time-series change between representative image groups.

FIG. 47 is a schematic diagram illustrating another example of a screen created by the comparison screen creation unit 612. In the screen M14 shown in FIG. 47, the representative image group (image I (A) _z ) selected from the current examination is arranged in the center, and the representative image group (image I (C)) selected from the past examination (1). _y ) and a representative image group (image I (C) _x ) selected from the past examination (2) are arranged on both sides thereof. Thus, by arranging each of the representative image groups selected from the past examinations (1) and (2) next to the representative image group selected from the current examination, the examination performed at each past period This makes it easier to compare with inspection.

(Embodiment 8)
Next, an eighth embodiment of the present invention will be described.
In the first to seventh embodiments, one average color bar for the previous inspection is displayed in comparison with the average color bar for the current inspection. However, a plurality of average color bars with different comparison methods may be displayed. . 48 and 49 are schematic diagrams showing an example of creating an average color bar in the eighth embodiment.

  As an example, in FIG. 48, with respect to the average color bar b30 of the current examination, the index is the imaging time, the average color bar b31 of the past examination in which the top images are associated with each other, the index is the landmark, Are simultaneously displayed with the average color bar b32 of the past examination associated with At this time, the average color bars b31 and b32 of the past inspection may be displayed above and below the average color bar b30 of the current inspection so that the comparative observation between the current inspection and the past inspection becomes easy.

  Also, in FIG. 48, landmark images (such as lesion images) detected in the past examination are mapped to average color bars b31 and b32 (see marks c11 and c12), and this time corresponding to these marks c11 and c12. A warning mark c10 is displayed at a position on the average color bar b30 of the inspection. The warning mark c10 may be switched between display and non-display by user selection.

  As another example, in FIG. 49, with respect to the average color bar b33 of the current examination, the index is the imaging time, the average color bar b34 of the past examination in which the start position of the small intestine is associated, the index is the landmark, The average color bar b35 of the past examination in which the boundary of the organ and the landmark X of the lesion are associated with each other is displayed at the same time. Among these, between the average color bar b33 and the average color bar b35, a section from the start position of the small intestine to the landmark X (small intestine (1)) and a section from the landmark X to the end position of the small intestine (small intestine ( 2)) are also associated with each other. In this way, by setting the corresponding section based on the organ boundary and the landmark position, the user can, for example, change that occurred in each region before and after the lesion during the period from the previous examination to the current examination. Can be grasped.

  In FIG. 49, the display of the scale is corrected so that the start position of the small intestine commonly associated with the three average color bars b33 to b35 becomes a reference (for example, 0h). Further, in these average color bars b33 to b35, the mark Y indicating the excision mark of the region excised by the operation and the region Y ′ before the excision are shown in association with each other. By performing such display, the user can grasp the processing performed between the past examination and the current examination.

  The display form of such average color bars, that is, the indicators, scales, and corresponding landmarks of each average color bar, the number of average color bars of the past inspection displayed in comparison with the current inspection, and the arrangement order of the average color bars Etc. may be appropriately selected by the user using a pull-down menu or the like.

  The present invention described above is not limited to Embodiments 1 to 8 and modifications thereof, and various combinations can be made by appropriately combining a plurality of components disclosed in the embodiments and modifications. An invention can be formed. For example, some constituent elements may be excluded from all the constituent elements shown in each embodiment or modification, or may be formed by appropriately combining the constituent elements shown in different embodiments or modifications. May be.

DESCRIPTION OF SYMBOLS 1 Capsule-type endoscope system 2 Capsule-type endoscope 3 Reception apparatus 3a Cradle 4 Reception antenna unit 4a-4h Reception antenna 5, 6 Image display apparatus 10 Subject 21 Imaging part 22 Illumination part 23 Signal processing part 24 pH sensor 25 , 33 Memory 26 Transmitter 27 Antenna 28, 38 Battery 31 Receiver 32 Signal processor 34 Data transmitter 35 Operation unit 36, 55 Display unit 37, 56, 61 Control unit 51 Input unit 52 Image data acquisition unit 53 Image processing unit 54 Storage Unit 541 Program Storage Unit 542 Image Data Storage Unit 561 Inspection Determination Unit 562 Index Setting Unit 563 Corresponding Image Setting Unit 564 Average Color Bar Creation Unit 565 Display Control Unit 611 Corresponding Image Extraction Unit 612 Comparison Screen Creation Unit

Claims (14)

An image display device that displays an image group acquired by an examination using a capsule endoscope that is introduced into a subject and images the inside of the subject on a display unit,
A test determination unit for determining a first test for displaying a test result and a second test for comparing the first test with the test result from a plurality of tests on the same subject;
An index setting unit for setting an index when comparing the test results of the first and second tests;
A corresponding image setting unit that associates an image in the first image group acquired by the first examination with an image in the second image group obtained by the second examination based on the index; ,
First summary information that represents a summary of the result of the first examination based on the index and information on the images in the first and second image groups associated with each other by the corresponding image setting unit. And a summary information creation unit that creates second summary information that represents a summary of the result of the second examination,
A display control unit that displays the first and second summary information side by side on the display unit;
An image display device comprising:   The first and second summary information are first and second average color bars in which the average colors of the images in the first and second image groups are arranged in time series order or image order, respectively. The image display apparatus according to claim 1, wherein the image display apparatus is provided. The index is an elapsed time from when an image in each of the first and second image groups is captured from an arbitrary timing, or an image from an arbitrary reference image in the first and second image groups. The number of images counted along the order of
The correspondence image setting unit associates a pair of images having a common feature between the first and second image groups,
The summary information creation unit creates the first and second average color bars having a common scale,
The display control unit arranges the first and second average color bars by aligning positions on the first and second average color bars corresponding to the set of images. Item 3. The image display device according to Item 2.   The corresponding image setting unit is configured such that the first images extracted from the first and second image groups, the last images, images showing a common organ boundary, or anatomically characteristic images are extracted. The image display device according to claim 3, wherein the images are associated with each other. The index is an image having a characteristic extracted from each of the first and second image groups,
The correspondence image setting unit associates a plurality of sets of images having a common feature between the first and second image groups,
The summary information creation unit has a length of a section divided by positions on the first and second average color bars corresponding to a plurality of sets of images associated by the corresponding image setting unit. 3. The image display according to claim 2, wherein the scale of one of the first and second average color bars is expanded and contracted for each section so as to be equal between the second average color bars. apparatus.   The corresponding image setting unit includes, for example, head images extracted from the first and second image groups, end images, images showing a common organ boundary, anatomically characteristic images, An image in which lesions of the same kind are detected, an image in which a treatment mark or a surgical excision mark is shown, an image in which ink is printed, and an image at a pH change point are associated with each other. Item 6. The image display device according to Item 5.   6. The display control unit according to claim 2, wherein the display control unit displays a plurality of types of the second average color bars having different indices on the display unit with respect to the first average color bar. The image display device according to claim 1.   The display control unit includes an image showing an organ boundary, an image where a lesion is detected, an image showing a treatment mark or a surgical excision mark, an image showing ink, and a pH change point on the display unit. 8. The image display device according to claim 2, wherein a mark is displayed at a position on the first and second average color bars corresponding to at least one of the images. It further includes an input unit for inputting a signal according to an external operation,
The image display device according to claim 8, wherein the display control unit switches between a display state and a non-display state of the mark on the display unit based on a signal input from the input unit. An input unit for inputting a signal according to an external operation;
When a signal for selecting an area on the second average color bar is input from the input unit, the area on the first average color bar is based on the arrangement of the area on the second average color bar. At least one image in the first image group corresponding to the determined area on the first average color bar, and on the selected second average color bar. A corresponding image extraction unit that extracts at least one image in the second image group corresponding to a region;
A comparison screen creation unit for creating a screen for comparing the images in the first image group extracted by the corresponding image extraction unit with the images in the second image group;
The image display device according to claim 2, further comprising: The corresponding image extraction unit, when extracting a plurality of images from the first or second image group, selects one or more representative images based on the similarity between the plurality of images,
The image display device according to claim 10, wherein the comparison screen creation unit arranges the one or more representative images on the screen. It further includes an input unit for inputting a signal according to an external operation,
The display control unit switches between a display state and a non-display state of the second average color bar on the display unit based on a signal input from the input unit. The image display device according to claim 1. An image display method executed by an image display device that displays on a display unit an image group acquired by examination using a capsule endoscope that is introduced into a subject and images the inside of the subject,
A test determination step for determining a first test for displaying a test result and a second test for comparing the first test and the test result from a plurality of tests on the same subject;
An index setting step for setting an index when comparing the test results of the first and second tests;
A corresponding image setting step for associating an image in the first image group acquired by the first examination with an image in the second image group obtained by the second examination based on the index; ,
First summary information that represents a summary of the result of the first examination based on the index and information related to the images in the first and second image groups associated in the corresponding image setting step. And a summary information creating step for creating second summary information representing a summary of the result of the second examination,
A display control step of displaying the first and second summary information side by side on the display unit;
An image display method comprising: An image display program for causing an image display device to display on a display unit an image group acquired by an examination using a capsule endoscope that is introduced into a subject and images the inside of the subject,
A test determination step for determining a first test for displaying a test result and a second test for comparing the first test and the test result from a plurality of tests on the same subject;
An index setting step for setting an index when comparing the test results of the first and second tests;
A corresponding image setting step for associating an image in the first image group acquired by the first examination with an image in the second image group obtained by the second examination based on the index; ,
First summary information that represents a summary of the result of the first examination based on the index and information related to the images in the first and second image groups associated in the corresponding image setting step. And a summary information creating step for creating second summary information representing a summary of the result of the second examination,
A display control step of displaying the first and second summary information side by side on the display unit;
An image display program for executing

Images