WO2012165298A1

WO2012165298A1 - Receiving device and capsule-type endoscope system

Info

Publication number: WO2012165298A1
Application number: PCT/JP2012/063372
Authority: WO
Inventors: 直人小出; 徹宮園
Original assignee: オリンパスメディカルシステムズ株式会社
Priority date: 2011-06-01
Filing date: 2012-05-24
Publication date: 2012-12-06

Abstract

Provided are a receiving device and a capsule-type endoscope system making it possible, immediately after the receiving device receives the image data, for user to comprehend the position of a capsule-type endoscope imaging inside of a subject. This receiving device (20) receives image data transmitted wirelessly from a capsule-type endoscope (10) which is introduced into a subject and images inside said subject, and is provided with an average color calculation unit (208) which, on the basis of image data received from the capsule-type endoscope (10), calculates the average color of images corresponding to the image data, a color bar generation unit (211) which uses said average color to generate color bars corresponding to the imaging time of a group of images imaged in time series by the capsule-type endoscope (10), and a display unit (203) which displays said color bars.

Description

Receiving device and capsule endoscope system

The present invention relates to a receiving apparatus and a capsule endoscope system that receive image data wirelessly transmitted from a capsule endoscope introduced into a subject.

In an examination using a capsule endoscope that is introduced into a subject and images the inside of the subject, image data that is captured and wirelessly transmitted by the capsule endoscope is received outside the body of the subject. Receive by device. The image data received by the receiving device is stored in a memory built in the receiving device during the examination, transferred (downloaded) to an image display device such as a workstation via the cradle after the examination is completed, and used for diagnosis by a doctor. .

By the way, once the capsule endoscope is introduced into the subject, the user cannot grasp the position of the capsule endoscope in the subject (the part being imaged). Therefore, it is required that the user can easily recognize which organ the image captured by the capsule endoscope is. In order to meet this requirement, for example, Patent Document 1 shows information on the average color of an image from color information of image data, and shows an entire imaging period of an image captured in time series by a capsule endoscope. A technique for displaying an average color bar (also called a color bar) on a screen of an image display device is disclosed. In this technology, a movable slider is displayed on the average color bar, an image at the imaging time corresponding to the position of the slider is displayed in the image display field in conjunction with the movement of the slider, and the average color based on the captured image data is displayed. Is displayed at a position corresponding to the average color bar in time.

In the above-described image display device, image processing such as white balance processing, demosaicing, and gamma conversion is performed on a group of image data downloaded from the receiving device, and the average color of each image is calculated from the image processed image data. An arithmetic process is performed. These average colors are temporarily stored in the memory in association with the corresponding image data, and are read out from the memory and used when the color bar is generated.

JP 2004-337596 A

However, the color bar can be displayed in the image display device after the imaging by the capsule endoscope is completed and all image data is downloaded from the receiving device to the image display device. That is, in the configuration of the conventional capsule endoscope system, the user can capture a part of the subject that the capsule endoscope is imaging while the capsule endoscope is imaging the subject. I can't figure out.

The present invention has been made in view of the above, and a receiving apparatus that allows a user to grasp a part of a subject that is being imaged by a capsule endoscope immediately after the receiving apparatus receives image data. It is another object of the present invention to provide a capsule endoscope system.

In order to solve the above-described problems and achieve the object, a receiving apparatus according to the present invention receives image data wirelessly transmitted from a capsule endoscope that is introduced into a subject and images the inside of the subject. An average color calculation unit that calculates an average color of an image corresponding to the image data based on image data received from the capsule endoscope, and the capsule using the average color The image processing apparatus includes a color bar generation unit that generates a color bar corresponding to the imaging time of a group of images captured by the mold endoscope in time series, and a display unit that displays the color bar.

In the receiving device, the color bar generating unit uses the average color calculated based on image data received so far during a period in which the image data is received from the capsule endoscope. The color bar is generated.

In the above receiving apparatus, the color bar generating unit generates the color bar at a predetermined time interval or frame interval.

In the receiving apparatus, the display unit updates and displays the color bar at a predetermined time interval or frame interval.

In the receiving apparatus, the average color calculation unit calculates the average color based on raw data of the image data.

In the receiving apparatus, the average color calculation unit calculates the average color based on data extracted from the image data corresponding to pixel values at a plurality of predetermined positions in the image.

The receiving device includes a first storage area that stores image data received from the capsule endoscope, and a second storage area that is different from the first storage area. And a second storage area for storing information on the calculated average color.

The receiving apparatus further includes an image processing unit that performs image processing on the image data for displaying an image based on the image data stored in the first storage area on the display unit.

The receiving device includes an operation input unit that receives an instruction input to the receiving device, and extracts image data based on the instruction from image data stored in the first storage area, and performs image processing. And a control unit that controls the image processing unit.

A capsule endoscope system according to the present invention includes the receiving device and a capsule endoscope that wirelessly transmits image data obtained by imaging the inside of the subject to the receiving device.

According to the present invention, the receiving device calculates the average color of the image based on the image data received from the capsule endoscope, and generates and displays a color bar using the average color. Immediately after receiving the image data, the user can grasp the part of the subject that is being imaged by the capsule endoscope.

FIG. 1 is a schematic diagram showing a schematic configuration of a capsule endoscope system according to an embodiment of the present invention. FIG. 2 is a schematic diagram illustrating an appearance of the receiving apparatus illustrated in FIG. FIG. 3 is a block diagram showing a configuration of the receiving apparatus shown in FIG. FIG. 4 is a flowchart showing the operation of the receiving apparatus shown in FIG. FIG. 5 is a flowchart showing the operation of the receiving apparatus in the playback mode. FIG. 6 is a schematic diagram illustrating a display example of the screen in the playback mode.

Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the following description, as an example, a system including a capsule endoscope that is introduced into the body of a subject and captures an in-vivo image is illustrated, but the present invention is not limited by this embodiment. Absent.

(Embodiment)
FIG. 1 is a schematic diagram showing a schematic configuration of a capsule endoscope system according to an embodiment of the present invention. A capsule endoscope system 1 illustrated in FIG. 1 includes a capsule endoscope 10 that wirelessly transmits image data acquired by being introduced into a body of a subject (patient) 100 and performing imaging, and a capsule endoscope. It is realized by a receiving device 20 that receives image data wirelessly transmitted from the mirror 10 and a workstation or personal computer having a display screen such as a monitor, and the image data transferred from the receiving device 20 via the cradle 30 to the image data. And an image display device 40 for displaying an image based on the screen.

The capsule endoscope 10 includes an illumination element that illuminates the inside of a subject, a condensing lens that collects reflected light from the subject, and an imaging element such as a CCD that converts received light into an electrical signal (imaging signal). Various components such as an IC that constitutes a signal processing unit that processes an imaging signal acquired by the imaging element, and a transmission wireless antenna are incorporated. After the capsule endoscope 10 is swallowed from the mouth of the subject 100, the capsule endoscope 10 moves through the digestive tract of the subject 100 by peristaltic movement of the organ 100, etc. Images are taken sequentially at predetermined time intervals (for example, 0.5 second intervals). Then, image data is generated by performing predetermined signal processing on the imaging signal obtained by imaging, and the image data is sequentially wirelessly transmitted to the receiving device 20 together with related information of the image data.

The receiving device 20 is mounted near the body surface of the subject 100 and wirelessly transmitted from the capsule endoscope 10 via the antenna unit 21 having a plurality (eight in FIG. 1) of receiving antennas 21a to 21h. Received image data. Each of the receiving antennas 21a to 21h is realized by using, for example, a loop antenna, and corresponds to a predetermined position on the body surface of the subject 100 (for example, each organ in the subject 100 that is a passage route of the capsule endoscope 10). Arranged).

FIG. 2 is a schematic diagram showing the external appearance of the receiving device 20. FIG. 3 is a block diagram illustrating a configuration of the receiving device 20. As illustrated in FIGS. 2 and 3, the receiving device 20 includes a power switch 201 that switches a power state (ON / OFF) of the receiving device 20, a battery 202 that supplies power to each unit of the receiving device 20, and various types of inspections. An interface (I / I) that mediates communication between a display unit 203 that displays information, an operation input unit 204 that receives input of various information and instructions to the receiving device 20, and an external device connected to the receiving device 20. F) unit 205, a reception unit 206 that receives image data wirelessly transmitted from the capsule endoscope 10 via the antenna unit 21, a signal processing unit 207, an average color calculation unit 208, a memory 209, An image processing unit 210, a color bar generation unit 211, and a control unit 212 that controls these units are provided.

The display unit 203 is realized by a display panel such as liquid crystal or organic EL. As shown in FIG. 2, during the examination (during execution of imaging by the capsule endoscope 10), the display unit 203 includes a color bar in addition to information related to the examination such as a patient ID, a patient name, and an examination date. M1 is displayed.

Here, the color bar M1 is a belt-like image in which the capsule endoscope 10 displays the average color of each image captured in the subject 100 along the time axis. The entire length of the color bar M1 corresponds to the imaging time of the latest image measured from the time when the examination is started (the capsule endoscope 10 is powered on). By referring to such a color bar, the user can determine the type of a part (organ) corresponding to the average color of each captured image and can grasp the elapsed time of the examination.

The operation input unit 204 is realized by a hardware operation member such as a push button provided on the housing of the receiving device 20 and is used when a user inputs various instructions and information to the receiving device 20. As shown in FIG. 2, for example, the operation input unit 204 includes a cursor movement button 204a and a determination button 204b for moving the cursor in the up, down, left, and right directions. In addition, the operation input unit 204 may be realized by a touch panel provided over the display unit 203.

The signal processing unit 207 demodulates the image data received via the receiving unit 206 and inputs the image data to the average color calculating unit 208 and the first storage area 213 in the memory 209, respectively. Note that image data at this stage where image processing such as demosaicing is not performed is also referred to as raw data or RAW data.

The average color calculation unit 208 calculates the average color of the image based on the image data input from the signal processing unit 207. More specifically, the average color calculation unit 208 extracts data corresponding to pixel values at a plurality of predetermined locations (for example, four locations) in the image from the image data, and calculates the average color of the image based on the extracted data. calculate. The average color calculation unit 208 executes such an average color calculation process every time image data is input.

The memory 209 stores a program or the like for controlling the operation of the receiving device 20. The memory 209 includes a first storage area 213 and a second storage area 214 which are storage areas different from each other. The first storage area 213 stores image data input from the signal processing unit 207. On the other hand, the second storage area 214 stores information on the average color calculated by the average color calculation unit 208 (hereinafter referred to as color information). In this embodiment, a built-in memory is used as the memory 209. Instead, a memory that can be attached to and detached from the receiving device 20 such as a USB memory or a compact flash (registered trademark) may be used. . In this embodiment, the first storage area 213 and the second storage area 214 are provided in one medium. However, these storage areas may be realized by media independent from each other.

The image processing unit 210 performs white balance processing, demosaicing, color conversion, density conversion (gamma conversion) on image data extracted from the image data stored in the first storage area 213 under the control of the control unit 212. Etc.), image processing for display is generated by performing image processing such as smoothing (noise removal, etc.), sharpening (edge enhancement, etc.).

The color bar generation unit 211 acquires the color information stored in the second storage area 214, and generates a color bar using these color information.

The control unit 212 is realized by hardware such as a CPU, and reads various programs stored in the memory 209, so that the reception device 20 is read according to various operation signals input through the operation input unit 204 and the interface unit 205. Overall control of the overall operation.

Next, the operation of the receiving device 20 will be described. FIG. 4 is a flowchart showing the operation of the receiving device 20.
First, in step S <b> 101, the receiving device 20 receives image data from the capsule endoscope 10.

In subsequent step S102, the receiving apparatus 20 demodulates the received image data, stores the RAW data as it is in the first storage area 213, and calculates an average color based on the RAW data in parallel. Is stored in the second storage area 214. At this time, under the control of the control unit 212, the memory 209 determines an address of each color information so that a storage area for a series of color information sequentially calculated corresponds to the imaging time. Of the image data input to the average color calculation unit 208, data not used for calculating the average color is deleted.

In step S103, the color bar generation unit 211 acquires all the color information stored in the second storage area 214 in time series, and generates a color bar using these color information.
In step S104, the display unit 203 displays a color bar (see FIG. 2).

When the receiving device 20 receives the next image data from the capsule endoscope 10 (step S105: Yes), the operation returns to step S101. As a result, new image data is stored in the first storage area 213 and a color bar to which color information based on the new image data is added is generated and updated and displayed on the display unit 203.
On the other hand, when the next image data is not received (step S105: No), the operation of the receiving device 20 ends.

Note that when the image data stored in the receiving device 20 is downloaded to the image display device 40 after the inspection is completed, only the image data stored in the first storage area 213 is transferred. The color information stored in the second storage area 214 is deleted when the receiving device 20 is initialized.

Next, the playback mode in the receiving device 20 will be described.
Here, the playback mode is a mode in which a captured image is displayed on the screen retroactive to the user's desired imaging time. When the operation input unit 204 receives an instruction to shift to the playback mode with respect to the receiving device 20 being inspected, the receiving device 20 performs the operation in the playback mode in parallel with the above operation (steps S101 to S105). Execute. As an operation for inputting an instruction to shift to the playback mode, for example, a predetermined operation such as pressing the enter button 204b while the screen under examination shown in FIG. 2 is displayed is set in advance.

FIG. 5 is a flowchart showing the operation of the receiving device 20 in the playback mode. After shifting to the playback mode, in step S111, the image processing unit 210 extracts image data from the first storage area 213 under the control of the control unit 212, and displays the extracted image data by performing image processing. Image data is generated. Immediately after shifting to the playback mode, predetermined image data (for example, the latest image data) is extracted from the image data stored in the first storage area 213.

In step S112, the display unit 203 displays an image based on the display image data generated by the image processing unit 210 and the color bar generated by the color bar generation unit 211 on the screen.

FIG. 6 is a schematic diagram showing a display example of the screen in the playback mode. As shown in FIG. 6, an image M2 representing the inside of the subject 100 is displayed in the approximate center of the screen of the display unit 203, and a color bar M1 is displayed below the image M2. At this time, the control unit 212 may control the display unit 203 to display the slider M3 indicating the imaging time corresponding to the image M2 being displayed on the color bar M1. Even in the playback mode, information such as the examination date and the current time may be displayed on the screen. The color bar M1 may be updated according to the reception status of the image data in step S101.

In step S113, the control unit 212 determines whether an instruction to change the image being displayed is input from the operation input unit 204. As an operation for inputting an image change instruction, for example, an operation in which the image is moved up or down in accordance with the imaging order by pressing the cursor movement button 204a, or the slider M3 is moved by pressing the cursor movement button 204a. An operation of instructing a desired imaging time and pressing the enter button 204b is set in advance.

When an image change instruction is input (step S113: Yes), the operation of the receiving device 20 returns to step S111. At this time, the control unit 212 controls the image processing unit 210 to extract image data corresponding to the image selected by the change instruction in step S113 and perform image processing.

On the other hand, when an image change instruction is not input (step S113: No), the control unit 212 determines whether or not a playback mode end instruction is input from the operation input unit 204 (step S114). As an operation for inputting an instruction to end the playback mode, for example, a predetermined operation such as pressing the enter button 204b while the playback mode screen is displayed is set in advance.

When an instruction to end the playback mode is input (step S114: Yes), the receiving device 20 ends the playback mode. In this case, the screen during normal inspection (see FIG. 2) is displayed on the display unit 203 again. On the other hand, when the instruction to end the playback mode is not input (step S114: No), the operation of the receiving device 20 returns to step S112.

As described above, according to the present embodiment, on the receiving device 20 side, the average color of the image corresponding to the image data received from the capsule endoscope 10 is calculated, and the color is calculated using the average color. Since the bar is generated and displayed, the receiving device indicates the position of the capsule endoscope 10 being imaged and the approximate position (examination progress) of the capsule endoscope 10 in the subject 100. It becomes possible to grasp immediately after receiving the image data.

Here, when displaying a color bar in a general image display device, image processing such as white balance processing, demosaicing, and gamma conversion is performed on a group of image data (RAW data) downloaded from a receiving device. Above, an extremely heavy calculation process is performed in which an average color is calculated based on the pixel value of each pixel in the image. For this reason, if the same arithmetic processing is performed by a small receiving device that is carried on the subject and carried, it takes too much time to display the color bar. In addition, the power consumption for such processing is greatly increased.

However, in the present embodiment, the average color calculation unit 208 extracts data relating to a plurality of predetermined locations in the image directly from the RAW data received from the capsule endoscope 10, and the image is based on the extracted data. Since the average color is calculated, the processing load is very light. Therefore, the color bar can be displayed in a short time and the power consumption can be reduced.

Also, according to the present embodiment, every time image data is received, calculation of the average color and generation of a color bar using all average colors including the latest average color are performed. The color bar corresponding to the locus of the capsule endoscope 10 is periodically updated and displayed. Therefore, the user can always grasp the latest inspection status.

Further, according to the present embodiment, the color information related to the average color calculated by the average color calculation unit 208 is stored in a storage area different from the storage area of the image data so as to have continuous addresses corresponding to the imaging time. Since they are stored sequentially, the color information can be read out in a short time when the color bar is generated. Therefore, the receiving device 20 can update the color bar immediately after receiving the image data (for example, at almost the same timing as the imaging rate of the capsule endoscope 10).

(Modification 1)
In the above embodiment, the average color calculation unit 208 extracts the data used for calculating the average color from the image data input from the signal processing unit 207 and calculates the average color. However, the signal processing unit 207 may extract data used for calculating the average color from the image data and input only the extracted data to the average color calculation unit 208.

(Modification 2)
In the above embodiment, the color bar generating unit 211 generates a color bar every time image data is received from the capsule endoscope 10. However, the color bar generation unit 211 may be configured to generate color bars at predetermined time intervals or predetermined frame intervals. For example, in order to make the user feel that the color bar has been updated as soon as the receiving apparatus receives the image data, the color bar is generated at intervals of about 1 second or 2 frames, and is updated and displayed. Just do it. In this case, it is possible to reduce the load due to the color bar generation processing and to reduce power consumption.

(Modification 3)
In the above-described embodiment, the display unit 203 updates and displays the newly generated color bar every time image data is received from the capsule endoscope 10 in synchronization with the color bar generation unit 211. However, the display unit 203 may be configured to update and display the color bar at a predetermined time interval or a predetermined frame interval. This time interval or frame interval may be synchronized with the operation of the color bar generator 211 or may be asynchronous. For example, in order for the user to feel that the color bar has been updated as soon as the receiving apparatus receives the image data, the color bar may be updated and displayed at intervals of about 1 second or 2 frames. . In this case, it is possible to suppress power consumption when the color bar is displayed again.

The embodiments and modifications described above are merely examples for carrying out the present invention, and the present invention is not limited to these. It is obvious from the above description that the present invention can be variously modified according to specifications and the like, and that various other embodiments are possible within the scope of the present invention.

DESCRIPTION OF SYMBOLS 1 Capsule-type endoscope system 10 Capsule-type endoscope 20 Reception apparatus 21 Antenna unit 21a-21h Reception antenna 30 Cradle 40 Image display apparatus 100 Subject 201 Power switch 202 Battery 203 Display part 204 Operation input part 204a Cursor movement button 204b Determination button 205 Interface (I / F) unit 206 Reception unit 207 Signal processing unit 208 Average color calculation unit 209 Memory 210 Image processing unit 211 Color bar generation unit 212 Control unit 213 First storage area 214 Second storage area

Claims

A receiving device that receives image data that is introduced into a subject and wirelessly transmitted from a capsule endoscope that images the inside of the subject,
Based on the image data received from the capsule endoscope, an average color calculation unit that calculates an average color of an image corresponding to the image data;
A color bar generating unit that generates a color bar corresponding to an imaging time of a group of images captured in time series by the capsule endoscope using the average color;
A display unit for displaying the color bar;
A receiving apparatus comprising:
The color bar generation unit generates the color bar using the average color calculated based on the image data received so far during a period in which the image data is received from the capsule endoscope. The receiving apparatus according to claim 1, wherein:
The receiving apparatus according to claim 1, wherein the color bar generating unit generates the color bar at a predetermined time interval or frame interval.
The receiving apparatus according to claim 1, wherein the display unit updates and displays the color bar at a predetermined time interval or frame interval.
The receiving apparatus according to claim 1, wherein the average color calculation unit calculates the average color based on raw data of the image data.
The reception according to claim 1, wherein the average color calculation unit calculates the average color based on data extracted from the image data corresponding to pixel values in a plurality of predetermined locations in the image. apparatus.
A first storage area for storing image data received from the capsule endoscope;
A second storage area different from the first storage area, wherein the second storage area stores information on the average color calculated by the average color calculation unit;
The receiving apparatus according to claim 1, further comprising:
The image processing unit according to claim 7, further comprising an image processing unit that performs image processing for displaying an image based on the image data stored in the first storage area on the display unit. Receiver device.
An operation input unit that receives an instruction input to the receiving device;
A control unit that controls the image processing unit to perform image processing by extracting image data based on the instruction from the image data stored in the first storage area;
The receiving apparatus according to claim 8, further comprising:
A receiving device according to claim 1;
A capsule endoscope that wirelessly transmits image data obtained by imaging the inside of the subject to the receiving device;
A capsule endoscope system comprising: