WO2011070904A1 - Endoscopic device - Google Patents

Endoscopic device Download PDF

Info

Publication number
WO2011070904A1
WO2011070904A1 PCT/JP2010/070700 JP2010070700W WO2011070904A1 WO 2011070904 A1 WO2011070904 A1 WO 2011070904A1 JP 2010070700 W JP2010070700 W JP 2010070700W WO 2011070904 A1 WO2011070904 A1 WO 2011070904A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
line
image processing
signal
image signal
Prior art date
Application number
PCT/JP2010/070700
Other languages
French (fr)
Japanese (ja)
Inventor
高山真一
Original Assignee
Hoya株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hoya株式会社 filed Critical Hoya株式会社
Priority to JP2011545159A priority Critical patent/JP5647996B2/en
Publication of WO2011070904A1 publication Critical patent/WO2011070904A1/en

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/04—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances
    • A61B1/05—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances characterised by the image sensor, e.g. camera, being in the distal end portion
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00002—Operational features of endoscopes
    • A61B1/00004—Operational features of endoscopes characterised by electronic signal processing
    • A61B1/00009—Operational features of endoscopes characterised by electronic signal processing of image signals during a use of endoscope
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00002—Operational features of endoscopes
    • A61B1/0002—Operational features of endoscopes provided with data storages
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00002—Operational features of endoscopes
    • A61B1/00043—Operational features of endoscopes provided with output arrangements
    • A61B1/00045—Display arrangement
    • A61B1/0005—Display arrangement combining images e.g. side-by-side, superimposed or tiled
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H30/00—ICT specially adapted for the handling or processing of medical images
    • G16H30/20—ICT specially adapted for the handling or processing of medical images for handling medical images, e.g. DICOM, HL7 or PACS
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H30/00—ICT specially adapted for the handling or processing of medical images
    • G16H30/40—ICT specially adapted for the handling or processing of medical images for processing medical images, e.g. editing

Definitions

  • the present invention relates to an endoscope apparatus capable of simultaneously displaying a special observation image subjected to special image processing and a normal observation image subjected to normal image processing.
  • the endoscope apparatus includes an endoscope scope that is inserted into the subject's body and an endoscope processor that is provided outside the subject's body and performs image processing.
  • the endoscope scope includes an imaging device provided at a distal end portion, and a forceps conduit that penetrates from a forceps insertion opening that opens to the proximal end side of the endoscope scope to a forceps opening that opens to the distal end portion. .
  • the surgeon inserts a surgical tool such as a forceps from the forceps insertion opening, and projects the surgical tool from the forceps opening toward the observation object via the forceps conduit.
  • the observation image captured by the image sensor is sent to the endoscope processor and displayed on the display device. The surgeon operates the surgical tool while referring to the surgical tool and the image of the observation object included in the observation image (Patent Document 1).
  • special image processing such as emphasizing a specific color or contrast may be applied to the observation image in order to clarify the characteristics of the observation object, for example, a lesion.
  • the color of the surgical instrument in the observation image may be different from the original color, or the surgical instrument and the observation target in the observation image There is a risk that the boundary between objects may be difficult to understand.
  • the present invention has been made in view of these problems, and an object thereof is to obtain an endoscope apparatus that can accurately grasp the state of a surgical instrument by referring to an observation image.
  • a line image signal obtained by dividing an image of one frame into a plurality of rows extending along the first direction is obtained with respect to a second direction different from the first direction. It is formed by an imaging unit that outputs in order, an image processing unit that performs image processing of line image signals, a plurality of line memories that store different line image signals, and a line signal stored in one of the line memories.
  • a display unit for each line memory, and one or two or more line memories store line image signals image-processed by the image processing unit and store the image-processed line signals.
  • the line memory that is not stored stores a line image signal that is not subjected to image processing by the image processing unit.
  • the line memory includes first and second line memories that store line image signals, and the display unit displays a first image formed by the line signals stored in the first line memory. And a second display area for displaying a second image formed by the line signal stored in the second line memory, and the line image signal subjected to image processing by the image processor is the first display area. It is preferable that the second line memory stores a line image signal stored in the line memory and not processed by the image processing unit.
  • the line image signal is composed of a plurality of image signals arranged along the first direction, and the first and second line memories store the line image signals at positions determined according to a predetermined cycle in the second direction.
  • the first display area preferably displays an image formed by an image signal at a position determined according to a predetermined cycle in the first direction.
  • the line image signal is composed of a plurality of image signals arranged along the first direction, and the first and second line memories store even-numbered line image signals in the second direction, and the first display area Preferably displays an image formed by even-numbered image signals in the first direction.
  • the line image signal is composed of a plurality of image signals arranged along the first direction, and the first and second line memories store odd-numbered line image signals in the second direction, and the first display area May display an image formed by odd-numbered image signals in the first direction.
  • the line image signal is composed of a plurality of image signals arranged along the first direction, and the display area displays an image formed by the image signal meeting a predetermined condition.
  • the plurality of line memories respectively record line image signals periodically according to a predetermined distribution ratio.
  • the imaging unit sequentially outputs a line image signal obtained by dividing one frame image into a plurality of lines extending in the horizontal direction in the vertical direction.
  • the image processing unit may perform image processing that emphasizes a lesion part included in the image.
  • the image processing unit may perform image processing for enhancing the contrast of the image.
  • the image processing unit may perform processing for enlarging a part of the image.
  • the second direction is orthogonal to the first direction.
  • an endoscope apparatus that can accurately grasp the state of a surgical instrument by referring to an observation image is obtained.
  • FIG. 1 is a diagram schematically illustrating an endoscope apparatus according to a first embodiment.
  • FIG. It is the figure which showed the image which an image pick-up element outputs. It is the figure which showed the observation image displayed on the monitor. It is an output timing chart of a line image signal by a selector. It is the figure which showed the observation image displayed on the monitor by 2nd Embodiment. It is an output timing chart of a line image signal.
  • Endoscope apparatus 100 Endoscope apparatus 200 Endoscope scope 210 Flexible part 211 Distal end part 214 Image sensor 215 Timing generator 220 Operation connector part 221 AFE 222 Conversion unit 300 Endoscope processor 310 Frame memory 311 Frame memory controller 320 Special image processing unit 330 Line memory 331 First line memory 332 Second line memory 334 Selector 335 Line memory controller 400 Monitor 410 Screen 411 First display Area 412 Second display area 500 Printer
  • the endoscope apparatus 100 includes an endoscope scope 200 that is inserted into a subject's body, an endoscope processor 300 that is provided outside the subject's body and performs image processing, and a monitor 400 that is connected to the endoscope processor 300. And a printer 500.
  • the monitor 400 forms a display unit.
  • the endoscope scope 200 mainly includes a flexible part 210 that is inserted into the body of a subject and an operation connector part 220 that is held by an operator and connects the flexible part 210 to the endoscope processor 300.
  • the distal end 211 of the flexible part 210 is inserted into the body of the subject, and the other end is connected to the operation connector part 220.
  • the distal end portion 211 of the flexible portion 210 is mainly provided with an image sensor 214 that is a CCD that forms an imaging portion, and a timing generator 215 that transmits operation timing to the image sensor 214.
  • the operation connector unit 220 is mainly provided with an AFE (analog front end) 221 that performs image processing and a conversion unit 222 that performs color space conversion processing.
  • the image sensor 214 is configured by pixels of m columns ⁇ n rows, for example, 1280 ⁇ 960 pixels.
  • the i (0 ⁇ i ⁇ n ⁇ 1) row extends in the horizontal direction
  • the l (0 ⁇ l ⁇ m ⁇ 1) column extends in the vertical direction.
  • One row is composed of pixels in a total of m columns from the 0th column to the m ⁇ 1th column
  • one column is composed of pixels in a total of n columns from the 0th row to the n ⁇ 1th row.
  • the image sensor 214 that has captured the subject via an imaging lens (not shown) outputs an analog line image signal for each row from the 0th row to the (n ⁇ 1) th row.
  • One analog line image signal is composed of image signals output from m pixels constituting one row.
  • One observation image is constituted by a total of n analog line image signals from the 0th row to the (n ⁇ 1) th row. That is, the observation image is composed of pixels of n rows ⁇ m columns (see FIG. 2).
  • the analog line image signal is transmitted to the AFE 221.
  • the column number increases from 0 to m-1 in the horizontal direction and the row number increases from 0 to n-1 in the vertical direction with the upper left corner as the origin in FIG.
  • the AFE 221 converts the analog line image signal into a digital line image signal, performs predetermined image processing, and transmits the converted image to the conversion unit 222.
  • the digital line image signal is a digital conversion of the analog line image signal, and is composed of an image signal output from m pixels constituting one row, like the analog line image signal.
  • the conversion unit 222 converts the color space of the image included in the digital line image signal into the YCrCb space, and then transmits it to the endoscope processor 300.
  • the endoscope processor 300 mainly includes a frame memory 310 and a line memory 330 that store digital line image signals, a special image processing unit 320 that performs special image processing, and a selector 334.
  • the frame memory 310 is controlled by the frame memory controller 311.
  • the frame memory controller 311 causes the frame memory 310 to receive the digital line image signal, and stores the digital line image signals of all rows constituting one frame.
  • One frame means one observation image. That is, the frame memory 310 stores the digital line image signals from the 0th row to the (n ⁇ 1) th row constituting one observation image.
  • the frame memory 310 outputs a digital line image signal to the line memory 330 and the special image processing unit 320.
  • the frame memory controller 311 controls the frame memory 310 so that the frame memory 310 outputs the digital line image signal at a predetermined cycle. For example, the frame memory 310 outputs all the rows from the 0th row to the (n ⁇ 1) th row, or outputs every odd row, that is, every other row.
  • the output digital line image signal is input to the special image processing unit 320 and the line memory 330.
  • the special image processing unit 320 performs a process of emphasizing the image of the part that the operator pays attention to with respect to the digital line image signal received from the line memory 330.
  • processing includes, for example, blue enhancement processing for enhancing blue contained in the observation image, H-enhancement processing for increasing the contrast of the observation image, or partial enlargement processing for enlarging a part of the observation image.
  • the line memory 330 includes a first line memory 331 and a second line memory 332.
  • the first line memory 331 is connected to the special image processing unit 320 and receives and stores a digital line image signal for one row.
  • the second line memory 332 is connected to the frame memory 310 and stores a digital line image signal for one row.
  • the line memory 330 is controlled by the line memory controller 335.
  • the line memory controller 335 causes the selector 334 to output all m image signals included in the digital line image signal or any one of the m image signals according to a predetermined period.
  • the frame memory 310 when the frame memory 310 outputs all rows to the special image processing unit 320 and the second line memory 332, all m columns of image signals included in the digital line image signal are output to the selector 334. Further, when the frame memory 310 outputs the digital line image signal of the even number row to the special image processing unit 320 and the second line memory 332, the first line memory 331 and the second line memory 332 are equivalent to one row. Of the digital line image signals, the even-numbered image signals are output to the selector 334.
  • the selector 334 is controlled by the line memory controller 335 and alternately receives the image signals output from the first line memory 331 and the second line memory 332. Then, an image signal is output to either the monitor 400 or the printer 500.
  • the line memory controller 335 outputs the digital line image signal for one row to the first line memory 331 and causes the selector 334 to receive the digital line image signal for one row, then the second line memory
  • the data is output to 332 and received by the selector 334. This is performed for all the digital line image signals constituting the observation image of one frame.
  • the observation image is output to the selector 334 at the same ratio in area ratio, and when the frame memory 310 outputs every other row, the observation image is The signal is output to the selector 334 with a size of 1/4 in the area ratio.
  • the size of the observation image received by the selector 334 can be adjusted.
  • the monitor 400 has a screen 410, and a first display area 411 and a second display area 412 are provided on the screen 410.
  • FIG. 3 is a diagram showing a screen 410 when the frame memory 310 outputs the digital line image signals of even rows to the special image processing unit 320 and the second line memory 332.
  • An observation image that has passed through the second line memory 332 is displayed in the first display area 411, and an observation image that has passed through the special image processing unit 320 and the first line memory 331 is displayed in the second display area 412.
  • the observation image that has passed through the second line memory 332 is a normal observation image that has not been subjected to special image processing, and the observation image that has passed through the first line memory 331 has been subjected to special image processing. It is.
  • the normal observation image and the special observation image are composed of image signals for every other row and every other column as described above, the size of (n / 2) rows ⁇ (m / 2) columns, that is, the observation output by the image sensor.
  • the area ratio is 1/4 with respect to the image.
  • FIG. 4 is a diagram showing the timing when the normal observation image and the special observation image are displayed on the screen 410 with the same size and an area ratio of 1/4 with respect to the observation image output by the image sensor. It is. This control is executed by the line memory 330, the line memory controller 335, and the selector 334.
  • the first line memory 331 stores the digital line image signal of the 0th row subjected to special image processing, and the second line memory 332 is not subjected to special image processing.
  • the digital line image signal of the 0th row is stored.
  • the selector 334 is connected to the first line memory 331, and the first line memory 331 starts output.
  • the first line memory 331 outputs image signals to the selector 334 every other column, such as the 0th column, the 2nd column, and the 4th column.
  • the selector 334 switches the connection to the second line memory 332.
  • the second line memory 332 starts output.
  • the second line memory 332 outputs image signals to the selector 334 every other column, such as the 0th column, the 2nd column, and the 4th column.
  • the selector 334 switches the connection to the first line memory 331.
  • the first line memory 331 While the second line memory 332 outputs the image signal to the selector 334, the first line memory 331 stores the digital line image signal of the next first row. Similarly, the first line memory 331 outputs an image signal to the selector 334 every other column, such as the 0th column, the 2nd column, and the 4th column.
  • the second line memory 332 While the first line memory 331 outputs the image signal to the selector 334, the second line memory 332 stores the digital line image signal of the next first row. Similarly, the second line memory 332 outputs image signals to the selector 334 every other column, such as the 0th column, the 2nd column, and the 4th column. The selector 334 transmits the image signal to the monitor 400 every time it receives the image signal.
  • the monitor 400 has a size of 1/4 the area ratio of the observation image output from the image sensor 214. Is displayed.
  • the first line memory 331 and the second line memory 332 may not store even rows and columns, but may store odd rows and columns.
  • the second embodiment differs from the first embodiment in terms of control by the frame memory controller 311 and the line memory controller 335.
  • the line memory controller 335 causes the frame memory 310 to output the digital line image signal of the row whose remainder is 0 and 1 when the row number is divided by 3 to the second line memory 332. Then, the digital line image signal of the row in which the remainder obtained by dividing the row number by 3 is 2 is output from the frame memory 310 to the special image processing unit 320.
  • the special image processing unit 320 performs image processing on the digital line image signal, and the first line memory 331 stores the image-processed digital line image signal.
  • the first line memory 331 outputs to the selector 334 the image signal of the column whose remainder is 2 when the column number is divided by 3.
  • the second line memory 332 outputs to the selector 334 the image signal of the column in which the remainder obtained by dividing the column number by 3 is 0 and 1.
  • FIG. 5 is a diagram showing a screen 410 according to the present embodiment.
  • An observation image that has passed through the second line memory 332 is displayed in the first display area 411, and an observation image that has passed through the special image processing unit 320 and the first line memory 331 is displayed in the second display area 412.
  • the observation image that has passed through the second line memory 332 is a normal observation image that has not been subjected to special image processing, and the observation image that has passed through the first line memory 331 has been subjected to special image processing. It is.
  • the normal observation image is displayed with a size of 4/9 compared to the observation image output from the image sensor 214, and the special observation image is 1/9 compared with the observation image output from the image sensor 214. Is displayed.
  • FIG. 6 is a diagram showing the timing when the normal observation image and the special observation image are displayed on the screen 410 in different sizes. This control is executed by the line memory 330, the line memory controller 335, and the selector 334.
  • the first line memory 331 stores the digital line image signal of the second row subjected to the special image processing, and the second line memory 332 is not subjected to the special image processing.
  • the digital line image signal of the 0th row is stored.
  • the selector 334 is connected to the first line memory 331, and the first line memory 331 starts output.
  • the first line memory 331 outputs, to the selector 334, the image signal of the column in which the remainder is obtained by dividing the column number by 3, such as the second column, the fifth column, and the eighth column.
  • the selector 334 switches the connection to the second line memory 332.
  • the second line memory 332 starts output.
  • the second line memory 332 outputs, to the selector 334, image signals of columns whose remainders are 0 and 1 when the column number is divided by 3, such as the 0th column, the 1st column, the 3rd column, and the 4th column. To do.
  • the selector 334 switches the connection to the first line memory 331.
  • the first line memory 331 While the second line memory 332 outputs the image signal to the selector 334, the first line memory 331 stores the digital line image signal of the next fifth row. Similarly, the first line memory 331 outputs, to the selector 334, the image signal of the column in which the remainder is obtained by dividing the column number by 3, such as the second column, the fifth column, and the eighth column. .
  • the second line memory 332 While the first line memory 331 outputs the image signal to the selector 334, the second line memory 332 stores the digital line image signal of the next first row. Similarly, the second line memory 332 stores the image signals of columns in which the remainder obtained by dividing the column number by 3 is 0 and 1, such as the 0th column, the 1st column, the 3rd column, and the 4th column. Is output to the selector 334. The selector 334 transmits the image signal to the monitor 400 every time it receives the image signal.
  • the normal observation image is larger than the special observation image, and the normal observation image has an area ratio of 4/9 as compared with the observation image output by the image sensor 214.
  • the image is displayed on the monitor 400 with an area ratio of 1/9.
  • the special observation image may be displayed larger than the normal observation image.
  • the pixels of the image sensor 214 do not have to be constituted by rows extending in the horizontal direction and columns extending in the vertical direction, but may be rows and columns extending in the oblique direction. Further, the row and the column need not be orthogonal.
  • row numbers and the output columns stored in the line memory 330 described above are merely examples, and are not limited to the above values.
  • the image sensor 214 may not be a CCD but may be an image sensor such as a CMOS.

Abstract

An endoscopic device is provided with an image capturing unit, an image processing unit, a plurality of line memories, and a display unit. The image capturing unit sequentially outputs line image signals, which are obtained by dividing the image of one frame into a plurality of rows extending along a first direction, in a second direction different from the first direction. The image processing unit subjects the line image signal to image processing. The line memories store the line image signals different from each other. The display unit is provided with, for each line memory, a display region for displaying an image formed by the line signal stored in one of the line memories. One or more line memories each store the line image signal subjected to the image processing by the image processing unit. The line memory which does not store the line signal subjected to the image processing stores the line image signal that is not subjected to the image processing by the image processing unit.

Description

内視鏡装置Endoscope device
　本発明は、特殊な画像処理が施された特殊観察画像と、通常の画像処理が施された通常観察画像とを同時に表示可能な内視鏡装置に関する。 The present invention relates to an endoscope apparatus capable of simultaneously displaying a special observation image subjected to special image processing and a normal observation image subjected to normal image processing.
　内視鏡装置は、被験者の体内に挿入される内視鏡スコープと被験者の体外に設けられて画像処理を行う内視鏡プロセッサとを備える。内視鏡スコープは、遠位端部に設けられる撮像素子と、内視鏡スコープの近位端側に開口する鉗子挿入口から遠位端部に開口する鉗子口まで貫通する鉗子管路を備える。術者は鉗子挿入口から鉗子などの術具を挿入し、鉗子管路を経て鉗子口から観察対象物に向けて術具を突出させる。撮像素子が撮像した観察画像は内視鏡プロセッサに送られ、表示装置に表示される。術者は観察画像に含まれる術具や観察対象物の画像を参照しながら術具を操作する（特許文献１）。 The endoscope apparatus includes an endoscope scope that is inserted into the subject's body and an endoscope processor that is provided outside the subject's body and performs image processing. The endoscope scope includes an imaging device provided at a distal end portion, and a forceps conduit that penetrates from a forceps insertion opening that opens to the proximal end side of the endoscope scope to a forceps opening that opens to the distal end portion. . The surgeon inserts a surgical tool such as a forceps from the forceps insertion opening, and projects the surgical tool from the forceps opening toward the observation object via the forceps conduit. The observation image captured by the image sensor is sent to the endoscope processor and displayed on the display device. The surgeon operates the surgical tool while referring to the surgical tool and the image of the observation object included in the observation image (Patent Document 1).
特開２００９－１０６４２４号公報JP 2009-106424 A
　しかし、観察対象物の特徴、例えば病変部を明らかにするために、特定の色やコントラストを強調する等の特殊な画像処理を観察画像に施すことがある。このような処理が施された観察画像を参照しながら術具を操作する場合、観察画像中の術具の色が本来の色とは異なるものとなったり、観察画像上における術具と観察対象物との境界がわかりにくくなったりするおそれがある。 However, special image processing such as emphasizing a specific color or contrast may be applied to the observation image in order to clarify the characteristics of the observation object, for example, a lesion. When operating a surgical instrument while referring to an observation image that has been processed in this way, the color of the surgical instrument in the observation image may be different from the original color, or the surgical instrument and the observation target in the observation image There is a risk that the boundary between objects may be difficult to understand.
　本発明はこれらの問題に鑑みてなされたものであり、観察画像を参照することにより術具の状態を的確に把握可能な内視鏡装置を得ることを目的とする。 The present invention has been made in view of these problems, and an object thereof is to obtain an endoscope apparatus that can accurately grasp the state of a surgical instrument by referring to an observation image.
　本願発明による内視鏡装置は、１フレームの画像を第１の方向に沿って伸びる複数の行に分割して得られるライン画像信号を、第１の方向とは異なる第２の方向に対して順番に出力する撮像部と、ライン画像信号を画像処理する画像処理部と、互いに異なるライン画像信号を記憶する複数のラインメモリと、ラインメモリのうちの１つに記憶されたライン信号により形成される画像を表示する表示領域を、ラインメモリごとに設ける表示部とを備え、１又は２以上のラインメモリは、画像処理部が画像処理したライン画像信号を記憶し、画像処理されたライン信号を記憶しないラインメモリは、画像処理部が画像処理しないライン画像信号を記憶することを特徴とする。 In the endoscope apparatus according to the present invention, a line image signal obtained by dividing an image of one frame into a plurality of rows extending along the first direction is obtained with respect to a second direction different from the first direction. It is formed by an imaging unit that outputs in order, an image processing unit that performs image processing of line image signals, a plurality of line memories that store different line image signals, and a line signal stored in one of the line memories. A display unit for each line memory, and one or two or more line memories store line image signals image-processed by the image processing unit and store the image-processed line signals. The line memory that is not stored stores a line image signal that is not subjected to image processing by the image processing unit.
　ラインメモリは、ライン画像信号を記憶する第１及び第２のラインメモリを有し、表示部は、第１のラインメモリに記憶されたライン信号により形成される第１の画像を表示する第１の表示領域、及び第２のラインメモリに記憶されたライン信号により形成される第２の画像を表示する第２の表示領域を有し、画像処理部が画像処理したライン画像信号を第１のラインメモリが記憶し、画像処理部が画像処理しないライン画像信号を第２のラインメモリが記憶することが好ましい。 The line memory includes first and second line memories that store line image signals, and the display unit displays a first image formed by the line signals stored in the first line memory. And a second display area for displaying a second image formed by the line signal stored in the second line memory, and the line image signal subjected to image processing by the image processor is the first display area. It is preferable that the second line memory stores a line image signal stored in the line memory and not processed by the image processing unit.
　ライン画像信号は、第１の方向に沿って並ぶ複数の画像信号から成り、第１及び第２のラインメモリは、第２の方向において所定の周期に従って決定される位置にあるライン画像信号を記憶し、第１の表示領域は、第１の方向において所定の周期に従って決定される位置にある画像信号により形成される画像を表示することが好ましい。 The line image signal is composed of a plurality of image signals arranged along the first direction, and the first and second line memories store the line image signals at positions determined according to a predetermined cycle in the second direction. The first display area preferably displays an image formed by an image signal at a position determined according to a predetermined cycle in the first direction.
　ライン画像信号は、第１の方向に沿って並ぶ複数の画像信号から成り、第１及び第２のラインメモリは、第２の方向において偶数番目のライン画像信号を記憶し、第１の表示領域は、第１の方向において偶数番目の画像信号により形成される画像を表示することが好ましい。 The line image signal is composed of a plurality of image signals arranged along the first direction, and the first and second line memories store even-numbered line image signals in the second direction, and the first display area Preferably displays an image formed by even-numbered image signals in the first direction.
　ライン画像信号は、第１の方向に沿って並ぶ複数の画像信号から成り、第１及び第２のラインメモリは、第２の方向において奇数番目のライン画像信号を記憶し、第１の表示領域は、第１の方向において奇数番目の画像信号により形成される画像を表示してもよい。 The line image signal is composed of a plurality of image signals arranged along the first direction, and the first and second line memories store odd-numbered line image signals in the second direction, and the first display area May display an image formed by odd-numbered image signals in the first direction.
　ライン画像信号は、第１の方向に沿って並ぶ複数の画像信号から成り、表示領域は、所定の条件に合致した画像信号により形成される画像を表示することが好ましい。 It is preferable that the line image signal is composed of a plurality of image signals arranged along the first direction, and the display area displays an image formed by the image signal meeting a predetermined condition.
　複数のラインメモリは、所定の分配比率に従って周期的にライン画像信号を各々記録することが好ましい。 It is preferable that the plurality of line memories respectively record line image signals periodically according to a predetermined distribution ratio.
　撮像部は、１フレームの画像を水平方向に伸びる複数のラインに分割して得られるライン画像信号を、垂直方向に対して順番に出力することが好ましい。 It is preferable that the imaging unit sequentially outputs a line image signal obtained by dividing one frame image into a plurality of lines extending in the horizontal direction in the vertical direction.
　画像処理部は、画像に含まれる病変部を強調する画像処理を行ってもよい。 The image processing unit may perform image processing that emphasizes a lesion part included in the image.
　画像処理部は、画像のコントラストを強調する画像処理を行ってもよい。 The image processing unit may perform image processing for enhancing the contrast of the image.
　画像処理部は、画像の一部を拡大する処理を行ってもよい。 The image processing unit may perform processing for enlarging a part of the image.
　第２の方向は、第１の方向と直交することが好ましい。 It is preferable that the second direction is orthogonal to the first direction.
　本発明によれば、観察画像を参照することにより術具の状態を的確に把握可能な内視鏡装置を得る。 According to the present invention, an endoscope apparatus that can accurately grasp the state of a surgical instrument by referring to an observation image is obtained.
第１の実施形態による内視鏡装置を概略的に示した図である。1 is a diagram schematically illustrating an endoscope apparatus according to a first embodiment. FIG. 撮像素子が出力する画像を示した図である。It is the figure which showed the image which an image pick-up element outputs. モニタに表示された観察画像を示した図である。It is the figure which showed the observation image displayed on the monitor. セレクタによるライン画像信号の出力タイミングチャートである。It is an output timing chart of a line image signal by a selector. 第２の実施形態によるモニタに表示された観察画像を示した図である。It is the figure which showed the observation image displayed on the monitor by 2nd Embodiment. ライン画像信号の出力タイミングチャートである。It is an output timing chart of a line image signal.
　１００　内視鏡装置
　２００　内視鏡スコープ
　２１０　可撓部
　２１１　遠位端部
　２１４　イメージセンサ
　２１５　タイミングジェネレータ
　２２０　操作コネクタ部
　２２１　ＡＦＥ
　２２２　変換部
　３００　内視鏡プロセッサ
　３１０　フレームメモリ
　３１１　フレームメモリコントローラ
　３２０　特殊画像処理部
　３３０　ラインメモリ
　３３１　第１のラインメモリ
　３３２　第２のラインメモリ
　３３４　セレクタ
　３３５　ラインメモリコントローラ
　４００　モニタ
　４１０　画面
　４１１　第１の表示領域
　４１２　第２の表示領域
　５００　プリンタ DESCRIPTION OF SYMBOLS 100 Endoscope apparatus 200 Endoscope scope 210 Flexible part 211 Distal end part 214 Image sensor 215 Timing generator 220 Operation connector part 221 AFE
222 Conversion unit 300 Endoscope processor 310 Frame memory 311 Frame memory controller 320 Special image processing unit 330 Line memory 331 First line memory 332 Second line memory 334 Selector 335 Line memory controller 400 Monitor 410 Screen 411 First display Area 412 Second display area 500 Printer
　以下、本発明における第１の実施形態について添付図面を参照して説明する。まず、図１及び２を用いて内視鏡装置１００の構成について説明する。 Hereinafter, a first embodiment of the present invention will be described with reference to the accompanying drawings. First, the configuration of the endoscope apparatus 100 will be described with reference to FIGS.
　内視鏡装置１００は、被験者の体内に挿入される内視鏡スコープ２００と、被験者の体外に設けられて画像処理を行う内視鏡プロセッサ３００と、内視鏡プロセッサ３００に接続されるモニタ４００及びプリンタ５００とを主に備える。モニタ４００は表示部を成す。 The endoscope apparatus 100 includes an endoscope scope 200 that is inserted into a subject's body, an endoscope processor 300 that is provided outside the subject's body and performs image processing, and a monitor 400 that is connected to the endoscope processor 300. And a printer 500. The monitor 400 forms a display unit.
　内視鏡スコープ２００は、被験者の体内に挿入される可撓部２１０と、術者が保持し、かつ可撓部２１０を内視鏡プロセッサ３００に接続する操作コネクタ部２２０とを主に備える。 The endoscope scope 200 mainly includes a flexible part 210 that is inserted into the body of a subject and an operation connector part 220 that is held by an operator and connects the flexible part 210 to the endoscope processor 300.
　可撓部２１０の遠位端部２１１は被験者の体内に挿入され、他端は操作コネクタ部２２０に接続される。 The distal end 211 of the flexible part 210 is inserted into the body of the subject, and the other end is connected to the operation connector part 220.
　可撓部２１０の遠位端部２１１には、撮像部を成すＣＣＤであるイメージセンサ２１４、イメージセンサ２１４に動作タイミングを送信するタイミングジェネレータ２１５が主に設けられる。操作コネクタ部２２０には、画像処理を行うＡＦＥ（アナログ・フロント・エンド）２２１と色空間変換処理を行う変換部２２２とが主に設けられる。 The distal end portion 211 of the flexible portion 210 is mainly provided with an image sensor 214 that is a CCD that forms an imaging portion, and a timing generator 215 that transmits operation timing to the image sensor 214. The operation connector unit 220 is mainly provided with an AFE (analog front end) 221 that performs image processing and a conversion unit 222 that performs color space conversion processing.
　イメージセンサ２１４は、ｍ列×ｎ行、例えば１２８０×９６０ピクセルの画素により構成される。ｉ（０≦ｉ≦ｎ－１）行は水平方向に伸び、ｌ（０≦ｌ≦ｍ－１）列は垂直方向に伸びる。１つの行は、第０列から第ｍ－１列まで合計ｍ列の画素から成り、１つの列は、第０行から第ｎ－１行まで合計ｎ列の画素から成る。図示しない撮像レンズを介して被写体を撮像したイメージセンサ２１４は、第０行から第ｎ－１行まで１行ごとにアナログライン画像信号を出力する。１つのアナログライン画像信号は、１つの行を構成するｍ個の画素が出力した画像信号から成る。第０行から第ｎ－１行まで合計ｎ個のアナログライン画像信号により１つの観察画像が構成される。すなわち、観察画像は、ｎ行×ｍ列の画素により構成される（図２参照）。アナログライン画像信号はＡＦＥ２２１に送信される。以下、図２において左上隅を原点として、水平方向に０からｍ－１まで列番号が増加し、垂直方向に０からｎ－１まで行番号が増加するものとして説明する。 The image sensor 214 is configured by pixels of m columns × n rows, for example, 1280 × 960 pixels. The i (0 ≦ i ≦ n−1) row extends in the horizontal direction, and the l (0 ≦ l ≦ m−1) column extends in the vertical direction. One row is composed of pixels in a total of m columns from the 0th column to the m−1th column, and one column is composed of pixels in a total of n columns from the 0th row to the n−1th row. The image sensor 214 that has captured the subject via an imaging lens (not shown) outputs an analog line image signal for each row from the 0th row to the (n−1) th row. One analog line image signal is composed of image signals output from m pixels constituting one row. One observation image is constituted by a total of n analog line image signals from the 0th row to the (n−1) th row. That is, the observation image is composed of pixels of n rows × m columns (see FIG. 2). The analog line image signal is transmitted to the AFE 221. In the following description, it is assumed that the column number increases from 0 to m-1 in the horizontal direction and the row number increases from 0 to n-1 in the vertical direction with the upper left corner as the origin in FIG.
　ＡＦＥ２２１は、アナログライン画像信号をデジタルライン画像信号に変換すると共に、所定の画像処理を行って、変換部２２２に送信する。デジタルライン画像信号は、アナログライン画像信号をデジタル変換したものであって、アナログライン画像信号と同様に、１つの行を構成するｍ個の画素が出力した画像信号から成る。 The AFE 221 converts the analog line image signal into a digital line image signal, performs predetermined image processing, and transmits the converted image to the conversion unit 222. The digital line image signal is a digital conversion of the analog line image signal, and is composed of an image signal output from m pixels constituting one row, like the analog line image signal.
　変換部２２２はデジタルライン画像信号が有する画像の色空間をＹＣｒＣｂ空間に変換した後に、内視鏡プロセッサ３００に送信する。 The conversion unit 222 converts the color space of the image included in the digital line image signal into the YCrCb space, and then transmits it to the endoscope processor 300.
　内視鏡プロセッサ３００は、デジタルライン画像信号を記憶するフレームメモリ３１０及びラインメモリ３３０と、特殊な画像処理を行う特殊画像処理部３２０と、セレクタ３３４とを主に備える。 The endoscope processor 300 mainly includes a frame memory 310 and a line memory 330 that store digital line image signals, a special image processing unit 320 that performs special image processing, and a selector 334.
　フレームメモリ３１０は、フレームメモリコントローラ３１１により制御される。フレームメモリコントローラ３１１は、デジタルライン画像信号をフレームメモリ３１０に受信させ、１フレームを構成する全ての行のデジタルライン画像信号を記憶する。１フレームとは、１枚の観察画像をいう。すなわち、フレームメモリ３１０は、１枚の観察画像を構成する第０行から第ｎ－１行までのデジタルライン画像信号を記憶する。 The frame memory 310 is controlled by the frame memory controller 311. The frame memory controller 311 causes the frame memory 310 to receive the digital line image signal, and stores the digital line image signals of all rows constituting one frame. One frame means one observation image. That is, the frame memory 310 stores the digital line image signals from the 0th row to the (n−1) th row constituting one observation image.
　フレームメモリ３１０は、ラインメモリ３３０及び特殊画像処理部３２０にデジタルライン画像信号を出力する。このとき、フレームメモリコントローラ３１１は、フレームメモリ３１０がデジタルライン画像信号を所定の周期で出力するようにフレームメモリ３１０を制御する。例えば、第０行から第ｎ－１行まで全ての行をフレームメモリ３１０が出力したり、奇数行、すなわち隔行ごとに出力したりする。出力されたデジタルライン画像信号は、特殊画像処理部３２０及びラインメモリ３３０に入力される。 The frame memory 310 outputs a digital line image signal to the line memory 330 and the special image processing unit 320. At this time, the frame memory controller 311 controls the frame memory 310 so that the frame memory 310 outputs the digital line image signal at a predetermined cycle. For example, the frame memory 310 outputs all the rows from the 0th row to the (n−1) th row, or outputs every odd row, that is, every other row. The output digital line image signal is input to the special image processing unit 320 and the line memory 330.
　特殊画像処理部３２０は、ラインメモリ３３０から受信したデジタルライン画像信号に対して、術者が注目する部位の画像を強調する処理を行う。このような処理は、例えば観察画像に含まれる青色を強調する青色強調処理、観察画像のコントラストを上げるＨ－エンハンス処理、又は観察画像の一部分を拡大する部分拡大処理などである。 The special image processing unit 320 performs a process of emphasizing the image of the part that the operator pays attention to with respect to the digital line image signal received from the line memory 330. Such processing includes, for example, blue enhancement processing for enhancing blue contained in the observation image, H-enhancement processing for increasing the contrast of the observation image, or partial enlargement processing for enlarging a part of the observation image.
　ラインメモリ３３０は、第１のラインメモリ３３１と第２のラインメモリ３３２とを有する。第１のラインメモリ３３１は、特殊画像処理部３２０に接続され、１行分のデジタルライン画像信号を受信して記憶する。第２のラインメモリ３３２は、フレームメモリ３１０に接続されて、１行分のデジタルライン画像信号を記憶する。ラインメモリ３３０は、ラインメモリコントローラ３３５により制御される。ラインメモリコントローラ３３５は、デジタルライン画像信号に含まれるｍ個の画像信号の全て、あるいはｍ個の画像信号のいずれかを所定の周期に従ってセレクタ３３４に出力させる。 The line memory 330 includes a first line memory 331 and a second line memory 332. The first line memory 331 is connected to the special image processing unit 320 and receives and stores a digital line image signal for one row. The second line memory 332 is connected to the frame memory 310 and stores a digital line image signal for one row. The line memory 330 is controlled by the line memory controller 335. The line memory controller 335 causes the selector 334 to output all m image signals included in the digital line image signal or any one of the m image signals according to a predetermined period.
　例えば、フレームメモリ３１０が全ての行を特殊画像処理部３２０及び第２のラインメモリ３３２に出力するとき、デジタルライン画像信号に含まれるｍ列の画像信号全てがセレクタ３３４に出力される。また、フレームメモリ３１０が偶数行のデジタルライン画像信号を特殊画像処理部３２０及び第２のラインメモリ３３２に出力するとき、第１のラインメモリ３３１及び第２のラインメモリ３３２は、１行分のデジタルライン画像信号のうち偶数列の画像信号をセレクタ３３４に出力する。 For example, when the frame memory 310 outputs all rows to the special image processing unit 320 and the second line memory 332, all m columns of image signals included in the digital line image signal are output to the selector 334. Further, when the frame memory 310 outputs the digital line image signal of the even number row to the special image processing unit 320 and the second line memory 332, the first line memory 331 and the second line memory 332 are equivalent to one row. Of the digital line image signals, the even-numbered image signals are output to the selector 334.
　セレクタ３３４は、ラインメモリコントローラ３３５により制御されて、第１のラインメモリ３３１及び第２のラインメモリ３３２が出力した画像信号を交互に受信する。そして、モニタ４００又はプリンタ５００のいずれか一方に画像信号を出力する。言い換えると、ラインメモリコントローラ３３５は、１行分のデジタルライン画像信号を第１のラインメモリ３３１に出力させてセレクタ３３４に受信させた後、１行分のデジタルライン画像信号を第２のラインメモリ３３２に出力させてセレクタ３３４に受信させる。これを１フレームの観察画像を構成する全てのデジタルライン画像信号について行う。 The selector 334 is controlled by the line memory controller 335 and alternately receives the image signals output from the first line memory 331 and the second line memory 332. Then, an image signal is output to either the monitor 400 or the printer 500. In other words, the line memory controller 335 outputs the digital line image signal for one row to the first line memory 331 and causes the selector 334 to receive the digital line image signal for one row, then the second line memory The data is output to 332 and received by the selector 334. This is performed for all the digital line image signals constituting the observation image of one frame.
　以上の処理を行うことにより、例えばフレームメモリ３１０が全ての行を出力する場合、観察画像は面積比において等倍でセレクタ３３４に出力され、フレームメモリ３１０が隔行ごとに出力する場合、観察画像は面積比において１／４の大きさでセレクタ３３４に出力される。 By performing the above processing, for example, when the frame memory 310 outputs all rows, the observation image is output to the selector 334 at the same ratio in area ratio, and when the frame memory 310 outputs every other row, the observation image is The signal is output to the selector 334 with a size of 1/4 in the area ratio.
　すなわち、フレームメモリ３１０及びラインメモリ３３０が出力する画像信号を制御することにより、セレクタ３３４が受信する観察画像の大きさを調節できる。 That is, by controlling the image signal output from the frame memory 310 and the line memory 330, the size of the observation image received by the selector 334 can be adjusted.
　図３を参照すると、モニタ４００は、画面４１０を有し、画面４１０上には第１の表示領域４１１及び第２の表示領域４１２が設けられる。図３は、フレームメモリ３１０が偶数行のデジタルライン画像信号を特殊画像処理部３２０及び第２のラインメモリ３３２に出力するときの画面４１０を示した図である。 Referring to FIG. 3, the monitor 400 has a screen 410, and a first display area 411 and a second display area 412 are provided on the screen 410. FIG. 3 is a diagram showing a screen 410 when the frame memory 310 outputs the digital line image signals of even rows to the special image processing unit 320 and the second line memory 332.
　第１の表示領域４１１には、第２のラインメモリ３３２を経た観察画像が表示され、第２の表示領域４１２には特殊画像処理部３２０及び第１のラインメモリ３３１を経た観察画像が表示される。第２のラインメモリ３３２を経た観察画像は、特殊な画像処理を施されていない通常観察画像であり、第１のラインメモリ３３１を経た観察画像は、特殊な画像処理が施された特殊観察画像である。 An observation image that has passed through the second line memory 332 is displayed in the first display area 411, and an observation image that has passed through the special image processing unit 320 and the first line memory 331 is displayed in the second display area 412. The The observation image that has passed through the second line memory 332 is a normal observation image that has not been subjected to special image processing, and the observation image that has passed through the first line memory 331 has been subjected to special image processing. It is.
　通常観察画像及び特殊観察画像は、前述のように隔行ごと及び隔列ごとの画像信号から成るため、（ｎ／２）行×（ｍ／２）列の大きさ、すなわちイメージセンサが出力した観察画像に対して面積比１／４の大きさである。 Since the normal observation image and the special observation image are composed of image signals for every other row and every other column as described above, the size of (n / 2) rows × (m / 2) columns, that is, the observation output by the image sensor. The area ratio is 1/4 with respect to the image.
　次に、図４を用いて、ラインメモリコントローラ３３５による制御について説明する。 Next, control by the line memory controller 335 will be described with reference to FIG.
　図４は、通常観察画像と特殊観察画像とを同じ大きさで、かつイメージセンサが出力した観察画像に対して面積比１／４の大きさで画面４１０に表示する場合のタイミングを示した図である。この制御は、ラインメモリ３３０、ラインメモリコントローラ３３５、及びセレクタ３３４により実行される。 FIG. 4 is a diagram showing the timing when the normal observation image and the special observation image are displayed on the screen 410 with the same size and an area ratio of 1/4 with respect to the observation image output by the image sensor. It is. This control is executed by the line memory 330, the line memory controller 335, and the selector 334.
　この制御が開始される前に、第１のラインメモリ３３１は特殊な画像処理が施された第０行のデジタルライン画像信号を記憶し、第２のラインメモリ３３２は特殊な画像処理が施されない第０行のデジタルライン画像信号を記憶している。 Before this control is started, the first line memory 331 stores the digital line image signal of the 0th row subjected to special image processing, and the second line memory 332 is not subjected to special image processing. The digital line image signal of the 0th row is stored.
　まず、セレクタ３３４が第１のラインメモリ３３１に接続され、第１のラインメモリ３３１が出力を開始する。第１のラインメモリ３３１は、第０列、第２列、第４列というように、１列おきに画像信号をセレクタ３３４に出力する。そして、最終アドレスの列が画像信号を出力すると、セレクタ３３４は、第２のラインメモリ３３２に接続を切り換える。次に、第２のラインメモリ３３２が出力を開始する。第２のラインメモリ３３２は、第０列、第２列、第４列というように、１列おきに画像信号をセレクタ３３４に出力する。そして、最終アドレスの列が画像信号を出力すると、セレクタ３３４は、第１のラインメモリ３３１に接続を切り換える。 First, the selector 334 is connected to the first line memory 331, and the first line memory 331 starts output. The first line memory 331 outputs image signals to the selector 334 every other column, such as the 0th column, the 2nd column, and the 4th column. When the last address column outputs an image signal, the selector 334 switches the connection to the second line memory 332. Next, the second line memory 332 starts output. The second line memory 332 outputs image signals to the selector 334 every other column, such as the 0th column, the 2nd column, and the 4th column. When the last address column outputs an image signal, the selector 334 switches the connection to the first line memory 331.
　第２のラインメモリ３３２が画像信号をセレクタ３３４に出力する間、第１のラインメモリ３３１は、次の第１行のデジタルライン画像信号を記憶する。そして、第１のラインメモリ３３１は、同様にして第０列、第２列、第４列というように、１列おきに画像信号をセレクタ３３４に出力する。 While the second line memory 332 outputs the image signal to the selector 334, the first line memory 331 stores the digital line image signal of the next first row. Similarly, the first line memory 331 outputs an image signal to the selector 334 every other column, such as the 0th column, the 2nd column, and the 4th column.
　第１のラインメモリ３３１が画像信号をセレクタ３３４に出力する間、第２のラインメモリ３３２は、次の第１行のデジタルライン画像信号を記憶する。そして、第２のラインメモリ３３２は、同様にして第０列、第２列、第４列というように、１列おきに画像信号をセレクタ３３４に出力する。そして、セレクタ３３４は、画像信号を受信する度に、モニタ４００に画像信号を送信する。 While the first line memory 331 outputs the image signal to the selector 334, the second line memory 332 stores the digital line image signal of the next first row. Similarly, the second line memory 332 outputs image signals to the selector 334 every other column, such as the 0th column, the 2nd column, and the 4th column. The selector 334 transmits the image signal to the monitor 400 every time it receives the image signal.
　これらの処理をｎ／２回反復することにより、通常観察画像と特殊観察画像とが同じ大きさで、かつイメージセンサ２１４が出力した観察画像に対して面積比１／４の大きさでモニタ４００に表示される。 By repeating these processes n / 2 times, the normal observation image and the special observation image have the same size, and the monitor 400 has a size of 1/4 the area ratio of the observation image output from the image sensor 214. Is displayed.
　本実施形態によれば、観察画像と特殊画像とを同時に観察することが可能となる。また、容易に画像を縮小することが可能となる。 According to this embodiment, it is possible to observe the observation image and the special image at the same time. In addition, the image can be easily reduced.
　なお、第１の実施形態において、第１のラインメモリ３３１及び第２のラインメモリ３３２は偶数行及び列を記憶しなくても良く、奇数行及び列を記憶しても良い。 In the first embodiment, the first line memory 331 and the second line memory 332 may not store even rows and columns, but may store odd rows and columns.
　次に、第２の実施形態について図５及び６を用いて説明する。第１の実施形態と同様の構成については同じ符号を付して説明を省略する。 Next, a second embodiment will be described with reference to FIGS. The same components as those in the first embodiment are denoted by the same reference numerals and description thereof is omitted.
　第２の実施形態は、第１の実施形態に対して、フレームメモリコントローラ３１１及びラインメモリコントローラ３３５による制御の点で異なる。 The second embodiment differs from the first embodiment in terms of control by the frame memory controller 311 and the line memory controller 335.
　本実施形態によるラインメモリコントローラ３３５は、行番号を３で除した余りが０及び１となる行のデジタルライン画像信号をフレームメモリ３１０から第２のラインメモリ３３２に出力させる。そして、行番号を３で除した余りが２となる行のデジタルライン画像信号をフレームメモリ３１０から特殊画像処理部３２０に出力させる。特殊画像処理部３２０は、デジタルライン画像信号を画像処理し、第１のラインメモリ３３１は画像処理されたデジタルライン画像信号を記憶する。 The line memory controller 335 according to the present embodiment causes the frame memory 310 to output the digital line image signal of the row whose remainder is 0 and 1 when the row number is divided by 3 to the second line memory 332. Then, the digital line image signal of the row in which the remainder obtained by dividing the row number by 3 is 2 is output from the frame memory 310 to the special image processing unit 320. The special image processing unit 320 performs image processing on the digital line image signal, and the first line memory 331 stores the image-processed digital line image signal.
　第１のラインメモリ３３１は、列番号を３で除した余りが２となる列の画像信号をセレクタ３３４に出力する。第２のラインメモリ３３２は、列番号を３で除した余りが０及び１となる列の画像信号をセレクタ３３４に出力する。 The first line memory 331 outputs to the selector 334 the image signal of the column whose remainder is 2 when the column number is divided by 3. The second line memory 332 outputs to the selector 334 the image signal of the column in which the remainder obtained by dividing the column number by 3 is 0 and 1.
　図５は、本実施形態による画面４１０を示した図である。第１の表示領域４１１には、第２のラインメモリ３３２を経た観察画像が表示され、第２の表示領域４１２には特殊画像処理部３２０及び第１のラインメモリ３３１を経た観察画像が表示される。第２のラインメモリ３３２を経た観察画像は、特殊な画像処理を施されていない通常観察画像であり、第１のラインメモリ３３１を経た観察画像は、特殊な画像処理が施された特殊観察画像である。通常観察画像は、イメージセンサ２１４が出力した観察画像と比較して４／９の大きさで表示され、特殊観察画像は、イメージセンサ２１４が出力した観察画像と比較して１／９の大きさで表示される。 FIG. 5 is a diagram showing a screen 410 according to the present embodiment. An observation image that has passed through the second line memory 332 is displayed in the first display area 411, and an observation image that has passed through the special image processing unit 320 and the first line memory 331 is displayed in the second display area 412. The The observation image that has passed through the second line memory 332 is a normal observation image that has not been subjected to special image processing, and the observation image that has passed through the first line memory 331 has been subjected to special image processing. It is. The normal observation image is displayed with a size of 4/9 compared to the observation image output from the image sensor 214, and the special observation image is 1/9 compared with the observation image output from the image sensor 214. Is displayed.
　次に、図６を用いて、ラインメモリコントローラ３３５による制御について説明する。 Next, control by the line memory controller 335 will be described with reference to FIG.
　図６は、通常観察画像と特殊観察画像とを異なる大きさで画面４１０に表示する場合のタイミングを示した図である。この制御は、ラインメモリ３３０、ラインメモリコントローラ３３５、及びセレクタ３３４により実行される。 FIG. 6 is a diagram showing the timing when the normal observation image and the special observation image are displayed on the screen 410 in different sizes. This control is executed by the line memory 330, the line memory controller 335, and the selector 334.
　この制御が開始される前に、第１のラインメモリ３３１は特殊な画像処理が施された第２行のデジタルライン画像信号を記憶し、第２のラインメモリ３３２は特殊な画像処理が施されない第０行のデジタルライン画像信号を記憶している。 Before this control is started, the first line memory 331 stores the digital line image signal of the second row subjected to the special image processing, and the second line memory 332 is not subjected to the special image processing. The digital line image signal of the 0th row is stored.
　まず、セレクタ３３４が第１のラインメモリ３３１に接続され、第１のラインメモリ３３１が出力を開始する。第１のラインメモリ３３１は、第２列、第５列、第８列というように、列番号を３で除した余りが２となる列の画像信号をセレクタ３３４に出力する。そして、最終アドレスの列が画像信号を出力すると、セレクタ３３４は、第２のラインメモリ３３２に接続を切り換える。次に、第２のラインメモリ３３２が出力を開始する。第２のラインメモリ３３２は、第０列、第１列、第３列、第４列というように、列番号を３で除した余りが０及び１となる列の画像信号をセレクタ３３４に出力する。そして、最終アドレスの列が画像信号を出力すると、セレクタ３３４は、第１のラインメモリ３３１に接続を切り換える。 First, the selector 334 is connected to the first line memory 331, and the first line memory 331 starts output. The first line memory 331 outputs, to the selector 334, the image signal of the column in which the remainder is obtained by dividing the column number by 3, such as the second column, the fifth column, and the eighth column. When the last address column outputs an image signal, the selector 334 switches the connection to the second line memory 332. Next, the second line memory 332 starts output. The second line memory 332 outputs, to the selector 334, image signals of columns whose remainders are 0 and 1 when the column number is divided by 3, such as the 0th column, the 1st column, the 3rd column, and the 4th column. To do. When the last address column outputs an image signal, the selector 334 switches the connection to the first line memory 331.
　第２のラインメモリ３３２が画像信号をセレクタ３３４に出力する間、第１のラインメモリ３３１は、次の第５行のデジタルライン画像信号を記憶する。そして、第１のラインメモリ３３１は、同様にして第２列、第５列、第８列というように、列番号を３で除した余りが２となる列の画像信号をセレクタ３３４に出力する。 While the second line memory 332 outputs the image signal to the selector 334, the first line memory 331 stores the digital line image signal of the next fifth row. Similarly, the first line memory 331 outputs, to the selector 334, the image signal of the column in which the remainder is obtained by dividing the column number by 3, such as the second column, the fifth column, and the eighth column. .
　第１のラインメモリ３３１が画像信号をセレクタ３３４に出力する間、第２のラインメモリ３３２は、次の第１行のデジタルライン画像信号を記憶する。そして、第２のラインメモリ３３２は、同様にして第０列、第１列、第３列、第４列というように、列番号を３で除した余りが０及び１となる列の画像信号をセレクタ３３４に出力する。そして、セレクタ３３４は、画像信号を受信する度に、モニタ４００に画像信号を送信する。 While the first line memory 331 outputs the image signal to the selector 334, the second line memory 332 stores the digital line image signal of the next first row. Similarly, the second line memory 332 stores the image signals of columns in which the remainder obtained by dividing the column number by 3 is 0 and 1, such as the 0th column, the 1st column, the 3rd column, and the 4th column. Is output to the selector 334. The selector 334 transmits the image signal to the monitor 400 every time it receives the image signal.
　これらの処理を全ての行について行うことにより、通常観察画像が特殊観察画像よりも大きく、イメージセンサ２１４が出力した観察画像と比較すると通常観察画像が面積比４／９の大きさで、特殊観察画像が面積比１／９の大きさでモニタ４００に表示される。 By performing these processes for all the rows, the normal observation image is larger than the special observation image, and the normal observation image has an area ratio of 4/9 as compared with the observation image output by the image sensor 214. The image is displayed on the monitor 400 with an area ratio of 1/9.
　本実施形態によれば、術者が注目したい画像をより大きく表示することができる。 According to the present embodiment, it is possible to display an image that the operator wants to focus on larger.
　なお、第２の実施形態において、通常観察画像よりも特殊観察画像を大きく表示しても良い。 In the second embodiment, the special observation image may be displayed larger than the normal observation image.
　なお、全ての実施形態において、イメージセンサ２１４の画素は、水平方向に伸びる行と垂直方向に伸びる列により構成されなくても良く、斜め方向に伸びる行と列であってもよい。また、行と列は直交しなくても良い。 In all the embodiments, the pixels of the image sensor 214 do not have to be constituted by rows extending in the horizontal direction and columns extending in the vertical direction, but may be rows and columns extending in the oblique direction. Further, the row and the column need not be orthogonal.
　また、前述したラインメモリ３３０が記憶する行番号及び出力する列は単なる例示であって、前記の値に限定されない。 Further, the row numbers and the output columns stored in the line memory 330 described above are merely examples, and are not limited to the above values.
　イメージセンサ２１４は、ＣＣＤでなくても良く、ＣＭＯＳ等の撮像素子であっても良い。 The image sensor 214 may not be a CCD but may be an image sensor such as a CMOS.
　ここに付随する図面を参照して本発明の複数の実施形態が説明されたが、記載された発明の範囲と精神から逸脱することなく、変形が各部の構造と関係に施されることは、当業者にとって自明である。 While embodiments of the present invention have been described with reference to the accompanying drawings, it is understood that modifications may be made to the structure and relationship of each part without departing from the scope and spirit of the described invention. It is obvious to those skilled in the art.
　本開示は、ここに参照としてその全体が含まれる、日本国特許出願特願２００９－２７７３３８号（２００９年１２月７日出願）に含まれる主題に関連する。 This disclosure relates to the subject matter included in Japanese Patent Application No. 2009-277338 (filed on Dec. 7, 2009), which is hereby incorporated by reference in its entirety.

Claims (12)

  1. 　１フレームの画像を第１の方向に沿って伸びる複数の行に分割して得られるライン画像信号を、前記第１の方向とは異なる第２の方向に対して順番に出力する撮像部と、
    　前記ライン画像信号を画像処理する画像処理部と、
    　互いに異なる前記ライン画像信号を記憶する複数のラインメモリと、
    　前記ラインメモリのうちの１つに記憶されたライン信号により形成される画像を表示する表示領域を、前記ラインメモリごとに設ける表示部とを備え、
    　１又は２以上の前記ラインメモリは、前記画像処理部が画像処理した前記ライン画像信号を記憶し、
    　画像処理された前記ライン信号を記憶しない前記ラインメモリは、前記画像処理部が画像処理しない前記ライン画像信号を記憶する内視鏡装置。     An imaging unit that sequentially outputs a line image signal obtained by dividing an image of one frame into a plurality of rows extending along a first direction in a second direction different from the first direction;
    An image processing unit that performs image processing on the line image signal;
    A plurality of line memories for storing the line image signals different from each other;
    A display area for displaying an image formed by a line signal stored in one of the line memories, provided for each line memory; and
    One or more of the line memories store the line image signal image-processed by the image processing unit;
    The endoscope apparatus that stores the line image signal that is not subjected to image processing by the image processing unit, wherein the line memory that does not store the image-processed line signal.
  2. 　前記ラインメモリは、前記ライン画像信号を記憶する第１及び第２のラインメモリを有し、
    　前記表示部は、前記第１のラインメモリに記憶されたライン信号により形成される第１の画像を表示する第１の表示領域、及び前記第２のラインメモリに記憶されたライン信号により形成される第２の画像を表示する第２の表示領域を有し、
    　前記画像処理部が画像処理した前記ライン画像信号を第１のラインメモリが記憶し、
    　前記画像処理部が画像処理しない前記ライン画像信号を第２のラインメモリが記憶する請求項１に記載の内視鏡装置。     The line memory has first and second line memories for storing the line image signal,
    The display unit is formed by a first display area for displaying a first image formed by a line signal stored in the first line memory, and a line signal stored in the second line memory. A second display area for displaying a second image,
    A first line memory stores the line image signal image-processed by the image processing unit,
    The endoscope apparatus according to claim 1, wherein the second line memory stores the line image signal that is not subjected to image processing by the image processing unit.
  3. 　前記ライン画像信号は、前記第１の方向に沿って並ぶ複数の画像信号から成り、
    　前記第１及び第２のラインメモリは、前記第２の方向において所定の周期に従って決定される位置にあるライン画像信号を記憶し、
    　前記第１の表示領域は、前記第１の方向において所定の周期に従って決定される位置にある画像信号により形成される画像を表示する請求項２に記載の内視鏡装置。     The line image signal is composed of a plurality of image signals arranged along the first direction,
    The first and second line memories store line image signals at positions determined according to a predetermined period in the second direction;
    The endoscope apparatus according to claim 2, wherein the first display area displays an image formed by an image signal at a position determined according to a predetermined cycle in the first direction.
  4. 　前記ライン画像信号は、前記第１の方向に沿って並ぶ複数の画像信号から成り、
    　前記第１及び第２のラインメモリは、前記第２の方向において偶数番目のライン画像信号を記憶し、
    　前記第１の表示領域は、前記第１の方向において偶数番目の画像信号により形成される画像を表示する請求項３に記載の内視鏡装置。     The line image signal is composed of a plurality of image signals arranged along the first direction,
    The first and second line memories store even-numbered line image signals in the second direction;
    The endoscope apparatus according to claim 3, wherein the first display area displays an image formed by even-numbered image signals in the first direction.
  5. 　前記ライン画像信号は、前記第１の方向に沿って並ぶ複数の画像信号から成り、
    　前記第１及び第２のラインメモリは、前記第２の方向において奇数番目のライン画像信号を記憶し、
    　前記第１の表示領域は、前記第１の方向において奇数番目の画像信号により形成される画像を表示する請求項３に記載の内視鏡装置。     The line image signal is composed of a plurality of image signals arranged along the first direction,
    The first and second line memories store odd-numbered line image signals in the second direction;
    The endoscope apparatus according to claim 3, wherein the first display area displays an image formed by odd-numbered image signals in the first direction.
  6. 　前記ライン画像信号は、前記第１の方向に沿って並ぶ複数の画像信号から成り、
    　前記表示領域は、所定の条件に合致した前記画像信号により形成される画像を表示する請求項１に記載の内視鏡装置。     The line image signal is composed of a plurality of image signals arranged along the first direction,
    The endoscope apparatus according to claim 1, wherein the display area displays an image formed by the image signal meeting a predetermined condition.
  7. 　前記複数のラインメモリは、所定の分配比率に従って周期的に前記ライン画像信号を各々記録する請求項１に記載の内視鏡装置。 The endoscope apparatus according to claim 1, wherein the plurality of line memories respectively record the line image signals periodically according to a predetermined distribution ratio.
  8. 　前記撮像部は、１フレームの画像を水平方向に伸びる複数のラインに分割して得られるライン画像信号を、垂直方向に対して順番に出力する請求項１から７に記載の内視鏡装置。 The endoscope apparatus according to any one of claims 1 to 7, wherein the imaging unit sequentially outputs a line image signal obtained by dividing an image of one frame into a plurality of lines extending in a horizontal direction in the vertical direction.
  9. 　前記画像処理部は、画像に含まれる病変部を強調する画像処理を行う請求項１から８に記載の内視鏡装置。 The endoscope apparatus according to any one of claims 1 to 8, wherein the image processing unit performs image processing that emphasizes a lesion part included in an image.
  10. 　前記画像処理部は、画像のコントラストを強調する画像処理を行う請求項１から８に記載の内視鏡装置。 The endoscope apparatus according to any one of claims 1 to 8, wherein the image processing unit performs image processing for enhancing a contrast of an image.
  11. 　前記画像処理部は、画像の一部を拡大する処理を行う請求項１から８に記載の内視鏡装置。 The endoscope apparatus according to any one of claims 1 to 8, wherein the image processing unit performs a process of enlarging a part of an image.
  12. 　前記第２の方向は、前記第１の方向と直交する請求項１から１１に記載の内視鏡装置。 The endoscope apparatus according to claim 1, wherein the second direction is orthogonal to the first direction.
PCT/JP2010/070700 2009-12-07 2010-11-19 Endoscopic device WO2011070904A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2011545159A JP5647996B2 (en) 2009-12-07 2010-11-19 Endoscope device

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2009-277338 2009-12-07
JP2009277338 2009-12-07

Publications (1)

Publication Number Publication Date
WO2011070904A1 true WO2011070904A1 (en) 2011-06-16

Family

ID=44145451

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2010/070700 WO2011070904A1 (en) 2009-12-07 2010-11-19 Endoscopic device

Country Status (2)

Country Link
JP (1) JP5647996B2 (en)
WO (1) WO2011070904A1 (en)

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS63214231A (en) * 1987-03-03 1988-09-06 オリンパス光学工業株式会社 Endoscopic apparatus
JPH01178234A (en) * 1988-01-08 1989-07-14 Olympus Optical Co Ltd Electronic endoscopic apparatus
JPH02277430A (en) * 1989-04-20 1990-11-14 Toshiba Corp Endoscope apparatus
JPH05337077A (en) * 1992-06-12 1993-12-21 Toshiba Corp Electronic endoscope device
JPH0973034A (en) * 1995-09-06 1997-03-18 Asahi Optical Co Ltd Electronic endoscopic device
JPH10118032A (en) * 1996-10-24 1998-05-12 Olympus Optical Co Ltd Image displaying apparatus for medical treatment and method therefor
JPH11234654A (en) * 1998-02-19 1999-08-27 Fujitsu Ltd Multi-image composition method and multi-image composition system
JP2000245692A (en) * 1999-03-02 2000-09-12 Toshiba Iyo System Engineering Kk Endoscope device
JP2003010113A (en) * 2001-06-29 2003-01-14 Pentax Corp Electronic endoscope system
JP2009006118A (en) * 2007-05-28 2009-01-15 Olympus Corp Endoscope apparatus

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003187239A (en) * 2001-12-20 2003-07-04 Matsushita Electric Ind Co Ltd Method and device for distributing image, and image processing apparatus

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS63214231A (en) * 1987-03-03 1988-09-06 オリンパス光学工業株式会社 Endoscopic apparatus
JPH01178234A (en) * 1988-01-08 1989-07-14 Olympus Optical Co Ltd Electronic endoscopic apparatus
JPH02277430A (en) * 1989-04-20 1990-11-14 Toshiba Corp Endoscope apparatus
JPH05337077A (en) * 1992-06-12 1993-12-21 Toshiba Corp Electronic endoscope device
JPH0973034A (en) * 1995-09-06 1997-03-18 Asahi Optical Co Ltd Electronic endoscopic device
JPH10118032A (en) * 1996-10-24 1998-05-12 Olympus Optical Co Ltd Image displaying apparatus for medical treatment and method therefor
JPH11234654A (en) * 1998-02-19 1999-08-27 Fujitsu Ltd Multi-image composition method and multi-image composition system
JP2000245692A (en) * 1999-03-02 2000-09-12 Toshiba Iyo System Engineering Kk Endoscope device
JP2003010113A (en) * 2001-06-29 2003-01-14 Pentax Corp Electronic endoscope system
JP2009006118A (en) * 2007-05-28 2009-01-15 Olympus Corp Endoscope apparatus

Also Published As

Publication number Publication date
JPWO2011070904A1 (en) 2013-04-22
JP5647996B2 (en) 2015-01-07

Similar Documents

Publication Publication Date Title
JP4780980B2 (en) Endoscope device
EP1779766B1 (en) Signal processing device for endoscope
ES2818174T3 (en) Endoscopic image enhancement using contrast-limited adaptive histogram equalization (CLAHE) implemented in a processor
JP3382973B2 (en) Electronic endoscope device
JP5620612B2 (en) Imaging apparatus and imaging system
JP5123443B2 (en) Signal processing apparatus and still image generation method
JP5308884B2 (en) Endoscopic processor device and method of operating the same
JP2004321244A (en) Electronic endoscope system
JP2009219573A (en) Image processor for endoscope and image processing method for endoscope
JP6489644B2 (en) Imaging system
JP5647996B2 (en) Endoscope device
JP5959331B2 (en) Endoscope device
JP2018079249A (en) Medical signal processing apparatus and medical observation system
JP2008093174A (en) Endoscope apparatus
JP6082658B2 (en) Imaging device and endoscope apparatus
JP2010017452A (en) Processor for electronic endoscope and image processing system
JP5137634B2 (en) Medical image processing device
JP2019153969A (en) Medical treatment observation device
JP5289371B2 (en) Endoscope device and processor device in endoscope system
JP2010051372A (en) Processor of endoscope, and method of masking endoscopic image
JP4709784B2 (en) Endoscope signal processing device
JP3288412B2 (en) Endoscope system
JP6412361B2 (en) Endoscopic imaging device
JP4398106B2 (en) Image sensor driving unit and image pickup apparatus using the same
JP4823539B2 (en) Endoscope insertion shape detection device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 10835826

Country of ref document: EP

Kind code of ref document: A1

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 10835826

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2011545159

Country of ref document: JP

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 10835826

Country of ref document: EP

Kind code of ref document: A1