JP2009207522A - Medical image treatment system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To accurately reproduce a PinP-related image displayed on a monitor during inspection for an appropriate image diagnosis. <P>SOLUTION: A CPU 31 includes such functional parts as a system control part 310 as a record controller, a magnification setting part 311 as a magnification setter, a PinP relation part 312 as a related information generator, an image placement setting part 313 as a placement setter, and a layout information generation part 314 as a layout information generator. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to a medical image processing apparatus that synthesizes and displays a plurality of medical images on a monitor screen.

An endoscopic image obtained by imaging the inside of the subject as a subject and an image from a modality (observation device) different from the endoscope are respectively subjected to enlargement / reduction processing and then combined to be a parent-child image An apparatus for generating a signal and displaying a parent-child image based on the parent-child image signal on a monitor or recording it on a recording medium has been proposed in, for example, Japanese Patent Laid-Open Nos. 10-308896 and 2002-112958. .
JP 10-308896 A JP 2002-112958 A

  However, since the parent image and the child image constituting the parent-child image are generally subjected to a scaling process on an original image obtained from an endoscope or other modality, for example, on a recording medium after an inspection. There has been a problem that it is difficult to make a detailed diagnosis based on the recorded parent-child image (when the original image is reduced, it is difficult to make a diagnosis because the image itself is small and difficult to see. When the enlargement process is performed, it is difficult to make a diagnosis because the image becomes rough and difficult to see).

  In order to solve this problem, it is conceivable to record the original image, which is the basis of the parent image and the child image, on the recording medium in association with each other. Since no special consideration is given to the layout of the image to be displayed, the layout of the displayed image may differ between the endoscopic examination and the diagnosis based on the recorded image after the examination. It was difficult to grasp the image.

  The present invention has been made in view of the above circumstances, and provides a medical image processing apparatus capable of accurately reproducing a display image of a monitor with a PinP image at the time of inspection and accurately performing image diagnosis. It is an object.

The medical image processing apparatus of the present invention is
An input means capable of inputting a first signal output from a medical observation device and a second signal different from the first signal;
Expansion processing or reduction processing for at least one of the first video signal generated based on the first signal and the second video signal generated based on the second signal Zooming means for generating first and second zoomed video signals subjected to
Magnification setting means for setting an enlargement ratio or reduction ratio in the scaling means;
Synthesizing means for synthesizing the first and second scaled video signals based on the setting of the magnification setting means and generating a synthesized image signal;
Association information generating means for generating association information representing an association between the first and second video signals based on the first and second scaled video signals synthesized by the synthesis means;
An arrangement setting means for setting an arrangement of the first and second scaled video signals when the first and second scaled video signals are synthesized by the synthesis means;
Layout information generating means for generating layout information representing settings of the magnification setting means and the arrangement setting means;
Recording control means for controlling the recording of the first and second video signals, the association information, and the layout information on a recording medium;
It is configured with.

  According to the present invention, there is an effect that an image displayed on a monitor with a PinP image at the time of inspection can be accurately reproduced and image diagnosis can be performed accurately.

  Embodiments of the present invention will be described below with reference to the drawings.

  1 to 34 relate to the first embodiment of the present invention, FIG. 1 is a block diagram showing the configuration of the video processor, FIG. 2 is a functional block diagram showing the functional configuration of the CPU in FIG. 1, and FIG. 3 is a PCMCIA in FIG. FIG. 4 is a diagram showing a directory structure of the CF card of FIG. 1; FIG. 5 is a first example showing reproduction of images stored in the CF card in the directory structure of FIG. FIG. 6 is a second diagram showing an example of reproduction of an image stored in the CF card in the directory structure of FIG. 4, FIG. 7 is a diagram showing an example of a window developed by the XML file of FIG. Is a diagram showing an example of reproduction of an image stored in the CF card by the window of FIG. 7, FIG. 9 is a first diagram illustrating a PinP image displayed on the monitor of FIG. 1, and FIG. 10 is displayed on the monitor of FIG. In the second figure explaining the PinP image is there.

  11 is a flowchart for explaining the process of determining the layout of the PinP image displayed on the monitor of FIG. 1, FIG. 12 is a diagram for explaining the layout of the PinP image determined by the process of FIG. 11, and FIG. FIG. 14 is a flowchart for explaining image reproduction processing from a CF card based on the inspection management information file, FIG. 14 is a first diagram for explaining a PinP image reproduced from the CF card by the processing of FIG. 13, and FIG. FIG. 16 is a second diagram for explaining the PinP image reproduced from the CF card, FIG. 16 is a third diagram for explaining the PinP image reproduced from the CF card by the process of FIG. 13, and FIG. 17 is a CF card by the process of FIG. FIG. 18 illustrates a PinP image reproduced from the CF card, FIG. 18 illustrates a fifth diagram illustrating a PinP image reproduced from the CF card by the processing of FIG. 13, and FIG. 19 is connected to the USB controller of FIG. Printer FIG. 20 is a first flowchart for explaining the processing of FIG. 19.

  21 is a second diagram for explaining the processing of FIG. 19, FIG. 22 is a second flowchart for explaining the second control for the printer connected to the USB controller of FIG. 1, and FIG. 23 is the USB of FIG. FIG. 24 is a first flowchart for explaining the processing of FIG. 23, and FIG. 25 is a second flowchart for explaining the processing of FIG. FIG. 26 is a diagram for explaining the fourth control for the printer connected to the USB controller of FIG. 1, and FIG. 27 is the fifth control for explaining the fifth control for the printer connected to the USB controller of FIG. 5 is a diagram for explaining the processing of FIG. 27, FIG. 29 is a diagram showing the directory structure of FIG. 4 according to the modification 1, and FIG. 30 is a block diagram showing the configuration of the video processor according to the modification 2. A click view.

  31 is a diagram for explaining the operation of the video processor of FIG. 30, FIG. 32 is a block diagram showing the configuration of the video processor according to the modification 3, and FIG. 33 is a block diagram showing the configuration of the video processor according to the modification 4. FIG. 34 is a diagram showing a configuration of the capsule endoscope of FIG.

  As shown in FIG. 1, a video processor 1 which is a medical image processing apparatus of the present embodiment performs an endoscopic examination and is obtained by an electronic endoscope (hereinafter abbreviated as an endoscope) 2. The endoscopic image and the external input image obtained from the external image device (for example, an ultrasonic observation apparatus) 3 are displayed on the monitor 4 as a PinP (picture-in-picture) image, and the PinP image displayed on the monitor 4 Is an image processing apparatus capable of recording the image on a CF card 5 as a recording medium.

  The video processor 1 includes a preprocessing unit 11 as a first input unit that inputs an imaging signal from, for example, a CCD 6 serving as an imaging unit disposed in the distal end of the endoscope 2, and a video from the external image device 3. An A / D conversion unit 16 as a second input unit for inputting a signal is provided as input means.

  The preprocessing unit 11 performs preprocessing such as correlated double sampling processing on the input imaging signal, and outputs the preprocessed signal to the video signal processing circuit 12 at the subsequent stage. The video signal processing circuit 12 performs known video processing such as RGB matrix processing, white balance processing, and contour enhancement processing, and then outputs the processed signal to the first scaler 13 at the subsequent stage as an endoscopic image.

  On the other hand, the A / D conversion unit 16 converts the video signal from the external image device 3 into a digital signal and generates binarized video data, which are sequentially stored in the FIFO memory 17 at the subsequent stage. The FIFO memory 17 outputs the stored video data to the second scaler 19 at the subsequent stage as an external input image via the synchronization circuit 18.

  The first scaler 13 and the second scaler 18 constitute a scaling unit that sets the size of the endoscopic image and the external input image.

  The video processor 1 includes a CPU 31, a USB controller 32, a first F-RAM (flash memory) 33, a second F-RAM 34, a work RAM 35, a first scaler 13, and a second scaler via an internal bus 30. 18, a compression / decompression processing unit 24, a PCMCIA controller 25, and the like are connected. These units can transmit and receive various data and commands to each other via the internal bus 30.

  The CPU 31 executes processing such as various calculations using the WORK RAM 35 according to the system program stored in the first F-RAM 33 via the internal bus 30.

  The USB controller 32 has an input / output port that can communicate with a printer (not shown) and a keyboard (not shown) using the USB protocol. For example, various setting information input from the keyboard is sent to the internal bus 30 via the USB controller 32.

  Information from the keyboard input via the USB controller 32 and processing information such as the calculation result of the CPU 31 are appropriately stored in the second F-RAM 34 via the internal bus 30.

  Examples of various setting information input from the keyboard include image information for setting the state of an image displayed on the monitor 4. For example, this image information is setting information of a PinP image when the endoscope image and the external input image are PinP displayed on the monitor 4. Specifically, the setting information of the PinP image includes, for example, setting information of the parent image and child image of the PinP image, size information of the child image, arrangement position information of the child image, and the like.

  When the CPU 31 recognizes the parent image and child image setting information and the child image size information from the keyboard via the USB controller 32, the CPU 31 performs magnification information on the first scaler 13 and the second scaler 19. Are output via the internal bus 30. The first scaler 13 and the second scaler 19 enlarge or reduce the endoscopic image and the external input image based on the magnification information, and set the size corresponding to the PinP image.

  An endoscopic image and an external input image having a size corresponding to the PinP image processed by the first scaler 13 and the second scaler 19 are output to an OSD (on-screen display) / synthesis unit 15 as a synthesis unit. Is done.

  The OSD / synthesis unit 15 generates a PinP image from the endoscope image and the external input image having a size corresponding to the input PinP image using the SDRAM 21. At this time, the OSD / synthesis unit 15 displays a GUI menu (not shown) by the on-screen display function on the monitor 4, and sets the size and arrangement of the parent image and child image of the PinP image by operating the keyboard or the like. Accept and generate a PinP image based on this information.

  Furthermore, the OSD / synthesis unit 15 performs various types of examination information (for example, patient name, patient date of birth, patient ID, patient age, patient sex, examination year) related to the endoscopic examination by the endoscope 2 by operating the keyboard or the like. Information such as the date of the month, the examination site, and the name of the operator in charge of the examination) is input from the CPU 31 via the internal bus 30 as a character image. Then, the OSD / synthesis unit 15 superimposes the character image on a predetermined position of the generated PinP image and outputs the superimposed image to the D / A conversion unit 22 at the subsequent stage.

  The D / A converter 22 converts the PinP image on which the character image is superimposed into a known TV signal, and displays it on the monitor 4 as a PinP observation image.

  The video processor 1 stores the endoscopic image from the video signal processing circuit 12 and the external input image from the synchronization circuit 18 in the memory 23. The endoscopic image and the external input image stored in the memory 23 are compressed by the compression / expansion processing unit 24 and recorded on the CF card 5 as an image file via the PCMCIA controller 25.

  Here, in the CF card 5, in addition to the above-described image files of the endoscopic image and the external input image, an inspection management information file based on the inspection information from the CPU 31 and image related information on the PinP image is stored in the PCMCIA controller 25. And the inspection management information file is stored.

  The endoscope image and the external input image stored in the CF card 5 are decompressed by the compression / decompression processing unit 24 via the PCMCIA controller 25 under the control of the CPU 31 by operating the keyboard, for example, and stored in the memory 23. can do.

  At this time, the OSD / compositing unit 15 performs the endoscopic image read from the CF card 5 stored in the memory 23 and the external image based on the image related information related to the PinP image in the examination management information file stored in the CF card 5. A PinP image having the same display form as that of the PinP image displayed on the monitor 4 at the time of inspection is constructed, a character image is generated from the inspection information, and the generated character image is superimposed on the PinP image. It is displayed on the monitor 4.

  That is, the video processor 1 according to the present embodiment can display the PinP image displayed at the time of the inspection with the same PinP image even after observation.

  As shown in FIG. 2, the CPU 31 includes a system control unit 310 as a recording control unit, a magnification setting unit 311 as a magnification setting unit, a PinP association unit 312 as an association information generation unit, and an image arrangement setting unit as an arrangement setting unit. 313 and a layout information generation unit 314 as a layout information generation unit are configured by functional units.

  As shown in FIG. 3, the PCMCIA controller 25 includes examination information including information # 1 to information # 13 and information # 16, endoscope image information including information # 14 and information # 15, information # 17A, information # 18A. , # 19A etc., and an inspection management information file made up of PinP image information (image related information) and the like are generated.

  The examination information (information # 1 to information # 13, information # 16) includes the patient name, patient birth date, patient ID, patient age, patient sex, examination date, examination site, It is generated from information such as the name of the operator in charge of the examination and comments.

  Endoscopic image information information # 14 is a file name of an endoscopic image managed by this examination management information file, and the file name is designated by a full path below DCIM. Information # 15 is information indicating the size of the endoscopic image by the magnification setting unit 311 of the CPU 31.

  PinP image information (information # 17A to 17D, information # 18A to 18D, information # 19A to 19D, etc.) is PinP information for the endoscopic image managed by the examination management information file, and is output by the layout information generation unit 314 of the CPU 31. Generated.

  Examination information and endoscopic image information are conventionally managed by an examination management information file. In this embodiment, PinP image information is managed by this examination management information file.

Detailed description of PinP image information
(1) Information # 17A to 17D = Information indicating the parent-child relationship between the endoscopic image and the external input image (by the PinP associating unit 312 of the CPU 31): Specific example “xxxxyyyy” = “xxxx” is the parent image, “yyyy” is the parent image Child image (the upper 4 bits specify the parent image file and the lower 4 bits specify the child image file)
(2) Information # 18A to 18D = Position information on the PinP image (by the image arrangement setting unit 313 of the CPU 31) on the PinP image: specific example “00” = lower left, “01” = upper left, “10” = upper right , “11” = lower right (3) information # 19A to 19D = information indicating the size of the sub-screen (by the magnification setting unit 311 of the CPU 31): specific example “00” = 1/9, “01” = 1 / 4, “10” = the parent image has the same size.

  Note that there are a plurality of pieces of PinP image information corresponding to the number of PinP images. That is, in the example of FIG. 3, there are four PinP images, and each of the PinP image information is indicated by A to D.

  The inspection management information file generated in this way is managed / stored in the CF card 5 as “FILES.bin” in a directory structure as shown in FIG. This directory structure is based on, for example, a known DCIM standard.

  Here, “FILES.bin” is a binary format file, but a hyperlink format file named “FILES.xml” is also managed / stored in the directory structure of the inspection management information file at the same time. The

  The CF card 5 generates an inspection folder (for example, 100ABCD) for each inspection as in the directory structure of FIG. 4, and in addition to “FILES.bin” and “FILES.xml” in this inspection folder, A full-size JPEG file (for example, ABCD0001.jpg or ABCD0002.jpg) is generated. The lower 4 bits of the JPEG file are a code for identifying image data.

  For example, when the user accesses the CF card 5 on a PC (personal computer) and double-clicks “ABCD0001.jpg”, a full-size endoscope image as shown in FIG. 5 is reproduced, or “ABCD0002.jpg” is displayed. When double-clicked, a full-size ultrasonic image as shown in FIG. 6 is reproduced. In this case, it is not a PinP image.

  On the other hand, when the user accesses the CF card 5 on the PC and double-clicks “FILES.xml”, the XML file activation software is activated and a browser window as shown in FIG. 7 is displayed. As described above, the XML file is a hyperlink format file that is almost the same as HTML, and can display characters and images at predetermined positions. Thus, as shown in FIG. 7, when the PinP relationship is established, for example, an image associated with an arrow graphic 500 or the like can be displayed easily, and a browser window as shown in FIG. By double-clicking on one of the image files, a PinP image composed of an endoscope image 50, an external input image (for example, an ultrasonic image) 51, and a character image 52 as shown in FIG. Can be displayed.

  Next, the above PinP image information will be described in more detail by schematically showing the display of the monitor 4 at the time of observation.

  As shown in FIG. 9, the PinP image displayed on the monitor 4 has position patterns P (n) (n = 1 to 4) which are PinP patterns of four different arrangements depending on the display position of the child image. The above-described information # 18A to 18D is data corresponding to this position pattern P (n).

  As shown in FIG. 10, the PinP image displayed on the monitor 4 is a child image size pattern S (n) (n = 1 to 4) which is a PinP pattern of four different arrangements depending on the size (size) of the child image. 3) exists. The information # 19A to 19D described above is data corresponding to the position pattern P (n).

  Since there are a plurality of patterns in this way, the OSD / compositing unit 15 acquires various setting information on the monitor 4 by the on-screen display function, performs processing as shown in FIG. 11, and combines the parent image and the child image. Then, a PinP image in which character images are superimposed is constructed.

  That is, as shown in FIG. 11, the OSD / synthesis unit 15 determines whether or not the child image size pattern set by the on-screen display function in step S21 is S (3). If the child image size pattern is S (3) (child image size = parent image size), the OSD / synthesis unit 15 sets the layout to the sixth layout L (6) shown in FIG. 12 in step S31. For example, a PinP image in which a character image is superimposed on the lower part of the image is constructed.

  If the child image size pattern is not S (3), the OSD / synthesis unit 15 determines whether the position pattern set by the on-screen display function in step S22 is P (3) or P (4). To do. If the position pattern is P (3) or P (4), the OSD / synthesis unit 15 sets the layout to the fifth layout L (5) shown in FIG. For example, a PinP image superimposed on the left part of the image, which is a position that does not cover the mirror image and the external input image, is constructed.

  If the position pattern is not P (3) or P (4), the OSD / synthesis unit 15 determines whether the position pattern set by the on-screen display function is P (1) in step S23. If the position pattern is P (1), the OSD / synthesis unit 15 determines whether the child image size pattern set by the on-screen display function in step S27 is S (2) (= 1/4). To do. If the child image size pattern is S (2), the OSD / synthesis unit 15 sets the layout to the fourth layout L (4) shown in FIG. 12 in step S29, and the character image does not cover at least the child image. For example, a PinP image superimposed on the lower left portion of the image, which is the position, is constructed.

  If it is determined in step S27 that the child image size pattern is not S (2) (that is, S (1) = 1/9), the OSD / synthesis unit 15 displays the layout in step S28 as shown in FIG. The layout L (3) is used to construct a PinP image in which a character image is superimposed at, for example, the lower left portion of the image at a position that does not cover the child image.

  If the OSD / synthesis unit 15 determines that the position pattern is not P (1) in step S23, the child image size pattern set by the on-screen display function in step S24 is S (2) (= 1). / 4). If the child image size pattern is S (2), the OSD / synthesis unit 15 sets the layout to the second layout L (2) shown in FIG. 12 in step S26, and does not cover at least the child image with the character image. For example, a PinP image superimposed on the upper left corner of the image is constructed.

  If it is determined in step S24 that the child image size pattern is not S (2) (that is, S (1) = 1/9), the OSD / synthesis unit 15 displays the layout in step S25 shown in FIG. And a PinP image in which a character image is superimposed at, for example, the upper left portion of the image, which is a position that does not cover at least a child image, is constructed.

  As described above, the OSD / synthesis unit 15 determines the PinP image layouts L (1) to L (6) by the on-screen display function, constructs the PinP image using the SDRAM 21, and displays it on the monitor 4. To do.

  Control of layout determination in the OSD / synthesis unit 15 is executed by control of the functional units of the magnification setting unit 311, the PinP association unit 312, and the image arrangement setting unit 313 of the CPU 31 illustrated in FIG. The layout information generation unit 314 acquires the determined layout information as PinP image information (information # 17A to 17D, information # 18A to 18D, information # 19A to 19D, etc.).

  When a PinP image having the layout determined as described above is displayed on the monitor 4, for example, when an instruction to record the display image is input by a keyboard operation, the system control unit 310 of the CPU 31 performs compression / decompression processing. The unit 24 is controlled to compress the endoscope image and the external input image stored in the memory 23, and store the image data in the CF card 5 via the PCMCIA controller 25.

  At this time, the CPU 31 includes the inspection information (information # 1 to information # 13, information # 16) and the PinP image information (information # 17A to 17D, information # 18A to 18D, information #) generated by the layout information generation unit 314. 19A to 19D) are output to the PCMCIA controller 25.

  As a result, the PCMCIA controller 25 generates “FILES.bin” and “FILES.xml” together with the image data, and stores them in the CF card 5 (see FIGS. 3 and 4).

  Next, playback of a PinP image made up of an endoscopic image and an external input image stored in the CF card 5 by the video processor 1 after the endoscopic examination will be described.

  When the CPU 31 detects the reproduction of the CF card 5 by the keyboard operation, as shown in FIG. 13, the CPU 31 accesses the “setting.bin” file (see FIG. 4) of the CF card 5 via the PCMCIA controller 25 in step S1. Then, the CPU 31 reads the directory structure of the CF card 5 in step S2, controls each part in the video processor 1, and displays a thumbnail image of the stored image data on the monitor 4.

  Next, the CPU 31 controls the OSD / synthesis unit 15 in step S3, displays a menu using a GUI on the monitor 4 displaying the thumbnail image by the on-screen display function, and selects a desired thumbnail image by the user. Prompt.

  When a desired thumbnail image is selected, the CPU 31 constructs a PinP image from the information # 17A to 17D etc. (see FIG. 3) in “FILES.bin” in step S4. Judge whether the image.

  If it is determined that the selected thumbnail image is an image constructing a PinP image, the CPU 31 determines whether the two image files constituting the PinP image from information # 17A to 17D etc. in “FILES.bin” in step S5. Get name and parent-child information.

  For example, in FIG. 4, if the parent image is “ABCD0001” and the child image is “ABCD0002”, for example, in # 17A, the upper 4 bits indicate the parent image file name and the lower 4 bits indicate the child image file name. The data is “00010002”.

  Next, the CPU 31 acquires the position information of the child image from information # 18A to 18D in “FILES.bin” in step S6. Furthermore, the CPU 31 acquires the size of the child image from information # 19A to 19D in “FILES.bin” in step S7. In step S7, the CPU 31 acquires inspection information (information # 1 to information # 13, information # 16) of the selected thumbnail image.

  Subsequently, the CPU 31 controls the OSD / compositing unit 15 in step S9 to develop two images constituting the PinP image on the SDRAM 21, and the CPU 31 further selects an image to be a child image in step S10. Scaling is performed based on the child image size information acquired in step S7.

  Then, the CPU 31 controls the OSD / synthesis unit 15 in step S11, synthesizes the parent image, the scaled child image, and the character image based on the inspection information, constructs a PinP image, and monitors in step S12. A PinP image in which a character image is superimposed on 4 is output.

  If the CPU 31 determines that the thumbnail image selected in step S12 is not an image constructing a PinP image, the CPU 31 acquires the file name of the original image of the thumbnail image selected in step S13. Then, the CPU 31 acquires inspection information (information # 1 to information # 13, information # 16) of the thumbnail image selected in step S14. Further, the CPU 31 controls the OSD / synthesis unit 15 in step S11 to synthesize a character image with the original image of the selected thumbnail image, and proceeds to step S12.

   FIG. 14 shows a display image on the monitor 4 when the PinP image of the first layout L (1) is reproduced from the CF card 5, and FIG. 15 shows the PinP image of the second layout L (2) from the CF card 5. The display image of the monitor 4 at the time of reproduction | regeneration is shown.

  Further, the video processor 1 of the present embodiment reflects the aspect ratio as shown in FIG. 16 (aspect ratio = 4: 3) or FIG. 17 (aspect ratio = 16: 9) according to the aspect ratio of the monitor 4. It is also possible to configure a PinP image by arranging arranged child images. Also in this case, by storing the aspect ratio information of the monitor 4 in the CF card 5, the image from the CF card 5 can be displayed in the same display form as the display form of the monitor 4 at the time of inspection.

  Further, the video processor 1 according to the present embodiment uses the on-screen display function of the OSD / compositing unit 15 for the PinP image of the monitor 4 at the time of inspection, as shown in FIG. The size of the image can be changed and displayed, or the parent image, the child image, and the character image can be switched left and right (position change). When a PinP image is recorded on the CF card 5, the size information of the endoscopic image is recorded in information # 15. Further, the left / right switching information of the parent image and the child image and the character image is added to the PinP image information and stored. Thus, in this case as well, the size information of the endoscope image and the left / right switching information of the parent image and child image and the character image are stored in the CF card 5 so that the display form of the monitor 4 at the time of inspection Images from the CF card 5 can be displayed in the same display form.

  Thus, in this embodiment, even if the display form displayed at the time of the examination is a single endoscopic image or a PinP image of the endoscopic image and the external input image, the examination information (information # 1 to # 13 and # 16) and PinP image information (information # 17A to 17D, information # 18A to 18D, information # 19A to 19D, etc.) is used to manage recording of endoscopic images and external input images Therefore, it is possible to reproduce an image having the same layout configuration (the arrangement of the child images, the size, the arrangement of the character images, etc.) as the image displayed during the inspection.

  Accordingly, the user can reproduce the inspection image in exactly the same display form as at the time of inspection and appropriately check the inspection result, so that a more appropriate and accurate diagnosis can be performed.

  Incidentally, in this embodiment, as shown in FIG. 1, the video processor 1 can be connected to a printer (not shown) via the USB controller 32. Usually, since it is necessary to store a medical image print in a medical record or the like, for example, an A4 size printing paper is printed in four divided sizes. However, when a PinP image is printed in such a four-divided manner, it is particularly difficult to confirm a child image from the print.

  Therefore, in this embodiment, such a problem is solved by performing the following processing on the print output of the Pin image displayed on the monitor 4.

  That is, as shown in FIG. 19, the CPU 31 (the system control unit 310) determines whether or not the position (capture position) for capturing and printing an image in the printer is set to the left in step S51. If the capture position is not left, in step S52, the capture position is set to the left and the process proceeds to step S53. If the capture position is left, the process proceeds to step S53 as it is.

  In step S53, the CPU 31 separates the PinP image 4A shown in FIG. 20 from the endoscope image 50 (including the character image 52) that is the parent image and the external input image 51 that is the child image. (Including the character image 52) is output to the printer via the USB controller 32, and a capture command for instructing capture is output to the printer in step S54.

  Subsequently, in step S55, the CPU 31 sets the capture position = right and proceeds to step S56.

  In step S56, the CPU 31 outputs the external input image 51, which is a child image, to the printer via the USB controller 32, and outputs a capture command instructing capture to the printer in step S54.

  By performing the processing in this way, the print image 70 of the endoscopic image 50 (including the character image 52), which is the parent image, is printed on the (upper) left side of the print paper 75 divided into four as shown in FIG. A print image 71 of the external input image 51 as a child image is printed on the (upper) right side of the print paper 75. The user easily prints the print images 70 and 71 on the left and right sides of the print paper 75 so that the observation image at the time of the inspection is a PinP image having the print image 70 as a parent image and the print image 71 as a child image. Since the child image is printed as the print image 71, the external input image 51 that is clearer than the print image can be confirmed.

  Although the print image 70 of the endoscopic image 50 (including the character image 52), which is the parent image, is printed at the capture position = left, the present invention is not limited to this, and the capture position = left is as shown in FIG. Alternatively, the PinP image 4A may be printed.

  In the present embodiment, for example, a VTR can be connected as an external image device in addition to the ultrasonic observation apparatus. Since the VTR image is usually a recorded image, the VTR image is not printed out even if it is displayed as a PinP image on the monitor.

  Therefore, in this embodiment, as shown in FIG. 22, when printing is performed by the printer, the CPU 31 (the system control unit 310) determines whether the image signal of the external input image is a signal from the VTR in step S61. to decide. When determining that the image signal is a signal from the VTR, the CPU 31 ends the process without capturing the image signal of the external input image. When determining that the image signal is not a signal from the VTR, the CPU 31 determines in step S62 whether the external input image is, for example, an ultrasonic image signal. If it is determined that the external input image is not an ultrasonic image signal, the processing ends without capturing the image signal of the external input image. If the CPU 31 determines that the external input image is an ultrasonic image signal, the CPU 31 instructs the printer to capture the image signal of the external input image in step S62 and ends the process.

  In this embodiment, printing can be performed while reflecting the aspect ratio of the image from the external image device. That is, as shown in FIG. 23, when printing with the printer, the CPU 31 determines in step S71 whether the aspect ratio of the image from the external image device which is a child image is 16: 9. If it is determined that the aspect ratio of the child image is 4: 3 instead of 16: 9, the child image 51 is printed as it is on the right side of the print paper 75 in step S73 as shown in FIG.

  On the other hand, when determining that the aspect ratio of the child image is 16: 9, the CPU 31 adds a black band 80 to the top and bottom of the child image in FIG. In step S73, the child image 51 having an aspect ratio of 16: 9 is printed on the right side of the print paper 75.

  As shown in FIG. 26, when the PinP image 4A is printed, an image in which the sizes of the parent image 50 and the child image 51 are substantially equal is generated as the print image 85 and is printed on the print paper 75. Even if printing is performed, the user can easily recognize that the PinP image 4A has been printed, and the child image can be printed in a size that allows easy viewing.

  Up to now, the printing on the printer has been described by taking the quadrant printing of the print paper 75 as an example, but in the present embodiment, the print on the print paper 75 can be set to the two-split printing.

  Specifically, as shown in FIG. 27, the CPU 31 reads the set division number from the printer in step S81. Then, the CPU 31 determines whether or not the set division number read in step S82 is two divisions. If the set division number is two divisions, the print division number is set as the set division number in step S84, and the set division number is divided into two. If not, the number of print divisions is set to two in step S83, and the process proceeds to step S85.

  In step S85, the CPU 31 first outputs only the endoscopic image that is the parent image from the printer output port of the USB controller 32, and outputs a capture command for capturing the endoscopic image to the printer in step S86. To do.

  Next, the CPU 31 outputs only the external input image which is a child image from the printer output port of the USB controller 32 in step S87, and outputs a capture command for capturing this external input to the printer in step S88. .

  Then, the CPU 31 outputs a print command to the printer in step S89, and waits for the end of printing in step S90.

  When the end of printing is detected, the CPU 31 determines whether or not the set division number initially set in the printer in step S91 is two. If the set division number is not two, the CPU 31 sets the set division number. The number of set divisions is reset to the initially set number, and the process proceeds to step S92. If the set number of divisions is two, the process proceeds to step S92 as it is.

  Then, the CPU 31 repeats the processes of steps S81 to S91 until the end of the printing process is detected in step S92.

  By performing such processing, as shown in FIG. 28, it is possible to perform printing processing in a large printing form with two divisions as compared to the normal four-division printing processing of the printer paper 75.

(Modification 1)
As a second modification of the present embodiment, as shown in FIG. 29, the image file name is such that the parent image and the child image can be identified. In the case of FIG. 29, the character “M” of “ABCM0001” in the file name 90 indicates the master (parent image), and the character “S” of “ABCS0001” in the file name 91 is the slave (child image). It shows that there is. By changing the file name as in Modification 1, it becomes possible to easily identify the parent image and the child image from the directory structure.

(Modification 2)
As a second modification of the present embodiment, as shown in FIG. 30, when the external image device 3 can output character information in addition to the image signal, the video processor 1 converts the character information from the external image device 3 to the USB. It can be input via the controller 32. The PinP image in this case is an endoscope image, an external input image, and an image in which a character image made up of character information from the external image device 3 is superimposed in addition to a character image made up of character information at the time of endoscopy. Become. For example, as shown in FIG. 31, in the case of the sixth layout L (6) having the same size as the endoscopic image and the external input image, the character information at the time of the endoscopic examination is displayed below the endoscopic image. Is a PinP image in which a character image composed of character information from the external image device 3 is superimposed below the external input image.

(Modification 3)
As a third modification of the present embodiment, as shown in FIG. 32, a sensor 100 that detects information such as temperature and humidity pH is provided in the distal end portion of the endoscope 2, and the video processor 1 includes the sensor 100. A sensor information visualization unit 101 that visualizes and visualizes the above information may be provided, and a third scaler 102 that changes the size of the visualized character image and outputs it to the OSD / synthesis unit 15 may be provided.

  In the case of the third modification, a character image is provided by providing a circuit for generating an image based on a non-video signal obtained from the sensor 100 (for example, an image obtained by graphing statistical data from the sensor 100 or an image such as a thermography). Alternatively, an image other than that may be output to the OSD / synthesis unit 15.

  Thus, by superimposing sensor information as a character image or a visualized image on a PinP image, information at the time of inspection can be observed with one image, and the CF card 5 can be efficiently combined with image information and inspection information. Sensor information can be stored, and information can be reproduced in the same display form as that at the time of inspection even after the inspection.

(Modification 4)
As a fourth modification of the present embodiment, as compared with the third modification, a capsule endoscope 120 including the sensor 100 may be used instead of the endoscope 4 as shown in FIGS. The capsule endoscope 120 includes an imaging device 2 and a sensor 100, and a transmission unit 123 that outputs an imaging signal from the imaging device 2 and a sensor signal from the sensor 100 (see FIG. 34). The video processor 1 includes an antenna unit 121 for receiving a signal from the transmission unit 123 of the capsule endoscope 120, the received imaging signal to the preprocessing unit 11, and the received sensor signal to the sensor information visualization unit 101. The receiving unit 122 is configured to output each. In this case, it is possible to obtain the same effect as that of the third modification.

  The present invention is not limited to the above-described embodiments, and various changes and modifications can be made without departing from the scope of the present invention.

1 is a block diagram showing a configuration of a video processor according to Embodiment 1 of the present invention. Functional block diagram showing the functional configuration of the CPU of FIG. The figure which shows the inspection management information file which the PCMCIA controller of Figure 1 produces A diagram showing the directory structure of the CF card in FIG. FIG. 4 is a first diagram showing an example of reproduction of an image stored in a CF card in the directory structure of FIG. FIG. 4 is a second diagram showing an example of reproduction of an image stored in a CF card in the directory structure of FIG. The figure which shows an example of the window expand | deployed by the XML file of FIG. The figure which shows the example of reproduction | regeneration of the image stored in CF card by the window of FIG. The 1st figure explaining the PinP image displayed on the monitor of FIG. 2nd figure explaining the PinP image displayed on the monitor of FIG. The flowchart explaining the process which determines the layout of the PinP image displayed on the monitor of FIG. The figure explaining the layout of the PinP image determined by the process of FIG. Flowchart explaining the image reproduction processing from the CF card based on the inspection management information file of FIG. FIG. 13 is a first diagram for explaining a PinP image reproduced from a CF card by the process of FIG. 2nd figure explaining the PinP image reproduced | regenerated from CF card by the process of FIG. 3rd figure explaining the PinP image reproduced | regenerated from CF card by the process of FIG. 4th figure explaining the PinP image reproduced | regenerated from CF card by the process of FIG. FIG. 5 is a fifth diagram for explaining a PinP image reproduced from a CF card by the processing of FIG. First flowchart for explaining the first control for the printer connected to the USB controller of FIG. FIG. 19 is a first diagram for explaining the processing of FIG. FIG. 19 is a second diagram for explaining the processing of FIG. 2 is a second flowchart for explaining the second control for the printer connected to the USB controller of FIG. 3 is a third flowchart for explaining the third control for the printer connected to the USB controller of FIG. FIG. 23 is a first diagram for explaining the processing of FIG. FIG. 23 is a second diagram for explaining the processing of FIG. The figure for demonstrating the 4th control with respect to the printer connected to the USB controller of FIG. 5th flowchart explaining the 5th control with respect to the printer connected to the USB controller of FIG. The figure for demonstrating the process of FIG. The figure which shows the directory structure of FIG. 4 which concerns on the modification 1. A block diagram showing a configuration of a video processor according to Modification 2 The figure for demonstrating the effect | action of the video processor of FIG. A block diagram showing a configuration of a video processor according to Modification 3. A block diagram showing a configuration of a video processor according to Modification 4 The figure which shows the structure of the capsule endoscope of FIG.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... Video processor 2 ... Endoscope 3 ... External image equipment 4 ... Monitor 5 ... CF card 13 ... 1st scaler 15 ... OSD / synthesis | combination part 18 ... 2nd scaler 31 ... CPU

Claims (7)

An input means capable of inputting a first signal output from a medical observation device and a second signal different from the first signal;
Expansion processing or reduction processing for at least one of the first video signal generated based on the first signal and the second video signal generated based on the second signal Zooming means for generating first and second zoomed video signals subjected to
A magnification setting means for setting an enlargement ratio or a reduction ratio in the scaling means;
Combining means for combining the first and second scaled video signals based on the setting of the magnification setting means to generate a composite image signal;
Association information generating means for generating association information representing an association between the first and second video signals based on the first and second scaled video signals synthesized by the synthesis means;
An arrangement setting means for setting an arrangement of the first and second scaled video signals when the first and second scaled video signals are synthesized by the synthesis means;
Layout information generating means for generating layout information representing settings of the magnification setting means and the arrangement setting means;
Recording control means for controlling the recording of the first and second video signals, the association information, and the layout information on a recording medium;
A medical image processing apparatus comprising: The input means includes
An endoscope video signal can be input as the first video signal based on an imaging signal obtained by capturing an image of a body cavity with an endoscope.
The magnification setting means includes
The endoscope video signal and the second video signal are set so that the endoscopic video signal is a main screen having a relatively large size and the second video signal is a sub screen having a relatively small size. The medical image processing apparatus according to claim 1, wherein a variable magnification is set. Character superimposing means for superimposing a signal representing a character on the composite image signal;
The character superimposing means is
The medical image processing apparatus according to claim 1 or 2, wherein a position where a character is superimposed is determined based on settings of the magnification setting unit and the arrangement setting unit. Image processing means for performing image processing on at least one of the first video signal and the second video signal;
Image processing information generating means for generating image processing information representing the contents of image processing performed by the image processing means;
Further comprising
The recording control means includes
The medical image processing apparatus according to any one of claims 1 to 3, wherein control for recording the image processing information on the recording medium is performed. The image processing apparatus further comprises reproduction image construction means for reading out the first and second video signals recorded on the recording medium, the association information, and the layout information, and constructing a reproduction image based on the read information. The medical image processing apparatus according to any one of claims 1 to 4. The medical observation instrument is:
An image pickup means for picking up an image of a subject; and a sensor for generating image information representing a state of the subject.
The input means includes
The signal based on the output signal of the image sensor and the signal based on the output signal of the sensor can be input as the first signal and the second signal. The medical image processing apparatus according to any one of 5. The input means uses a signal based on an output signal of an image sensor provided in the medical observation device and a signal based on a signal output from an external device as the first signal and the second signal. The medical image processing apparatus according to claim 1, wherein the medical image processing apparatus is capable of input.

Images