JP4634731B2 - Portable medical image display device - Google Patents

Description

  The present invention relates to a portable medical image display apparatus.

Currently, there is a movement to use a highly portable PDA (Personal Digital Assistant) specialized for displaying medical images. When a medical image is displayed on a PDA, the thumbnail is always displayed on the right side regardless of the type and shape of the image. The thumbnail display position cannot be changed. Then, drag and drop the image you want to display from the thumbnail area to the display area to enlarge it. When a doctor uses a display interface with a small display such as a PDA when observing images, it is important to make effective use of the screen, display medical images as large as possible, and be easy to handle. As a result, the display area of the PDA cannot be effectively used. For example, for an axial image, the display is used in landscape orientation, but since the thumbnail is displayed on the right side, the image is reduced when displayed as a whole, and cannot be displayed when displayed as a large image. Since thumbnails are displayed at the same position, images cannot be displayed efficiently.
JP 2002-215810 A JP 2003-099541 A

  An object of the present invention is to display a medical image as large and efficiently as possible in a portable medical image display device.

A portable medical image display device according to the present invention includes a storage unit that stores data relating to a plurality of medical images and a plurality of thumbnail data respectively corresponding to the plurality of medical images, and an aspect ratio or image of the medical images. Based on the type, an arrangement direction determining unit that determines the arrangement direction of the thumbnails as either vertical or horizontal, a plurality of thumbnails arranged according to the determined arrangement direction, and a selection from among the plurality of thumbnails look including a medical image corresponding to the thumbnail in the state list, and still image display, moving image display, and the display screen data generating unit for generating data of a display screen that allows select four transition states of notes, the And a display unit for displaying the generated display screen.

  According to the present invention, a medical image can be displayed as large as possible in a portable medical image display device.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. The portable medical image display device includes a PDA (Personal Digital Assistant), an X-ray computed tomography apparatus (CT scanner), a magnetic resonance imaging apparatus (MRI), an ultrasonic diagnostic apparatus (US), an X-ray diagnostic apparatus ( Defined as a device specializing in the display of medical images generated by medical image inspection devices such as computed radiography systems (CR), digital radiography devices (DR), and X-ray angiography devices (XA)) Is done. Here, it is called a PDA viewer (Personal Digital Assistant Viewer).

  As shown in FIG. 1, the PDA viewers 1, 2, and 3 according to this embodiment are typically connected to a LAN (Local Area Network) 6 in a hospital in a wired or wireless manner. However, the present invention is not limited to this, and the other PDA viewer 4 according to the present embodiment is directly connected to the public network 12 typified by the public telephone exchange network, and yet another PDA according to the present embodiment. The viewer 5 can be connected to a LAN 13 outside the hospital. A medical image inspection apparatus, an image storage server 10, and an access router 10 for connecting the LAN 6 to the public network 12 are connected to the in-hospital LAN 6 together with the PDA viewers 1, 2, and 3. Similarly, the LAN 13 outside the hospital is connected to the public network 12 via the access router 11. The medical image inspection apparatus includes an X-ray computed tomography apparatus (CT) 7, a magnetic resonance imaging apparatus (MR) 8, a digital radiography apparatus (DR) 9, and the like. The image storage server 10 stores a plurality of medical image data files generated by the medical image inspection apparatus together with the accompanying information, and provides the medical image data files together with the accompanying information in response to requests from the PDA viewers 1 to 5. . The incidental information includes the examination date and time, the type code of the medical image examination apparatus, patient information, image information, and the like. The image information includes the matrix size (number of horizontal pixels × number of vertical pixels) or aspect ratio of the image. The image storage server 10 mainly stores medical image data files together with supplementary information, but also stores examination-related information, order information, report information, and the like.

  FIG. 2 shows the configuration of each of the PDA viewers 1 to 5. Each of the PDA viewers 1 to 5 is centered on the information processing unit 14, and includes a display setting condition memory 15, a PDA specific information memory 16, an image data memory 17, a list data memo data memory 18, a communication device 19, a display 20 such as a liquid crystal display, The touch panel 21 is configured. The display setting condition memory 15 stores display setting conditions given in advance or updated from the outside via the communication device 19. The display setting condition will be described in detail later, but the image is displayed as large as possible on the display screen of the display 20 having a resolution of approximately 312 × 416 (horizontal × vertical) pixels or less, in other words, with as little margin as possible. Therefore, mainly based on the aspect ratio (or image type) of the image and the aspect ratio of the medical image display area of the display 20, the arrangement direction of the thumbnails (the thumbnails are displayed vertically / displayed horizontally) Display rule) and rule information necessary for determining the PDA placement direction (vertical placement, horizontal placement). The PDA specific information memory 16 stores PDA specific information. The PDA specific information includes the matrix size of the entire display screen of the display 20 (the number of horizontal pixels × the number of vertical pixels), its aspect ratio, and the matrix size of the medical image display area that occupies most of the display screen (the number of horizontal pixels × the vertical pixels). Number), its aspect ratio, etc.

  The image data memory 17 stores a plurality of medical image data files to be displayed provided from the image storage server 10 together with the accompanying information. Further, the image data memory 17 stores a plurality of thumbnail data files (image samples reduced so that the pattern of the medical image can be seen at a glance) respectively corresponding to the plurality of stored medical image data files. The list data memo data memory 18 stores the examination list or memo data provided from the image storage server 10. The information processing unit 14 has a PDA overall control central function, a function for creating a thumbnail of a medical image, and an arrangement ratio of the thumbnail and a PDA arrangement direction (portrait and landscape) in light of the display setting condition of the aspect ratio of the medical image A direction according to the determined PDA arrangement direction from a plurality of thumbnails arranged according to the decided arrangement direction and a medical image corresponding to a thumbnail in a selected state among the plurality of thumbnails It has a function to generate screen data.

  FIG. 3 shows a typical flow of a medical image display operation by each of the PDA viewers 1 to 5. For convenience of explanation, the PDA viewer 1 will be described as an example. First, when the PDA viewer 1 is connected to the communication network 6, 12 or 13 via a LAN connector or the like, the information processing unit 14 performs processing necessary for logging in to the communication network 6, 12 or 13 (S1). ). After logging in, the information processing unit 14 checks whether or not the PDA viewer 1 is in an environment where it can be connected to the image storage server 10 (S2). When the PDA viewer 1 is not in an environment in which the PDA viewer 1 can be connected to the image storage server 10, the information processing unit 14 displays an examination list related to medical image data files already stored in the image data memory 17 on the display 20 (S 3). When the PDA viewer 1 is in an environment where it can be connected to the image storage server 10, the information processing unit 14 transmits a request for providing unread inspection list information and an unread message sent from the image storage server 10 in response thereto. The shadow inspection list information is received and stored in the memory 18 (S4). The information processing unit 14 displays the sent examination list on the display 20 (S5). A display example of the examination list is shown in FIG. A desired inspection is selected from the inspection list via the touch panel 21. A plurality of medical image data files generated in the selected examination are set as display targets. The information processing unit 14 transmits a request for providing an image data file generated in the selected examination to the image storage server 10 and attaches an unread image data file sent from the image storage server 10 in response thereto. It is received together with the information and stored in the image data memory 17.

  Next, the information processing unit 14 reads display setting conditions from the memory 15 (S6). Note that the latest display setting conditions may be sent from the image storage server 10 (S7). The display setting condition determines whether a medical image set as a display target is displayed in any one of the display patterns of FIG. 5A, FIG. 5B, FIG. 5C, and FIG. It is a rule for. FIG. 5A shows a pattern in which the PDA viewer 1 is placed vertically and thumbnails are arranged in the horizontal direction. FIG. 5B shows a pattern in which the PDA viewer 1 is placed vertically and thumbnails are arranged in the vertical direction. FIG. 5C shows a pattern in which the PDA viewer 1 is placed horizontally and thumbnails are arranged in the vertical direction. FIG. 5D shows a pattern in which the PDA viewer 1 is placed horizontally and thumbnails are arranged in the horizontal direction. In these four patterns, the aspect ratios of the main image display areas for displaying medical images are all different. The aspect ratio is defined by the number of vertical pixels / number of horizontal pixels. The pattern of FIG. 5B is suitable for displaying an image having the largest aspect ratio, that is, a very long image, and subsequently, the pattern of FIG. 5C has the second largest aspect ratio, that is, Suitable for displaying a slightly longer image. The pattern of FIG. 5 (d) is suitable for displaying an image having the smallest aspect ratio, that is, a very wide image, and subsequently, the pattern of FIG. 5 (a) has the second smallest aspect ratio, that is, It is suitable for displaying a slightly long image.

  Among these four display patterns, the signal processing unit 14 is the most suitable pattern for displaying the medical image to be displayed, that is, the number of vertical pixels or the horizontal width of the medical image while maintaining the original aspect ratio. When the enlargement / reduction processing is applied so that the number of pixels matches the number of vertical pixels or horizontal pixels in each main image display area, a pattern in which the margin portion generated in the horizontal direction or the vertical direction becomes the narrowest is displayed according to the display setting condition. Select (S8).

  Each of FIGS. 6 to 9 shows a difference in margin size for each pattern when the medical image is enlarged / reduced while maintaining the original aspect ratio. In other words, the pattern having the narrowest margin corresponds to a pattern that can display a medical image as large as possible. Usually, the aspect ratio of the generated medical image is almost determined by the medical image inspection apparatus. Therefore, as shown in S9 to S12, which display pattern is optimal can be determined in advance according to the image type that distinguishes the medical image inspection apparatus that is the generation source. In this case, the display setting condition is given as a correspondence table between image types and display patterns.

  The aspect ratio of the main image display area of the PDA viewer 1 is fixed for each display pattern. Therefore, it is possible to determine in advance which display pattern is optimal based on the aspect ratio of the medical image to be displayed. In this case, the display setting condition is given as a correspondence table between the aspect ratio of the medical image and the display pattern. Of course, in addition to determining the display setting conditions in advance, when the medical image to be displayed is determined, the medical image is subjected to enlargement / reduction processing to calculate the area of the margin for each display pattern, and the pattern with the narrowest margin is selected. The processing to be selected may be performed by the signal processing unit 14.

  A plurality of medical images generated in the same examination are typically generated with the same aspect ratio. Accordingly, the selection of the pattern is determined according to an arbitrary one of the plurality of medical image data files to be displayed, for example, the aspect ratio of the medical image of the first medical image data file. In addition, when the aspect ratio is not constant among multiple medical images generated in the same examination, select the display pattern with the most frequent aspect ratio or select the optimal display pattern for each medical image individually. You may make it do. However, even in that case, if the way of placing (holding) the PDA viewer 1 is frequently switched between portrait and landscape, it is very troublesome and difficult to see, so the portrait / landscape placement of the PDA viewer 1 is fixed, It is preferable to switch only the arrangement direction of the thumbnails.

  When the optimal display pattern is determined, the signal processing unit 14 creates a plurality of corresponding thumbnails from the plurality of medical images to be displayed stored in the memory 17, and vertically displays the plurality of thumbnails according to the selected display pattern. Alternatively, the medical images are arranged in the horizontal direction, and the medical image is enlarged or reduced in accordance with the number of vertical or horizontal pixels in the main image display area of the selected display pattern (S13). Then, the signal processing unit 14 creates a display screen including a plurality of thumbnails arranged in the vertical or horizontal direction and the medical image subjected to the enlargement / reduction processing, and displays the display screen as illustrated in FIGS. 10 and 11 ( S14). Initially, the first medical image generated in the examination is displayed in the main image display area, but thereafter, the medical image corresponding to the selected thumbnail among the plurality of thumbnails is displayed in the main image display area. Is displayed.

  As described above, a PDA viewer with a vertical or horizontal orientation is selected according to the aspect ratio or image type of a medical image, and the arrangement direction of thumbnails is selected with the vertical / horizontal direction, so that a PDA with a limited display range can be obtained. A medical image can be displayed as large as possible in the viewer. In the above description, the display of the medical image is mainly described. However, as shown in FIG. 12, it can be similarly applied to the display of a memo or an electronic medical record.

  As an actual operation, when an arbitrary thumbnail of a plurality of thumbnails is dragged and dropped from the thumbnail row to the main image display area of the medical image, the information processing unit 14 selects the medical image corresponding to the arbitrary thumbnail as the main image. The thumbnail array is scrolled back and forth so that it is displayed in the image display area and the thumbnail of the image is displayed at the center of the thumbnail array. If the image is an axial image by using image type (modality), image contour extraction, etc., the thumbnail is displayed above or below. For coronal images, thumbnails are displayed on the right or left. Depending on the type of image, the thumbnail is displayed at the optimum position. Further, it is preferable that the previous image can be displayed by dragging and dropping the image displayed in the display portion onto the thumbnail portion. Further, it is preferable that the thumbnail is displayed so that when the image displayed on the display portion is dragged and dropped onto the thumbnail portion, the image is positioned in the middle of the thumbnail. If the display frame of an image displayed as a thumbnail is left pointed, the image is displayed on the display unit so that the image is turned vertically. Alternatively, if you drag from the bottom to the top and point, the page will turn in the depth direction. Conversely, if you drag from the top to the bottom and point, the page will automatically turn to the front. All four transition states (list, still image display, moving image display, memo) necessary for handling medical images are displayed, and the state can be changed at any time by pressing the button. When a mark or the like is written on a part of the medical image, the thumbnail display unit displays the memo so that the memo can be automatically entered. For a person operating with the right hand, a right-handed (especially right thumb) functional arrangement is created for thumbnails and transition state sequences, and conversely when operating with the left hand (especially the left thumb), the arrangement is reversed. In other words, it operates with one hand. When two images are simultaneously displayed in the PDA display area at the maximum, the two images are arranged in a horizontal display, a vertical display, etc. so that the two images can be displayed on the PDA display screen at the maximum.

  In addition, the present invention is not limited to the above-described embodiment as it is, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage. In addition, various inventions can be formed by appropriately combining a plurality of constituent elements disclosed in the embodiment. For example, some components may be deleted from all the components shown in the embodiment. Furthermore, constituent elements over different embodiments may be appropriately combined.

The figure which shows the positioning of PDA viewer (portable medical image display apparatus) which concerns on embodiment of this invention. The figure which shows the structure of the PDA viewer which concerns on this embodiment. 6 is a flowchart showing the operation of the PDA viewer according to the present embodiment. The figure which shows the example of a list screen of S3 of FIG. The figure which shows four types of display patterns by this embodiment. The figure which shows the advantage of the display pattern selection by this embodiment. The figure which shows the advantage of the display pattern selection by this embodiment. The figure which shows the advantage of the display pattern selection by this embodiment. The figure which shows the advantage of the display pattern selection by this embodiment. The halftone image which shows the example of an actual display by this embodiment. The figure which shows the example of an actual display by this embodiment. The figure which shows the example of a display other than the image by this embodiment.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1-5 ... PDA viewer (Personal Digital Assistant Viewer), 6, 13 ... LAN, 7 ... X-ray computed tomography apparatus (CT scanner), 8 ... Magnetic resonance imaging apparatus (MR), 9 ... Digital radiography apparatus (DR) ) 10, 11 ... access router, 12 ... public network.

Claims (12)

A storage unit for storing data relating to a plurality of medical images and a plurality of thumbnail data respectively corresponding to the plurality of medical images;
An arrangement direction determining unit that determines the arrangement direction of the thumbnails as either vertical or horizontal based on an aspect ratio or an image type of the medical image;
A plurality of thumbnails arranged in accordance with the determined sequence direction, the saw plurality of containing a medical image corresponding to the thumbnail in the selected state in the thumbnail list, the still image display, moving image display, and notes 4 A display screen data generation unit that generates display screen data that enables selection of one transition state ;
A portable medical image display device, comprising: a display unit configured to display the generated display screen. The period when the thumbnail display frame is dragged from bottom to top and pointed as it is, the medical image is turned in the depth direction, and the thumbnail display frame is dragged from top to bottom and pointed as it is , the medical image is a portable medical image display apparatus according to claim 1, characterized in that displayed as turned toward the body. The arrangement direction determination unit, together with the aspect ratio of the medical image, based on the aspect ratio of the display area of the medical image of the display unit, according to claim 1 or 2, characterized in that to determine the direction of arrangement of the thumbnail The portable medical image display device described. The arrangement direction determining unit determines the arrangement direction of the thumbnails so that a margin is reduced when the medical image is arranged in a display area of the display unit while maintaining an aspect ratio. Or the portable medical image display apparatus of 2 description. The arrangement direction determining unit determines whether the portable medical image display device is placed vertically or horizontally along with the arrangement direction of the thumbnails based on an aspect ratio or an image type of the medical image. 3. The portable medical image display device according to 1 or 2 . The portable type according to claim 5, wherein the arrangement direction determination unit fixes the vertical / horizontal placement of the determined portable medical image display device during a period in which the plurality of medical images are to be displayed. Medical image display device. The arrangement direction determining unit, a portable medical image display apparatus according to claim 1 or 2, wherein the fixing the array direction of the thumbnail for the plurality of medical images. The arrangement direction determining unit, a portable medical image display apparatus according to claim 1 or 2, wherein the determining the direction of arrangement of the thumbnail for each of the medical image. The arrangement direction determining unit determines that the arrangement direction of the thumbnails is horizontal when the medical image is an image of a type generated by an X-ray computed tomography apparatus, a magnetic resonance imaging apparatus, or an ultrasonic diagnostic apparatus. The portable medical image display device according to claim 1 or 2, characterized in that 3. The portable device according to claim 1, wherein the arrangement direction determination unit determines the arrangement direction of the thumbnails to be vertical when the medical image is an image of a type generated by an X-ray diagnostic apparatus. Type medical image display device. Wherein the display unit, the portable medical image display apparatus according to claim 1 or 2, wherein the having the following resolutions substantially 312 × 416 pixels. The medical image corresponding to the arbitrary thumbnail is displayed in the display area when an arbitrary thumbnail of the plurality of thumbnails is dragged and dropped into the display area of the medical image. Or the portable medical image display apparatus of 2 description.

Images