JP7488092B2 - X-ray diagnostic apparatus, medical information processing apparatus, and medical information processing program - Google Patents

Description

The embodiments disclosed in this specification and the drawings relate to an X-ray diagnostic apparatus, a medical information processing apparatus, and a medical information processing program.

When performing catheter treatment, a user may display an X-ray fluoroscopic image based on X-ray imaging by an X-ray diagnostic device in real time and perform the procedure while checking the position of the catheter depicted in the X-ray fluoroscopic image.

In addition, there is a technique for supporting the procedures of users performing catheter treatment, which superimposes on a real-time X-ray fluoroscopy image a mask image (roadmap image) in which blood vessels are stained with a contrast agent, or a white-out version of this image, or a three-dimensional blood vessel image. This type of technology makes it possible to simultaneously check the position of the catheter appearing in the real-time X-ray fluoroscopy image and a mask image showing the direction of blood flow in the same area. This makes it easier for users to grasp the direction in which to advance the catheter even in areas with complex configurations, enabling them to perform accurate catheter manipulation.

However, the task of selecting and registering a mask image is cumbersome for the user. For example, the user is required to manually display multiple previously acquired Digital Subtraction Angiography (DSA) images of the subject in frame-by-frame order, and when the desired DSA image is reached, to finally designate that image as a mask image. Alternatively, the user is required to play back a video of multiple previously acquired DSA images of the subject, to pause the video playback when an image that appears to be the desired DSA image is displayed, and, if it is indeed the desired DSA image, to finally register that image as a mask image.

In actual catheter treatment, it may be necessary to register a mask image multiple times. For example, in coil embolization of an aneurysm, a coil is inserted into the aneurysm using a mask image registered through cumbersome procedures, multiple new DSA images of the subject are obtained to confirm the effect of the insertion, a mask image is registered again through cumbersome procedures, and the coil is inserted into the aneurysm using the registered mask image, and this process is repeated. For this reason, there is a demand for the development of technology that can register mask images easily and accurately.

JP 2016-007508 A

One of the problems that the embodiments disclosed in this specification and the drawings attempt to solve is to identify the image desired by the user based on a frame specification input received from the user during video playback of multiple X-ray images in which contrast blood vessels are depicted. However, the problems that the embodiments disclosed in this specification and the drawings attempt to solve are not limited to the above problem. Problems corresponding to the effects of each configuration shown in the embodiments described below can also be positioned as other problems.

The X-ray diagnostic apparatus according to the embodiment includes a video playback unit, a generation unit, and a registration unit. The video playback unit plays back a plurality of chronologically consecutive X-ray images of a subject in which contrast blood vessels are depicted, at a predetermined frame rate. When the generation unit receives a frame designation input from a user during video playback, it generates a mask image for a roadmap based on the X-ray image of the designated frame that was being played back at the time the frame designation input was received. The registration unit registers the mask image generated by the generation unit in the storage unit.

1 is a block diagram showing an example of the configuration of an X-ray diagnostic system including an X-ray diagnostic apparatus according to an embodiment. 11A and 11B are diagrams for explaining an example of an operation performed when a "mask select" instruction is received from a user during video playback. FIG. 11 is an explanatory diagram showing an example of a method for determining a range of a plurality of frames that are the subject of a mask image generation process. FIG. 13 is an explanatory diagram showing an example of an adjustment acceptance image including a to-be-registered image. A flowchart showing an example of a procedure in which a processing circuit identifies an image desired by a user based on a frame specification input by the user received during video playback of multiple DSA images, and generates and registers a mask image based on the identified image. A flowchart showing an example of a procedure in which a processing circuit identifies an image desired by a user based on a frame specification input by the user received during video playback of multiple DSA images, and registers a shooting angle based on the identified image. A flowchart showing an example of a procedure in which a processing circuit identifies an image desired by a user based on a frame specification input by the user received during video playback of multiple DSA images, and registers the position of the tabletop based on the identified image.

Below, embodiments of an X-ray diagnostic apparatus, a medical information processing apparatus, and a medical information processing program will be described in detail with reference to the drawings.

FIG. 1 is a block diagram showing an example of the configuration of an X-ray diagnostic system 1 including an X-ray diagnostic device 10 according to an embodiment. The X-ray diagnostic device 10 may be any device capable of capturing multiple frames of images in succession, and may include, for example, an X-ray TV device or an X-ray angiography device.

The X-ray diagnostic system 1 includes an X-ray diagnostic device 10 and an image server 102.

The X-ray diagnostic device 10 includes an imaging device 11 that performs X-ray imaging of a subject, and a console device 12 as an example of a medical information processing device.

The imaging device 11 is typically installed in an examination room and configured to generate image data related to the subject. The console device 12, which is an example of a medical information processing device, is installed in an operation room adjacent to the examination room and generates and displays X-ray images based on the image data. The console device 12 may be installed in the examination room where the imaging device 11 is installed, or may be connected to the imaging device 11 via a network 100 and installed in a remote location away from the examination room.

The console device 12 has an input interface 21, a display 22, a memory circuit 23, a network connection circuit 24, and a processing circuit 25.

The input interface 21 is composed of general input devices such as a trackball, switch buttons, a mouse, a keyboard, and a numeric keypad, and outputs operation input signals corresponding to user operations, such as input of a frame designation operation by the user during video playback, to the processing circuit 25. The display 22 is composed of general display output devices such as a liquid crystal display or an OLED (Organic Light Emitting Diode) display.

The memory circuit 23 has a configuration including a processor-readable recording medium, such as a semiconductor memory element such as a RAM (Random Access Memory), a flash memory, a hard disk, an optical disk, etc., and stores the programs used by the processing circuit 25, mask images instructed to be registered, information on auto angles instructed to be registered, information on auto tables instructed to be registered, and other data. Note that some or all of the programs and data in the recording medium of the memory circuit 23 may be downloaded by communication via the network 100, or may be provided to the memory circuit 23 via a portable storage medium such as an optical disk.

The network connection circuit 24 implements various information and communication protocols according to the form of the network 100. The network connection circuit 24 connects to other electrical devices via the network 100 in accordance with these various protocols. The network 100 refers to information and communication networks in general that utilize electrical communication technology, and includes wireless/wired LANs such as hospital backbone LANs (Local Area Networks) and Internet networks, as well as telephone communication line networks, optical fiber communication networks, cable communication networks, and satellite communication networks.

The X-ray diagnostic device 10 is connected to the image server 102 via the network 100 so that data can be transmitted and received between them.

Note that while FIG. 1 shows an example in which the X-ray diagnostic apparatus 10 and the image server 102 are connected via the network 100, they may also be directly connected without using the network 100. Standards used for direct connection may be, for example, wired communication standards such as the ATA (Advanced Technology Attachment) standard, the SCSI (Small Computer System Interface) standard, the LTO (Linear Tape-Open) standard, the USB (Universal Serial Bus) standard, and the IEEE 2394 standard, or wireless communication standards such as infrared communication.

The processing circuitry 25 realizes the function of controlling the X-ray diagnostic apparatus 10. The processing circuitry 25 is also a processor that reads and executes a medical information processing program stored in the memory circuitry 23, thereby executing processing to identify an image desired by the user based on a frame specification input by the user received during video playback of multiple X-ray images in which contrast blood vessels are depicted.

The processing circuitry 25 further reads out and executes the medical information processing program stored in the memory circuitry 23 to identify an image desired by the user based on a frame specification input by the user received during video playback of multiple X-ray images in which contrast blood vessels are depicted, and executes a process of generating and registering a mask image based on the identified image. The processing circuitry 25 may also register the imaging angle of the identified image based on the identified image. The processing circuitry 25 may also register the position of the tabletop at the time of imaging of the image based on the identified image.

In the following embodiment, an example will be described in which a DSA image is used as an X-ray image depicting contrast blood vessels to be played back as a video, and as an X-ray image that is the basis of a mask image for a roadmap. First, an example will be described in which the processing circuitry 25 executes a process of generating and registering a mask image based on a specified image.

As shown in FIG. 1, the processor of the processing circuitry 25 realizes an acquisition function 31, a video playback function 32, a reception function 33, an image generation function 34, an adjustment function 35, a registration function 36, and a reproduction function 37. Each of these functions is stored in the memory circuitry 23 in the form of a program.

The acquisition function 31 acquires multiple X-ray images of the subject that are consecutive in time series, in which contrast blood vessels are depicted. For example, the acquisition function 31 acquires multiple DSA images by generating multiple DSA images based on projection data of the subject before and after administration of a contrast agent, which is imaged by the imaging device 11. If the X-ray diagnostic device 10 is configured to be capable of rotational DSA imaging, the imaging device 11 performs rotational DSA imaging to generate projection data before and after administration of a contrast agent. In rotational DSA imaging, image data (mask image data) before the injection of a contrast agent and image data (contrast image data) after the injection of a contrast agent are generated for the same part of the subject. If rotational DSA imaging is possible, the X-ray diagnostic device 10 can also obtain a three-dimensional blood vessel image (3D blood vessel image) based on the contrast image data and mask image obtained by rotational DSA imaging. The acquisition function 31 may also acquire multiple DSA images that have been generated in advance and stored in the image server 102 via the network 100.

Figure 2 is a diagram illustrating an example of the operation when a "mask select" instruction is received from the user during video playback.

The video playback function 32 plays back multiple chronologically consecutive X-ray images of the subject in which contrast blood vessels are depicted as video. In the example shown in this embodiment, the video playback function 32 plays back multiple chronologically consecutive DSA images of the subject as video (see the upper part of Figure 2). Here, "video playback" refers to automatically displaying DSA images (still images) continuously in chronological order at a predetermined frame rate, and does not include manually displaying DSA images as a video by frame-by-frame using a jog dial or the like. The video playback function 32 is an example of a video playback unit.

The reception function 33 receives frame specification input by the user via the input interface 21 during video playback. During playback of a video displayed in the video display area 41 of the display 22, the user touches and presses a button 42 for receiving frame specification input (the "Mask Select" button in the example shown in FIG. 2) (see the lower part of FIG. 2).

When the image generation function 34 receives a frame specification input from the user during video playback, it identifies the X-ray image of the frame (hereinafter, referred to as the specified frame) that was being played at the time the frame specification input was received. In the example shown in this embodiment, the image generation function 34 identifies a DSA image. In addition, the image generation function 34 generates a mask image for the roadmap based on the identified DSA image.

The image generation function 34 may use the DSA image of the specified frame as the mask image as is. In this case, image generation processing is not required. The image generation function 34 is an example of a generation unit.

The image generation function 34 may also generate a mask image based on a frame that is a certain number of frames before the specified frame, or more simply, the DSA image of the frame that is a certain number of frames before the specified frame may be used as the mask image as is. When the frame rate is high, it is possible that at the timing specified by the user, a DSA image that is several frames before the DSA image desired by the user may already be displayed. Therefore, by replacing the specified frame with the frame that is a certain number of frames before, it is possible to absorb the time difference between the user's visual recognition and the button press, especially when the frame rate is high. It is advisable to empirically determine the number of specified frames in advance according to the frame rate.

The image generating function 34 may also generate a mask image by averaging or tracing a number of frames including a specified frame. The higher the frame rate of video playback, the more advantageous it is to increase the number of frames to be subjected to averaging or tracing. Furthermore, when the frame rate is low, an image that interpolates two frames by averaging two frames can be generated and used as a mask image. Trace processing is a process for extracting blood vessels, and includes bottom trace processing and peak trace processing. Bottom trace processing is a process for extracting blood vessels by picking up the lowest value (the pixel value with the highest contrast agent concentration) in each frame through which the contrast agent flows. Peak trace processing is a process for extracting blood vessels in carbon dioxide angiography.

In addition, when the image generation function 34 receives a frame specification input from the user by pressing and holding a button, it may generate a mask image by averaging or tracing multiple frames that were played during the press and hold. In this case, the user is not forced to specify a pinpoint, and can easily generate a mask image by pressing and holding a rough section.

In addition, the image generation function 34 may not include undesirable images in the mask image generation process described above. Examples of undesirable images include images with different X-ray conditions, images with different imaging angles, and images with sharpness below a threshold (images with large blur).

For example, when performing averaging or tracing of multiple frames, it is advisable to exclude undesirable images from the processing. Also, because the frame rate is high, if you try to use a DSA image of a frame a certain number of frames before the specified frame as a mask image, and that image turns out to be undesirable, you can go back one frame at a time to the previous frame, or go back one frame at a time to the specified frame, and use any desirable images that are found.

An example of an image with significantly different X-ray conditions would be a DSA image based on an image captured immediately after X-ray output begins. Images captured immediately after X-ray output begins may have different brightness because the X-ray output is not stable.

Images with different imaging angles may be included when imaging is performed while the tabletop is moving, for example, when contrast agent is injected into the legs. For example, if the first five frames of 10 frames to be the subject of averaging have the same angle, but the latter five frames have a change in angle as the tabletop position begins to be changed, then the latter five frames may be excluded from the subject of averaging.

Images with sharpness below the threshold value may include images where the subject has moved significantly during imaging, for example. Various methods of measuring sharpness have been known in the past, such as representing the sharpness by the value of the MTF (Modulation Transfer Function) at a specified frequency, and any of these may be used.

Figure 3 is an explanatory diagram showing an example of a method for determining the range of multiple frames that are the subject of the mask image generation process.

As shown in FIG. 3, the image generating function 34 may set the frames that belong to the range of frames before and after the designated frame fi (see black circle in FIG. 3) that are consecutive images with the same X-ray conditions, the same imaging angle, and images with sharpness above a threshold (see white circle in FIG. 3) as the multiple frames to be processed for generating the mask image. In this case, the extension of this range ends when an undesirable image (see X mark in FIG. 3) appears. Therefore, the multiple frames include only desirable images that are consecutive before and after the designated frame fi, and undesirable images can be reliably excluded from the processing target. In general, when a mask image is generated by tracing all frames, there is a high possibility that undesirable images will be included, but according to the range determination method shown in FIG. 3, a mask image with very high image quality can be generated based on frames in a partial range.

In addition, after generating the mask image, the image generation function 34 may display the mask image on the display 22 as the to-be-registered image 51.

Figure 4 is an explanatory diagram showing an example of an adjustment acceptance image 50 including a registration target image 51.

The adjustment function 35 generates an adjustment acceptance image 50 for accepting input of adjustment instructions for the frame on which the mask image is based by a user who has confirmed the registration-to-be-registered image 51 displayed on the display 22, and displays the image on the display 22. Note that the adjustment acceptance image 50 including the registration-to-be-registered image 51 may be displayed on any display, but it is preferable that it be displayed on the same display as the display on which the video display area 41 was displayed. The adjustment function 35 is an example of an adjustment unit.

The user can check the mask image before roadmapping by checking the image 51 to be registered.

Furthermore, if the user wishes to adjust the image to be registered 51, the user can issue an instruction to adjust the frame on which the mask image is based (hereinafter referred to as the frame to be used) via the adjustment acceptance image 50. For example, the frame number on which the image to be registered 51 is based is displayed in the frame to be used display area 54. This display is automatically updated in response to an instruction to adjust the frame to be used. Furthermore, the image generation function 34 regenerates the mask image based on the instruction to adjust the frame to be used, and updates the image to be registered 51.

The user can change the used frame one frame at a time by pressing the frame rewind button 52 and frame forward button 53. For example, when the used frames are three frames fi-1, fi, and fi+1, if the user presses the frame rewind button 52 once, the used frames will change to fi-2, fi-1, and fi, and a mask image regenerated based on the used frames instructed to be adjusted will be displayed in the image to be registered 51. The used frame display area 54 is also updated according to the adjustment instruction for the used frames.

The adjustment acceptance image 50 may also include a user-specified area 55. The user-specified area 55 may include an image for directly accepting the specification of a center frame, for example. The user-specified area 55 may also include an image for accepting the specification of a range of frames that will be the basis of the mask image. The image for accepting the specification of the range of frames may include an image for directly accepting the setting of the number of frames or an instruction to change, or may include an image that allows specification of whether or not to exclude undesirable images by type, as described with reference to FIG. 3.

The adjustment acceptance image 50 may also include a registration button 56 that allows the user to input a confirmation that the image to be registered 51 may be registered as a mask image.

When the registration function 36 identifies the DSA image desired by the user based on the frame specification input received during video playback of multiple DSA images, by performing averaging or peak processing of the DSA image of the specified frame, the image a certain frame before that, multiple frames, excluding undesirable images, etc., the registration function 36 registers information based on the identified DSA image. The registration function 36 is an example of a registration unit.

For example, the registration function 36 registers the mask image generated by the image generation function 34 in the memory circuitry 23. When an adjustment instruction is received via the adjustment reception image 50, the registration function may register in the memory circuitry 23 the image to be registered 51 at the time when the registration button 56 is pressed.

The registration function 36 may also register the imaging angle corresponding to the identified image (for example, included in the additional information of the image) based on the identified image. The registration function 36 may also register the position of the tabletop at the time the image was captured based on the identified image.

The reproduction function 37 calls up the information registered by the registration function 36 and reproduces it. For example, when the information registered by the registration function 36 is a mask image and the fluoroscopy of the subject is started and the roadmap function is called, the reproduction function 37 reads out the mask image registered in the memory circuitry 23 and displays it as a roadmap image superimposed on the X-ray fluoroscopy image of the subject acquired in real time. When the information registered by the registration function 36 is imaging angle information and the auto-angle function is called, the reproduction function 37 reads out the imaging angle information registered in the memory circuitry 23 and automatically moves the imaging system of the imaging device 11 to the position of the imaging angle. When the information registered by the registration function 36 is information on the position of the top plate and the auto-table function is called, the reproduction function 37 reads out the information on the position of the top plate registered in the memory circuitry 23 and automatically moves the top plate to the registered position. The reproduction function 37 is an example of a reproduction unit.

Next, an example of the operation of the X-ray diagnostic apparatus, medical information processing apparatus, and medical information processing program according to this embodiment will be described.

Figure 5 is a flowchart showing an example of a procedure for the processing circuit 25 to identify an image desired by a user based on a frame specification input by the user received during video playback of multiple DSA images, and to generate and register a mask image based on the identified image. In Figure 5, the reference numbers beginning with S indicate each step in the flowchart.

First, in step S1, the acquisition function 31 acquires multiple DSA images of the subject that are successive in time series. Next, in step S2, the video playback function 32 starts video playback of the multiple DSA images of the subject that are successive in time series (see the upper part of Figure 2). Next, in step S3, the reception function 33 receives input of frame designation by the user via the input interface 21 during video playback (see the lower part of Figure 2).

Next, in step S4, when the image generation function 34 receives a frame specification input from the user during video playback, it generates a mask image based on the specified frame that was being played (displayed) at the time the frame specification input was received.

Next, in step S5, the adjustment function 35 displays the adjustment acceptance image 50 on the display and accepts an adjustment instruction for the frame to be used from the user via the adjustment acceptance image 50 (see FIG. 4).

Next, in step S6, the adjustment function 35 determines whether or not a confirmation instruction for the mask image has been received from the user. If a confirmation instruction has not been received, the process returns to step S5. On the other hand, if a confirmation instruction has been received, the process proceeds to step S7.

In step S7, the registration function 36 registers the mask image in the memory circuitry 23. At this time, the registration function 36 may associate the mask image with the subject and register it in the memory circuitry 23.

By following the procedure of steps S1-S7, a mask image can be generated and registered based on frame specification input from the user received during video playback of multiple DSA images.

Then, in step S8, fluoroscopy of the subject is started and the roadmap function is called up. In step S9, the reproduction function 37 reads out the mask image registered in the memory circuitry 23 and displays it as a roadmap image superimposed on the X-ray fluoroscopy image of the subject acquired in real time.

By following the above steps, the image desired by the user can be identified based on the frame specification input received from the user during video playback of multiple DSA images, and a mask image can be generated and registered based on the identified image. In addition, the roadmap function can be used using the registered mask image.

The X-ray diagnostic device 10 according to this embodiment can accept frame designation by the user while playing back a video of multiple DSA images. This allows the user to intuitively and easily designate a desired frame in a short time while playing back the video. Therefore, with the X-ray diagnostic device 10 according to this embodiment, the procedure time can be significantly shortened and the workflow can be improved compared to the conventional method in which the user has to pause the video while closely watching it, and then make fine adjustments by frame-by-frame advance before finally registering the desired frame in the mask image.

Figure 6 is a flow chart showing an example of a procedure for the processing circuit 25 to identify an image desired by a user based on a frame specification input by the user received during video playback of multiple DSA images, and to register an imaging angle based on the identified image. Steps equivalent to those in Figure 5 are given the same reference numerals, and duplicate explanations will be omitted.

In step S3, when the user specifies a frame during video playback (see the lower part of Figure 2), in step S11, the image generation function 34 generates an image for the auto angle based on the specified frame that was being played (displayed) at the time the frame specification input was received.

Next, in step S12, the adjustment function 35 displays the adjustment acceptance image 50 on the display and accepts an adjustment instruction for the frame to be used from the user via the adjustment acceptance image 50 (see FIG. 4). Note that in the example of imaging angle registration shown in FIG. 6, the adjustment acceptance image 50 differs from the examples of mask selection shown in FIGS. 4 and 5 only in that an image for an auto angle is displayed instead of the image to be registered 51, but they are similar in other respects and have in common the point that the frame to be used of the image (corresponding to the desired imaging angle) is adjusted.

Next, in step S13, the registration function 36 registers the imaging angle information corresponding to the image for the auto angle in the memory circuitry 23.

By following the procedure of steps S1-S13 in FIG. 6, imaging angle information can be registered based on the frame specification input received from the user during video playback of multiple DSA images.

When the auto angle function is called in step S14, in step S15, the reproduction function 37 reads out the imaging angle information registered in the memory circuitry 23 and automatically moves the imaging system of the imaging device 11 to the position of that imaging angle.

The above procedure allows the user to specify the image desired by the user based on the frame specification input received during video playback of multiple DSA images, and to register the imaging angle based on the specified image. For example, the user may want to determine the working angle while checking 3D-DSA images or 3D-DA images (including multi-axis rotation images). In this case, when an image with the desired imaging angle is displayed during video playback of 3D images at a specified frame rate, the user can intuitively specify the frame at that timing (for example, by simply pressing the "auto angle" button as in the example shown in Figure 2), and the angle of the image displayed at the time of specification can be registered as the movement destination of the C-arm.

Figure 7 is a flow chart showing an example of a procedure for the processing circuit 25 to identify an image desired by a user based on a frame specification input by the user received during video playback of multiple DSA images, and to register the position of the tabletop based on the identified image. Steps equivalent to those in Figure 5 are given the same reference numerals, and duplicate explanations will be omitted.

In step S3, when the user specifies a frame during video playback (see the lower part of Figure 2), in step S21, the image generation function 34 generates an image for the auto table based on the specified frame that was being played (displayed) at the time the frame specification input was received.

Next, in step S22, the adjustment function 35 displays an adjustment acceptance image 50 on the display and accepts an adjustment instruction for the frame to be used from the user via the adjustment acceptance image 50 (see FIG. 4). Note that the example relating to tabletop position registration shown in FIG. 7 is similar to the example relating to imaging angle registration shown in FIG. 6 in that the adjustment acceptance image 50 displays an image for the auto table instead of the image to be registered 51, but is otherwise similar.

Next, in step S23, the registration function 36 registers the tabletop position information corresponding to the image for the auto table in the memory circuitry 23.

By following the procedure of steps S1-S23 in FIG. 7, tabletop position information can be registered based on the frame specification input received from the user during video playback of multiple DSA images.

Then, when the auto table function is called in step S24, in step S25, the reproduction function 37 reads out the tabletop position information registered in the memory circuitry 23 and automatically moves the tabletop to the registered position.

The above procedure allows the user to specify the image desired by the user based on the frame specification input received during video playback of multiple DSA images, and to register the tabletop position information for the auto table based on the specified image. For example, in the lower limb area, the user may perform DA imaging of the entire leg while moving the bed. When the DA images collected in this way are being played back at a specified frame rate and an image of the desired tabletop position is displayed, the user can intuitively specify the frame at that timing (for example, by simply pressing the "Auto Table" button as in the example shown in Figure 2), and the tabletop position of the image displayed at the time of specification can be registered as the destination.

According to at least one of the embodiments described above, it is possible to identify the image desired by the user based on a frame specification input received from the user during video playback of multiple DSA images.

In the above embodiment, the term "processor" refers to a circuit such as a dedicated or general-purpose CPU (Central Processing Unit), GPU (Graphics Processing Unit), or an Application Specific Integrated Circuit (ASIC), a programmable logic device (for example, a Simple Programmable Logic Device (SPLD), a Complex Programmable Logic Device (CPLD), and a Field Programmable Gate Array (FPGA)). When the processor is a CPU, for example, the processor realizes various functions by reading and executing a program stored in a memory circuit. When the processor is an ASIC, for example, instead of storing a program in a memory circuit, a function corresponding to the program is directly built into the processor circuit as a logic circuit. In this case, the processor realizes various functions by hardware processing that reads and executes the program built into the circuit. Alternatively, the processor can realize various functions by combining software processing and hardware processing.

In addition, in the above embodiment, an example was shown in which a single processor of the processing circuit realizes each function, but a processing circuit may be configured by combining multiple independent processors, and each processor may realize each function. In addition, when multiple processors are provided, a memory circuit for storing programs may be provided separately for each processor, or a single memory circuit may collectively store programs corresponding to the functions of all the processors.

Furthermore, in the above embodiment, an example is described in which a DSA image is used as an X-ray image depicting contrast blood vessels that is the subject of video playback and the source of a mask image for a roadmap, but the embodiment is not limited to this. For example, a contrast X-ray image may be used as the subject of video playback, while a mask image for a roadmap may be generated based on a DSA image created from the contrast X-ray image. In addition, instead of a DSA image, a blood vessel image generated from a contrast X-ray image using a machine learning technique may be used as an X-ray image that is the subject of video playback and/or the source of a mask image for a roadmap. As such a machine learning technique, for example, a convolutional neural network trained with a learning dataset in which the input side is a contrast X-ray image and the output side is a DSA image generated from the contrast X-ray image can be used.

Although several embodiments have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These embodiments can be implemented in various other forms, and various omissions, substitutions, modifications, and combinations of embodiments can be made without departing from the spirit of the invention. These embodiments and their modifications are within the scope of the invention and its equivalents as set forth in the claims, as well as the scope and spirit of the invention.

10 X-ray diagnostic device 12 Console device (medical information processing device)
32 Video playback function 34 Image generation function 35 Adjustment function 36 Registration function 37 Reproduction function 41 Video display area 50 Adjustment acceptance image fi Designated frame

Claims (10)

a video playback unit that plays back a plurality of time-series consecutive X-ray images of a subject in which contrast-enhanced blood vessels are depicted at a predetermined frame rate;
a generation unit that, when receiving a frame designation input from a user during playback of the moving image, generates a mask image for a roadmap based on the X-ray image of the designated frame that was being played back at the time the frame designation input was received;
a registration unit that registers the mask image generated by the generation unit in a storage unit;
Equipped with
The generation unit is
a frame preceding the designated frame by a predetermined number of frames is set as the designated frame, and the mask image is generated based on the designated frame.
X- ray diagnostic equipment. The generation unit is
generating the mask image by averaging or tracing a plurality of frames including the designated frame;
2. The X-ray diagnostic apparatus according to claim 1 . The generation unit is
and when a user inputs a frame designation by pressing and holding a button during playback of the video, the mask image is generated by averaging or tracing a plurality of frames that were played during the pressing and holding of the button.
2. The X-ray diagnostic apparatus according to claim 1 . The generation unit is
Among the plurality of frames, images obtained under different X-ray conditions, images obtained from different imaging angles, and images having a sharpness less than a threshold value are excluded from the targets of the averaging or tracing process.
4. The X-ray diagnostic apparatus according to claim 2 or 3 . The generation unit is
The plurality of frames are defined as frames that belong to a range of frames adjacent to the designated frame, the range including consecutive images having the same X-ray conditions, the same imaging angle, and images having a sharpness equal to or higher than a threshold value.
3. The X-ray diagnostic apparatus according to claim 2 . The generation unit is
Displaying the mask image on a display as an image to be registered;
an adjustment unit that generates an adjustment receiving image for receiving an input of an adjustment instruction for a frame that is a basis of the mask image by the user who has confirmed the to-be-registered image displayed on the display, and displays the adjustment receiving image on the display;
Further equipped with
The generation unit is
regenerating the mask image based on the frame on which the adjusted mask image is based;
6. An X-ray diagnostic apparatus according to claim 1. The adjustment acceptance image is
An image for receiving an input of an instruction to change the number of frames on which the mask image is based,
7. The X-ray diagnostic apparatus according to claim 6 . a reproduction unit that reads out the mask image registered in the storage unit, and displays it as a roadmap image superimposed on an X-ray fluoroscopic image of the subject acquired in real time;
Further equipped with
8. An X-ray diagnostic apparatus according to claim 1. a video playback unit that plays back a plurality of time-series consecutive X-ray images of a subject in which contrast-enhanced blood vessels are depicted at a predetermined frame rate;
a generation unit that, when receiving a frame designation input from a user during playback of the moving image, generates a mask image for a roadmap based on the X-ray image of the designated frame that was being played back at the time the frame designation input was received;
a registration unit that registers the mask image generated by the generation unit in a storage unit;
Equipped with
The generation unit is
a frame preceding the designated frame by a predetermined number of frames is set as the designated frame, and the mask image is generated based on the designated frame.
Medical information processing equipment. a step of playing back, on a computer, a plurality of time-series successive X-ray images of the subject in which the contrast-enhanced blood vessels are depicted, as moving images at a predetermined frame rate;
receiving a frame designation input from a user during playback of the moving image;
generating a mask image for a roadmap based on the X-ray image of the designated frame being reproduced at the time when the input of the frame designation is received;
A step of registering the generated mask image in a storage unit;
A medical information processing program for executing
The step of generating a mask image for the roadmap includes:
a step of setting a frame that is a predetermined number of frames before the designated frame as the designated frame, and generating the mask image based on the designated frame,
Medical information processing program .

Images