JP2021069698A - Radiographic apparatus, radiographic system, radiographic method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To improve the reproducibility of positioning at the time of photographing while considering the privacy of a patient. SOLUTION: The radiography apparatus according to the present invention has a first acquisition means for acquiring a radiographic image based on the radiation applied to a subject, and a first acquisition means by optically photographing the subject. A second acquisition means for acquiring an optical image of the above, and a first generation means for generating a first processed image by masking at least a part of a region of the subject in the first optical image. As a second generation means for generating a second processed image by masking at least a part of a region of the subject in the second optical image taken before the first optical image. The first optical image, the first processed image, and the display control means for displaying the second processed image on the display unit so as to be superimposed are provided. [Selection diagram] Fig. 6

Description

The present invention relates to a radiographic apparatus, a radiological imaging system, a radiological imaging method and a program.

Conventionally, in imaging using a radiography system in the medical field, the imaging site may be imaged in the same posture as in the past due to re-examination of follow-up observation or the like. In such a case, a user such as a doctor must determine whether or not the posture is the same from images taken in the past, and there is a problem that it takes time to position the posture of the patient.

In recent years, there are those having the following configurations for the above problems.

In Patent Document 1, an optical camera is attached to a radiation generator, and an optical image taken by the optical camera when the radiation generator generates radiation is stored together with a radiation image and a patient's imaging condition. Then, a technique of generating a guide image from an optical image and superimposing the guide image on an optical moving image displayed on a display device of an imaging system at the time of subsequent imaging of the same patient is disclosed.

Further, in Patent Document 2, in consideration of the problem of patient privacy, an index image obtained by extracting only the outline of the patient from the camera image is stored, and the camera image and the index are displayed on the screen of the imaging system when the same patient is photographed thereafter. A technique for displaying a composite image obtained by synthesizing an image is disclosed.

JP-A-2014-117368 JP-A-2019-33830

However, when the image obtained by extracting only the contour information of the patient is used for positioning from the viewpoint of privacy, the information of the optical image of the patient is lost, so that the reproducibility of the positioning of the patient's posture may not be improved. It was.

The disclosure of the present specification has been made in view of the above problems, and one of the purposes is to improve the reproducibility of positioning at the time of imaging while considering the privacy of the patient.

It should be noted that the disclosure of the present specification is not limited to the above-mentioned purpose, and is an action and effect derived by each configuration shown in the embodiment for carrying out the invention described later, and exerts an action and effect that cannot be obtained by the conventional technique. It can be positioned as one of the other purposes.

The radiography apparatus according to the present invention has a first acquisition means for acquiring a radiographic image based on the radiation applied to the subject, and a first optical image by optically photographing the subject. A second acquisition means for acquisition, a first generation means for generating a first processed image by masking at least a part of a region of the subject in the first optical image, and the first generation means. A second generation means for generating a second processed image by masking at least a part of a region of the subject in the second optical image taken in the past of the optical image of the above, and the first generation means. The optical image, the first processed image, and the second processed image are displayed on the display unit so as to be superimposed.

According to the present invention, the reproducibility of positioning at the time of imaging can be improved while giving consideration to the privacy of the patient.

The figure which shows an example of the system structure of the medical image system which concerns on Embodiment 1. The figure which shows an example of the hardware composition of the radiography control apparatus which concerns on Embodiment 1. The figure which shows an example of the structure of the radiography control apparatus which concerns on Embodiment 1. The figure which shows an example of the masking setting screen composition of the radiography control apparatus which concerns on Embodiment 1. The figure which shows an example of the guide image composition generated according to the masking setting of the radiography control apparatus which concerns on Embodiment 1. A flowchart showing an example of a processing procedure of the radiography control device according to the first embodiment. The figure which shows an example of the display structure of the image display means at the time of patient imaging of the radiography control device which concerns on Embodiment 1. The figure which shows an example of the patient information composition of the storage part which concerns on Embodiment 1. The figure which shows an example of the display configuration of the image display means at the time of photographing the patient who performed the examination in the same posture in the past of the radiography control apparatus which concerns on Embodiment 1. The figure which shows an example of the structure of the radiography control apparatus which concerns on Embodiment 2. A flowchart showing an example of a processing procedure of the radiography control device according to the second embodiment. The figure which shows an example of the display configuration of the image display means at the time of photographing the patient who performed the examination in the same posture in the past of the radiography control apparatus which concerns on Embodiment 2. The figure which shows an example of the structure of the radiography control apparatus of the medical image system which concerns on Embodiment 3. A flowchart showing an example of a processing procedure of the radiography control device according to the third embodiment.

Hereinafter, preferred embodiments of the radiography system disclosed herein will be described in detail with reference to the accompanying drawings. However, the components described in this embodiment are merely examples, and the technical scope of the radiography system disclosed in the present specification is determined by the claims, and the following individual embodiments are made. It is not limited by the form. Further, the disclosure of the present specification is not limited to the following embodiments, and various modifications (including organic combinations of each embodiment) are possible based on the purpose of the disclosure of the present specification. It is not excluded from the scope of disclosure herein. That is, all the configurations in which each of the examples described later and the modified examples thereof are combined are also included in the embodiments disclosed in the present specification.

Here, first, the terms used in the present embodiment are defined.

Privacy masking and masking refer to a function of blocking or masking a specific part to hide the part when displaying an image or recording a video. More specifically, for example, a process of rewriting the pixel value of a pixel in the target area to a pixel value corresponding to black or white is performed.

Further, in the following, an image taken by a radiation photographing apparatus will be referred to as a "radiation image", and an image optically taken by an optical camera or the like will be referred to as an "optical image". Further, the "optical image" includes a moving image taken optically.

[Embodiment 1]
The radiography system according to the present embodiment is a radiography system that displays an optical image of a patient on a display device and enables positioning during radiography while looking at the optical image, and considers the privacy of the patient at the time of examination. However, the purpose is to improve the positioning accuracy.

More specifically, while displaying an image (first processed image) obtained by masking an optical image (first optical image) of a patient to be examined, the image is displayed in the past. The past guide image (second processed image) generated based on the image (second optical image) taken in the same posture is superimposed and displayed. The past guide image is also masked so that the information of the optical image is not lost, and the inspector performs positioning based on the masked past guide image.

The system configuration of this embodiment will be described with reference to FIGS. 1 to 3.

FIG. 1 is a configuration example of the entire radiography system of the present embodiment. This system is composed of a radiography control device 100, a radiography imaging device 110, a radiation generator 120, and an image acquisition device 130 via a network 140. The network 140 may be a wired network or a wireless network.

The radiography control device 100 is a device composed of an information processing device such as a computer that communicates with the radiography imaging device 110 and controls radiography. Further, the radiography control device 100 communicates with the radiation generator 120 and acquires information when radiation is irradiated from the radiation generator 120. Further, the radiography control device 100 communicates with the image acquisition device 130 to control the image acquisition device 130 and acquire the image captured by the image acquisition device 130.

The radiography imaging device 110 transitions to a state in which imaging is possible according to an instruction from the radiography imaging control device 100. Then, it is a device that performs radiation imaging under predetermined imaging conditions set by the user while synchronizing with the radiation generator 120, and generates an image based on the radiation emitted from the radiation generator 120. That is, the radiographic apparatus 110 corresponds to an example of a first acquisition means for acquiring a radiographic image based on the radiation applied to the subject under predetermined imaging conditions.

The number of radiographic imaging devices 110 is not limited to one, and a plurality of radiographic imaging devices may be used.

The radiation generator 120 detects the radiation irradiation instruction by the exposure switch 121 and generates radiation from the tube 122 based on the irradiation information set by the user input device (not shown) that accepts the user operation such as the operation panel. It is a device to make it.

The image acquisition device 130 is a device that acquires an image by taking an image according to an instruction from the radiography control device 100. In the present embodiment, an optical camera is used in the image acquisition device 130 to acquire an optical image. That is, the image acquisition device 130 corresponds to an example of a second acquisition means for acquiring a first optical image by optically photographing a subject. There is no limitation on the configuration of the image acquisition device 130 as long as the captured image information can be acquired. Further, in the present embodiment, the image acquisition device 130 is attached to the tube 122 to take an image of the radiation generation direction of the tube 122.

FIG. 2 is a hardware configuration example of the radiography control device 100 of the radiography imaging system of the present embodiment.

The radiography control device 100 includes a network device 201 connected to the network 140, a user input device 202 that accepts user operations such as a keyboard, and the like.

Further, the radiography control device 100 includes an operation screen such as a liquid crystal display, a UI display device 203 for displaying a radiographic image, and a CPU 204 for controlling the entire device.

Further, the radiography control device 100 is a storage device 206 that stores the RAM 205 that provides the workspace of the CPU 204, various control programs, the radiographic image received from the radiography camera 110, and the image information received from the image acquisition device 130. Has.

Here, each device constituting the radiography control device 100 is connected by the main bus 207, and data can be transmitted and received to and from each other.

Although the user input device 202 and the UI display device 203 are described as separate devices, an operation unit in which these devices are integrated may be used.

FIG. 3 is a configuration example of the radiography control device 100 of the radiography imaging system of the present embodiment.

Each functional unit shown in FIG. 3 is realized by the CPU 204 on the radiography control device 100 reading the control program stored in the storage device 206 onto the RAM 205 and executing the control program.

The radiography control device 100 includes a communication unit 301, a system control unit 302, an image processing unit 303, a display control unit 304, a storage unit 305, an identification unit 306, a generation unit 307, a setting unit 308, and a determination unit 309.

The communication unit 301 is software that controls the network device 201 to perform communication.

The system control unit 302 controls the image acquisition device 130, acquires irradiation information of the radiation generator 120 and imaging information of the radiation imaging device 110, and manages the respective states via the communication unit 301. Further, the system control unit 302 acquires a radiographic image from the radiographic imaging device 110 and an optical image from the image acquisition device 130 via the communication unit 301. Further, the system control unit 302 is a program that realizes the basic functions of the radiography control device 100, and controls the operation of each unit.

The image processing unit 303 processes the radiographic image acquired via the system control unit 302 to generate an image to be used on the radiography control device 100.

The display control unit 304 displays the image generated by the image processing unit 303 via the UI display device 203. Further, the display control unit 304 displays the optical image acquired by the image acquisition device 130 via the UI display device 203. Further, the display control unit 304 displays the guide image generated by the generation unit 307 via the UI display device 203. Further, the display control unit 304 displays the past guide image generated from the images taken in the same posture in the past via the UI display device 203. That is, the display control unit 304 masks the first optical image obtained by optically photographing the subject and at least a part of the region of the subject in the first optical image. The processed image and the second processed image obtained by masking at least a part of the area of the subject in the second optical image taken earlier than the first optical image are displayed on the display so as to be superimposed. Corresponds to an example of display control means. Since it is sufficient that the image displayed on the display unit is masked, at least one of the first processed image and the second processed image may be displayed on the display unit. .. Further, the superimposed display indicates, for example, a state in which the human body region in the guide image and the human body region in the past guide image are displayed so as to be superimposed, and the human body region in the guide image and the human body region in the past guide image are completely overlapped. Includes inconsistent states.

Further, the display control unit 304 reflects the processing on the image instructed by the system control unit 302 based on the operation from the user input device 202, performs the processing of switching the screen display of the UI display device 203, and the like.

The storage unit 305 uses the radiation image generated by the image processing unit 303, the patient's imaging conditions (patient ID, examination site, imaging direction, etc.) related to the radiation image, and the irradiation information (tube voltage and tube) of the radiation generator 120. Save current etc.). In addition, the storage unit 305 also stores the guide image generated by the generation unit 307 related to the radiographic image.

The identification unit 306 identifies the human body region in the optical image obtained from the image acquisition device 130. Alternatively, it identifies which part (chest, abdomen, arm, etc.) the human body region captured in the optical image is. That is, the identification unit 306 corresponds to an example of the identification means for identifying the human body region of the subject from the first optical image. Further, the identification unit 306 corresponds to an example of the identification means for further identifying the identified human body region into at least two or more parts.

In the present embodiment, in the subsequent mask processing, the range to be masked can be changed, so that the identification unit 306 identifies the human body region for each part. For example, if it is set only whether or not to apply the mask treatment to the whole body, the identification unit 306 may simply be able to distinguish between the human body region and the non-human body region from the optical image. That is, the fineness of the human body region identified by the identification unit 306 may be arbitrarily determined by the user by the design of the mask processing in the subsequent stage.

The identification method may be, for example, a rule-based table or a trained model that has undergone machine learning. Here, the trained model is a machine learning model that follows a machine learning algorithm such as deep learning using a support vector machine or a neural network, and is trained using appropriate learning data in advance. The machine learning model is shown. The trained model is not limited to the one that does not perform further learning, and additional learning can be performed.

The training data is composed of one or more pairs of input data and output data (correct answer data). The trained model according to the present embodiment learns output data (data for identifying a human body region) for input data (data related to a plurality of feature quantities detected from a human body image) as training data according to an arbitrary learning algorithm. There is.

For example, the identification unit 306 holds a table that holds a relationship between a feature amount such as a pixel value, a coordinate value, a region size or a region shape in an optical image, and a part of a human body region in the optical image. Is used to identify the human body region in an optical image.

Alternatively, the identification unit 306 has learned the relationship between a feature amount such as a pixel value, a coordinate value, a region size or a region shape in an optical image, and which part of the human body is indicated by the feature amount. Models are used to identify human body regions in optical images.

Alternatively, the identification unit 306 learns an optical image of a human body as input data, and an image in which the pixels constituting the optical image are classified into any class of a class group including at least two or more classes as output data. The trained model is used to identify the human body region. The classification result may output which of the class groups each pixel belongs to, or may output the likelihood of each class of the class group. The class constituting the class group includes, for example, a class indicating that it is a human body region and a class indicating that it is not a human body region. Alternatively, it includes a class indicating that it is a head, a class indicating that it is a body part, or a class indicating that it is an arm part.

The combination of information held as a table and the input data to be input when the trained model is generated are not limited to the above.

Further, when the photographed human body region is identified for each part, the table and the trained model may be different for each part of the human body to be identified, and one table and the trained model may be different for each part. May be identified.

Further, the identification unit 306 generates masking information of the human body region and masking additional information of the human body region based on the setting of the setting unit 308 described later. The masking information of the human body region represents the information of the masking of the human body region performed based on the setting of the setting unit 308. Further, the masking additional information of the human body region represents information for adding the part information of the human body region lost by the masking information of the human body region performed based on the setting of the setting unit 308 by another means. Details will be described in the configuration diagram of the masking setting screen of the setting unit 308.

The generation unit 307 generates a guide image obtained by masking the optical image obtained from the image acquisition device 130 based on the masking information of the human body region generated by the identification unit 306 and the masking additional information of the human body region. That is, the generation unit 307 corresponds to an example of the first generation means for generating the first processed image by masking at least a part of the region of the subject in the first optical image. After that, the generation unit 307 instructs the display control unit 304 to display the guide image on the screen. Further, when the determination unit 309 determines that the patient has taken the same posture in the past, the generation unit 307 acquires the information of the past guide image of the patient stored in the storage unit 305 and generates the past guide image. After that, the generation unit 307 instructs the display control unit 304 to display the screen of the guide image on which the past guide image is superimposed.

The setting unit 308 sets a method of generating masking information of the human body region and masking additional information of the human body region generated by the identification unit 306.

The determination unit 309 determines whether or not there is information that matches the past patient imaging conditions of the storage unit 305 based on the imaging conditions input in advance to the radiography control device 100 by the user. For example, it is determined whether or not there is an optical image obtained based on a predetermined shooting condition among the optical images taken in the past than the optical image taken by the image acquisition device 130. In the present embodiment, the determination unit 309 uses at least information on the patient ID, examination site, and imaging direction as the imaging conditions of the patient, but is configured as long as the information can be determined to match the imaging conditions of the past patient. There is no limit to. Further, in the present embodiment, when the imaging conditions of a plurality of past patients match, the determination unit 309 uses the latest one as the matched information.

The configuration of the masking setting screen of the radiography control device 100 and the configuration of the guide image generated according to the masking setting in the present embodiment will be described with reference to FIGS. 4 to 5.

FIG. 4 is a configuration diagram of a masking setting screen of the radiography control device 100 of the present embodiment.

The masking setting screen 400 has a masking function setting unit 401, a masking range setting unit 402, a masking method setting unit 403, and a site information display setting unit 404. In the present embodiment, it is assumed that the settings of the masking range setting unit 402 and the masking method setting unit 403 contribute to the generation of masking information, and the settings of the site information display setting unit 404 contribute to the generation of masking additional information. In this embodiment, masking is set for four items as shown in FIG. 4, but the number of items to be set is not necessarily four. For example, the masking range may be predetermined and only the masking method can be set, or conversely, the masking method may be predetermined and only the masking range can be set. That is, the configuration may be such that at least one of the range in which the subject in the first optical image is masked and the type of masking is accepted from the user.

The masking function setting unit 401 has settings related to a guide image that generates masking information and masking additional information based on the optical image. When the user sets the setting to invalid, the radiography control device 100 does not generate the guide image. Specifically, the processes of steps S604 to S606 of FIG. 6 to be described later, and the processes related to the masking information and masking additional information of steps S607 to S609 are not executed. When the user enables the item, the masking range setting unit 402, the masking method setting unit 403, and the part information display setting unit 404 are additionally set.

The masking range setting unit 402 has a setting relating to a region for generating masking information based on an optical image. When the user sets the setting for the whole body, the radiography control device 100 generates masking information for the whole body of the patient from the optical image. When the user sets the item to only a specific part, the part such as the face area and the chest area is additionally set. Of the above items, only the items that are validly set by the user are masked and displayed as the guide image of the radiography control device 100. That is, the range of the human body region to be masked may be the entire identified human body region or a part of the identified human body region.

In the masking range setting unit 402, only the part region identified by the identification unit 306 may be displayed as a specific part. Alternatively, a predetermined part may be displayed as a specific part, but an error may be displayed when an attempt is made to select a part area not identified by the identification unit 306.

The masking method setting unit 403 has a setting relating to a method of generating masking information for the area set by the masking range setting unit 402. In this embodiment, it is possible to select filling of the masking range, mosaicking, line-of-sight hiding, avatarization, skeletonization, and the like. However, there is no limitation on the configuration as long as the target area can be masked. Further, in the present embodiment, one type of mask processing is applied to the set masking range, but for example, different mask processing may be applied to each identified portion.

The part information display setting unit 404 has a setting relating to a method of generating masking additional information for the area set by the masking range setting unit 402. When the user sets not to display the setting, the radiography control device 100 does not generate masking additional information for the guide image. Specifically, the processes of steps S604 to S606 and the processes related to the generation of additional masking information in steps S607 to S609, which will be described later, are not executed. When the user enables the item, the display setting of the part information is additionally performed. In the present embodiment, it is possible to select the character string display of the part, the area division display of the part, the display of the face part, the display in the three-dimensional direction, etc. for the masked range. However, there is no limitation on the configuration as long as the site of the target region can be specified.

FIG. 5 is a diagram showing an example of a guide image generated according to the masking setting of the masking setting screen 400 of the radiography control device 100 of the present embodiment.

The optical image 500 is an image when the masking function setting unit 401 is disabled on the masking setting screen 400, and is equivalent to an optical image in which the guide image is not displayed. In the following description of the guide image, it is assumed that the masking function unit 401 is effectively set on the masking setting screen 400.

The guide image 510 is a guide image when the masking range setting unit 402 is selected as “whole body”, the masking method setting unit 403 is selected as “filled”, and the site information display setting unit 404 is selected as “not displayed”.

The guide image 511 is a guide image when the masking range setting unit 402 is selected as "only a specific part, face", the masking method setting unit 403 is selected as "mosaic", and the part information display setting unit 404 is selected as "not displayed". is there.

The guide image 512 is a guide image when the masking range setting unit 402 is selected as "only a specific part, face", the masking method setting unit 403 is selected as "hidden line of sight", and the part information display setting unit 404 is selected as "not displayed". Is.

The guide image 513 is a guide image when the masking range setting unit 402 is selected as “whole body”, the masking method setting unit 403 is selected as “avatar”, and the site information display setting unit 404 is selected as “not displayed”.

The guide image 514 is a guide image when the masking range setting unit 402 is selected as “whole body”, the masking method setting unit 403 is selected as “skeleton”, and the site information display setting unit 404 is selected as “not displayed”.

The guide image 520 is a guide image when the masking range setting unit 402 is selected as “whole body”, the masking method setting unit 403 is selected as “fill”, and the part information display setting unit 404 is selected as “display, character string display”. is there.

The guide image 521 is a guide image when the masking range setting unit 402 is selected as “whole body”, the masking method setting unit 403 is selected as “fill”, and the part information display setting unit 404 is selected as “display, area division display”. is there.

The guide image 522 is a guide image when the masking range setting unit 402 is selected as “whole body”, the masking method setting unit 403 is selected as “fill”, and the part information display setting unit 404 is selected as “display, face part display”. is there.

The guide image 523 is a guide image when the masking range setting unit 402 is selected as “whole body”, the masking method setting unit 403 is selected as “fill”, and the part information display setting unit 404 is selected as “display, three-dimensional direction display”. Is.

In the present embodiment, the masking setting of the masking setting screen 400 will be described later as a state in which the setting of FIG. 4 is enabled, that is, a setting for generating a guide image 521.

The display processing of the radiography control device 100 at the time of patient imaging in the present embodiment will be described with reference to FIG. 6, and the configuration diagrams relating to the display of the optical image and the guide image will be described with reference to FIGS. 7 to 9.

FIG. 6 is a flowchart of a display process of the radiography control device 100 at the time of patient imaging.

In step S601, the system control unit 302 sets the radiography control device 100 in the inspection start state based on the user operation. Specifically, the system control unit 302 transmits an instruction to prepare for imaging to the radiography imaging device 110 via the communication unit 301 based on the imaging conditions of the patient instructed by the user operation. When the radiography imaging device 110 is ready for imaging, the radiography imaging device 110 returns and sends a notification of completion of preparation for radiography to the radiography imaging control device 100. After receiving the preparation completion notification, the system control unit 302 sets the radiography imaging control device 100 in an imaging enable state and accepts step S611, which will be described later. The system control unit 302 also transmits an instruction to start shooting to the image acquisition device 130 via the communication unit 301. After receiving the imaging start instruction, the image acquisition device 130 returns and sequentially transmits the optical image acquired by itself to the radiography imaging control device 100.

Between S602 and S610, sequential parallel processing by the system control unit 302 is executed. That is, step S603, steps S604 to S606, steps S607 to S609, and other control processes and user control reception are executed in parallel. The processing between steps is executed by the system control unit 302 until step S611 is executed or the inspection is stopped (not shown) by the user operation.

The processing between S602 and S610 does not necessarily have to be parallel processing, and is generated from an optical image of a patient, a guide image generated from the optical image, and an optical image of the patient taken in the past. It suffices if the past guide image can be displayed on the display device.
For example, after executing the process of step S603, the processes of steps S604 to S606 may be executed, and then the processes of steps S607 to S609 may be performed.

In step S603, the system control unit 302 displays the optical image acquired from the image acquisition device 130 via the communication unit 301 on the UI display device 203 via the display control unit 304.

In step S604, the identification unit 306 generates masking information and masking additional information of the patient in the optical image based on the setting unit 308 based on the optical image acquired via the system control unit 302.

In step S605, the generation unit 307 generates a guide image based on the masking information and masking additional information generated by the identification unit 306.

In step S606, the display control unit 304 superimposes and displays the guide image on the optical image on the UI display device 203.

Here, the configuration relating to the display of the optical image and the guide image displayed on the UI display device 203 in steps S603 to S606 will be described with reference to FIG.

Steps S603 to S606 are steps of masking an optical image obtained by photographing a patient undergoing examination in real time and displaying it on the UI display device 203.

The optical image 700 is an optical image acquired from the image acquisition device 130 displayed on the UI display device 203 in step S603. In the actual optical image, an object within the imaging range of the image acquisition device 130 is reflected, such as the presence of the radiographing device 110 behind the patient. Use a diagram that expresses only information. Further, as for the subsequent optical images and images related to the optical images, unless otherwise specified, the drawings expressing only the physical information of the patient are used in the same manner.

The guide image 701 is an image generated by the generation unit 307 based on the patient masking information and masking additional information generated by the identification unit 306 in step S604. The generation unit 307 gives an instruction to superimpose and display the guide image 701 on the optical image 700 to the display control unit 304, and the optical image 700 on which the guide image 701 is superposed and displayed is displayed as the superposed image 702.

Returning to the description of the flowchart of FIG.

Steps S607 to S609 are steps in which the optical image obtained by photographing the patient in the past under the same imaging conditions is masked and displayed on the UI display device 203.

In step S607, the determination unit 309 searches the data stored in the storage unit 305 and determines whether or not there is a past imaging condition that matches the imaging condition of the patient instructed to perform the examination.

When it is determined in step S607 that the patient has performed the same imaging conditions in the past, as step S608, the generation unit 307 acquires the optical image, masking information, and masking additional information captured in the past from the storage unit 305 and guides the past. Generate an image.
If the past guide image is stored in the storage unit 305, the past guide image is acquired.

In step S609, the display control unit 304 superimposes and displays the past guide image on the optical image and the guide image on the UI display device 203.

If it is not determined in step S607 that the patient has performed the same imaging conditions in the past, the radiography control device 100 does not generate the past guide image, that is, does not execute the processes of steps S608 to S609.

Here, the structure of the data stored in the storage unit 305 will be described with reference to FIG. Further, the display of the past guide image will be described with reference to FIG.

FIG. 8 is a diagram showing an example of data stored in the storage unit 305. The storage unit 305 has a past patient imaging condition table 800, and is composed of an imaging condition unit 801 and a guide image information unit 802.

The imaging condition unit 801 stores the radiation image generated by the image processing unit 303, the imaging conditions of the patient related to the radiation image, the irradiation information of the radiation generator 120, and the like. In the present embodiment, the determination unit 309 uses at least information such as the patient ID, examination site, and imaging direction as the patient's imaging conditions, but any information that can be used to determine the matching of the patient's imaging conditions in the past. There are no restrictions on the configuration. Further, in the present embodiment, when the imaging conditions of a plurality of past patients match, the determination unit 309 uses the latest one as the matching information.

The guide image information unit 802 stores the optical image acquired from the image acquisition device 130, the masking information generated by the identification unit 306, and the masking additional information in the storage unit 305. In the present embodiment, the optical image and the masking information are stored respectively, but the guide image generated by the generation unit 307 may be stored together, or only the guide image may be stored. By storing the guide image, the image that has already been masked can be displayed at the time of reading, so that the privacy of the patient can be further protected.

Further, in the present embodiment, the masking information and the masking additional information are collectively stored as image information, but only the masking information, the coordinate information of the masking additional information, and the character information are stored, and the generation unit 307 reproduces from the information. It may be configured to be formed.

In the present embodiment, the generation unit 307 refers to the imaging condition table 800 of the past patient in the storage unit 305, but there is no limitation on the configuration as long as the determination in step S607 can be performed. That is, the determination may be made using the information on the information processing device (not shown) having the imaging condition table 800 of the past patient via the network 140.

FIG. 9 is a configuration diagram relating to the display of the past guide image.

The superimposed image 900 is an image generated in the same manner as the above-mentioned superimposed image 702.

The past guide image 901 is an image that the generation unit 307 acquires and generates an optical image, masking information, and masking additional information from the shooting conditions stored in the storage unit 305 in step S608. The generation unit 307 gives an instruction to superimpose and display the past guide image 901 on the superposed image 900 to the display control unit 304, and displays an image in which the past guide image 901 is superposed and displayed on the superposed image 900 as the past guide superposed image 902. ..

Returning to the description of the flowchart of FIG. 6 again.

In step S611, the user presses the exposure switch 121 of the radiation generator 120 to start photographing. When the imaging is started, the radiation generator 120 generates radiation from the tube 122, the radiation that has passed through the patient is notified to the radiation imaging device 110, and the radiation imaging device generates a radiographic image. After that, the radiography imaging device 110 transmits a radiographic image to the radiography imaging control device 100. Further, in parallel with the above processing, the radiation generator 120 transmits the irradiation information of the radiography to the radiography control device 100.

In step S612, the system control unit 302 stores the radiation image acquired in step S611, the imaging conditions of the patient related to the radiation image, the irradiation information of the radiation generator 120, and the like in the storage unit 305. In parallel with the processing, the system control unit 302 also stores the optical image at the time of shooting in step S611, masking information, and masking additional information in the storage unit 305 in association with the information in the processing.

As described above, the processing of the radiography system according to the present embodiment is performed.

According to the above, in the first embodiment, the display control unit 304 UIs the optical image acquired from the image acquisition device 130 at the start of the inspection and the guide image generated by the identification unit 306 based on the settings made on the masking setting screen 400. It is displayed on the display device 203. Further, the past guide image generated from the optical image taken in the past is superimposed and displayed on the optical image and the guide image generated based on the optical image.

As a result, not only the optical image showing how the patient to be inspected is being photographed, but also the past image generated from the optical image taken in the past is displayed on the display device in a masked state. Can be done. Therefore, even if the posture of the patient deviates from the past guide image that has been masked, the image that is currently taken is also displayed on the display device with the mask processed, so that the patient's posture is displayed. You can protect your privacy. Further, for example, when photographing the side surface of the chest, the parts of the patient overlap each other depending on the imaging method. In such a case, it is difficult to reproduce the orientation, posture, etc. only with the past contour image, but according to the radiography system according to the present embodiment, mask processing is performed so as not to impair the information of the optical image of the patient. The applied past image can be used as a positioning guide image. That is, it is possible to improve the reproducibility of posture positioning in the same posture imaging of the same patient while giving consideration to the privacy of the patient at the time of examination.

[Embodiment 2]
Next, Embodiment 2 of the present invention will be described.

In the configuration of the first embodiment, an optical image of a patient under examination, a guide image generated based on the optical image, masking information of the patient, and additional masking information, an optical image taken in the past, masking information, The past guide image based on the masking additional information can be superimposed and displayed. However, since the region covering the human body region is masked, even the irradiation field indicating the region to be irradiated by the tube 122 of the radiation generator 120 is masked.

In that case, in the configuration of the first embodiment, in order for the user to confirm the accurate irradiation field area, it is necessary to use another means such as visual confirmation, which may take time and effort to position the posture of the user. There is.

Therefore, in the configuration of the second embodiment, a process of detecting the irradiation field information and changing the display process by the radiography control device 100 is added. Hereinafter, only the difference from the first embodiment will be described with reference to FIGS. 10 to 12.

FIG. 10 is a configuration example of the radiography control device 100 of the radiography imaging system of the present embodiment. The radiography control device 100 additionally has an irradiation field detection unit 1000.

The irradiation field detection unit 1000 uses the optical image obtained from the image acquisition device 130 to generate irradiation field information indicating the position of the irradiation field region in the optical image. In the present embodiment, the irradiation field detection unit 1000 analyzes the change in brightness in the optical image when the irradiation field lamp of the tube 122 obtained from the image acquisition device 130 is lit, and generates irradiation field information. However, the specific method is not limited as long as the position information of the irradiation field region can be acquired. For example, the irradiation field region may be calculated by acquiring the aperture information of the tube 122 from the radiation generator 120 in advance. Further, in the present embodiment, after the irradiation field lamp of the tube 122 is turned off, the irradiation field information immediately before the light is turned off is retained.

FIG. 11 is a flowchart of a display process at the time of patient imaging of the radiography control device 100 of the present embodiment.

In step S1101, the irradiation field detection unit 1000 generates irradiation field information from the optical image.

In step S1102, the generation unit 307 generates an irradiation field guide image from the irradiation field information generated in the step.

In step S1103, the display control unit 304 superimposes and displays the irradiation field guide image on the optical image, the guide image, or the past guide image displayed on the UI display device 203. That is, the display control unit 304 superimposes and displays the irradiation field image generated based on the irradiation field information on at least one of the first optical image, the first processed image, and the second processed image. It corresponds to an example of control means.

Alternatively, the display control unit 304 superimposes and displays the irradiation field guide image on the optical image, the guide image, and the past guide image displayed on the UI display device 203.

A configuration related to the display of the past guide image displayed on the UI display device 203 in steps S1101 to S1103 will be described with reference to FIG. Since the configuration related to the display of the optical image and the guide image is the same, the description thereof is omitted. Further, the mask processing setting of the radiography control device 100 here is based on the setting of the masking setting screen 400 of FIG. 4, and the past guide superimposed image 902 is the same as that of FIG.

The irradiation field guide image 1201 is an image generated by the generation unit 307 based on the irradiation field information generated by the irradiation field detection unit 1000 in step S1101. The generation unit 307 gives an instruction to the display control unit 304 to superimpose and display the irradiation field guide image 1201 on the optical image 500, and the past guide superimposition image in which the irradiation field guide image 1201 is superposed and displayed as the irradiation field guide image superimposition display image 1202. 902 is displayed.

As described above, in the second embodiment, the radiography control device 100 controls to generate an irradiation field guide image from the detection of the position information of the irradiation field and superimpose and display it on the optical image, the guide image, and the past guide image. As a result, the irradiation field area can be confirmed on the UI display device 203, and the time and effort required for the user's posture positioning work can be reduced.

[Embodiment 3]
Next, Embodiment 3 of the present invention will be described.

In the configuration of the second embodiment, the radiography control device 100 controls to generate an irradiation field guide image from the detection of the irradiation field information and superimpose it on the guide image and the past guide image. As a result, the irradiation field area can be confirmed on the UI display device 203, and the time and effort required for the user's posture positioning work can be reduced. However, since the region covering the human body region is masked, the region of the detector of the radiography apparatus 110 is also masked. The detector is included in the radiography apparatus 110 and is provided at a position facing the tube 122. In the detector, for example, pixels including a switch element such as a TFT and a photoelectric conversion element are arranged two-dimensionally, and on each photoelectric conversion element, for example, a phosphor that converts radiation into visible light. Is provided and configured. The radiation incident on the detection unit 107 is converted into visible light by a phosphor, and the converted visible light is incident on the photoelectric conversion element of each pixel, and in each photoelectric conversion element, the charge (electric signal) corresponding to the visible light. Is generated as radiographic image data.

When the detector area is masked in this way, in the configuration of the first or second embodiment, it is necessary for the user to use another means such as visual confirmation in order to confirm the accurate detector area, and the posture of the user. There is a possibility that the positioning work of the above will take time and effort.

Therefore, in the configuration of the third embodiment, a process of detecting the detector information and changing the display process by the radiography control device 100 is added. Hereinafter, only the difference from the first embodiment will be described with reference to FIGS. 13 to 14.

FIG. 13 is a configuration example of the radiography control device 100 of the radiography imaging system of the present embodiment. The radiography control device 100 additionally has a detector identification unit 1300.

The detector identification unit 1300 identifies the detector in the optical image obtained from the image acquisition device 130, and generates detector information representing the position information of the radiography apparatus 110.

As the identification method, the same method as the method for identifying the human body region in the first embodiment can be used. For example, it may be a table based on a rule base or a trained model obtained by machine learning. Good.

Further, the detector identification unit 1300 is not limited in configuration as long as it can detect the position information of the detector in the optical image by using the optical image obtained from the image acquisition device 130. For example, a marker may be arranged in the radiography apparatus 110, and the detector identification unit 1300 may recognize the marker position from the optical image and calculate the positional relationship.

In the configuration of the present embodiment, since the detector information is generated from the optical image obtained from the image acquisition device 130, there is a case where the detector is partially or totally not reflected from the optical image when the positioning of the patient is started. is there. In that case, the detector identification unit 1300 holds the detector information immediately before the detector disappears from the optical image, and interpolates the position information of the detector based on the information. More specifically, the position information of the detector immediately before the detector disappears from the optical image is used as it is in the optical image in which the detector disappears.

FIG. 14 is a flowchart of a display process at the time of patient imaging of the radiography control device 100 of the present embodiment.

In step S1401, the detector identification unit 1300 generates detector information from the optical image.

In step S1402, the generation unit 307 generates a detector guide image from the detector information generated in the step.

In step S1403, the display control unit 304 superimposes and displays the detector guide image on the optical image, the guide image, and the past guide image displayed on the UI display device 203.

Regarding the display of the detector guide image displayed on the UI display device 203 in steps S1401 to S1403, the description is omitted because the irradiation field guide image 1201 of FIG. 12 is replaced with the detector guide image.

As described above, in the third embodiment, the radiography control device 100 controls to generate a detector guide image from the detection of the detector region of the radiography camera 110 and superimpose and display it on the optical image, the guide image, and the past guide image. .. As a result, the detector area can be confirmed on the UI display device 203, and the time and effort required for the user's posture positioning work can be reduced.

[Embodiment 4]
Next, a fourth embodiment of the present invention will be described.

In the configuration of the first embodiment, the posture of the user is positioned by superimposing and displaying an optical image, a guide image based on the patient's masking information and masking additional information, and a past guide image linked from the past patient's imaging conditions. Improves the reproducibility of. In addition to this, by showing the image to the patient, the patient may use it to improve the reproducibility of the posture.

Specifically, the display control unit 304 additionally has a control function capable of displaying the optical image, the guide image superimposed display image, or the past guide image superimposed display image on the UI display device 203 in reverse left and right (not shown). .. During the process of steps S602 to S610 of FIG. 4 above, the user activates the control function and presents the UI display device 203 to the patient.

As described above, in the fourth embodiment, the patient displays the optical image of the radiography control device 100, the guide image based on the patient's masking information and the masking additional information, and the past guide image linked from the past patient's imaging conditions. You can check yourself. As a result, in addition to improving the reproducibility of the posture positioning of the user, the patient himself can improve the reproducibility of the posture.

100 Radiation imaging control device 110 Radiation imaging device 120 Radiation generator 130 Image acquisition device 301 Communication unit 302 System control unit 303 Image processing unit 304 Display control unit 305 Storage unit 306 Identification unit 307 Generation unit 308 Setting unit 309 Judgment unit

Claims (22)

The first acquisition means for acquiring a radiographic image based on the radiation applied to the subject, and
A second acquisition means for acquiring a first optical image by optically photographing the subject, and
A first generation means for generating a first processed image by masking at least a part of a region of the subject in the first optical image.
A second generation means for generating a second processed image by masking at least a part of a region of the subject in the second optical image taken in the past of the first optical image.
A display control means for displaying on the display unit such that the first optical image, the first processed image, and the second processed image are superimposed.
A radiographing apparatus characterized in that it is provided with. It is characterized by further comprising a storage means for storing at least one of the first optical image and the mask processing performed by the first processing means, or at least one of the first processed images in a storage unit. The radiography apparatus according to claim 1. 2. The storage means according to claim 2, wherein the storage means stores the first optical image, information about the mask processing performed by the first processing means, and the first processed image in a storage unit. Radiation imaging device. The radiography apparatus according to claim 2 or 3, wherein the storage means stores the predetermined imaging conditions in a storage unit together with the second processed image. The radiography apparatus according to any one of claims 1 to 4, further comprising an identification means for identifying a human body region of the subject from the first optical image. The radiography apparatus according to claim 5, wherein the identification means further identifies the identified human body region into at least two or more parts. The identification means first inputs the first optical image to a trained model trained to identify a plurality of pixels constituting the optical image into the first class group. The radiography apparatus according to claim 5 or 6, wherein the human body region of the subject is identified in an optical image. The radiography apparatus according to claim 7, wherein the first class group includes a class indicating that it is a human body region and a class indicating that it is not a human body region. The identification means first inputs the first optical image to a trained model trained to identify a plurality of pixels constituting the optical image into the first class group. The radiography apparatus according to claim 6, further comprising identifying the human body region of the subject in an optical image into at least two or more parts. The radiography apparatus according to claim 9, wherein the first class group includes a class indicating that it is a head, a class indicating that it is a body portion, and a class indicating that it is an arm portion. .. The radiography apparatus according to any one of claims 5 to 10, wherein the first processing means performs mask processing on the entire identified human body region. Further, a determination means for determining whether or not an optical image obtained based on a predetermined imaging condition exists in an optical image captured in the past of the first optical image is provided.
The second generation means is an optical image taken before the first optical image, and at least a part of the subject in the second optical image obtained based on the predetermined imaging conditions. The radiographing apparatus according to any one of claims 1 to 11, wherein a second processed image is generated by applying a masking process to the region. The radiography apparatus according to claim 12, wherein the predetermined imaging condition includes information on an ID, an examination site, or an imaging direction. The second processing means is any one of claims 1 to 13, wherein the same mask processing as the mask processing performed by the first processing means is applied to the second optical image. The radiography apparatus described in. Further provided is a receiving means for receiving from the user a range in which the mask processing is performed on the subject in the first optical image and at least one of the types of the mask processing.
The first processing means according to any one of claims 1 to 14, wherein the first processing means performs mask processing on the first optical image based on the conditions accepted by the receiving means. Radiation imaging device. A third generation unit that detects the position of the irradiation field of the radiation generator from the first optical image and generates irradiation field information is further provided.
The display control means superimposes and displays the irradiation field image generated based on the irradiation field information on at least one of the first optical image, the first processed image, and the second processed image. The radiographing apparatus according to any one of claims 1 to 15, wherein the radiographing apparatus is characterized. The display control unit is characterized in that the first optical image, the first processed image, and the second processed image displayed on the display unit can be reversed left and right. 16. The radiographing apparatus according to 16. A fourth generator that detects the position of the detector of the radiation generator from the first optical image and generates detector information is further provided.
The display control means superimposes the detector guide image generated based on the detector information on at least one of the first optical image, the first processed image, and the second processed image. The radiography apparatus according to any one of claims 1 to 17, wherein the radiographic apparatus is displayed. The first acquisition means for acquiring a radiographic image based on the radiation applied to the subject, and
A second acquisition means for acquiring a first optical image by optically photographing the subject, and
A first generation means for generating a first processed image by masking at least a part of a region of the subject in the first optical image.
A display control means for displaying on the display unit so that the first optical image and the first processed image are superimposed.
A radiographing apparatus characterized in that it is provided with. The first acquisition means for acquiring a radiographic image based on the radiation applied to the subject, and
A second acquisition means for acquiring a first optical image by optically photographing the subject, and
A first generation means for generating a first processed image by masking at least a part of a region of the subject in the first optical image.
A second generation means for generating a second processed image by masking at least a part of a region of the subject in the second optical image taken in the past of the first optical image.
A display control means for superimposing and displaying the first optical image, the first processed image, and the second processed image on the display unit.
A radiography system characterized by being equipped with. The first acquisition step of acquiring a radiographic image based on the radiation applied to the subject, and
A second acquisition step of acquiring a first optical image by optically photographing the subject, and
A first generation step of generating a first processed image by masking at least a part of a region of the subject in the first optical image.
A second generation step of generating a second processed image by masking at least a part of a region of the subject in the second optical image taken in the past of the first optical image.
A display control step of displaying the first optical image, the first processed image, and the second processed image on the display unit, and
A radiological imaging method characterized by comprising. A program for executing each means of the radiography apparatus according to any one of claims 1 to 19.

Images