WO2023100979A1 - Information processing device, information processing method, and program - Google Patents

Abstract

The present invention provides an information processing device, etc., for assisting the selection of a therapeutic device.　The information processing device comprises: a classification data acquisition unit that acquires a plurality of items of classification data (57) in which pixels constituting a plurality of tomographic images (58) acquired using an image acquisition catheter that performs three-dimensional scanning while gradually moving the direction of transmission of a scanning beam are classified into a plurality of regions including a tissue region (46) and a lumen region (40); an entrance determining unit that determines a branch entrance (53) at which a prescribed region in a three-dimensional image (59) constructed using the plurality of items of classification data (57) branches into a trunk part (51) and a branch part (52); and a dimensions output unit that outputs values relating to the dimensions of the branch entrance (53).

Description

Information processing device, information processing method and program

The present invention relates to an information processing device, an information processing method, and a program.

A therapeutic device that is indwelled inside a hollow organ via a catheter is used (Patent Document 1).

Japanese Patent Application Laid-Open No. 2009-56102

There are individual differences in the size and shape of the affected area where the therapeutic device is placed. A doctor selects a therapeutic device suitable for each individual patient based on preoperative CT (Computed Tomography) images and the like. However, the size and shape of the affected area may change between the day of the preoperative imaging and the day of the treatment.

In one aspect, the object is to provide an information processing device or the like that supports selection of a therapeutic device.

In the information processing device, each pixel constituting a plurality of tomographic images acquired using an image acquisition catheter that performs three-dimensional scanning while sequentially moving the transmission direction of the scanning beam includes a biological tissue region and a lumen region. A classification data acquisition unit that acquires a plurality of classification data classified into a plurality of regions, and a branching unit that divides the predetermined region in a three-dimensional image constructed using the plurality of classification data into a trunk and a branch. An entrance determination unit that determines the entrance, and a dimension output unit that outputs a value related to the dimension of the branch entrance.

In one aspect, it is possible to provide an information processing device or the like that supports selection of a therapeutic device.

FIG. 4 is an explanatory diagram for explaining an outline of a dimension measurement process; It is an explanatory view explaining a classification model. It is an explanatory view explaining the composition of an information processor. FIG. 4 is an explanatory diagram for explaining a record layout of a tomogram DB; 4 is a flowchart for explaining the flow of processing of a program; This is an example screen. This is an example screen. FIG. 4 is an explanatory diagram showing a cross section of a three-dimensional image cut along a reference plane; This is an example screen. This is an example screen. It is an example of a screen of a modification. 10 is a flowchart for explaining the flow of processing of a program according to Embodiment 2; It is an example of a screen of Embodiment 2. FIG. It is an example of a screen of Embodiment 2. FIG. 11 is a flowchart for explaining the flow of processing of a program according to Embodiment 3; It is an example of a screen of Embodiment 3. It is an example of a screen of Embodiment 3. FIG. 13 is an explanatory diagram illustrating an initial position of a reference plane according to the fourth embodiment; FIG. FIG. 13 is a flowchart for explaining the flow of processing of a program according to Embodiment 4; FIG. It is an example of a screen of Embodiment 4. FIG. 10 is a flowchart for explaining the processing flow of a reference plane selection-1 subroutine; FIG. 14 is a flowchart for explaining the flow of processing of a program according to Embodiment 5; It is an example of a screen of Embodiment 5. FIG. It is an example of a screen of Embodiment 5. FIG. FIG. 14 is a flowchart for explaining the flow of processing of a program according to Embodiment 6; FIG. FIG. 10 is a flowchart for explaining the processing flow of a reference plane selection-2 subroutine; FIG. FIG. 21 is an explanatory diagram for explaining a branch shaft that is an axis of a branch portion of Embodiment 7; FIG. 11 is an example of a screen according to Embodiment 7. FIG. FIG. 11 is an example of a screen according to Embodiment 7. FIG. FIG. 21 is a flow chart for explaining the flow of processing of a program according to Embodiment 7; FIG. FIG. 10 is a flowchart for explaining the flow of processing of a branch axis creation subroutine; FIG. FIG. 22 is a flowchart for explaining the flow of processing of a program of Embodiment 8; FIG. FIG. 11 is a flow chart for explaining the processing flow of a reference plane selection-3 subroutine; FIG. FIG. 11 is an example of a screen according to Embodiment 9. FIG. FIG. 11 is an example of a screen according to Embodiment 9. FIG. FIG. 22 is a flowchart for explaining the flow of processing of a program according to Embodiment 9; FIG. FIG. 22 is a flow chart for explaining the flow of processing of a program according to the tenth embodiment; FIG. FIG. 11 is a flow chart for explaining the processing flow of a reference plane selection-4 subroutine; FIG. FIG. 22 is a flowchart for explaining the flow of processing of a subroutine for constructing a three-dimensional image according to Embodiment 11; FIG. FIG. 20 is an explanatory diagram illustrating the configuration of a catheter system according to a twelfth embodiment; FIG. 22 is an explanatory diagram for explaining the configuration of an information processing apparatus according to a thirteenth embodiment; FIG. 22 is a functional block diagram of an information processing device according to a fourteenth embodiment;

[Embodiment 1]
FIG. 1 is an explanatory diagram for explaining the outline of the dimension measurement process. A user such as a doctor inserts the image acquisition catheter 28 (see FIG. 33) near the affected area. The image acquisition catheter 28 is for three-dimensional scanning, and can continuously capture a plurality of tomographic images 58 in which the scanning plane is gradually changed in the axial direction. In the following description, the tomographic images 58 created by one three-dimensional scan may be referred to as a set of tomographic images 58. FIG.

In FIG. 1, a so-called XY-format tomographic image 58 constructed according to the actual shape is shown as an example. The tomographic image 58 may be of a so-called RT format constructed by arranging scanning lines in parallel in the order of scanning angles. Conversion between the RT format and the XY format may be performed during the process described using FIG. Since the conversion method between the RT format and the XY format is known, the explanation is omitted.

Classification data 57 is created based on each tomographic image 58 . Classification data 57 is data obtained by classifying each pixel constituting tomographic image 58 into a plurality of regions such as lumen region 40, biological tissue region 46, extracavity region 45, and catheter region 47, for example. Based on the classification data 57, it is possible to create a classified image in which the pixels forming the tomographic image 58 are colored separately for each area. A set of classified images is created based on the set of tomograms 58 . The details of the classified data 57 and the classified images will be described later.

The control unit 201 (see FIG. 3) constructs a three-dimensional image 59 based on the set of classified images. The user can appropriately designate an area to be displayed in the three-dimensional image 59 . FIG. 1 shows an example of a three-dimensional image 59 displaying only the lumen region 40 . The lumen region 40 is the region surrounded by the tissue region 46 . When the image acquisition catheter 28 is inserted into a blood vessel or circulatory system such as the heart, the lumen region 40 is a blood flow region filled with blood.

A dashed line indicates the axis of the image acquisition catheter 28 . Around the axis is the catheter area 47, so the three-dimensional image 59 of the lumen area 40 has a through hole along the axis, as shown in FIG. The user can smoothly grasp the three-dimensional shape of the three-dimensional image 59 by appropriately cutting and rotating the three-dimensional image 59 and observing it.

The control unit 201 determines the branch entrance 53 based on the user's instruction. The branch entrance 53 is a surface that divides a predetermined area in the three-dimensional image 59 into the trunk 51 and the branches 52 branching from the trunk 51 . The control unit 201 calculates dimensions such as the major axis, the minor axis, or the area of the branch entrance 53, for example. Here, the major diameter is the maximum diameter of the branch entrance 53 and the minor diameter is the minimum diameter of the branch entrance 53 . The control unit 201 may calculate the volume of the branch portion 52, the length of the branch portion 52, or the like.

The use of the dimensions calculated by the above process will be explained with specific examples. For example, there is a treatment technique called Left Atrial Appendage Closure (LAAC). The left atrial appendage is a pouch-like area that projects outward from the left atrium of the heart. Patients with atrial fibrillation are at risk of serious diseases such as cerebral infarction or pulmonary thromboembolism due to thrombus generated in the left atrial appendage flowing out of the heart.

By placing a device for closing the left atrial appendage via a catheter at the entrance of the left atrial appendage, it is possible to prevent the occurrence and outflow of thrombus. Due to the wide variation in the shape and size of the left atrial appendage, left atrial appendage closure device suppliers offer a line of devices in multiple sizes. Physicians select the appropriate size device for their patients from the lineup.

The dimensions of the left atrial appendage are measured based on preoperative CT images or MRI (Magnetic Resonance Imaging) images. However, the size and shape of the affected area may change between the day of the preoperative imaging and the day of the treatment.

　Intraoperatively, a TEE (Transesophageal Echocardiography) probe can be used to measure the dimensions of the left atrial appendage through the esophageal wall. However, the TEE probe is highly invasive to the patient's body, and the task of visualizing the left atrial appendage and measuring its dimensions is complicated, requiring manpower and time.

In the process described with reference to FIG. 1, the image acquisition catheter 28 is inserted into the vicinity of the left atrial appendage using the pathway used to place the left atrial appendage closure device, and the TEE probe is used for dimensional measurements. It is less invasive to the patient's body than when it is used. Furthermore, by performing measurement from the vicinity of the left atrial appendage, higher measurement accuracy can be obtained than with a TEE probe. In addition, by performing the measurement immediately before placing the device, the user can select a device with an appropriate size compared to using a CT image or the like taken before surgery.

In the following explanation, the case of measuring the dimensions of the left atrial appendage will be explained as an example. However, the application of this sizing process is not limited to sizing the left atrial appendage. For example, when performing coil embolization for a cerebral aneurysm, the user can select an embolization coil with appropriate specifications by measuring the volume of the cerebral aneurysm using this size measurement process.

The object of dimension measurement is not limited to the lumen region 40. The use of measured dimensions is not limited to device selection. For example, when the image acquisition catheter 28 is inserted into the pancreatic duct to capture the tomographic image 58, the dimensions of IPMN (Intraductal Papillary Mucinous Neoplasm) can be measured from the three-dimensional shape of the biological tissue region 46. It is known that follow-up observation of IPMN dimensional and shape changes is useful for early detection of pancreatic cancer.

FIG. 2 is an explanatory diagram explaining the classification model 31. FIG. The classification model 31 receives the tomographic image 58 and classifies each pixel constituting the tomographic image 58 into a plurality of regions such as the lumen region 40, the biological tissue region 46, the extracavity region 45, and the catheter region 47, and It outputs data that associates the pixel position with the label indicating the classification result.

The classification model 31 is a trained model that performs semantic segmentation on the tomographic image 58, for example. The classification model 31 is generated by machine learning using training data in which a large number of pairs of tomographic images 58 and correct data obtained by coloring the tomographic images 58 for each region by a specialist such as a doctor are recorded. is a model. Generating a trained model for performing semantic segmentation has been conventionally performed, so detailed description thereof will be omitted.

1 and 2 schematically illustrate the classification data 57 using classification images. For example, in the tomographic image 58, pixels corresponding to the label of the lumen region 40 are colored in a first color, pixels corresponding to the label of the biological tissue region 46 are colored in a second color, and pixels corresponding to the label of the extracavity region 45 are colored. is set to the third color, and pixels corresponding to the labels of the catheter region 47 are set to the fourth color. In FIGS. 1 and 2, the first color is indicated by left-sloping hatching, the second color is indicated by thick left-sloping hatching, the third color is indicated by right-sloping hatching, and the fourth color is indicated by no hatching.

It should be noted that the classification data 57 described above is an example. The classification model 31 classifies each pixel constituting the tomographic image 58 into an arbitrary region such as a device region corresponding to a device such as a guide wire used simultaneously with the image acquisition catheter 28, a calcification region, or a plaque region. You may

The classification model 31 divides the lumen region 40 into a first lumen region that is a lumen into which the image acquisition catheter 28 is inserted and a second lumen region that is a lumen into which the image acquisition catheter 28 is not inserted. can be classified separately. The classification model 31 may be a trained model trained to receive the RT format tomogram 58 and output the RT format classification data 57 .

FIG. 3 is an explanatory diagram for explaining the configuration of the information processing device 200. As shown in FIG. The information processing device 200 includes a control section 201, a main memory device 202, an auxiliary memory device 203, a communication section 204, a display section 205, an input section 206 and a bus. The control unit 201 is an arithmetic control device that executes the program of this embodiment. One or a plurality of CPUs (Central Processing Units), GPUs (Graphics Processing Units), multi-core CPUs, or the like is used for the control unit 201 . The control unit 201 is connected to each hardware unit forming the information processing apparatus 200 via a bus.

The main storage device 202 is a storage device such as SRAM (Static Random Access Memory), DRAM (Dynamic Random Access Memory), flash memory, or the like. The main storage device 202 temporarily stores information necessary during the processing performed by the control unit 201 and the program being executed by the control unit 201 .

The auxiliary storage device 203 is a storage device such as SRAM, flash memory, hard disk, or magnetic tape. The auxiliary storage device 203 stores a tomogram DB (database) 36, programs to be executed by the control unit 201, and various data necessary for executing the programs. The tomogram DB 36 may be stored in an external large-capacity storage device connected to the information processing apparatus 200 . Communication unit 204 is an interface that performs communication between information processing apparatus 200 and a network.

The display unit 205 is, for example, a liquid crystal display panel or an organic EL (electro-luminescence) panel. Input unit 206 is, for example, a keyboard or a mouse. The display unit 205 and the input unit 206 may be stacked to form a touch panel.

The information processing device 200 is a general-purpose personal computer, a tablet, a large computer, a virtual machine running on a large computer, or a quantum computer. The information processing apparatus 200 may be configured by hardware such as a plurality of personal computers or large-scale computers that perform distributed processing. The information processing device 200 may be configured by a cloud computing system. The information processing apparatus 200 may be configured by hardware such as a plurality of personal computers or large computers that operate in cooperation with each other.

FIG. 4 is an explanatory diagram for explaining the record layout of the tomogram DB 36. FIG. The tomogram DB 36 is a database in which tomograms 58 created by three-dimensional scanning and classification data 57 are recorded. The tomogram DB 36 has a 3D scan ID field, a tomogram number field, a tomogram field and a classification data field. The tomogram field and classification data field each have an RT format field and an XY format field.

The 3D scan ID field records a 3D scan ID given for each three-dimensional scan. A number indicating the order of the tomographic images 58 created by one three-dimensional scan is recorded in the tomographic number field. An RT format tomogram 58 is recorded in the RT format field of the tomogram field. An XY format tomographic image 58 is recorded in the XY format field of the tomographic image field. RT format classification data 57 is recorded in the RT format field of the classification data field. XY format classification data 57 is recorded in the XY format field of the classification data field.

Note that the tomographic image DB 36 records only the RT format tomographic image 58, and the control unit 201 may create the XY format tomographic image 58 by coordinate conversion as necessary. Instead of the DB in which the tomographic image 58 is recorded, a DB in which data regarding scanning lines before creating the tomographic image 58 is recorded may be used.

Similarly, only one of the RT format classification data 57 and the XY format classification data 57 is recorded in the tomogram DB 36, and the control unit 201 creates the other classification data 57 by coordinate conversion as necessary. may Instead of the tomogram 58, a DB in which data on scanning lines before creating the tomogram 58 is recorded may be used. The tomogram DB 36 may record only the classification data 57 created based on the tomogram 58 without including the tomogram field.

In the present embodiment, a case where the tomogram DB 36 is created in advance and recorded in the auxiliary storage device 203 will be described as an example. Only the tomographic images 58 are recorded in the tomographic image DB 36 , and the control unit 201 may create the classification data 57 based on each of the set of tomographic images 58 and record them in the tomographic image DB 36 .

When the control unit 201 creates the classification data 57 , the classification model 31 is stored in the auxiliary storage device 203 or an external large-capacity storage device connected to the information processing device 200 . The control unit 201 implements the function of a tomogram acquisition unit that acquires a plurality of tomograms 58 and the function of a classification data acquisition unit that acquires classification data 57 corresponding to the tomograms 58 .

FIG. 5 is a flowchart explaining the flow of program processing. The control unit 201 acquires a set of classification data 57 from the tomogram DB 36 (step S501). By step S<b>501 , the control unit 201 implements the function of a classification data acquisition unit that acquires a plurality of classification data 57 .

The control unit 201 constructs a three-dimensional image 59 based on the set of classification data 57 (step S502). The construction of the three-dimensional image 59 has been conventionally performed, so detailed description thereof will be omitted.

The control unit 201 extracts a predetermined area from the three-dimensional image 59 and displays it on the display unit 205 (step S503). In this embodiment, the predetermined area is lumen area 40 . Note that the control unit 201 may, for example, display the lumen region 40 opaquely and display the extraluminal region 45 surrounding the lumen region 40 semi-transparently.

The user operates the input unit 206 to appropriately cut and rotate the three-dimensional image 59, and grasp the three-dimensional shape of the three-dimensional image 59. The user marks the position determined to be the branch entrance 53 . The control unit 201 receives designation of the marking position by the user (step S504).

The control unit 201 superimposes and displays a marker indicating the marking position on the three-dimensional image 59 . Since a user interface for marking the three-dimensional image 59 has been used conventionally, detailed description thereof will be omitted. By step S504, the control unit 201 implements the function of the marker reception unit.

In step S504, the control unit 201 accepts designation of three or more marking positions. For example, the control unit 201 repeatedly accepts designation of the marking position until the user instructs the end of the marking position. The control unit 201 may proceed to the next step when designation of a predetermined number of marking positions is received.

The control unit 201 creates a reference plane 54 (see FIG. 8A) based on the marking positions (step S505). For example, if there are three marking positions, the control unit 201 calculates a plane passing through the three points. If the number of marking positions is four or more, the control unit 201 calculates a formula representing a plane that approximates the marking positions by, for example, the least-squares method. The plane calculated by the above processing is the reference plane 54 . The control unit 201 realizes the function of the reference plane creation unit that creates the reference plane 54 in step S505.

The control unit 201 determines the branch entrance 53 (step S506). The branch entrance 53 is a cross section obtained by cutting a predetermined area displayed on the display unit 205 along the reference plane 54 . By step S506, the control unit 201 implements the function of the entrance determination unit that determines the branch entrance 53 where the trunk 51 and the branch 52 diverge.

The control unit 201 superimposes the reference plane 54 and the branch entrance 53 on the three-dimensional image 59 displayed on the display unit 205 (step S507). By step S507, the control unit 201 implements the functions of the reference plane display unit and the entrance output unit. After that, the control unit 201 waits for an instruction from the user.

The control unit 201 determines whether or not the user's instruction is an instruction to determine the reference plane 54 (step S508). If it is determined that the instruction is not for determining the reference plane 54 (NO in step S508), the control unit 201 accepts an instruction by the user to move the reference plane 54 (step S509).

The user instructs to move the reference plane 54 by, for example, selecting and dragging the edge of the reference plane 54 . The user may give an instruction to move the reference plane 54 by an operation of adding a marking position. Alternatively, the control unit 201 may receive an instruction to move the reference plane 54 based on any user interface.

As described above, the user finely adjusts the position of the reference plane 54 . The control unit 201 implements the function of an adjustment reception unit that receives an adjustment instruction regarding the position of the reference plane 54 in step S509. After that, the control unit 201 returns to step S506 and re-determines the branch entrance 53 based on the reference plane 54 after movement.

When determining that an instruction to determine the reference plane 54 has been received (YES in step S508), the control unit 201 calculates the dimensions of the branch entrance 53 (step S510). As described above, the dimension is, for example, the major axis, minor axis, area, or the like of the branch entrance 53 . The dimension may be the volume of the branch 52, the length of the branch 52, or the like. The control unit 201 displays the calculated dimensions on the display unit 205 (step S511). After that, the control unit 201 terminates the processing.

In step S511, the control unit 201 may output arbitrary information regarding dimensions, such as values calculated based on the calculated dimensions. For example, the control unit 201 may output the value of the aspect ratio calculated based on the major axis and the minor axis of the branch entrance 53 .

　Figures 6A and 6B are screen examples. A three-dimensional image 59 showing the shape of the lumen region 40 is displayed on these screens. An end button 71 is displayed at the bottom right of the screen. M1 shown in FIG. 6A is a marker indicating the position marked first by the user. Similarly, M2 is a marker indicating the second marked position by the user.

FIG. 6B shows a state in which the user has rotated the three-dimensional image 59 so that the branch 52 can be seen in front, and has made the third marking. The M1 and M2 markers rotate with the three-dimensional image 59 while sticking to the surface of the lumen region 40 . In FIG. 6B the M2 marker is hidden behind the branch 52 . The control unit 201 may make the three-dimensional image 59 translucent so that the M2 marker can be seen.

The control unit 201 may accept instructions from the user such as moving the position of the marker and deleting the marker. The control unit 201 may receive a user-designated marking instruction for a cross-section and place a marker inside the three-dimensional image 59 .

After completing the marking, the user selects the end button 71 . Thus, the control unit 201 ends the processing from step S503 to step S504 described using FIG. The control unit 201 calculates the reference plane 54 based on the three-dimensional coordinates of the position marked by the user. The reference plane 54 is a plane that approximates the marking position, and is calculated, for example, by the method of least squares.

FIG. 7 is an explanatory diagram showing a cross section of the three-dimensional image 59 cut along the reference plane 54. FIG. A three-dimensional image 59 showing lumen region 40 is separated into two. The portion corresponding to trunk 51 has an oval hole corresponding to catheter area 47 . The control unit 201 determines that the portion having no hole corresponding to the catheter region 47 is the bifurcation entrance 53 where the trunk 51 and the branch 52 diverge.

　Figures 8A and 8B are screen examples. FIG. 8A shows an example of a screen displayed by the control unit 201 in step S507 of the flowchart explained using FIG. The reference plane 54 and the branch inlet 53 are superimposed on the screen described using FIG. 6A. The branch entrance 53 is indicated by grid-like hatching. A decision button 72 is displayed at the bottom right of the screen.

FIG. 8A shows an example of displaying the reference plane 54 in the vicinity of the branch entrance 53 . The control unit 201 may display the reference plane 54 including the portion where the trunk 51 is cut. The control unit 201 may receive an instruction from the user regarding the range in which the reference plane 54 is to be displayed.

If the cross section cut by the reference plane 54 does not include a region without a hole in the catheter region 47 described with reference to FIG. . The control unit 201 may output a message such as "Unable to detect the entrance of the bifurcation" on the screen.

The user can appropriately adjust the position of the reference plane 54 on the screen shown in FIG. 8A. For example, the user drags the edge of reference plane 54 to change the position of reference plane 54 in three-dimensional space. The control unit 201 receives an instruction regarding movement of the reference plane 54 from the user, and changes the display of the reference plane 54 and the branch entrance 53 .

The user selects the decision button 72 after adjusting the reference plane 54 to an appropriate state. Control unit 201 determines that an instruction to determine reference plane 54 has been received (YES in step S<b>508 ), and calculates the dimensions of branch entrance 53 . In the three-dimensional image 59, processing for calculating the length, area, volume, etc. of a three-dimensional object based on a designated cross section has been conventionally used in three-dimensional CAD (Computer Aided Design) software and the like. Therefore, the detailed description is omitted.

FIG. 8B is an example of a screen displayed by the control unit 201 in step S511 of the flowchart described using FIG. Various calculated dimensions are displayed in the dimension column 76 at the top of the screen. In FIG. 8B, the “major diameter” indicates the maximum value of the outer shape of the branch entrance 53 . “Minor diameter” indicates the minimum value of the outer shape of the branch entrance 53 . “Area” indicates the area of the branch entrance 53 . "Volume" indicates the volume of the branch portion 52 on the front side of the reference plane 54 in FIG. 8B.

The items shown in the dimension column 76 in FIG. 8B are examples of dimensions calculated and output by the control unit 201 . The types of dimensions to be output are not limited to those shown in FIG. 8B. For example, the dimensions may include the height of branch 52 , ie the distance between reference plane 54 and the surface of branch 52 furthest from reference plane 54 . The dimensions may include the average value of the major axis and the minor axis, or the oblateness of the bifurcation inlet 53, or the like. The control unit 201 implements the function of the dimension output unit using the dimension field 76 . The user refers to the dimensions displayed in the dimension column 76 to determine the device to be used.

According to the present embodiment, by outputting the dimensions of the branch inlet 53, it is possible to provide the control unit 201 that supports device selection. By measuring dimensions and selecting a device immediately prior to treatment, the physician can use the device that best suits the condition of the affected area. By using the path used for placing the device, it is possible to provide the information processing apparatus 200 that greatly reduces the invasiveness to the patient and the burden on the doctor and the like compared to the case of using the TEE probe.

The information processing device 200 can be provided that allows the doctor to select an appropriate dimension measurement location based on his/her expertise by marking the three-dimensional image 59 and adjusting the reference plane 54 .

[Modification]
FIG. 9 is a screen example of a modification. In FIG. 9 , a recommended device column 77 is displayed below the dimension column 76 . For example, the control unit 201 transmits the dimensions of the branch inlet 53 to a device manufacturer's server, or to a material management server in a medical institution, and receives a recommended device according to the dimensions. A program for selecting a recommended device based on the dimensions of the bifurcation entrance 53 may be recorded in the auxiliary storage device 203 .

The control unit 201 may display a plurality of recommended device candidates in the recommended device column 77 and select the device that the doctor actually uses. The control unit 201 realizes the function of a device information output unit that outputs information about recommended devices using the recommended device column 77 .

[Embodiment 2]
This embodiment relates to an information processing apparatus 200 in which some markers are automatically set. Descriptions of the parts common to the first embodiment are omitted.

FIG. 10 is a flowchart explaining the processing flow of the program according to the second embodiment. The control unit 201 acquires a set of classification data 57 from the tomogram DB 36 (step S501). The control unit 201 constructs a three-dimensional image 59 based on the set of classification data 57 (step S502).

The control unit 201 determines the position of the automatically set marker (step S521). The position set in step S521 is, for example, the vicinity of the base of the branch portion 52 . A specific example will be given for explanation. Control unit 201 extracts the surface of lumen region 40 . Control unit 201 extracts a portion where the surface of lumen region 40 is a saddle-shaped curved surface, for example, by pattern matching or numerical analysis. The control unit 201 determines the extracted vertex of the saddle-shaped curved surface as the position of the marker. The control unit 201 implements the function of the automatic placement unit in step S521.

The control unit 201 extracts a predetermined area from the three-dimensional image 59. The control unit 201 displays the three-dimensional image 59 on which the markers determined in step S521 are superimposed on the display unit 205 (step S522).

11A and 11B are screen examples of the second embodiment. FIG. 11A shows an example of a three-dimensional image 59 having the same shape as in the first embodiment. The vertex of the saddle surface is indicated by the marker M1. A message to the effect that the first mark has been automatically set is displayed above the three-dimensional image 59 .

FIG. 11B shows an example of a three-dimensional image 59 from which two vertices of the saddle-shaped curved surface are extracted. The vertices of the saddle surface are indicated by two markers M1 and M2. A message to the effect that the first and second marks have been automatically set is displayed above the three-dimensional image 59 .

Return to Fig. 10 to continue the explanation. The user operates the input unit 206 to appropriately cut and rotate the three-dimensional image 59, and grasps the three-dimensional shape of the three-dimensional image 59 and the positions of automatically set markers. The user makes additional markings at the location determined to be the bifurcation entrance 53 . The control unit 201 accepts designation of additional marking positions by the user so that the total of the automatically set markers is 3 or more (step S523).

The control unit 201 superimposes and displays a marker indicating the marking position on the three-dimensional image 59 . Note that the control unit 201 may receive instructions from the user such as to move the position of the marker, including the automatically set marker, and to delete the marker.

The control unit 201 calculates the reference plane 54 based on the marking position (step S505). Since subsequent processing is the same as the processing flow of the first embodiment described using FIG. 5, description thereof is omitted.

Note that the control unit 201 may display the marker whose position is determined in step S521 and the marker whose marking position is specified by the user in the same manner or in a manner that allows them to be distinguished.

According to the present embodiment, it is possible to provide the information processing apparatus 200 that reduces the user's trouble by automatically extracting the vertices of the saddle-shaped curved surface and setting the markers. Note that the position of the marker set in step S521 is not limited to the vertex of the saddle-shaped curved surface. For example, the position of the marker may be determined by pattern matching using a template showing the shape of a typical affected area and the position of the marker.

[Embodiment 3]
This embodiment relates to an information processing device 200 that uses a reference plane 54 perpendicular to the axis of the image acquisition catheter 28 . Descriptions of the parts common to the first embodiment are omitted.

FIG. 12 is a flowchart for explaining the processing flow of the program according to the third embodiment. The control unit 201 acquires a set of classification data 57 from the tomogram DB 36 (step S501). The control unit 201 constructs a three-dimensional image 59 based on the set of classification data 57 (step S502). The control unit 201 extracts a predetermined region from the three-dimensional image 59 and displays it on the display unit 205 together with the reference plane 54 perpendicular to the axis of the image acquisition catheter 28 (step S531).

FIG. 13A is a screen example of the third embodiment. A reference plane 54 perpendicular to the axis of the image acquisition catheter 28 is shown. On the reference plane 54, left-down hatching indicating a cross section of the three-dimensional image 59 is displayed.

Return to Fig. 12 to continue the explanation. The control unit 201 receives an instruction to move the reference plane 54 from the user (step S532). For example, when the user selects and drags the reference plane 54 , the control unit 201 receives an instruction to move the reference plane 54 in parallel along the axis of the image acquisition catheter 28 , and moves the position of the reference plane 54 . to change The control unit 201 implements the function of the movement reception unit in step S532.

The control unit 201 may accept, for example, the pressing of a cursor key or an instruction by voice. The control unit 201 may display buttons for receiving an instruction to move the reference plane 54 at both ends of the axis of the image acquisition catheter 28 .

The control unit 201 determines the branch entrance 53 based on the reference plane 54 after being moved based on the user's instruction (step S533). Note that, as shown in FIG. 13A, if there is no region without a hole in the catheter region 47 in the cross section of the three-dimensional image 59 cut along the reference plane 54, the control unit 201 cannot determine the bifurcation entrance 53. Decide and move on to the next step.

The control unit 201 superimposes the bifurcation entrance 53 and the reference plane 54 after movement on the three-dimensional image 59 displayed on the display unit 205 (step S534). After that, the control unit 201 waits for an instruction from the user.

FIG. 13B is a screen example of the third embodiment. FIG. 13B shows the state in which the user has moved the reference surface 54 to the appropriate position. A reference plane 54 perpendicular to the axis of the image acquisition catheter 28 is shown. On the reference plane 54, grid-like hatching indicating the branch entrance 53 and left-downward hatching indicating cross sections other than the branch entrance 53 are displayed.

After the user adjusts the reference plane 54 to an appropriate state, the user selects the enter button 72 to issue an instruction to select the reference plane 54 . The control unit 201 determines whether or not the user's operation is an instruction to determine the reference plane 54 (step S535). If it is determined that the instruction is not for determining the reference plane 54 (NO in step S535), the control unit 201 returns to step S532 and receives an instruction by the user to move the reference plane .

When determining that an instruction to determine the reference plane 54 has been received (YES in step S535), the control unit 201 calculates the dimensions of the branch entrance 53 (step S510). The control unit 201 displays the calculated dimensions on the display unit 205 (step S511). After that, the control unit 201 terminates the processing.

According to the present embodiment, it is possible to provide the information processing device 200 in which the operation of adjusting the position of the reference plane 54 is simple.

Note that in step S532 of the flowchart described using FIG. 12, the control unit 201 may receive an instruction to move the reference plane 54 obliquely with respect to the axis of the image acquisition catheter 28. For example, after moving the reference plane 54 to the vicinity of the target position, the user switches the operation mode of the reference plane 54 by right-clicking, voice input, or the like. The control unit 201 accepts switching of the operation mode, and then accepts an instruction such as tilting the reference plane 54 in step S532.

[Embodiment 4]
This embodiment relates to an information processing apparatus 200 that automatically extracts the bifurcation entrance 53 using a reference plane 54 perpendicular to the axis of the image acquisition catheter 28 . The description of the parts common to the third embodiment is omitted.

FIG. 14 is an explanatory diagram for explaining the initial position of the reference plane 54 of the fourth embodiment. Five reference planes 54 perpendicular to the axis of the image acquisition catheter 28 are indicated by reference planes 54S1 to 54S5. The position of each reference plane 54 is indicated by an arrow pointing from the reference plane 54 to the three-dimensional image 59 .

A cross section of the trunk 51 appears on the reference surface 54S1. A cross section of the trunk 51 extending downward appears on the reference surface 54S2. A cross section in which the stem 51 and the branch 52 are separated appears on the reference plane 54S3. A cross section of the stem 51 and a cross section of the tip portion of the branch portion 52 appear on the reference plane 54S4. A cross section of the trunk 51 appears on the reference surface 54S5.

The control unit 201 sequentially moves the reference plane 54 perpendicular to the axis of the image acquisition catheter 28, and extracts the final reference plane 54 where the trunk 51 appears. Specifically, in the example shown in FIG. 14, the control unit 201 sequentially moves the reference plane 54 from the reference plane 54S1 toward the reference plane 54S5, and the reference plane 54S4, which is the last reference plane 54 where the branch portion 52 appears, is moved. to extract

After that, the control unit 201 sequentially moves the branch entrance 53 from the reference plane 54S4 toward the branch 52, and extracts the final reference plane 54 where the trunk 51 appears. Specifically, in the example shown in FIG. 14, the control unit 201 sequentially moves the reference plane 54 from the reference plane 54S4 toward the reference plane 54S1, and extracts the last reference plane 54 where the branch portion 52 appears. Since the reference plane 54 extracted here is the same as the reference plane 54 shown in FIG. 13B described in Embodiment 3, illustration thereof is omitted in FIG.

Note that the control unit 201 may use the individual classification data 57 acquired in step S501 instead of the cross section obtained by cutting the three-dimensional image 59 constructed in step S502 along the reference plane 54 . In this case, the scanning plane corresponding to each classification data 57 corresponds to the reference plane 54 .

FIG. 15 is a flow chart for explaining the processing flow of the program of the fourth embodiment. The control unit 201 acquires a set of classification data 57 from the tomogram DB 36 (step S501). The control unit 201 constructs a three-dimensional image 59 based on the set of classification data 57 (step S502).

As described with reference to FIG. 14, the control unit 201 uses the reference plane 54 perpendicular to the axis of the image acquisition catheter 28 to extract the reference plane 54 including the end of the branch 52 (step S541 ). The reference plane 54 extracted in step S541 is the reference plane 54S4 in FIG.

The control unit 201 determines in which side direction the branch portion 52 exists with reference to the reference plane 54 extracted in step S541 (step S542). The control unit 201 displays the three-dimensional image 59 in which the predetermined area is extracted, the reference plane 54 extracted in step S541, and the direction determined in step S542 on the display unit 205 (step S543).

FIG. 16 is a screen example of the fourth embodiment. FIG. 16 shows an example of a screen displayed on the display unit 205 by the control unit 201 in step S543. A reference plane 54 corresponding to the reference plane 54S4 in FIG. 14 is superimposed on the three-dimensional image 59 and displayed. An arrow indicating the direction determined in step S542 is displayed near the reference plane 54 . A comment "Please wait" is displayed at the top of the screen.

With the screen shown in FIG. 16, the user can confirm that the control unit 201 has appropriately determined the reference plane 54 including the tip of the branch 52 and the direction toward the base of the branch 52 . If the determination by control unit 201 is incorrect, the user instructs the transition to the operation mode described in the third embodiment, for example, and manually determines reference plane 54 .

Return to Fig. 15 to continue the explanation. The control unit 201 starts the reference plane selection-1 subroutine (step S544). The reference plane selection-1 subroutine is a subroutine that translates the reference plane 54 perpendicular to the axis of the image acquisition catheter 28 toward the base of the branch 52 . The control unit 201 moves the reference plane 54 to the position shown in FIG. 13B, for example, by the reference plane selection-1 subroutine. The processing flow of the reference plane selection-1 subroutine will be described later.

The control unit 201 determines the branch entrance 53 based on the reference plane 54 after movement (step S506). Since subsequent processing is the same as the processing flow of the first embodiment described using FIG. 5, description thereof is omitted.

FIG. 17 is a flowchart for explaining the processing flow of the reference plane selection-1 subroutine. The reference plane selection-1 subroutine is a subroutine that translates the reference plane 54 perpendicular to the axis of the image acquisition catheter 28 toward the base of the branch 52 .

The control unit 201 translates the reference plane 54 by a predetermined amount in the direction determined in step S542 (step S551). The predetermined amount is, for example, one or more scan planes of the image acquisition catheter 28 . The predetermined amount is not limited to integral multiples of the scanning plane.

The control unit 201 determines whether or not the branch portion 52 has ended on the reference plane 54 after movement (step S552). Specifically, if the section obtained by cutting the three-dimensional image 59 on the reference plane 54 does not include a region without a hole in the catheter region 47 described with reference to FIG. Determine that it is finished.

If it is determined that the branch section 52 has not ended (NO in step S552), the control section 201 returns to step S551. If it is determined that the branch portion 52 has ended (YES in step S552), the control unit 201 returns the reference plane 54 to the previous loop position (step S553). After that, the control unit 201 terminates the processing.

Note that after step S551, the control unit 201 calculates the area of the branch portion 52 on the reference plane 54, and if the area of the branch portion 52 changes significantly compared to the previous loop, the branch portion 52 ends in step S552. It may be determined that

The control unit 201 may update the screen shown in FIG. 16 each time the reference plane 54 is moved in step S551. The user can confirm the process in which the control unit 201 automatically determines the position of the reference plane 54 .

According to this embodiment, the information processing device 200 that automatically determines the position of the reference plane 54 perpendicular to the axis of the image acquisition catheter 28 can be provided. The user can adjust the automatically determined reference plane 54 as needed to confirm the dimensions of the bifurcation inlet 53 and select the appropriate device.

Note that the control unit 201 may automatically detect a point near the root of the branch 52 as described in the second embodiment, and translate the reference plane 54 to that point.

[Embodiment 5]
This embodiment relates to an information processing device 200 that uses a reference plane 54 parallel to the axis of the image acquisition catheter 28 . The description of the parts common to the third embodiment is omitted.

FIG. 18 is a flowchart for explaining the processing flow of the program according to the fifth embodiment. The control unit 201 acquires a set of classification data 57 from the tomogram DB 36 (step S501). The control unit 201 constructs a three-dimensional image 59 based on the set of classification data 57 (step S502). The control unit 201 extracts the endpoint 522 (see FIG. 19A) (step S561).

FIG. 19A is a screen example of the fifth embodiment. As shown in FIG. 19A, end point 522 is the most distal point of branch 52 when viewed from the axis of image acquisition catheter 28 . In step S561, the control unit 201 realizes the function of the distal point selection unit that automatically selects the end point 522, which is the distal point.

A specific example will be given to explain the method of extracting the endpoint 522. For example, the control unit 201 extracts the branches 52 for each cross section perpendicular to the axis of the image acquisition catheter 28, as described using FIG. The control unit 201 extracts the farthest point from the axis of the image acquisition catheter 28 among the extracted branch portions 52 . After extracting the branch 52 from the three-dimensional image 59 by pattern matching, the control unit 201 may extract the farthest point from the axis of the image acquisition catheter 28 in the branch 52 .

The screen shown in FIG. 19A allows the user to confirm that the control unit 201 has appropriately determined the reference plane 54 that includes the axis of the image acquisition catheter 28 and is substantially perpendicular to the extending direction of the branch portion 52 . If the determination by control unit 201 is incorrect, the user instructs the mode to shift to, for example, the modes described in Embodiments 1 to 4, and determines reference plane 54 by an algorithm different from that of the present embodiment. do.

Note that the control unit 201 may receive an instruction from the user to change the orientation of the reference plane 54, the orientation of the perpendicular P, or the position of the end point 522.

Return to Fig. 18 to continue the explanation. The control unit 201 determines a perpendicular line P drawn down from the end point 522 extracted in step S561 to the axis of the image acquisition catheter 28 (step S562). In FIG. 19A, the axis of the image acquisition catheter 28 is indicated by a dashed line, and the perpendicular line P is indicated by a thin solid line.

The control unit 201 creates a reference plane 54 that includes the axis of the image acquisition catheter 28 and is perpendicular to the perpendicular line P (step S563). The control unit 201 realizes the function of the reference plane creation unit that creates the reference plane 54 in step S563. The control unit 201 extracts a predetermined area from the three-dimensional image 59 and displays it on the display unit 205 together with the end point 522, the perpendicular line P and the reference plane 54 (step S564).

FIG. 19A described above is an example of the screen displayed by the control unit 201 in step S531. A reference plane 54 is shown that includes and is parallel to the axis of the image acquisition catheter 28 . On the reference plane 54, left-down hatching indicating a cross section of the three-dimensional image 59 is displayed. In FIG. 19A , both ends of the hatched section are stumps of the three-dimensional image 59 and are not surrounded by closed curves indicating the surface of the three-dimensional image 59 .

Return to Fig. 18 to continue the explanation. The control unit 201 receives an instruction to move the reference plane 54 from the user (step S565). For example, when the user selects and drags the reference plane 54 , the control unit 201 receives an instruction to move the reference plane 54 parallel to the perpendicular line P and changes the position of the reference plane 54 .

The control unit 201 may accept, for example, the pressing of a cursor key or an instruction by voice. The control unit 201 may display buttons at both ends of the perpendicular line P for accepting an instruction to move the reference plane 54 . The control unit 201 implements the function of the movement reception unit in step S565.

The control unit 201 determines the branch entrance 53 based on the reference plane 54 after being moved based on the user's instruction (step S566). Note that when the cross section of the three-dimensional image 59 cut by the reference plane 54 is not surrounded by a closed curve representing the surface of the three-dimensional image 59 as in the reference plane 54 shown in FIG. 53 cannot be determined and proceed to the next step.

The control unit 201 superimposes the reference plane 54 after movement on the three-dimensional image 59 displayed on the display unit 205 (step S567). If the branch entrance 53 can be determined in step S566, the controller 201 also superimposes the branch entrance 53 in step S567. After that, the control unit 201 waits for an instruction from the user.

FIG. 19B is a screen example of the fifth embodiment. FIG. 19B shows an example of a screen displayed by the control unit 201 in step S567 when the control unit 201 has successfully determined the branch entrance 53 . The area determined by the control unit 201 to be the branch entrance 53 is indicated by grid-like hatching. After the user adjusts the reference plane 54 to an appropriate state, the user selects the enter button 72 to issue an instruction to select the reference plane 54 .

Return to Fig. 18 to continue the explanation. The control unit 201 determines whether or not the user's operation is an instruction to determine the reference plane 54 (step S568). If it is determined that the instruction is not to determine the reference plane 54 (NO in step S568), the control unit 201 returns to step S565 and accepts the user's instruction to move the reference plane .

When determining that an instruction to determine the reference plane 54 has been received (YES in step S568), the control unit 201 calculates the dimensions of the branch entrance 53 (step S510). The control unit 201 displays the calculated dimensions on the display unit 205 (step S511). After that, the control unit 201 terminates the processing.

According to the present embodiment, it is possible to provide the information processing device 200 in which the operation of adjusting the position of the reference plane 54 is simple.

It should be noted that in step S565 of the flowchart explained using FIG. For example, after moving the reference plane 54 to the vicinity of the target position, the user switches the operation mode of the reference plane 54 by right-clicking, voice input, or the like. The control unit 201 accepts switching of the operation mode, and in subsequent step S565, accepts an instruction such as tilting the reference plane 54 .

[Embodiment 6]
This embodiment relates to an information processing apparatus 200 that automatically extracts a bifurcation entrance 53 using a reference plane 54 parallel to the axis of the image acquisition catheter 28 . Descriptions of the portions common to the fifth embodiment are omitted.

FIG. 20 is a flow chart for explaining the processing flow of the program of the sixth embodiment. The flow of processing up to step S564 is the same as the flow of processing of the program of Embodiment 5 described using FIG. 18, so description thereof will be omitted.

The control unit 201 starts the reference plane selection-2 subroutine (step S571). The reference plane selection-2 subroutine is a subroutine that translates the reference plane 54 perpendicular to the perpendicular P to a position where the branch portion 52 is cut. The processing flow of the reference plane selection-2 subroutine will be described later.

The control unit 201 determines the branch entrance 53 based on the reference plane 54 after movement (step S506). Since subsequent processing is the same as the processing flow of the first embodiment described using FIG. 5, description thereof is omitted.

FIG. 21 is a flowchart for explaining the processing flow of the reference plane selection-2 subroutine. The reference plane selection-2 subroutine is a subroutine that translates the reference plane 54 perpendicular to the perpendicular P to a position where the branch portion 52 is cut.

The control unit 201 performs parallel movement toward the end point 522 (step S581). The control unit 201 creates a cross section in which the reference plane 54 after movement cuts the three-dimensional image 59 (step S582). The control unit 201 determines whether or not the cross section is surrounded by a closed curve representing the surface of the three-dimensional image 59, that is, whether or not the cross section is a closed surface (step S583).

If it is determined that the surface is not closed (NO in step S583), the control unit 201 returns to step S581. If it is determined that the face is closed (YES in step S583), the control unit 201 ends the process.

According to this embodiment, the information processing device 200 that automatically determines the position of the reference plane 54 including the axis of the image acquisition catheter 28 can be provided. The user can adjust the automatically determined reference plane 54 as needed to confirm the dimensions of the bifurcation inlet 53 and select the appropriate device.

Note that the control unit 201 may automatically detect a point near the root of the branch 52 as described in the second embodiment, and translate the reference plane 54 to that point. When the control unit 201 cannot detect a plane with a closed cross section within a predetermined range from the vicinity of the base of the branch 52 (NO in step S583), the control unit 201 determines that the branch entrance 53 cannot be automatically detected, and states that. may be displayed on the display unit 205 .

[Embodiment 7]
This embodiment relates to an information processing apparatus 200 that uses a reference plane 54 perpendicular to the axis of the branch portion 52 . The description of the parts common to the third embodiment is omitted.

FIG. 22 is an explanatory diagram for explaining a branch shaft 521 that is the axis of the branch portion 52 of the seventh embodiment. Classified images S6 to S10 are classified images created based on five tomographic images 58 perpendicular to the axis of the image acquisition catheter 28. FIG. The position of each classified image is indicated by an arrow pointing from the classified image to the three-dimensional image 59 .

The cross section of the trunk 51 appears in the classified images S6 to S10. In the classified images S6 to S10, the cross section of the branch 52 separated from the trunk 51 to the lower side also appears. The coordinates of the center of gravity 55 are calculated with respect to the cross section of each branch portion 52 .

The control unit 201 approximates the coordinates of the center of gravity 55 calculated for each classified image with a straight line, for example, by the method of least squares, and calculates an equation representing the branch axis 521 . Since the calculation of the center of gravity 55 and the linear approximation of a plurality of points have been conventionally performed, detailed description thereof will be omitted. As described above, the control unit 201 creates the branch shaft 521 that is the axis of the branch portion 52 .

23A and 23B are examples of screens according to the seventh embodiment. A reference plane 54 perpendicular to the branch axis 521 is displayed superimposed on the three-dimensional image 59 . The user selects the decision button 72 after translating the reference plane 54 to a desired position, for example, as shown in FIG. 23B. The control unit 201 extracts the bifurcation entrance 53 from the cross section of the three-dimensional image 59 cut along the reference plane 54 and calculates the dimensions.

FIG. 24 is a flow chart for explaining the processing flow of the program of the seventh embodiment. The control unit 201 acquires a set of classification data 57 from the tomogram DB 36 (step S501). The control unit 201 constructs a three-dimensional image 59 based on the set of classification data 57 (step S502).

The control unit 201 starts a branch axis creation subroutine (step S591). The branch axis creation subroutine is a subroutine for creating the branch axis 521, which is the axis of the branch portion 52, as described with reference to FIG. 23A. The processing flow of the branch axis creation subroutine will be described later. The control unit 201 realizes the function of the branch axis calculation unit by a branch axis creation subroutine.

The control unit 201 selects a penetration point 523 where the branch shaft 521 penetrates the branch portion 52 (step S592). The control unit 201 creates a reference plane 54 passing through the piercing point 523 selected in step S592 and perpendicular to the branch axis 521 (step S593). The control unit 201 implements the function of the reference plane creation unit that creates the reference plane 54 in step S593. The control unit 201 displays the three-dimensional image 59 from which the predetermined area is extracted, the branch axis 521, and the reference plane 54 determined in step S593 on the display unit 205 (step S594).

FIG. 23A described above is an example of the screen displayed on the display unit 205 by the control unit 201 in step S594. The screen shown in FIG. 23A allows the user to confirm that the control unit 201 has created the branch axis 521 appropriately. If branch axis 521 created by control unit 201 is inappropriate, for example, the user instructs a transition to the mode described in Embodiments 1 to 6, and an algorithm different from that of this embodiment is used. A reference plane 54 is determined.

The control unit 201 may receive an instruction from the user to change the orientation of the reference plane 54, the orientation of the branch shaft 521, or the position of the branch shaft 521 via the screen illustrated in FIG. 23A.

The control unit 201 receives an instruction to move the reference plane 54 from the user (step S595). For example, when the user selects and drags the reference plane 54 , the control unit 201 receives an instruction to move the reference plane 54 parallel to the branch axis 521 and changes the position of the reference plane 54 .

The control unit 201 may accept, for example, the pressing of a cursor key or an instruction by voice. The control unit 201 may display buttons at both ends of the branch shaft 521 to receive an instruction to move the reference plane 54 . The control unit 201 realizes the function of the movement reception unit in step S595.

The control unit 201 determines the branch entrance 53 based on the reference plane 54 after being moved based on the user's instruction (step S596). Note that if the section of the three-dimensional image 59 cut by the reference plane 54 does not include a region having no hole in the catheter region 47, the control unit 201 determines that the bifurcation entrance 53 cannot be determined, and proceeds to the next step. proceed to

The control unit 201 superimposes the bifurcation entrance 53 and the reference plane 54 after movement on the three-dimensional image 59 displayed on the display unit 205 (step S597). After that, the control unit 201 waits for an instruction from the user. FIG. 23B described above is an example of the screen displayed on the display unit 205 by the control unit 201 in step S597.

After the user adjusts the reference plane 54 to an appropriate state, the user selects the enter button 72 to issue an instruction to select the reference plane 54 . The control unit 201 determines whether or not the user's operation is an instruction to determine the reference plane 54 (step S598). If it is determined that the instruction is not for determining the reference plane 54 (NO in step S598), the control unit 201 returns to step S595 and receives an instruction for moving the reference plane 54 from the user.

When determining that an instruction to determine the reference plane 54 has been received (YES in step S598), the control unit 201 calculates the dimensions of the branch entrance 53 (step S510). The control unit 201 displays the calculated dimensions on the display unit 205 (step S511). After that, the control unit 201 terminates the processing.

According to the present embodiment, it is possible to provide the information processing device 200 in which the operation of adjusting the position of the reference plane 54 is simple.

It should be noted that in step S595 of the flowchart explained using FIG. For example, after moving the reference plane 54 to the vicinity of the target position, the user switches the operation mode of the reference plane 54 by right-clicking, voice input, or the like. The control unit 201 accepts switching of the operation mode, and in subsequent step S595, accepts an instruction such as tilting the reference surface 54 .

FIG. 25 is a flowchart for explaining the processing flow of the branch axis creation subroutine. The branch axis creation subroutine is a subroutine for creating the branch axis 521, which is the axis of the branch portion 52, as described with reference to FIG. 23A.

The control unit 201 acquires the classification data 57 corresponding to one tomographic image 58 from the tomographic image DB 36 (step S601). The control unit 201 creates one classified image based on the classified data 57 acquired in step S601 (step S602).

The control unit 201 determines whether the created classified image includes the cross section of the branch portion 52 (step S603). If it is determined that it is included (YES in step S603), the control unit 201 calculates the three-dimensional coordinates of the center of gravity 55 of the branch portion 52 (step S604). The control unit 201 realizes the function of the center-of-gravity calculation unit in step S604. The control unit 201 records the calculated coordinates in the main storage device 202 or the auxiliary storage device 203 (step S605).

When it is determined that the branch part 52 is not included (NO in step S603) or after step S605 is completed, the control unit 201 determines whether or not the processing of the set of classification data 57 has been completed (step S606). If it is determined that the processing has not ended (NO in step S606), the control unit 201 returns to step S601. If it is determined that the processing has ended (YES in step S606), the control unit 201 calculates the branch axis 521 based on the plurality of centroids 55 recorded in step S605 (step S607). After that, the control unit 201 terminates the processing.

According to the present embodiment, it is possible to provide the information processing device 200 in which the operation of adjusting the position of the reference plane 54 is simple.

[Embodiment 8]
This embodiment relates to an information processing apparatus 200 that automatically extracts a branch entrance 53 using a reference plane 54 perpendicular to the axis of the branch 52 . The description of the parts common to the seventh embodiment is omitted.

FIG. 26 is a flow chart for explaining the processing flow of the program of the eighth embodiment. The flow of processing up to step S594 is the same as the flow of processing of the program of Embodiment 7 described using FIG. 24, so description thereof will be omitted.

The control unit 201 starts the reference plane selection-3 subroutine (step S611). The reference plane selection-3 subroutine is a subroutine that translates the reference plane 54 perpendicular to the branch axis 521 to the position where the branch portion 52 is cut. The processing flow of the reference plane selection-3 subroutine will be described later.

The control unit 201 determines the branch entrance 53 based on the reference plane 54 after movement (step S506). Since subsequent processing is the same as the processing flow of the first embodiment described using FIG. 5, description thereof is omitted.

FIG. 27 is a flowchart for explaining the processing flow of the reference plane selection-3 subroutine. The reference plane selection-3 subroutine is a subroutine that translates the reference plane 54 perpendicular to the branch axis 521 to the position where the branch portion 52 is cut.

The control unit 201 translates the reference plane 54 along the branch shaft 521 toward the root of the branch 52 (step S621). The control unit 201 creates a cross section in which the reference plane 54 after movement cuts the three-dimensional image 59 (step S622). The control unit 201 determines whether or not the branch portion 52 has ended on the reference plane 54 after movement (step S623). Specifically, if the section obtained by cutting the three-dimensional image 59 on the reference plane 54 does not include a region without a hole in the catheter region 47 described with reference to FIG. Determine that it is finished.

If it is determined that the branch unit 52 has not ended (NO in step S623), the control unit 201 returns to step S621. If it is determined that the branch portion 52 has ended (YES in step S623), the control unit 201 returns the reference plane 54 to the previous loop position (step S624). After that, the control unit 201 terminates the processing.

Note that after step S622, the control unit 201 calculates the area of the branch portion 52 on the reference plane 54, and if the area of the branch portion 52 changes significantly compared to the previous loop, the branch portion 52 ends in step S623. It may be determined that

The control unit 201 may update the screen described using FIGS. 23A and 23B each time a cross section is created in step S622. The user can confirm the process in which the control unit 201 automatically determines the position of the reference plane 54 .

According to this embodiment, the information processing device 200 that automatically determines the position of the reference plane 54 perpendicular to the axis of the branch portion 52 can be provided. The user can adjust the automatically determined reference plane 54 as needed to confirm the dimensions of the bifurcation inlet 53 and select the appropriate device.

Note that the control unit 201 may automatically detect a point near the root of the branch 52 as described in the second embodiment, and translate the reference plane 54 to that point.

[Embodiment 9]
This embodiment relates to an information processing apparatus 200 that uses a reference plane 54 that rotates about a rotation axis 542 set near the base of a branch portion 52 . The description of the parts common to the third embodiment is omitted.

FIGS. 28A and 28B are screen examples of the ninth embodiment. Reference plane 54 of the present embodiment will be described with reference to FIGS. 28A and 28B. 28A and 28B, the reference point 541 is a point near the base of the branch portion 52. FIG.

Explain with specific examples. Control unit 201 extracts the surface of lumen region 40 . Control unit 201 extracts a portion where the surface of lumen region 40 is a saddle-shaped curved surface, for example, by pattern matching or numerical analysis. The control unit 201 determines the extracted vertex of the saddle-shaped curved surface as the reference point 541 . In the above description, the lumen area 40 is an example of a predetermined area.

As shown in FIG. 28A , the control unit 201 determines a perpendicular line P drawn from the reference point 541 to the axis of the image acquisition catheter 28 . In FIG. 28A, the axis of the image acquisition catheter 28 is indicated by a dashed line, and the perpendicular line P is indicated by a thin solid line. The controller 201 determines a reference plane 54 that passes through the reference plane 54 and is perpendicular to the axis of the image acquisition catheter 28 . The control unit 201 determines a rotation axis 542 perpendicular to the perpendicular line P on the reference plane 54 .

As shown in FIG. 28B, the control unit 201 rotates the reference plane 54 around the rotation axis 542 based on the user's instruction. The user selects the determination button 72 outside the field where the reference plane 54 has been rotated to the desired angle, and determines the junction entrance 53 .

FIG. 29 is a flowchart for explaining the processing flow of the program according to the ninth embodiment. The control unit 201 acquires a set of classification data 57 from the tomogram DB 36 (step S501). The control unit 201 constructs a three-dimensional image 59 based on the set of classification data 57 (step S502).

The control unit 201 determines the coordinates of the reference point 541 near the base of the branch 52 (step S631). A specific example will be given for explanation. Control unit 201 extracts the surface of lumen region 40 . Control unit 201 extracts a portion where the surface of lumen region 40 is a saddle-shaped curved surface, for example, by pattern matching or numerical analysis. The control unit 201 determines the coordinates of the extracted vertex of the saddle-shaped curved surface as the coordinates of the reference point 541 .

The control unit 201 determines a perpendicular line P drawn from the reference point 541 determined in step S631 to the central axis of the image acquisition catheter 28 (step S632). The control unit 201 creates a reference plane 54 passing through the reference point 541 determined in step S631 and perpendicular to the central axis of the image acquisition catheter 28 (step S633). The control unit 201 implements the function of the cross section selection unit in step S633.

The control unit 201 determines the rotation axis 542 perpendicular to the perpendicular line P determined in step S632 on the reference plane 54 created in step S633 (step S634). By step S<b>634 , the control unit 201 realizes the function of the rotation axis calculation unit that calculates the rotation axis 542 .

The control unit 201 extracts a predetermined area from the three-dimensional image 59. The control unit 201 displays on the display unit 205 a three-dimensional image 59 in which the rotation axis 542 determined in step S634 and the reference plane 54 set in step S633 are superimposed (step S635).

FIG. 28A described above is an example of the screen displayed on the display unit 205 by the control unit 201 in step S635. The screen shown in FIG. 28A allows the user to confirm that the control unit 201 has created the rotation shaft 542 appropriately. If the rotation axis 542 created by the control unit 201 is inappropriate, the user instructs a shift to the modes described in the first to eighth embodiments, for example, and an algorithm different from that of the present embodiment is executed. determines the reference plane 54 by .

The control unit 201 may receive an instruction from the user to change the orientation of the rotation axis 542 or the position of the reference point 541 via the screen illustrated in FIG. 28A.

The control unit 201 receives an instruction to move the reference plane 54 from the user (step S636). For example, when the user selects and drags the reference plane 54 , the control unit 201 receives an instruction to rotate the reference plane 54 around the rotation axis 542 and changes the position of the reference plane 54 . By step S<b>636 , the control unit 201 implements the function of a rotation reception unit that receives an instruction to rotate the reference plane 54 .

The control unit 201 may accept, for example, the pressing of a cursor key or an instruction by voice. The control unit 201 may display buttons for accepting clockwise and counterclockwise directions near the rotation shaft 542 .

The control unit 201 determines the branch entrance 53 based on the reference plane 54 after being moved based on the user's instruction (step S637). Note that if the section of the three-dimensional image 59 cut by the reference plane 54 does not include a region having no hole in the catheter region 47, the control unit 201 determines that the bifurcation entrance 53 cannot be determined, and proceeds to the next step. proceed to

The control unit 201 superimposes the bifurcation entrance 53 and the reference plane 54 after movement on the three-dimensional image 59 displayed on the display unit 205 (step S638). After that, the control unit 201 waits for an instruction from the user. FIG. 28B described above is an example of a screen displayed on the display unit 205 by the control unit 201 in step S637.

After the user adjusts the reference plane 54 to an appropriate state, the user selects the enter button 72 to issue an instruction to select the reference plane 54 . The control unit 201 determines whether or not the user's operation is an instruction to determine the reference plane 54 (step S639). If it is determined that the instruction is not for determining the reference plane 54 (NO in step S639), the control unit 201 returns to step S636 and receives an instruction for rotating the reference plane 54 from the user.

When it is determined that an instruction to determine the reference plane 54 has been received (YES in step S639), the control section 201 calculates the dimensions of the branch entrance 53 (step S510). The control unit 201 displays the calculated dimensions on the display unit 205 (step S511). After that, the control unit 201 terminates the processing.

According to the present embodiment, it is possible to provide the information processing device 200 that adjusts the position of the reference plane 54 by rotating.

It should be noted that in step S631, if there are multiple suitable reference point 541 candidates, the control unit 201 may accept selection of the reference point 541 by the user.

[Embodiment 10]
This embodiment relates to an information processing apparatus 200 that automatically extracts a branch entrance 53 using a reference plane 54 that rotates about a rotation axis 542 set near the base of a branch 52 . The description of the parts common to the ninth embodiment is omitted.

FIG. 30 is a flow chart explaining the processing flow of the program of the tenth embodiment. The flow of processing up to step S635 is the same as the flow of processing of the program of Embodiment 7 described using FIG. 29, so description thereof will be omitted.

The control unit 201 starts the reference plane selection-4 subroutine (step S641). The reference plane selection-4 subroutine is a subroutine for rotating the reference plane 54 about the rotation shaft 542 to a predetermined direction. The processing flow of the reference plane selection-4 subroutine will be described later.

The control unit 201 determines the branch entrance 53 based on the reference plane 54 after rotation (step S506). Since subsequent processing is the same as the processing flow of the first embodiment described using FIG. 5, description thereof is omitted.

FIG. 31 is a flowchart for explaining the processing flow of the reference plane selection-4 subroutine. The reference plane selection-4 subroutine is a subroutine for rotating the reference plane 54 perpendicular to the axial center of the image acquisition catheter 28 described using FIG. 28A to an angle just before the branch 52 is cut. However, in this embodiment, the control unit 201 rotates the reference surface 54 within a range not exceeding a predetermined angle. The predetermined angle is, for example, 45 degrees with respect to the axis of the image acquisition catheter 28 .

The control unit 201 rotates the reference plane 54 by a predetermined angle around the rotation shaft 542 (step S651). The rotation direction is such that the portion where the reference plane 54 cuts the three-dimensional image 59 moves away from the tip of the branch portion 52 . The control unit 201 determines whether or not the angle between the reference plane 54 and the axis of the image acquisition catheter 28 exceeds a predetermined threshold (step S652).

If it is determined that it does not exceed (NO in step S652), the control unit 201 creates a cross section in which the reference plane 54 after rotation cuts the three-dimensional image 59 (step S653). The control unit 201 determines whether or not the branch portion 52 has ended on the reference plane 54 after rotation (step S654). Specifically, if the section obtained by cutting the three-dimensional image 59 on the reference plane 54 does not include a region without a hole in the catheter region 47 described with reference to FIG. Determine that it is finished.

If it is determined that the branch unit 52 has not ended (NO in step S654), the control unit 201 returns to step S651. If it is determined that the branch portion 52 has ended (YES in step S654), or if it is determined that the threshold value has been exceeded (YES in step S652), the control unit 201 returns the reference plane 54 to the angle of the previous loop. (Step S655). After that, the control unit 201 terminates the processing.

Note that after step S653, the control unit 201 calculates the area of the branch portion 52 on the reference plane 54, and if the area of the branch portion 52 changes significantly compared to the previous loop, the branch portion 52 ends in step S654. It may be determined that

The control unit 201 may update the screen described using FIG. 28B each time a cross section is created in step S653. The user can confirm the process in which the control unit 201 automatically determines the position of the reference plane 54 .

According to this embodiment, the information processing apparatus 200 is provided that automatically extracts the branch entrance 53 using the reference plane 54 that rotates about the rotation shaft 542 set near the base of the branch 52 . can. The user can adjust the automatically determined reference plane 54 as needed to confirm the dimensions of the bifurcation inlet 53 and select the appropriate device.

[Embodiment 11]
This embodiment relates to an information processing apparatus 200 that selects and uses a tomographic image 58 to be used in synchronization with the patient's heartbeat. Descriptions of the parts common to the first embodiment are omitted.

In the present embodiment, together with a set of tomographic images 58, heartbeat data measured while acquiring the tomographic images 58 are recorded. The heartbeat data is, for example, data measured by an electrocardiograph. It is possible to associate the time when each tomographic image 58 was acquired with the heartbeat data using a time stamp or the like. The control unit 201 extracts the tomographic image 58 in which the pulsation is within a predetermined range, and constructs a three-dimensional image 59 . As described above, a highly accurate three-dimensional image 59 can be constructed while avoiding the influence of pulsation.

FIG. 32 is a flow chart for explaining the processing flow of the three-dimensional image construction subroutine according to the eleventh embodiment. The subroutine of FIG. 32 is executed instead of step S502 in the first to tenth embodiments. The information processing apparatus 200 of the present embodiment is realized by constructing the 3D image 59 using the 3D image construction subroutine.

The control unit 201 acquires the pulsation data stored in association with the set of tomographic images 58 (step S661). The control unit 201 acquires the classification data 57 created based on one tomographic image 58 (step S662).

The control unit 201 determines whether the classified data 57 acquired in step S662 is based on the tomographic image 58 acquired at a predetermined time in the pulse data (step S663). The predetermined period of time is specified by the user, for example, during a period in which the observation target region does not move much.

If it is determined to be based on the tomographic image 58 acquired at a predetermined time (YES in step S663), the control unit 201 associates the tomographic number with the classification data 57 and records them in the main storage device 202 or the auxiliary storage device 203. (step S664). If it is determined that the tomogram 58 is not based on the tomographic image 58 acquired at the time (NO in step S663), or after step S664 is completed, the control unit 201 determines whether the processing of the set of classification data 57 has been completed. Determine (step S665).

If it is determined that the processing has not ended (NO in step S665), the control unit 201 returns to step S662. If it is determined that the process has ended (YES in step S665), the control unit 201 uses the classification data 57 recorded in step S664 to construct a three-dimensional image 59 (step S666). The control unit 201 appropriately complements the portion corresponding to the scanning plane that has not been recorded in step S664 (step S667).

According to the present embodiment, it is possible to provide the information processing device 200 that avoids the influence of the patient's pulsation and builds a highly accurate three-dimensional image 59 .

It should be noted that multiple sets of tomographic images 58 may be repeatedly acquired at the same location. A three-dimensional image 59 with high accuracy and high spatial resolution is created by extracting the tomographic images 58 in which the pulsation is within a predetermined range from a plurality of sets of tomographic images 58 and constructing one three-dimensional image 59. can build.

[Embodiment 12]
This embodiment relates to a catheter system 10 that acquires a tomogram 58 in real time and records the tomogram 58 and classification data 57 in a tomogram DB 36 . Descriptions of the parts common to the first embodiment are omitted.

FIG. 33 is an explanatory diagram illustrating the configuration of the catheter system 10. FIG. The catheter system 10 includes an image processing device 210 , a catheter control device 27 , an MDU (Motor Driving Unit) 289 , and an image acquisition catheter 28 . Image acquisition catheter 28 is connected to image processing device 210 via MDU 289 and catheter control device 27 .

The image processing device 210 includes a control section 211, a main memory device 212, an auxiliary memory device 213, a communication section 214, a display section 215, an input section 216, and a bus. The control unit 211 is an arithmetic control device that executes the program of this embodiment. One or a plurality of CPUs, GPUs, multi-core CPUs, or the like is used for the control unit 211 . The control unit 211 is connected to each hardware unit forming the image processing apparatus 210 via a bus.

The main storage device 212 is a storage device such as SRAM, DRAM, and flash memory. Main storage device 212 temporarily stores information necessary during processing performed by control unit 211 and a program being executed by control unit 211 .

The auxiliary storage device 213 is a storage device such as SRAM, flash memory, hard disk, or magnetic tape. The auxiliary storage device 213 stores the classification model 31, the tomogram DB 36, programs to be executed by the control unit 211, and various data necessary for executing the programs. A communication unit 214 is an interface that performs communication between the image processing apparatus 210 and a network. The classification model 31 may be stored in an external mass storage device or the like connected to the image processing device 210 .

The display unit 215 is, for example, a liquid crystal display panel or an organic EL panel. Input unit 216 is, for example, a keyboard and a mouse. The input unit 216 may be layered on the display unit 215 to form a touch panel. The display unit 215 may be a display device connected to the image processing device 210 .

The image processing device 210 is a general-purpose personal computer, tablet, large computer, or a virtual machine running on a large computer. The image processing apparatus 210 may be configured by hardware such as a plurality of personal computers or large computers that perform distributed processing. The image processing device 210 may be configured by a cloud computing system. The image processing device 210 and the catheter control device 27 may constitute integrated hardware.

The image acquisition catheter 28 has a sheath 281 , a shaft 283 inserted inside the sheath 281 , and a sensor 282 arranged at the tip of the shaft 283 . MDU 289 rotates and advances shaft 283 and sensor 282 inside sheath 281 .

The sensor 282 is, for example, an ultrasonic transducer that transmits and receives ultrasonic waves, or a transmitter/receiver for OCT (Optical Coherence Tomography) that irradiates near-infrared light and receives reflected light. In the following description, an example in which the image acquisition catheter 28 is an IVUS (Intravascular Ultrasound) catheter used for capturing an ultrasonic tomographic image from the inside of the circulatory system will be described.

The catheter control device 27 creates one tomographic image 58 for each rotation of the sensor 282 . The catheter control device 27 continuously creates a plurality of tomographic images 58 substantially perpendicular to the sheath 281 by rotating the sensor 282 while pulling it in the axial direction or pushing it in the axial direction. The control unit 211 sequentially acquires the tomographic images 58 from the catheter control device 27 .

The control unit 211 inputs the tomographic image 58 to the classification model 31 and acquires the output classification data 57 . The control unit 211 creates a new record in the tomogram DB 36 and records the tomogram 58 and the classification data 57 in association with the tomogram number. After recording a set of tomographic images 58 in the tomographic image DB 36 , the control unit 211 may create the classification data 57 based on each tomographic image 58 and record it in the tomographic image DB 36 . As described above, so-called three-dimensional scanning is performed, and a set of tomographic images 58 and a set of classification data 57 are recorded in the tomographic image DB 36 .

In this embodiment, the image acquisition catheter 28 moves in the axial direction while the sensor 282 rotates, thereby realizing three-dimensional scanning while sequentially moving the transmission direction of the ultrasonic waves that are the scanning beams. is.

The advance/retreat operation of the sensor 282 includes both an operation to advance/retreat the entire image acquisition catheter 28 and an operation to advance/retreat the sensor 282 inside the sheath 281 . The advance/retreat operation may be automatically performed at a predetermined speed by the MDU 289, or may be manually performed by the user.

It should be noted that the image acquisition catheter 28 is not limited to a mechanical scanning method that mechanically rotates and advances and retreats. For example, it may be an electronic radial scanning type image acquisition catheter 28 using a sensor 282 in which a plurality of ultrasonic transducers are arranged in a ring. The image acquisition catheter 28 may mechanically rotate or oscillate a linear scan, convex scan, or sector scan sensor 282 to achieve three-dimensional scanning.

When the sensor 282 is of a linear scanning type, a convex scanning type, or a sector scanning type in which a plurality of ultrasonic transducers are arranged, the image acquisition catheter 28 sequentially switches between a plurality of ultrasonic transducers to generate an ultrasonic wave which is a scanning beam. Three-dimensional scanning is realized by sequentially moving the sound wave transmission direction. In this case, the image acquisition catheter 28 omits the sheath 281 and the MDU 289, and a handle portion for operating the shaft 283 and a connector extending from the handle portion are arranged at the proximal end of the shaft 283. to the catheter controller 27 via.

In addition, the catheter control device 27 sequentially creates a plurality of tomographic images 58 by sequentially switching a plurality of ultrasonic transducers that emit ultrasonic waves possessed by the sensor 282 . Note that the tomographic image obtained from the image acquisition catheter 28 whose sensor 282 is of the linear scanning type is rectangular in the XY format, and the tomographic image obtained from the image acquisition catheter 28 whose sensor 282 is of the convex scanning type or the sector scanning type. The image is fan-shaped in XY format.

The control unit 211 uses the tomographic image DB 36 recorded by the above operations to perform the processing described in the first to eleventh embodiments, and outputs the dimensions of the bifurcation entrance 53 . By starting the processing described in Embodiments 1 to 11 before the completion of the three-dimensional scanning, the control unit 211 can output the dimensions of the branch entrance 53 immediately after the completion of the three-dimensional scanning. .

[Embodiment 13]
FIG. 34 is an explanatory diagram illustrating the configuration of the information processing device 200 according to the thirteenth embodiment. The present embodiment relates to a mode of realizing the information processing apparatus 200 of the present embodiment by operating a general-purpose computer 90 and a program 97 in combination. Descriptions of the parts common to the first embodiment are omitted.

The computer 90 includes a reading section 209 in addition to the aforementioned control section 201, main storage device 202, auxiliary storage device 203, communication section 204, display section 205, input section 206 and bus.

The program 97 is recorded on a portable recording medium 96. The control unit 201 reads the program 97 via the reading unit 209 and stores it in the auxiliary storage device 203 . Control unit 201 may also read program 97 stored in semiconductor memory 98 such as a flash memory installed in computer 90 . Furthermore, the control unit 201 may download the program 97 from another server computer (not shown) connected via the communication unit 204 and a network (not shown) and store it in the auxiliary storage device 203 .

The program 97 is installed as a control program of the computer 90, loaded into the main storage device 202 and executed. As described above, the information processing apparatus 200 described in the first embodiment is realized. The program 97 of this embodiment is an example of a program product.

[Embodiment 14]
FIG. 35 is a functional block diagram of the information processing device 200 according to the fourteenth embodiment. The information processing device 200 includes a classification data acquisition section 81 , an entrance determination section 82 and a dimension output section 83 . The classification data acquisition unit 81 is configured such that each pixel constituting a plurality of tomographic images 58 acquired using the image acquisition catheter 28 acquires images while moving the scanning plane in the axial direction. A plurality of classified data 57 classified into a plurality of areas including the area 40 are acquired.

The entrance determination unit 82 determines the bifurcation entrance 53 where a predetermined area in the three-dimensional image 59 constructed using a plurality of classification data 57 branches into the trunk 51 and the branch 52 . The dimension output unit 83 outputs values related to the dimensions of the branch entrance 53 .

The technical features (constituent elements) described in each embodiment can be combined with each other, and new technical features can be formed by combining them.
The embodiments disclosed this time are illustrative in all respects and should be considered not restrictive. The scope of the present invention is not defined by the above-described meaning, but is indicated by the scope of claims, and is intended to include all modifications within the meaning and scope equivalent to the scope of claims.

10 catheter system 200 information processing device 201 control unit 202 main storage device 203 auxiliary storage device 204 communication unit 205 display unit 206 input unit 209 reading unit 210 image processing device 211 control unit 212 main storage device 213 auxiliary storage device 214 communication unit 215 display Section 216 Input Section 27 Catheter Control Device 28 Image Acquisition Catheter 281 Sheath 282 Sensor 283 Shaft 289 MDU
31 Classification model 36 Tomogram DB
40 lumen region 45 extracavity region 46 biological tissue region 47 catheter region 51 trunk 52 branch 521 branch axis 522 end point 523 penetration point 53 bifurcation entrance 54 reference plane 541 reference point 542 rotation axis 55 center of gravity 57 classification data 58 tomographic image 59 three-dimensional image 71 end button 72 enter button 76 dimension column 77 recommended device column 81 classification data acquisition unit 82 entrance determination unit 83 dimension output unit 90 computer 96 portable recording medium 97 program 98 semiconductor memory

Claims (20)

1. Each pixel constituting a plurality of tomographic images acquired using an image acquisition catheter that performs three-dimensional scanning while sequentially moving the transmission direction of the scanning beam is classified into a plurality of regions including a biological tissue region and a lumen region. a classification data acquisition unit that acquires a plurality of classification data obtained by
   an entrance determination unit that determines a bifurcation entrance where the predetermined region in the three-dimensional image constructed using the plurality of classification data branches into a trunk and a branch;
   and a dimension output unit that outputs a value related to the dimension of the branch entrance.
2. 2. The value for the dimension according to claim 1, wherein the values for the dimensions include the major diameter of the bifurcation entrance, the minor diameter of the bifurcation entrance, the area of the bifurcation entrance, the length of the branch, or the volume of the branch. Information processing equipment.
3. 3. The information processing apparatus according to claim 1, further comprising an entrance output unit that superimposes the branch entrance on the three-dimensional image and outputs the image.
4. a marker reception unit that receives input of three or more markers in the three-dimensional image;
   4. The information processing apparatus according to any one of claims 1 to 3, further comprising: a reference plane creation unit that creates a reference plane including the branch entrance based on the marker.
5. an automatic placement unit that automatically places a marker at the base of the branch in the three-dimensional image;
   a marker receiving unit that receives an input of a marker such that the sum of the markers placed by the automatic placement unit in the three-dimensional image is 3 or more;
   4. The information processing apparatus according to any one of claims 1 to 3, further comprising: a reference plane creation unit that creates a reference plane including the branch entrance based on the marker.
6. In the three-dimensional image, a reference plane creating unit that creates a reference plane that passes through the base of the branch and is parallel to the tomographic image,
   The information processing apparatus according to any one of claims 1 to 3, wherein the branch entrance is a portion of the reference plane through which the branch penetrates.
7. a reference plane display unit for superimposing and displaying the three-dimensional image and a reference plane parallel to the tomographic image;
   a movement reception unit that receives an instruction to move the reference plane in a direction perpendicular to the reference plane;
   The information processing apparatus according to any one of claims 1 to 3, wherein the branch entrance is a portion of the reference plane through which the branch penetrates.
8. a reference plane creating unit that creates a reference plane in the three-dimensional image that passes through the root of the branch and is perpendicular to a vertical line drawn from the root to the axis of the image acquisition catheter;
   The information processing apparatus according to any one of claims 1 to 3, wherein the branch entrance is a portion of the reference plane through which the branch penetrates.
9. a distal point selection unit that selects a distal point on the distal side of the branch from the image acquisition catheter in the three-dimensional image;
   a reference plane display unit for superimposing and displaying the three-dimensional image and a reference plane perpendicular to a perpendicular drawn from the distal point to the axis of the image acquisition catheter;
   a movement reception unit that receives an instruction to move the reference plane in a direction perpendicular to the reference plane;
   The information processing apparatus according to any one of claims 1 to 3, wherein the branch entrance is a portion of the reference plane through which the branch penetrates.
10. a center-of-gravity calculation unit that calculates the center of gravity of the branch for each of the classified data;
    a branch axis calculator that calculates the axis of the branch based on the plurality of calculated centers of gravity;
    a reference plane creation unit that creates a reference plane that passes through the base of the branch and is perpendicular to the axis in the three-dimensional image;
    The information processing apparatus according to any one of claims 1 to 3, wherein the branch entrance is a portion of the reference plane through which the branch penetrates.
11. a center-of-gravity calculation unit that calculates the center of gravity of the branch for each of the classified data;
    a branch axis calculator that calculates the axis of the branch based on the plurality of calculated centers of gravity;
    a reference plane display unit for superimposing and displaying the three-dimensional image and a reference plane perpendicular to the axis;
    a movement reception unit that receives an instruction to move the reference plane in a direction perpendicular to the reference plane;
    The information processing apparatus according to any one of claims 1 to 3, wherein the branch entrance is a portion of the reference plane through which the branch penetrates.
12. a cross-section selection unit that selects a cross-section that includes the base of the branch and is perpendicular to the axis of the image acquisition catheter in the three-dimensional image;
    a rotation axis calculator for calculating a rotation axis perpendicular to a vertical line extending from the base to the axis of the image acquisition catheter in the cross section;
    4. The information processing according to any one of claims 1 to 3, further comprising a reference plane creating unit that creates a reference plane by rotating the cross section about the rotation axis in the three-dimensional image. Device.
13. a reference plane creation unit that creates a reference plane that includes the base of the branch and is perpendicular to the axis of the image acquisition catheter in the three-dimensional image;
    a rotation axis calculation unit that calculates a rotation axis perpendicular to a vertical line extending from the base to the axis of the image acquisition catheter on the reference plane;
    a rotation reception unit that receives an instruction to rotate the reference plane about the rotation axis;
    The information processing apparatus according to any one of claims 1 to 3, wherein the branch entrance is a portion of the reference plane through which the branch penetrates.
14. The information processing apparatus according to any one of claims 4 to 13, further comprising an adjustment reception unit that receives an adjustment instruction for the reference plane.
15. 15. The information processing apparatus according to any one of claims 1 to 14, further comprising a device information output unit that outputs information regarding recommended devices selected based on the values regarding the dimensions.
16. the predetermined region is a lumen region;
    The information processing apparatus according to any one of claims 1 to 15, wherein the trunk is a lumen region into which the image acquisition catheter is inserted.
17. the predetermined region is a biological tissue region;
    16. The information processing apparatus according to any one of claims 1 to 15, wherein the branch portion is a protruding portion of a living tissue region.
18. A tomographic image acquisition unit that acquires a plurality of tomographic images acquired in time series using the image acquisition catheter,
    The classification data acquisition unit acquires the classification data to be output by inputting each of the tomograms acquired by the tomography acquisition unit into a model that outputs the classification data when a tomogram is input. The information processing apparatus according to any one of claims 1 to 17.
19. Each pixel constituting a plurality of tomographic images acquired using an image acquisition catheter that performs three-dimensional scanning while sequentially moving the transmission direction of the scanning beam is classified into a plurality of regions including a biological tissue region and a lumen region. Get multiple classification data that have been
    Determining a bifurcation entrance at which the predetermined region in the three-dimensional image constructed using the plurality of classification data branches into a trunk and a branch,
    An information processing method in which a computer executes a process of outputting a value related to the dimension of the branch entrance.
20. Each pixel constituting a plurality of tomographic images acquired using an image acquisition catheter that performs three-dimensional scanning while sequentially moving the transmission direction of the scanning beam is classified into a plurality of regions including a biological tissue region and a lumen region. Get multiple classification data that have been
    Determining a bifurcation entrance at which the predetermined region in the three-dimensional image constructed using the plurality of classification data branches into a trunk and a branch,
    A program for causing a computer to execute a process of outputting values relating to the dimensions of the entrance of the branch.

Images