JP2018148993A - X-ray image display device, x-ray imaging device, x-ray image display control program, and operation method of x-ray image display device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To enable a line-of-sight direction of a displayed X-ray image to be easily set in displaying an X-ray image based on image data that has processed X-ray image data acquired from a plurality of directions, or that includes a plurality of X-ray image data acquired from a plurality of directions.SOLUTION: An X-ray image display device 12 includes: a storage part 53 for storing image data (e.g., display direction setting image data 53d) that has processed X-ray image data acquired from a plurality of directions, or that includes a plurality of X-ray image data acquired from a plurality of directions; an image display part 61 for displaying an X-ray image generated for display from the image data; a line-of-sight direction acquisition part for acquiring an observer's line-of-sight direction of the image display part 61; and a display image processing part 45 for generating an X-ray image based on the image data according to the line-of-sight direction acquired by the line-of-sight direction acquisition part, and causing the image display part 61 to display the X-ray image.SELECTED DRAWING: Figure 3

Description

  The present invention relates to a technique for displaying an X-ray image based on X-ray image data acquired from multiple directions.

  Patent Document 1 discloses a configuration in which X-ray CT imaging is performed, three-dimensional distribution information of an X absorption coefficient of a target part is calculated, and then an arbitrary tomographic image of the local part is displayed. The operator can select a tomographic plane image by operating a tomographic plane selection unit and an angle setting unit provided in the display device.

International Publication No. 00/57789

  However, according to the technique disclosed in Patent Document 1, the operator needs to perform a predetermined operation on the tomographic plane selection unit, the angle setting unit, and the like provided in the display device.

  Therefore, the present invention displays X-ray images when processing X-ray image data acquired from a plurality of directions or displaying X-ray images based on image data including a plurality of X-ray image data acquired from a plurality of directions. It is an object to make it possible to easily set the line-of-sight direction of an X-ray image to be performed.

  In order to solve the above problem, an X-ray image display apparatus according to a first aspect processes an X-ray image data acquired from a plurality of directions or includes a plurality of X-ray image data acquired from a plurality of directions. A storage unit that stores data, an image display unit that displays an X-ray image generated for display from the image data, a gaze direction acquisition unit that acquires a gaze direction of an observer of the image display unit, and the gaze direction And an image processing unit that generates the X-ray image based on the image data in accordance with the line-of-sight direction acquired by the acquisition unit, and displays the X-ray image on the image display unit.

  A 2nd aspect is an X-ray image display apparatus which concerns on a 1st aspect, Comprising: The said gaze direction acquisition part is an imaging part which can image the observer of the said image display part, and the captured image of the said imaging part And a gaze direction determining unit that determines the relative position of the observer of the image display unit with respect to the image display unit and determines the gaze direction of the observer.

  A third aspect is an X-ray image display device according to the first or second aspect, wherein the image data is an X-ray CT image as the image data obtained by processing X-ray image data acquired from a plurality of directions. Data, X-ray tomosynthesis image data as image data obtained by processing X-ray image data acquired from a plurality of directions, a plurality of images taken from a plurality of directions as the image data including a plurality of X-ray image data acquired from a plurality of directions Including at least one kind of simple transmission X-ray image group data including simple transmission X-ray image data.

  A fourth aspect is the X-ray image display device according to the third aspect, wherein the image data is the X-ray CT image data as the image data obtained by processing the X-ray image data acquired from a plurality of directions, Including at least one kind of the X-ray tomosynthesis image data, the image processing unit generates a tomographic image sliced in a tomographic direction according to the visual line direction acquired by the visual line direction acquisition unit as the X-ray image, and It is displayed on the image display unit.

  A fifth aspect is an X-ray image display device according to the fourth aspect, further comprising a tomographic thickness receiving unit capable of receiving a setting of a tomographic thickness of a tomographic section of interest, wherein the image processing unit is a tomographic thickness receiving unit The X-ray image is generated on the basis of the tomographic thickness of the tomographic fault received in step S1, and is displayed on the image display unit.

  A sixth aspect is an X-ray image display device according to the third aspect, wherein the image data is image data obtained by processing the X-ray CT imaging data or X-ray tomosynthesis imaging data, and the image processing unit Generates a three-dimensional volume rendering image as the X-ray image in the direction corresponding to the line-of-sight direction acquired by the line-of-sight direction acquisition unit by performing image processing on the image data, and displays it on the image display unit It is something to be made.

  A seventh aspect is the X-ray image display device according to the second aspect, wherein the image processing unit detects a change in the relative position of the observer of the image display unit in the line-of-sight direction determination unit. Sometimes, an X-ray image is generated based on the viewing direction of the observer of the image display unit after the change, and is displayed on the image display unit.

  An eighth aspect is the X-ray image display device according to the seventh aspect, wherein the imaging unit images a viewer of the image display unit with a moving image, and the line-of-sight direction determination unit is the imaging unit. Based on the captured moving image, a change in the viewing direction of the observer of the image display unit relative to the image display unit is detected.

  A ninth aspect is an X-ray image display device according to any one of the second to eighth aspects, wherein the relative distance between the image display unit and the observer is determined based on a captured image of the imaging unit. A distance specifying unit to be obtained is further provided, and the image processing unit adjusts an enlargement ratio of the X-ray image according to the relative distance obtained by the distance specifying unit.

  A tenth aspect is an X-ray image display device according to any one of the first to ninth aspects, wherein the image processing unit is configured to receive a default X from a line-of-sight direction set in advance based on the image data. After generating a line image and displaying the line image on the image display unit, an X-ray image is generated based on the line-of-sight direction of the observer of the image display unit with reference to the line-of-sight direction of the default X-ray image, This is displayed on the image display unit.

  An eleventh aspect is an X-ray image display device according to the first aspect, further comprising a posture acquisition unit that acquires the posture of the image display unit, and the image processing unit is acquired by the posture acquisition unit. An X-ray image is generated based on the image data according to the posture.

  A twelfth aspect is an X-ray image display apparatus according to the eleventh aspect, wherein the posture acquisition unit includes at least one of an acceleration sensor and a gyro sensor.

  A thirteenth aspect is an X-ray image display device according to the eleventh or twelfth aspect, wherein the line-of-sight direction acquisition unit includes an imaging unit capable of imaging an observer of the image display unit, and the imaging unit. A line-of-sight direction determination unit that determines the line-of-sight direction of the observer based on the captured image and the posture acquired by the posture acquisition unit, and the image processing unit is determined by the line-of-sight direction determination unit An X-ray image is generated based on the image data in accordance with the line-of-sight direction.

  A fourteenth aspect is an X-ray image display device according to any one of the first to thirteenth aspects, further comprising a visual line direction operation receiving unit capable of receiving a visual line direction setting operation in an arbitrary direction, The image processing unit generates an X-ray image based on the image data in response to acceptance of a gaze direction setting operation in the gaze direction operation accepting unit, and causes the image display unit to display the X-ray image. It is.

  A fifteenth aspect is an X-ray image display device according to any one of the first to fourteenth aspects, wherein the image display unit is an image display unit of a tablet terminal device.

  An X-ray imaging apparatus according to a sixteenth aspect includes the X-ray image display apparatus according to any one of the first to fifteenth aspects as a display device.

  In order to solve the above-described problem, an X-ray image display control program according to a seventeenth aspect includes a plurality of X-ray image display apparatuses that have processed X-ray image data acquired from a plurality of directions or acquired from a plurality of directions. A storage unit that stores image data including X-ray image data, an image display unit that displays an X-ray image generated for display from the image data, and a line of sight that acquires a viewer's line-of-sight direction of the image display unit A direction acquisition unit and an image processing unit that generates an X-ray image based on the image data in accordance with the line-of-sight direction acquired by the line-of-sight direction acquisition unit and displays the X-ray image on the image display unit This is an X-ray image display control program.

  In order to solve the above problems, an operation method of an X-ray image display apparatus according to an eighteenth aspect is as follows: (a1) X-ray image data acquired from a plurality of directions is processed or a plurality of X-rays acquired from a plurality of directions A step of storing image data in the storage unit, including image data; (a2) a step of acquiring the line of sight of the observer of the image display unit; and (a3) the line of sight of the observer acquired in step (a2). A step of generating an X-ray image based on the image data according to a direction; and (a4) displaying the X-ray image generated in (a3) on the image display unit.

  According to the first aspect, the line-of-sight direction of the observer of the image display unit is acquired, an X-ray image is generated based on the image data according to the line-of-sight direction, and the X-ray image is displayed on the image display unit Let Therefore, X displayed when processing X-ray image data acquired from a plurality of directions or displaying an X-ray image based on image data including a plurality of X-ray image data acquired from a plurality of directions. The line-of-sight direction of the line image can be easily set.

  According to the 2nd aspect, a gaze direction can be determined easily using an imaging part.

  According to the third aspect, X-ray CT image data as the image data obtained by processing X-ray image data obtained from a plurality of directions, and X-ray tomosynthesis as the image data obtained by processing X-ray image data obtained from a plurality of directions. A plurality of simple transmission X-ray image group data including a plurality of simple transmission X-ray image data photographed from a plurality of directions as the image data including a plurality of X-ray image data acquired from a plurality of directions. X-ray images in the line-of-sight direction can be generated.

  According to the 4th aspect, the tomographic image sliced in the tomographic direction according to the gaze direction can be observed.

  According to the fifth aspect, an X-ray image having a desired tomographic thickness can be observed.

  According to the sixth aspect, it is possible to observe a three-dimensional volume rendering image directed in a direction corresponding to the line-of-sight direction.

  According to the seventh aspect, when a change in the relative position of the observer in the image display unit is detected, an X-ray image corresponding to the viewing direction of the observer in the image display unit after the change is displayed. Can do.

  According to the eighth aspect, it is possible to appropriately detect a change in the relative position of the observer based on the moving image.

  According to the ninth aspect, the magnification of the X-ray image can be adjusted according to the relative distance between the image display unit and the observer.

  According to the tenth aspect, it is possible to display an X-ray image that is tilted about the line-of-sight direction of the default X-ray image.

  According to the eleventh aspect, the line-of-sight direction of the displayed X-ray image can be easily set according to the attitude of the image display unit.

  According to the twelfth aspect, the attitude of the image display unit can be acquired based on the detection result of at least one of the acceleration sensor and the gyro sensor.

  According to the thirteenth aspect, the line-of-sight direction of the displayed X-ray image can be easily set according to the observer imaged by the imaging unit and the attitude of the image display unit.

  According to the fourteenth aspect, an X-ray image in an arbitrary line-of-sight direction can be displayed on the image display unit.

  According to the fifteenth aspect, the X-ray image can be observed by the image display unit of the tablet terminal device.

  According to the sixteenth aspect, the X-ray image can be observed on the image display unit of the X-ray imaging apparatus.

  According to the seventeenth aspect, when displaying an X-ray image based on image data including processing a plurality of X-ray image data acquired from several directions or including a plurality of X-ray image data acquired from a plurality of directions. The line-of-sight direction of the displayed X-ray image can be easily set according to the line-of-sight direction of the observer.

  According to the eighteenth aspect, when X-ray image data acquired from several directions is processed, or when displaying an X-ray image based on image data including a plurality of X-ray image data acquired from a plurality of directions, The line-of-sight direction of the displayed X-ray image can be easily set according to the line-of-sight direction of the observer.

1 is a schematic diagram illustrating an overall configuration of an X-ray imaging apparatus according to a first embodiment. 1 is a block diagram showing an electrical configuration of an X-ray imaging apparatus. It is a functional block diagram of an X-ray imaging apparatus. It is a flowchart which shows each process in a X-ray image processing apparatus and a tablet terminal device. It is explanatory drawing which shows the state in which the observer has the tablet terminal device. It is a figure which shows the example of a display of an image display part. It is a figure which shows the example of a display of an image display part. It is a figure which shows the example of a display of an image display part. It is a figure for demonstrating the example of a production | generation process of a default X-ray image. It is a figure for demonstrating the example of a production | generation process of a default X-ray image. It is a figure for demonstrating the example of a production | generation process of a default X-ray image. It is explanatory drawing which shows the observer's observation position and gaze direction with respect to a tablet terminal device. It is a figure which shows the captured image example. It is a figure which shows the captured image example. It is a figure for demonstrating the relationship between a gaze direction and the appearance of the tooth | gear in an X-ray image. It is a figure for demonstrating the appearance of a tooth | gear at the time of imaging a tooth | gear by normal radiation projection. It is a figure for demonstrating how a tooth | gear looks at the time of imaging a tooth | gear by eccentric centric projection. It is a figure for demonstrating the appearance of a tooth | gear at the time of imaging a tooth | gear by partial centrifugal projection. It is a figure for demonstrating the appearance of the tooth which images another tooth by partial centrifugal projection. It is a figure which shows the example of a partial centrifugal image. It is a figure for demonstrating the appearance of the tooth which images another tooth by eccentric centric projection. It is a figure which shows the example of an eccentric centric image. It is a functional block diagram which shows the X-ray image display apparatus which concerns on a 1st modification. It is a block diagram which shows the electric constitution of the X-ray image display apparatus which concerns on a 2nd modification. It is a functional block diagram of the X-ray image display apparatus which concerns on the modification same as the above. It is a flowchart which shows each process in the tablet terminal device which concerns on a modification same as the above. It is a schematic perspective view which shows the terminal device which concerns on a 3rd modification. It is a flowchart which shows each process in the tablet terminal device which concerns on a 4th modification. It is a functional block diagram of the tablet terminal device concerning the 5th modification. It is a flowchart which shows each process in the tablet terminal device which concerns on a modification same as the above. It is a figure for demonstrating the process which calculates | requires the relative distance of an image display part and an observer based on a captured image. It is a figure which shows the example which expanded and displayed the tooth | gear. It is a functional block diagram of the tablet terminal device concerning the 6th modification. It is the schematic which shows the tablet terminal device which concerns on a modification same as the above. It is a figure which shows the example of a display of the tablet terminal device which concerns on a 7th modification. It is a figure which shows the example of a display of the X-ray image in a tablet terminal device same as the above. It is a figure which shows the other example of a display of the X-ray image in a tablet terminal device same as the above. It is a functional block diagram of a bullet terminal device same as the above. It is the schematic which shows the other example of a display of a tablet terminal device same as the above. It is a block diagram which shows the electric constitution of the X-ray imaging apparatus which concerns on 2nd Embodiment. It is a functional block diagram of an X-ray imaging apparatus same as the above. It is a figure which shows the example of a display of the image display part in an X-ray imaging apparatus same as the above. It is a flowchart which shows each process of the X-ray imaging apparatus same as the above. It is a flowchart which shows each process in the attitude | position mode of an X-ray imaging apparatus same as the above. It is a figure for demonstrating how a solid object looks. It is a figure for demonstrating how a solid object looks. It is a figure for demonstrating the relationship between the state in which an observer observes an image display part, and the observation direction of the X-ray image of an image display part. It is a figure for demonstrating the relationship between the state in which an observer observes an image display part, and the observation direction of the X-ray image of an image display part. It is a figure for demonstrating the relationship between the state in which an observer observes an image display part, and the observation direction of the X-ray image of an image display part. It is a functional block diagram of a bullet terminal device concerning the 8th modification. It is a block diagram which shows the electrical constitution of the X-ray image display apparatus which concerns on 3rd Embodiment. It is a functional block diagram of an X-ray image display apparatus same as the above. It is a figure for demonstrating the relationship between the state in which an observer observes an image display part, and the observation direction of the X-ray image of an image display part. It is a figure for demonstrating the relationship between the state in which an observer observes an image display part, and the observation direction of the X-ray image of an image display part. It is a figure for demonstrating the relationship between the state in which an observer observes an image display part, and the observation direction of the X-ray image of an image display part. It is explanatory drawing which shows the up-down, left-right, and front-back direction with respect to a head. It is explanatory drawing which shows the example of local CT imaging | photography. It is explanatory drawing which shows the example of a setting of a curve model. It is explanatory drawing which shows the example of a setting of the tangent with respect to a curve model. It is explanatory drawing which shows the example of a display of an X-ray image. It is explanatory drawing which shows the example of a display of an X-ray image. It is explanatory drawing which shows the operation example of X-ray tomosynthesis imaging | photography.

{First embodiment}
Hereinafter, the X-ray image display apparatus according to the first embodiment will be described. Here, an example will be described in which the X-ray image display apparatus is integrally combined as a display apparatus of the X-ray imaging apparatus.

<About the overall configuration>
FIG. 1 is a schematic diagram showing the overall configuration of the X-ray imaging apparatus 10. The X-ray imaging apparatus 10 includes an imaging main body unit 20, an X-ray image processing apparatus 40, and a tablet terminal device 60. The X-ray imaging apparatus 10 also includes an X-ray irradiation command operation unit 20A. The imaging main body unit 20 is an apparatus that performs X-ray imaging (here, X-ray CT imaging) and collects projection data. The X-ray image processing apparatus 40 is an apparatus that processes the projection data collected in the imaging main body unit 20 to generate various images. The X-ray image processing apparatus 40 may include a display unit 41, and various images such as an image generated based on projection data may be displayed on the display unit 41. It also has a function as an X-ray image display device. The tablet terminal device 60 is a device that displays various images generated based on projection data. In the present embodiment, the X-ray image processing device 40 and the tablet terminal device 60 constitute an X-ray image display device 12. The X-ray imaging apparatus 10 is configured to execute not only X-ray CT imaging (Computed Tomography) but also simple transmission X-ray imaging and X-ray tomosynthesis imaging.

  All or part of the components of the X-ray image processing apparatus 40 may be incorporated in the imaging main body 20. When considered as a sales form, the X-ray imaging apparatus 10 is not necessarily accompanied by the X-ray image processing apparatus 40, and only the imaging main body 20 may be sold as an independent X-ray imaging apparatus.

  More specifically, the imaging main body unit 20 includes an X-ray generation unit 22, an X-ray detection unit 23, a turning arm 24, an elevating unit 26, a column 28, and a main body control unit 30.

  The X-ray generator 22 is configured to be able to emit an X-ray beam composed of a bundle of X-rays toward the subject M1. Inside the X-ray generator 22, an X-ray generator 22A having an X-ray tube XT and the X-ray generator 22A near the side facing the X-ray detector 23 and generated from the X-ray generator 22A An X-ray restricting unit (not shown) that forms an X-ray beam that allows passage of a part of the X-ray and shields the outside of the passing range and proceeds to the X-ray detection unit 23 is provided. The X-ray detector 23 includes an X-ray detector 23A, and is configured to be able to detect X-rays (X-ray beams) emitted from the X-ray generator 22 and passing through the subject M1. The X-ray detector 23A obtains projection data obtained by X-ray imaging.

  The swivel arm 24 is a member formed in a U shape that opens downward, and an X-ray generation unit 22 and an X-ray detection unit 23 are supported in opposite states at both ends. The support column 28 is erected so as to extend along the direction of gravity (vertical direction), and the elevating unit 26 is supported by the support column 28 so as to be driven up and down. In the state shown in FIG. 1, the elevating part 26 is located on the upper half side of the support column 28. The elevating part 26 protrudes to one side with respect to the column 28. The swivel arm 24 is supported so as to be rotatable around a swivel axis extending along the direction of gravity in a suspended state with respect to the elevating unit 26. Then, the swivel arm 24 moves up and down by the up and down movement of the lifting unit 26. Further, the elevating unit 26 incorporates a rotation drive unit composed of a motor or the like that rotationally drives the turning arm 24, and the turning arm 24 is rotated by the rotation drive of the rotation driving unit. The turning arm 24 is supported by the elevating part 26 via the shaft RS. The swivel arm 24 is configured to rotate around the axis AC (the swivel axis) of the shaft RS. The shaft RS can be moved in a two-dimensional direction orthogonal to the axial direction of the turning center RC by a known two-dimensional moving mechanism 2DD in the elevating unit 26.

  For example, the shaft RS is moved and fixed to a desired position by the two-dimensional movement mechanism 2DD, the axis AC is set as the turning center RC of the turning arm 24, and the turning arm 24 is rotated around the axis AC to obtain X-rays. Performing CT imaging or X-ray tomosynthesis imaging, the turning center RC of the turning arm 24 at a different location from the shaft RS by the combined movement of the movement of the shaft RS by the two-dimensional moving mechanism 2DD and the rotation around the axis AC of the turning arm 24 X-ray CT imaging or X-ray tomosynthesis imaging can be performed, and panoramic imaging can be performed by combining the movement of the shaft RS by the two-dimensional moving mechanism 2DD and the rotation of the turning arm 24 around the axis AC. It is.

  Then, the X-ray generation unit 22 and the X-ray detection unit 23 are rotated by rotating the swivel arm 24 with the subject M1, which is strictly the imaging target area of the subject M1, positioned between both ends of the swivel arm 24. By rotating around the subject M1, X-ray CT imaging can be performed and X-ray CT imaging data can be obtained. For example, this X-ray CT imaging data is one of the above-mentioned projection data, and is composed of a frame data group in which frame data obtained at each minute movement timing is gathered while the revolving arm 24 is moving. The projection data for each minute movement includes projection data for each minute turning angle. Further, simple transmission X-ray imaging is performed in a state where the rotation of the turning arm 24 is stopped, and a plurality of simple transmission X-ray images obtained by imaging the subject M1 from a plurality of directions are performed at a plurality of positions around the subject M1. Data can be obtained. The simple transmission X-ray image data is obtained at two or more timings obtained at each timing between when the swivel arm 24 is at one angle and when it is at another angle (for example, 0 ° and 90 ° from the reference angle). The frame data is a set of simple transmission X-ray image data, which is also one of the projection data. Furthermore, X-ray tomosynthesis imaging data can also be obtained by performing X-ray tomosynthesis imaging within a smaller rotation range of the swivel arm 24 than when X-ray CT imaging is performed. X-ray tomosynthesis imaging will be described later.

  The main body control unit 30 is configured to be able to control each operation of the photographing main body unit 20, and is incorporated in the turning arm 24, for example.

  Each part of the imaging main body 20 is housed in the X-ray prevention chamber 29. An X-ray irradiation command operation unit 20A that accepts an X-ray irradiation command operation is fixed outside the wall of the X-ray irradiation chamber 29, and a liquid crystal monitor that displays various information on the X-ray irradiation command operation unit 20A. A display unit 38 configured with the above and an operation panel 39 configured with buttons for realizing various command inputs to the main body control unit 30 are attached. The operation panel 39 is also used for designating the position of an imaging region such as a living organ. In addition, there are various types of X-ray imaging (CT imaging, simple transmission X-ray imaging, etc.), but the mode may be selected by operating the operation panel 39.

  In the present embodiment, the X-ray generator 22 and the X-ray detector 23 constitute both ends of the U-shaped swivel arm 24, but the X-ray generator and the X-ray detector are annular members. May be supported in an opposing state. In the present embodiment, the X-ray generation unit 22 and the X-ray detection unit 23 are supported so as to be rotatable around the vertical axis, but the axis along the horizontal direction orthogonal to the vertical direction, or the vertical It may be supported so as to be rotatable around an axis along an inclined direction that intersects both the horizontal direction and the horizontal direction.

  As shown in FIG. 2, the X-ray image processing apparatus 40 includes an information processing main body 50 configured by, for example, a computer or a workstation, and transmits and receives various data to and from the imaging main body 20 through a communication cable. can do. However, data transmission / reception may be performed between the imaging main body 20 and the X-ray image processing apparatus 40 by wireless communication.

  For example, a display unit 41 configured by a display device such as a liquid crystal monitor and an operation unit 42 configured by a keyboard, a mouse, and the like are connected to the X-ray image processing apparatus 40. The operator can give various commands to the information processing main body 50 by a pointer operation via a mouse or the like on the characters and images displayed on the display unit 41. In addition, a display part can also be comprised with a touchscreen, and in this case, a display part will be provided with a part or all of the function of an operation part.

  The tablet terminal device 60 is a portable computer, includes an image display unit 61 such as a liquid crystal display unit, and is connected to the X-ray image processing device 40 so as to be communicable by wireless communication or the like. The tablet terminal device 60 and the X-ray image processing device 40 may be connected by a cable or the like. Various images generated by the X-ray image processing apparatus 40 based on the projection data are displayed on the main image display unit 61. Here, the tablet terminal device 60 includes an imaging unit 62 such as a camera, and the main imaging unit 62 is configured to be capable of imaging the user of the tablet terminal device 60. The imaging unit 62 may be an infrared camera or the like.

<About hardware configuration and functional configuration of each part>
FIG. 2 is a block diagram showing an electrical configuration of the X-ray imaging apparatus 10, and FIG. 3 is a functional block diagram of the X-ray imaging apparatus 10.

  The main body control unit 30 of the imaging main body unit 20 controls an X-ray imaging operation of the imaging main body unit 20, and includes a CPU (Central Processing Unit) 31, a RAM (Random Access Memory) 32, a storage unit 33, and an input / output unit. Reference numerals 34 a and 34 b, the operation input unit 35, the image output unit 36, and the like are configured by a general device control computer interconnected via a bus line 37. The storage unit 33 is configured by a flash memory or a non-volatile storage device such as a hard disk device, and stores an imaging program 33a when the imaging main body unit 20 performs X-ray imaging. The RAM 32 is provided as a work area when the CPU 31 performs a predetermined process. The input / output unit 34a is a motor or the like (described as the drive unit 27 in FIG. 2) that rotates and moves the swivel arm 24 of the main imaging unit 20, the X-ray generator 22 (specifically, the X-ray generator 22A). And the X-ray detection unit 23 (specifically, the X-ray detector 23A), and the input / output unit 34b is connected to the X-ray image processing apparatus 40. The operation input unit 35 is connected to the operation panel 39, and the image output unit 36 is connected to the display unit 38.

  In the main body control unit 30, the CPU 31 performs arithmetic processing according to the procedure described in the imaging program 33 a and the instruction input through the operation input unit 35, whereby the drive unit 27, the X-ray generation unit 22, and the X-ray detection unit. 23, the detection result of detecting the X-ray beam irradiating the subject M1 by the X-ray detector 23 can be obtained. For example, X-ray CT imaging is performed by irradiating the X-ray from the X-ray generator 22 and detecting the X-ray by the X-ray detector 23 while rotating the X-ray generator 22 and the X-ray detector 23 around the subject. By performing the above, a detection result suitable for generating X-ray CT imaging data can be obtained. In this manner, the imaging main body unit 20 generates X-ray imaging of the subject M1 and generates imaging data that is the basis for displaying the subject M1 on the image display unit 61 of the tablet terminal device 60. A separate GPU (Graphics Processing Unit) may be provided, and part or all of the image processing may be processed in the GPU.

  The X-ray image processing device 40 generates display direction setting image data 53d based on the imaging data from the imaging main body unit 20, and the image display unit of the tablet terminal device 60 based on the display direction setting image data 53d. The information processing main unit 50 includes a CPU 51, a RAM 52, a storage unit 53, an input / output unit 54, an operation input unit 55, an image output unit 56, a wireless communication unit 57, and the like. Is constituted by a general computer interconnected via a bus line 58.

  The storage unit 53 is configured by a non-volatile storage device such as a flash memory or a hard disk device, and the storage image processing program 53a, the display image processing program 53b, the X-ray image data 53c, and the display direction setting image. Data 53d and the like are stored.

  The storage image processing program 53 a is for generating display direction setting image data 53 d based on the shooting data from the shooting main body 20, and the display image processing program 53 b is an image display of the tablet terminal device 60. An X-ray image (terminal display X-ray image 61i) to be displayed on the unit 61 is generated based on the display direction setting image data 53d. The storage image processing program 53a and the display image processing program 53b constitute an image processing program 53i.

  The storage unit 53 may store management data in which display direction setting image data 53d is associated with specific information of the subject M1. The RAM 52 is provided as a work area when the CPU 51 performs a predetermined process. The input / output unit 54 is connected to the imaging main body unit 20, and X-ray imaging data obtained by the imaging main body unit 20 is input via the input / output unit 54. The input / output unit 54 may be connected to the input / output unit 34b as illustrated. The operation input unit 55 is connected to the operation unit 42, and the image output unit 56 is connected to the display unit 41. The wireless communication unit 57 is a wireless communication interface that performs wireless communication with the tablet terminal device 60.

  Image processing includes image processing for storage and image processing for display. Therefore, the image processing program 53I includes the storage image processing program 53a and the display image processing program 53b, and the image processing unit 40I includes the storage image processing unit 43 and the display image processing unit 45. For example, the CPU 51 includes a circuit that functions as the image processing unit 40I. The storage image processing program 53a and the circuit that executes the storage image processing in the CPU 51 are the storage image processing unit 43, and the display image processing program 53b and the circuit that executes the display image processing in the CPU 51 are display images. A processing unit 45. Taking X-ray CT imaging as an example, in the information processing main body 50, the CPU 51 performs arithmetic processing according to the storage image processing program 53a, and specifically, X-ray imaging data obtained by the imaging main body 20; Represents projection data (X-ray image data acquired from a plurality of directions), if necessary, processed for storage, or X-ray CT image data indicating a three-dimensional distribution of the X-ray absorption degree (coefficient) based on the projection data Processing in the storage image processing unit 43 that generates (local X-ray CT image data in the case of local CT imaging) is executed. The X-ray CT image data is generated as display direction setting image data 53d which is an example of image data. The image data is data for generating an X-ray image for display. When the image data includes a plurality of X-ray image data acquired from a plurality of directions, specifically, when the imaging angle (viewing direction) is associated with each of the plurality of simple transmission X-ray image data. There is also. The display image processing program 53b may be responsible for part or all of the generation of the X-ray CT image data.

  Here, the storage unit 53 stores X-ray image data 53c (described later) based on X-ray CT imaging data, and stores the X-ray CT image data as display direction setting image data 53d which is an example of image data. . The storage unit 53 does not necessarily need to store the X-ray image data 53c after storing the display direction setting image data 53d.

  In the information processing main body 50, the CPU 51 performs arithmetic processing according to the display image processing program 53 b, so that the observer of the image display unit 61 relative to the image display unit 61 based on the captured image of the imaging unit 62. Based on the display direction setting image data 53d in accordance with the function as the line-of-sight direction determination unit 44 that determines the target position and determines the line-of-sight direction of the observer, and the line-of-sight direction of the observer. The terminal display X-ray image 61i) is generated, and the function as the display image processing unit 45 for displaying the X-ray image on the image display unit 61 is executed.

  The X-ray image data 53c and the display direction setting image data 53d are configured to be stored not only in the storage unit 53 on the X-ray image processing apparatus 40 side but also in the storage unit 33 on the imaging main body unit 20 side. Also good. With such a configuration, even if some trouble occurs on the X-ray image processing apparatus side, it is only necessary to send the data stored from the storage unit 33 after the trouble is solved, and the X-ray imaging again. Is no longer necessary.

  The tablet terminal device 60 images an observer of the image display unit 61 and displays the X-ray image generated by the display image processing unit 45 on the image display unit 61. The CPU 71, the RAM 72, and the storage unit 73 are used. The image display unit 61, the touch panel input unit 75, the imaging unit 62, and the wireless communication unit 77 are configured by a general portable computer interconnected via a bus line 78. The tablet terminal device 60 may be a smaller portable computer such as a smartphone. The storage unit 73 is configured by a non-volatile storage device such as a flash memory, and stores a display program 73a and the like describing processing when the tablet terminal device 60 displays an X-ray image on the image display unit 61. ing.

  The display program 73a can be configured to control, for example, the size, brightness, and layout of the X-ray image displayed on the image display unit 61.

  The display image processing program 53b and the display program 73a constitute an X-ray image display control program IP for controlling display on the X-ray image display device 12.

  The RAM 72 is used as a work area when the CPU 71 performs a predetermined process. The image display unit 61 displays an X-ray image or the like, and is provided on one main surface of the tablet terminal device 60. The touch panel input unit 75 accepts input of various instructions in combination with the operation screen displayed on the image display unit 61.

  The image display unit 61 displays an X-ray image or the like and displays an operation element such as a button or icon. When displaying an operation element, it also functions as an input element of the touch panel input unit 75. One screen may be divided so as to have both a space as the image display unit 61 and a space as the touch panel input unit 75.

  The imaging unit 62 is configured by a solid-state imaging device such as a CCD (Charge-Coupled Device) sensor or the like, and is configured to be able to image the observer of the image display unit 61. Here, the imaging unit 62 is provided on one main surface of the tablet terminal device 60. More specifically, the imaging unit 62 is one main surface of the tablet terminal device 60, and the front side of the tablet terminal device 60 is placed on the periphery of the image display unit 61 (for example, the upper central portion in the width direction). Installed to face. For this reason, in the image imaged by the imaging unit 62, the relative position of the imager of the tablet terminal device 60 can be determined by recognizing the position of the observer. The wireless communication unit 77 is a wireless communication interface that performs wireless communication with the X-ray image processing apparatus 40.

  The X-ray imaging apparatus 10 will be described in terms of functions. As shown in FIG. 3, the imaging data obtained by the imaging main body 20 is processed for storage as necessary and stored as X-ray image data 53c. And is processed by the storage image processing unit 43 of the X-ray image processing apparatus 40 to generate X-ray CT image data (display direction setting image data 53d). The display direction setting image data 53d is The data is stored in the storage unit 53 as image data for generating an X-ray image. The X-ray image data 53c is frame image data, for example, and may be paraphrased as the X-ray projection image data 53c.

  Further, when an X-ray image display command is given through the touch panel input unit 75 of the tablet terminal device 60, an imaging command is given to the imaging unit 62, and the imaging unit 62 captures a front image of the image display unit 61, and the imaging The image is given to the line-of-sight direction determination unit 44. The line-of-sight direction determination unit 44 determines the line-of-sight direction of the observer based on the captured image, and gives the line-of-sight direction to the display image processing unit 45. In the present embodiment, the imaging unit 62 and the line-of-sight direction determination unit 44 are line-of-sight direction acquisition units in which an observer who observes the image display unit 61 acquires the line-of-sight direction of the observer. As an operation for an observer observing the image display unit to change the line-of-sight direction, a first operation in which the observer changes or moves his / her face horizontally with respect to the image display unit 61, or a vertical change of posture. Alternatively, a second movement is assumed.

  A little more specific.

  Assume that the tablet terminal device 60 has vertical and horizontal directions. That is, in a state where the image display unit 61 of the tablet terminal device 60 is viewed from the front, the side that is visible on the right side of the tablet terminal device 60 is the left side of the tablet terminal device 60, and the side that is visible on the left side of the tablet terminal device 60 is the tablet terminal Assume that it is on the right side of the device 60. The one visible below the tablet terminal device 60 is the lower side of the tablet terminal device 60, and the one visible above the tablet terminal device 60 is the upper side of the tablet terminal device 60.

  Therefore, when the image display unit 61 of the tablet terminal device 60 is viewed from the front, the left end of the screen of the image display unit 61 is on the right side of the line of sight, and the right end of the screen of the image display unit 61 is on the left side of the line of sight. The upper end of the screen of the image display unit 61 is on the upper side, and the lower end of the screen of the image display unit 61 is on the lower side of the line of sight.

  The first operation described above is an operation of moving the viewpoint position of the observation state at a certain timing to the right or left with respect to the image display unit 61, and the second operation is a timing at which the viewer is at a certain timing. In this operation, the viewpoint position in the observation state is moved up or down with respect to the image display unit 61.

  The present embodiment assumes the first operation. An embodiment assuming the second operation will be described in a third embodiment. In the second embodiment, an additional configuration for generating an X-ray image in accordance with a change in posture of the image display unit 61 will be described.

  The display image processing unit 45 generates an X-ray image (terminal display X-ray image 61i) corresponding to the line-of-sight direction based on the display direction setting image data 53d stored in the storage unit 53, and the X-ray The image is given to the tablet terminal device 60. Accordingly, an X-ray image corresponding to the line-of-sight direction obtained by processing the display direction setting image data 53d is displayed on the image display unit 61 of the tablet terminal device 60.

  Each of the above programs is normally stored in the storage units 33, 53, 73 in advance, but is provided in a form recorded on a recording medium such as a CD-ROM or DVD-ROM, an external flash memory, or the like. Alternatively, it may be provided by downloading from an external server via a network. However, some or all of the functions realized in the above-described units may be realized in hardware by a dedicated logic circuit or the like.

<About processing of each part>
Processing in the X-ray image processing device 40 and the tablet terminal device 60 will be described. In the following description, X-ray CT imaging is performed in advance in the X-ray imaging apparatus 10, and X-ray CT image data obtained by processing X-ray CT imaging data is stored in the storage unit 53 as display direction setting image data 53 d. Will be described as being stored.

  FIG. 4 is a flowchart showing each process in the X-ray image processing device 40 and the tablet terminal device 60. In the following, each process in the X-ray image processing apparatus 40 and the tablet terminal apparatus 60 will be described based on the flowchart of FIG.

  In the initial state, it is assumed that the display program 73a is executed in the tablet terminal device 60 and the display image processing program 53b is executed in the X-ray image processing device 40.

  In this state, the observer P has the tablet terminal device 60 as shown in FIG. Usually, the viewer P is provided with the image display unit 61 of the tablet terminal device 60 in front of the eyes, and the center of the image display unit 61 in the possessed position is positioned at the center of the two eyes. It has a terminal device 60.

  The processing on the tablet terminal device 60 side will be described. In step S1, the tablet terminal device 60 determines whether or not an operation for displaying an X-ray image is performed. For example, as shown in FIG. 6, an X-ray image display operation is performed by displaying a “display start” button on the image display unit 61 of the tablet terminal device 60, and the observer P pressing the “display start” button. It is accepted by touching. In step S1, if it is determined that there is no operation for X-ray image display, the processing in step S1 is repeated, and if it is determined that there is an operation, the process proceeds to step S2.

  In step S <b> 2, the tablet terminal device 60 transmits a display command to the X-ray image processing device 40. Thereby, a default X-ray image is generated in the X-ray image processing apparatus 40.

  In next step S <b> 3, the tablet terminal device 60 determines whether or not a default X-ray image is received from the X-ray image processing device 40. Step S3 is repeated until a default X-ray image is received. When a default X-ray image is received, the process proceeds to step S4.

  In step S <b> 4, as illustrated in FIG. 7, the tablet terminal device 60 displays a default X-ray image on the image display unit 61. The default X-ray image is data including an X-ray image obtained by imaging an imaging portion of a subject from a predetermined direction set in advance. An example of the default X-ray image will be described later.

  In next step S <b> 5, the tablet terminal device 60 determines whether or not there is an operation in the movement follow-up mode. For example, as shown in FIG. 7, the motion follow mode is displayed on the image display unit 61 of the tablet terminal device 60, and the observer P touches the “motion follow” button. It is accepted by doing. If it is determined in step S5 that there is no operation in the movement follow-up mode, the same determination step is repeated (therefore, the default X-ray image remains displayed). Proceed to S6.

  In step S <b> 6, the tablet terminal device 60 transmits a motion follow-up mode command to the X-ray image processing device 40. As a result, the X-ray image processing apparatus 40 starts processing for executing the motion follow-up mode.

  In next step S <b> 7, the tablet terminal device 60 gives an imaging instruction to the imaging unit 62. Accordingly, the imaging unit 62 captures an image including the observer P in front of the tablet terminal device 60.

  In next step S <b> 8, the tablet terminal device 60 transmits the imaging data captured by the imaging unit 62 to the X-ray image processing device 40. Thereby, in the X-ray image processing apparatus 40, the line-of-sight direction of the observer P is determined and, based on the display direction setting image data 53d stored in the storage unit 53, the X-ray image corresponding to the line-of-sight direction Is generated.

  In next step S <b> 9, the tablet terminal device 60 determines whether an X-ray image is received from the X-ray image processing device 40. Step S9 is repeated until it is determined that an X-ray image has been received. If it is determined that an X-ray image has been received, the process proceeds to step S10.

  In step S <b> 10, as shown in FIG. 8, the tablet terminal device 60 displays the received X-ray image on the image display unit 61. Unlike the default X-ray image, the X-ray image displayed here is an image corresponding to the viewing direction of the observer P.

  In step S <b> 11, the tablet terminal device 60 determines whether or not there is a display end operation. For example, as shown in FIG. 8, the display end operation at this time is performed by displaying the “display end” button on the image display unit 61 of the tablet terminal device 60 and the observer P touching the “display end” button. Is accepted. If it is determined in step S11 that there is no display end operation, the process returns to step S7, and the process of displaying an image corresponding to the line-of-sight direction in step S7 and subsequent steps is repeated. If it is determined in step S11 that there is a display end operation, the process proceeds to step S12.

  In step S11, after it is determined that there is no display end operation, it may be modified to return to immediately before step S5 and re-determine the presence / absence of the operation in the movement follow-up mode.

  In step S12, the tablet terminal device 60 transmits a display end command to the X-ray image processing device 40, and ends the process.

  The processing on the X-ray image processing apparatus 40 side will be described. In step S21, the X-ray image processing apparatus 40 determines whether or not a display command has been received from the tablet terminal apparatus 60. The process of step S21 is repeated until it is determined that the display command is received, and if it is determined that the display command is received, the process proceeds to step S22.

  In step S22, the X-ray image processing apparatus 40 generates a default X-ray image. An example of generating a default X-ray image will be described later.

  In next step S <b> 23, the X-ray image processing device 40 transmits a default X-ray image to the tablet terminal device 60. Thereby, a default X-ray image is displayed on the tablet terminal device 60.

  In next step S <b> 24, the X-ray image processing device 40 determines whether or not a motion follow-up mode command is received from the tablet terminal device 60. The process of step S24 is repeated until it is determined that the motion follow-up mode command is received, and if it is determined that the motion follow-up mode command is received, the process proceeds to step S25.

  In step S <b> 25, the X-ray image processing apparatus 40 determines whether or not image data obtained by the imaging unit 62 has been received from the tablet terminal device 60. The process of step S25 is repeated until it is determined that the imaging data has been received. If it is determined that the imaging data has been received, the process proceeds to step S26.

  In step S26, the X-ray image processing apparatus 40 determines the line-of-sight direction based on the imaging data, and then proceeds to step S27. A processing example for determining the line-of-sight direction based on the imaging data will be described later.

  In step S <b> 27, the X-ray image processing apparatus 40 generates an X-ray image corresponding to the viewing direction based on the display direction setting image data 53 d stored in the storage unit 53. A processing example for generating an X-ray image corresponding to the line-of-sight direction will be described later.

  In next step S <b> 28, the X-ray image processing device 40 transmits the generated X-ray image to the tablet terminal device 60. As a result, an X-ray image corresponding to the viewing direction of the observer P is displayed on the image display unit 61 of the tablet terminal device 60.

  In next step S <b> 29, the X-ray image processing apparatus 40 determines whether a display end instruction is received from the tablet terminal device 60. If it is determined that the display command has not been received, the process returns to step S25, and the process of generating an X-ray image corresponding to the line-of-sight direction after step S26 is repeated. If it is determined that the display command has been received, the process is terminated.

  An example of a default X-ray image generation process, an example of a line-of-sight direction determination process, and an example of an X-ray image generation process corresponding to the line-of-sight direction will be described.

<Example of default X-ray image generation processing>
The default X-ray image generated in step S22 is the X-ray image from the default line-of-sight direction preset in the display image processing unit 45 based on the display direction setting image data 53d stored in the storage unit 53. It is assumed that they are generated as

  First, as shown in FIGS. 9 and 10, an example will be described in which the default line-of-sight direction is set as a direction that is orthogonal to the tangent line of the dental arch at the display target location and faces from the outside to the inside.

  Assume that local CT image data obtained by processing local CT imaging data is stored as the display direction setting image data 53d in the storage unit 53, as shown by a circled portion in FIG. Now, let the circled area be the local area LA. The local CT image data of the local area LA is stored in the storage unit 53 together with the position information on the dental arch 80. The storage unit 53 stores a general curve model 82 indicating the direction in which a plurality of teeth are arranged in the dental arch. When the display image processing unit 45 generates the default X-ray image based on the local CT image data, the position of one or more teeth included in the local CT image data in the dental arch 80 is specified. At the same time, based on the curve model 82, a tangent line 83 of the curve model 82 at the position (preferably the center) of one or a plurality of teeth is obtained. The position of the tooth to be imaged can be determined based on the medical information in the database associated with the display direction setting image data 53d or the scout position on the panoramic scout screen at the time of imaging. A direction perpendicular to the tangent line 83 and facing from the outside to the inside is defined as a default line-of-sight direction 84. Then, the display image processing unit 45 generates an X-ray image from the default line-of-sight direction 84 based on the display direction setting image data 53d which is local CT image data obtained by processing the local CT imaging data. When the generated X-ray image is an X-ray image generated by the Ray-Sum method in which a three-dimensional distribution of CT values included in local CT image data is added and projected in the default line-of-sight direction 84, the CT value In the three-dimensional distribution, the X-ray image may be generated by the MIP (Maximum Intensity Projection) method in which the maximum value in the default line-of-sight direction 84 is projected. An X-ray image generated by the Ray-Sum method is an image close to a general X-ray projection image.

  In the case of the present embodiment, an X-ray image from the default line-of-sight direction 84 is generated so that the local region is viewed normally. In other words, the correspondence is such that the top / bottom / left / right of the subject matches the top / bottom / left / right of the screen.

  The coordinate data of the curve model 82, the coordinate data of the tangent line 83, and the default line-of-sight direction 84 may be calculated geometrically each time, but a table that associates the tooth position with the default line-of-sight direction is prepared in advance. In addition, the default line-of-sight direction 84 may be called for each designated tooth position.

  When wide-area CT imaging data including the entire dental arch and the like is stored as the display direction setting image data 53d in the storage unit 53, the tablet terminal device 60 or the X-ray image processing device 40 uses the dental arch. , And by designating a display target location in the dental arch, a default X-ray image can be generated by determining the default line-of-sight direction 84 as described above.

  Since the curve model and the table define the default line-of-sight direction 84 with respect to the position of the display target, even if the default line-of-sight direction 84 is determined with reference to the position of the display target and the curve model or table, the default It can be said that the viewing direction 84 is preset. However, the default line-of-sight direction may be set by the observer each time display is performed.

  FIG. 11 is a diagram illustrating a setting example of other default line-of-sight directions 84Ba and 84Bb. Here, it is assumed that the dental films 88Fa and 88Fb are arranged at what position and posture with respect to the dental arch 80 when X-ray transmission imaging of the dental arch 80 is performed using the dental films 88Fa and 88Fb. ing. Here, it is assumed that an imaginary dental film 88Fa is disposed at an inner position of the front portion of the dental arch 80 in a posture along the left-right direction. For this reason, for the tooth group located at the front part of the dental arch 80, the direction perpendicular to the dental film 88Fa and directed from the front to the rear is set as the default line-of-sight direction 84Ba. For the tooth group located on the side of the dental arch 80, the direction perpendicular to the dental film 88Fb and directed from the front oblique outer side to the rear oblique inner side is set as the default line-of-sight direction 84Bb. Then, the default line-of-sight directions 84Ba and 84Bb are determined according to the position of the tooth to be displayed.

  Regarding the position of the tomographic plane, for example, in the case of the above-described virtual dental film 88Fa, the setting is made such that the detection surface of the virtual dental film 88Fa is moved in the direction opposite to the default visual line direction 84Ba. Is possible. The distance of the parallel movement can be set so as to be in the vicinity of the panoramic tomography of the corresponding dentition from the size and shape of the dental arch of the general skeleton.

  The default line-of-sight direction may be manually set on a dental arch or the like displayed on the image display unit 61.

<Gaze direction determination processing example>
Here, a process of acquiring the viewing direction of the observer P will be described. Here, the line-of-sight direction acquisition unit determines the relative position of the observer P with respect to the image display unit 61 based on the imaging unit 62 capable of imaging the observer P of the image display unit 61 and the captured image of the imaging unit 62. And a gaze direction determining unit 44 that determines the gaze direction of the observer P.

  FIG. 12 is an explanatory diagram showing the observation position and the line-of-sight direction 85 of the observer P with respect to the tablet terminal device 60. Note that the observer P in front of the tablet terminal device 60 is “Pa”, the line-of-sight direction 85 of the observer Pa is “85a”, the observer P shifted from the front of the tablet terminal device 60 is “Pb”, and the observer Pb The line-of-sight direction 85 may be distinguished by “85b”.

  As shown in the figure, when the observer Pa observes the image display unit 61 from directly in front of the tablet terminal device 60, the observer Pa exists on the central extension line of the image display unit 61 of the tablet terminal device 60. For this reason, the line-of-sight direction 85 a is orthogonal to the image display unit 61 and is a direction from the front of the image display unit 61 toward the image display unit 61. Further, when the observer Pb observes the image display unit 61 from the oblique side of the tablet terminal device 60, the observer Pb exists obliquely from the center of the image display unit 61 of the tablet terminal device 60. Therefore, the line-of-sight direction 85b is skewed with respect to the image display unit 61 (here, the line-of-sight direction 85b forms an angle α with respect to the line-of-sight direction 85a). The direction is toward the image display unit 61.

  Assume that an imaging unit 62 is provided at the center of the image display unit 61 of the tablet terminal device 60, and the imaging unit 62 captures an area centered on the front side of the tablet terminal device 60.

  In this case, as shown in FIG. 13, the observer Pa is observed at a position in the center in the width direction of the captured image. Further, as shown in FIG. 14, the observer Pb is observed at a position biased to any side of the captured image. For this reason, the observers Pa and Pb (faces) are recognized in the captured image, and the line-of-sight directions 85a and 85b are determined based on the positions in the captured image where the observers Pa and Pb are recognized. Can do. The line-of-sight direction may be determined from the positions of the observer's face, arms, body, and the like.

  For example, pattern recognition is performed based on the captured image, and the positions of the two eyes of the observers Pa and Pb are specified. The center of the positions of the two eyes is set as the positions of the viewers Pa and Pb. Then, based on the positions of the viewers Pa and Pb with respect to the center line L in the width direction of the captured image (whether they are positioned on the left or right), the distance between the positions of the viewers Pa and Pb and the center line L in the width direction of the captured image, and the like. The line-of-sight directions 85a and 85b are determined. For example, when it is determined that the distance from the observer Pa's width direction center line L is less than a preset first threshold, the line-of-sight direction 85a is orthogonal to the image display unit 61 and the image display unit 61 It is determined that the direction is from the front to the image display unit 61. Further, for example, when it is determined that the distance L1 between the observer Pb and the center line L in the width direction exceeds a preset first threshold value (if it is the same as the first threshold value, any determination is made) It is determined whether the observer Pb is located on the right or left with respect to the center line L in the width direction, and determines that the direction from the determined side toward the center of the image display unit 61 is the line-of-sight direction 85b. .

  Further, the positions of the viewers Pa and Pb may be determined to be slightly above the center of the head detected by image recognition.

  The default line-of-sight directions 84, 84Ba, 84Bb are set in a direction orthogonal to the tangent line of the dental arch 80, or set in a direction orthogonal to the dental films 88Fa, 88Fb, and the line-of-sight directions 85a, 85b defines a tilt direction, an angle, and the like with reference to the default line-of-sight directions 84, 84Ba, and 84Bb. For this reason, the X-ray image is generated based on the line-of-sight directions 85a and 85b of the observer P with reference to the default line-of-sight directions 84, 84Ba, and 84Bb of the default X-ray image (see FIGS. 9 and 10). ).

  In the above example, the line-of-sight directions 85a and 85b are the line-of-sight direction 85a toward the image display unit 61 from the front in front of the tablet terminal device 60, and the line-of-sight direction toward the image display unit 61 from the position on the front right side or the left side of the tablet terminal device 60. Although described with the example of three 85b and 85b, according to the distance of the observers Pa and Pb with respect to the center line L in the width direction, the line-of-sight directions may be associated in more stages. Further, the line-of-sight direction may be determined by performing a calculation based on a predetermined relational expression such as multiplying the distances of the viewers Pa and Pb with respect to the center line L in the width direction by a predetermined coefficient set in advance. Note that the distance between the viewers Pa and Pb and the image display unit 61 affects the positions of the viewers Pa and Pb reflected in the captured image. However, since the distances between the observers Pa and Pb and the image display unit 61 are usually limited to some extent, the image display unit according to the distances of the observers Pa and Pb with respect to the center line L in the width direction. It is also possible to grasp the angle of the viewing direction of the observer P with respect to the normal direction of 61 with a certain degree of accuracy. In addition, for example, the distance between the viewers Pa and Pb with respect to the center line L in the width direction (for example, the distance can be calculated based on the distance between the two eyes of the viewers Pa and Pb, the size of the face, etc.). (For example, a different table is prepared according to the distance, or an angle is calculated based on a relational expression in which the distance is also a variable), and the line-of-sight direction of the observer P with respect to the normal direction of the image display unit 61 The angle may be determined.

  However, if the positions of the observers Pa and Pb are determined to be the center of both eyes detected by image recognition, or if they are determined to be slightly above the center of the head detected by image recognition, even that point is specified. For example, the angle α or the distance L1 shown in FIG. 12 is determined.

  Further, the position of the observer P may be based on another part of the face (nose, mouth, etc.) recognized in the captured image, or may be based on the center of the face recognized in the captured image. The tablet terminal device 60 is provided with a plurality of imaging units, images a three-dimensional image of the observer based on the imaging data from the plurality of imaging units, and the observer for the tablet terminal device 60 based on the three-dimensional image. May be determined and the line-of-sight direction (angle with respect to the normal direction of the image display unit 61) may be determined.

<Example of X-ray image generation processing according to line-of-sight direction>
An example of an X-ray image generation process corresponding to the line-of-sight directions 85a and 85b determined as described above will be described.

  First, the relationship between the line-of-sight direction and the appearance of teeth in the X-ray image will be described.

  As shown in FIG. 15, it is assumed that an X-ray projection image of some teeth 90 in the dental arch 80 is captured. The tooth 90 on the left side of the lower dental arch has two roots 92 a and 92 b arranged in a direction perpendicular to the tangent to the dental arch 80. When an X-ray projection image of the tooth 90 is captured, an X-ray dental film 88 (or imaging plate) is disposed on the back side of the tooth 90 and X-rays are emitted from the outside of the tooth 90. X-ray imaging is based on normal intraoral radiography.

  When the X-ray generation source is arranged in a direction orthogonal to the tangent of the dental arch 80 and imaged by normal radiation projection in which the X-ray irradiation direction is a direction orthogonal to the tangent of the dental arch 80, A positive radiation image is obtained. In this case, as shown in FIG. 16A, since the X-rays are projected onto the X-ray dental film 88 through the two roots 92a and 92b, the two roots 92a and 92b overlap in the positive radiation image. (See FIG. 7). Further, a positive radiation image is obtained by imaging with a positive radiation projection in which the X-ray irradiation direction is a direction orthogonal to the tangent to the dental arch 80. In this case, as shown in FIG. 16, since X-rays are projected onto the X-ray dental film 88 through the two roots 92a and 92b along the projection direction, in the positive radiation image, the two roots 92a and 92b are projected. Are observed in an overlapping manner (see FIG. 7).

  When an X-ray generation source is disposed near the center of the dental arch 80 and the X-ray emission direction is tilted outward from the center side of the dental arch 80, an image of eccentricity is obtained. It is done. In this case, as shown in FIG. 17A, the X-rays are projected onto the X-ray dental film 88 through the two roots 92a and 92b at different locations along the projection direction. In the image, the two roots 92a and 92b are observed at different positions (see FIG. 8).

  When an X-ray generation source is arranged near the end of the dental arch 80 and the X-ray emission direction is tilted from the outside of the dental arch 80 to the center side, an image is obtained. In this case, as shown in FIG. 18A, the X-rays are projected onto the X-ray dental film 88 through the two roots 92a and 92b at different locations along the projection direction. In this case, the two roots 92a and 92b are observed at different positions. However, the positional relationship between the two roots 92a and 92b is reversed between the eccentric centroid image and the eccentric centrifugal image.

  In the above example, the tooth 90 having the two roots 92a and 92b has been described. When the tooth 94 having the three roots 94a, 94b, and 94c is examined like the tooth 94 on the back side of the dental arch 80, The significance of observing the tooth 94 in both the eccentric centroid image and the eccentric centrifugal image becomes clearer.

  That is, if the tooth 94 has a large number of roots 94a, 94b, 94c, the roots 94a, 94b, 94c are easily observed in an X-ray projection image from a certain direction.

  For example, as shown in FIG. 19, when the tooth 94 is imaged by partial centrifugal projection, the roots 94b and 94c are projected as shown in FIG. 20, and it is difficult to observe the roots 94b and 94c separately. It becomes.

  On the other hand, as shown in FIG. 21, when the tooth 94 is imaged by almost positive radiation projection or slightly eccentric projection, the roots 94a, 94b, and 94c are separately projected as shown in FIG. It can be observed separately.

  Here, it is assumed that the display direction setting image data 53d is image data in which a plurality of X-ray image data acquired from a plurality of directions by the following method is associated with each imaging angle (viewing direction).

  In this case, X-ray images from a plurality of directions acquired by the X-ray dental film 88 (or imaging plate) are scanned and stored in the storage unit 53 as X-ray image data. The X-ray image data is stored in the storage unit 53 as it is, or after being processed as necessary, as display direction setting image data 53d as simple transmission X-ray image group data associated with the imaging angle.

  If the default line-of-sight directions 84, 84Ba, 84Bb are set in a direction orthogonal to the tangent line of the dental arch 80 or set in a direction orthogonal to the dental films 88Fa, 88Fb, the default X-ray image is normal. A radiation image is generated and displayed on the image display unit 61. Note that the default X-ray image may be tilted with respect to the positive radiation image, and the default X-ray image may be tilted based on the line-of-sight direction to generate a positive radiation image, or a further tilted image may be generated.

  After that, the display image processing unit 45 has a shooting angle corresponding to the line-of-sight directions 85 a and 85 b determined by the line-of-sight direction determination unit 44 based on the display direction setting image data 53 d stored in the storage unit 53. An X-ray image is generated based on the X-ray image data (included in the display direction setting image data 53d). This X-ray image is displayed on the image display unit 61. The display direction setting image data 53d is a set of display direction setting image data obtained by associating the X-ray image data obtained for each of the plurality of X-ray irradiation directions with the imaging angle as described above. Prepared as 53d.

  In the above-described example, the configuration in which the X-ray dental film 88 (or imaging plate) is used as a detector to capture images by normal intraoral radiography is shown, but an electrical intraoral X-ray sensor may be used.

  In this case, for example, the subject M1 is positioned on the imaging main body 20 shown in FIG. 1, and the swivel arm 24 is swung while the X-ray generator 22A emits X-rays and the intraoral X-ray sensor emits transmitted X-rays. You may make it receive light. According to this method, the number of times of X-ray irradiation can be made large or continuous, so that the number of detections by the X-ray sensor can be increased, and a large number of transmission images can be obtained. Images can be prepared.

  X-ray CT imaging or X-ray tomosynthesis imaging may be performed, and similar results may be obtained by image processing.

  Specifically, the X-ray imaging apparatus 10 is used to perform X-ray CT imaging or X-ray tomosynthesis imaging of an area including at least the tooth 90. The obtained projection data is processed to generate a plurality of tomographic images parallel to the detection surface of the X-ray sensor in the buccal tongue direction as shown in FIG. 16B (tomographic images SC1, SC2, SC3... SCN). ). As shown in FIGS. 16 (c), 17 (b), and 18 (b), the arrangement of the plurality of tomographic images is shown in FIGS. 16 (a), 17 (a), and 18 (a). An image similar to the image formed on the X-ray dental film 88 (or imaging plate) can be generated by extraoral radiography. X-ray tomosynthesis imaging will be described later.

  The case where local CT image data is processed will be additionally described.

  Now, as shown in FIG. 56, suppose that the vertical direction of the head MH of the subject M1 is the Z1 direction, the horizontal direction of the head is the X1 direction, and the front-back direction of the head is the Y1 direction.

  In local CT imaging, the subject M1 is fixedly positioned with respect to the imaging main body 20 as shown in FIG. Specifically, the head MH of the subject M1 is placed and fixed and positioned on a head fixing part 26F such as a chin rest in the elevating part 26.

  As shown in FIG. 58, in the head MH, the curve model 82 described with reference to FIG. 9 is set at a specific position with respect to the chin rest 26F based on the data of the head of a general skeleton.

  The position of the curve model 82 can be specified three-dimensionally with the coordinates of X1Y1Z1.

  A local area LA shown in FIG. 9 is a field of view (FOV ... Field of View) in cylindrical CT, and is an irradiation target of the X-ray cone beam formed by the X-ray restricting unit during X-ray CT imaging.

  Assume that the surface TS1 in contact with the curved surface of the curve model 82 is determined. When the curve model 82 and the surface TS1 are viewed in plan from the Z1 direction, it is assumed that the surface TS1 has a geometric relationship in which the surface TS1 appears as a tangent TL as shown in FIG.

  When the contact point TP between the curve model 82 and the tangent line TL is three-dimensionally perspective, it becomes the central axis CX of the local region LA as shown in FIG.

  As shown in FIG. 60A, the X-ray image from the default line-of-sight direction 84 shown in FIG. 9 is cut from the X-ray CT image data as an X-ray image (X-ray CT image) TS1i of the tomographic plane of the surface TS1. And displayed on the image display unit 61.

  As shown in FIG. 60 (a), if the root canals RC1 and RC2 of the observation target tooth are at a position deviating from the surface TS1, as shown in FIG. 60 (b), the root canal RC1 is included in the X-ray image TS1i. , RC2 is not displayed.

  As shown in FIG. 61 (a), when the line-of-sight direction 85b shown in FIG. 9 is determined, the surface to be observed rotates around the central axis CX, and an X-ray image of a tomographic plane of the new surface TS2 ( X-ray CT image) TS2i is cut out from the X-ray CT image data and generated.

  When the root canals RC1 and RC2 coincide with the surface TS2, the root canals RC1 and RC2 are displayed in the X-ray image TS2i as shown in FIG. 61 (b).

  As described above, the rotation axis of the surface to be observed may be automatically determined or may be determined by receiving an input from the operator. For example, the X-ray CT image of the local area LA is temporarily displayed on the display unit 41, the operator performs an operation such as rotation on the displayed X-ray CT image, and a new rotation axis is manually set to the X-ray CT image. May be received and received.

  In the display on the image display unit 61 of the tablet terminal device 60, where the rotation axis of the surface to be observed is set on the display is arbitrary.

  For example, it is assumed that the screen of the image display unit 61 of the tablet terminal device 60 is a rectangular screen.

  Although not shown, the upper left corner of the screen of the image display unit 61 is DS1, the upper right corner is DS2, the lower left corner is DS3, and the lower right corner is DS4. A central point on the left and right of the points DS1 and DS2 is M12, and a central point on the left and right of the points DS3 and DS4 is M34. A line connecting the point M12 and the point M34 is assumed, and is set as a line LV. On display, the line LV and the rotation axis of the surface to be observed may coincide with each other, or may be set at another location. An observer may be allowed to set arbitrarily.

  The display content may be set so that there is a three-dimensional spread in the back of the screen of the image display unit 61, and image processing may be performed such that the rotation axis of the surface to be observed is in the back of the screen.

  FIG. 62 illustrates X-ray tomosynthesis imaging.

  In the illustrated example, the same dentition region as that in FIG. The X-ray generator 22A and the X-ray detector 23A turn around a center point TC of the imaging target area, and the X-ray generator 22A turns from the imaging start position TMS1 to the imaging end position TME1 via the intermediate position TMM1. The X-ray detector 23A turns from the imaging start position TMS2 to the imaging end position TME2 via the intermediate position TMM2.

  The turning angle is less than 180 °, and may be selected, for example, 60 ° or 90 °, or may be selected stepwise from 60 ° to 90 ° in total of 3 or more. , It may be determined steplessly between 60 ° and 90 °.

  The angle of the tomographic object to generate the image can be arbitrarily set to some extent, and the viewing direction T84 along the X-ray incidence direction at a position just between the imaging start position and the imaging end position is set as the default viewing direction, and the viewpoint of the observer The line-of-sight direction may be followed. The illustrated line-of-sight direction T85b is an example where the line-of-sight direction slightly closer to the mesial direction than the line-of-sight direction T84 is determined as a result of tracking.

  A fault LY1 that is substantially orthogonal to the line-of-sight direction T84 and a fault LY2 that is substantially orthogonal to the line-of-sight direction T85b are defined.

  The cross sections LY1 and LY2 have a cross section thickness including information before and after in the X-ray transmission direction. Moreover, the thickness of the fault can be variably set within a certain range. X-ray tomosynthesis image data generated by processing X-ray tomosynthesis imaging data obtained by X-ray tomosynthesis imaging is one of display direction setting image data 53d.

<Effects>
According to the operation method of the X-ray image display device 12, the X-ray imaging device 10, the X-ray image display control programs 53 b and 73 a, and the X-ray image display device 12 configured as described above, the observer P looks at the three-dimensional object. When a natural operation to change the direction is performed, the positional relationship of the image display unit 61 with respect to the observer P of the image display unit 61, that is, the line-of-sight directions 85a and 85b of the observer P of the image display unit 61 is changed. get. Then, the display image processing unit 45 generates an X-ray image based on the display direction setting image data 53d according to the acquired line-of-sight direction. This X-ray image is displayed on the image display unit 61. For this reason, when the X-ray image is displayed based on the display direction setting image data 53d including the X-ray image data obtained by processing the X-ray image data acquired from a plurality of directions or acquired from a plurality of directions, The line-of-sight direction of the line image can be easily set.

  In particular, the observer P of the image display unit 61 of the tablet terminal device 60 is imaged by the imaging unit 62, the relative position of the observer P with respect to the image display unit 61 is determined based on the captured image, and the observer P Therefore, the line-of-sight directions 85a and 85b can be easily determined using the imaging unit 62.

  Further, the display image processing unit 45 generates a default X-ray image from the preset default line-of-sight directions 84Ba and 84Bb based on the display direction setting image data 53d, and displays the default X-ray image on the image display unit 61. Thereafter, an X-ray image is generated based on the acquired line-of-sight directions 85a and 85b on the basis of the default line-of-sight directions 84Ba and 84Bb, and displayed on the image display unit 61. It is possible to display an X-ray image (for example, an eccentric centrifugal image or an eccentric centric image) tilted from the default visual line direction 84Ba, 84Bb of the image).

  Further, when the storage unit 53 includes X-ray CT image data as the display direction setting image data 53d, X-ray images from various directions can be easily generated. The display direction setting image data 53d may be X-ray tomosynthesis image data. Further, the display direction setting image data 53d may be a plurality of simple transmission X-ray image data (for example, data including a normal radiation image, a partial centrifuge image, and a partial centrifuge image) taken from a plurality of directions. In this case, as described above, the plurality of simple transmission X-ray image data and the line-of-sight direction (imaging angle) are stored in association with each other, and one simple transmission X-ray image is obtained based on the determined line-of-sight direction. It may be selected and displayed on the image display unit.

  Moreover, since the image display part 61 is an image display part of the tablet terminal device 60, the X-ray image according to the line-of-sight directions 85a and 85b is displayed on the image display part 61 of the tablet terminal device 60 which is easy to have. The observer P can easily observe the X-ray image.

  The X-ray image display device 12 is incorporated in the X-ray imaging device 10 and is provided as a display device of the X-ray imaging device 10. In addition, the observer can easily observe X-ray images from various viewing directions on the image display unit 61 that is a part of the X-ray imaging apparatus 10.

<Modifications for First Embodiment>
Various modifications will be described on the premise of the first embodiment.

<First Modification>
In the first embodiment, the processing step (see step S26) as the line-of-sight direction determination unit 44 is incorporated in the display image processing program 53b of the X-ray image processing apparatus 40. Therefore, the X-ray image processing apparatus 40 is in the line-of-sight direction. Although the example which has the determination part 44 demonstrated, it is not necessarily required.

  Like the X-ray image display device 112 of the first modified example shown in FIG. 23, the tablet terminal device 160 corresponding to the tablet terminal device 60 includes a processing step (see step S26) corresponding to the line-of-sight direction determining unit 44. The tablet terminal device 160 may be configured to include the line-of-sight direction determination unit 144, which is incorporated in the display program of the device 160. In this case, the line-of-sight direction determined by the line-of-sight direction determination unit 144 of the tablet terminal device 160 is transmitted to the X-ray image processing apparatus 140 corresponding to the X-ray image processing apparatus 40 via wireless communication or the like, and the first embodiment described above. Similarly to the above, an X-ray image corresponding to the line-of-sight direction is generated.

<Second Modification>
In the above-described embodiment, the X-ray image display device 12 is described as being configured by the X-ray image processing device 40 and the tablet terminal device 60. However, as in the second modification shown in FIGS. In addition, the tablet terminal device 260 may be used alone.

  That is, in the tablet terminal device 260, the CPU 71, the RAM 72, the storage unit 73, the image display unit 61, the touch panel input unit 75, the imaging unit 62, and the wireless communication unit 77 are connected via the bus line 78 in the same manner as the tablet terminal device 60. It is composed of interconnected general portable computers. The storage unit 73 stores an X-ray image display control program 273a and display direction setting image data 253d. The display direction setting image data 253d is the same data as the display direction setting image data 53d in the first embodiment. The display direction setting image data 253d is generated in advance based on data separately captured by the X-ray imaging apparatus, and is stored in the storage unit 73. Is remembered. Even in this case, it is preferable that management data in which display direction setting image data 253d is associated with specific information of the subject M1 and the like is stored in a server computer such as the X-ray image processing apparatus 40. The display direction setting image data 253d may be provided to the tablet terminal device 260 via wireless communication, or may be provided separately via a recording medium such as a flash memory. The X-ray image display control program 273a is a program described as a process for the CPU of the tablet terminal device 260 to execute the process described in the display image processing program 53b and the process described in the display program 73a. It is.

  The tablet terminal device 260 is functionally described. When an X-ray image display command is given through the touch panel input unit 75, an imaging command is given to the imaging unit 62, and the imaging unit 62 displays the front image of the image display unit 61. An image is captured and the captured image is provided to the line-of-sight direction determination unit 270. The line-of-sight direction determination unit 270 determines the line-of-sight direction of the observer based on the captured image, and gives the line-of-sight direction to the image processing unit 272. The line-of-sight direction determination unit 270 corresponds to the line-of-sight direction determination unit 44, and the image processing unit 272 corresponds to the display image processing unit 45.

  The image processing unit 272 generates an X-ray image corresponding to the viewing direction based on the display direction setting image data 253d stored in the storage unit 73 and causes the image display unit 61 to display the X-ray image.

  The storage unit 73 may store X-ray image data (not shown) similar to the X-ray image data 53c in the first embodiment, and generate display direction setting image data 253d in the image processing unit 272. Good.

  FIG. 26 is a flowchart showing each process in the tablet terminal device 260. Basically, a flow is shown in which each process shown in the flowchart shown in FIG. 4 is processed by the tablet terminal device 260.

  That is, in step S41, the tablet terminal device 260 determines whether or not there is an operation for displaying an X-ray image. If it is determined that there is an operation, the process proceeds to step S42.

  In step S42, the tablet terminal device 260 generates a default X-ray image.

  In next step S <b> 43, the tablet terminal device 260 displays a default X-ray image on the image display unit 61.

  In next step S44, the tablet terminal device 260 determines whether or not there is an operation in the movement follow-up mode. If it is determined that there is no operation, the process of step S44 is repeated (the state where the default X-ray image is displayed continues). If it is determined that there is an operation in the movement follow-up mode, the process proceeds to step S45.

  In step S <b> 45, the tablet terminal device 260 gives an imaging instruction to the imaging unit 62. Thereby, the imaging unit 62 captures an image including the observer P in front of the tablet terminal device 260, that is, the viewer P.

  In next step S46, the tablet terminal device 260 determines the line-of-sight direction based on the imaging data, and then proceeds to step S47.

  In step S47, the tablet terminal device 260 generates an X-ray image corresponding to the viewing direction based on the display direction setting image data 253d stored in the storage unit 73.

  In next step S <b> 48, the tablet terminal device 260 displays the generated X-ray image on the image display unit 61.

  In step S49, the tablet terminal device 260 determines whether or not there is a display end operation. If it is determined that there is no operation to end the display, the process returns to step S45, and the process of displaying an image corresponding to the line-of-sight direction after step S45 is repeated. If it is determined in step S49 that there is an operation for terminating display, the process is terminated.

  As described above, the tablet terminal device 260 alone may constitute the X-ray image processing device.

<Third Modification>
Further, the functions of the tablet terminal devices 60, 160, and 260 in the first embodiment, the first and second modified examples are information configured by a computer, a workstation, and the like as in the third modified example shown in FIG. The processing terminal device 361 may be realized by a terminal device 360 in which an imaging unit 362, an image display unit 363 configured by a display device such as a liquid crystal monitor, and an operation unit 364 configured by a keyboard or a mouse are connected. Even in this case, the image capturing unit 362 captures an image of the observer to determine the viewing direction, the image display unit 363 displays a default X-ray image and an X-ray image corresponding to the viewing direction, and the operation unit 364 performs various operations. By accepting, processing and display similar to those of the tablet terminal devices 60, 160, and 260 can be realized.

<Fourth Modification>
In the first embodiment and the first to third modifications, the line-of-sight direction determination units 44, 144, and 270 sequentially determine the line-of-sight directions 85a and 85b of the observer P, and the line-of-sight direction 85a, Although an example of generating and displaying an X-ray image based on 85b has been described, it is not always necessary.

  This will be described by further modifying the flowchart of the second modification (FIG. 25). As in the fourth modification shown in FIG. 28, step S51 is added between step S45 and step S46. In S <b> 51, the line-of-sight direction determination unit 270 of the tablet terminal device 260 may detect a change in the relative position of the observer of the image display unit 61 with respect to the image display unit 61 based on the captured image of the imaging unit 62. . For example, when the imaging unit 62 captures a still image, the position of the observer in the captured image is compared with the position of the observer in the captured image at the previous imaging, and the change in the position is determined in advance. When the predetermined distance is exceeded or exceeded, it can be determined that there is a change. If a captured image is obtained by the imaging unit 62 before or after displaying the default X-ray image, it is possible to determine whether or not the observer has changed even when step S51 is the first time. If a captured image is not obtained by the imaging unit 62 before or after displaying the default X-ray image, the first step S51 may be skipped.

  If it is determined in step S51 that there is no change in the relative position of the observer, the process proceeds to step S49. That is, the display of the original X-ray image is continued without generating an X-ray image corresponding to the line-of-sight direction. On the other hand, if it is determined in step S51 that there is a change in the relative position of the observer, the process proceeds to step S46, where X is determined based on the subsequent processing, that is, the line-of-sight direction of the observer in the image display unit 61 after the change. Steps S46 to S48 are executed in which a line image is generated and displayed on the image display unit 61.

  Thus, when a change in the relative position of the observer P is detected while reducing the burden of the image generation process as much as possible, an appropriate X-ray image corresponding to the line-of-sight direction after the change can be displayed. .

  As can be understood from the first embodiment and the first to fourth modifications, the X-ray image display device can be realized by a single computer, or can be realized by distributing each function to a plurality of computers. You can also. When the X-ray image display device is realized by a plurality of computers, each function may be processed by any computer.

<Fifth Modification>
In the fourth modification, the imaging unit 62 may capture an observer with a moving image. In this case, the movement of the observer in the moving image is detected, and when the movement of the observer exceeds or exceeds a predetermined amount, it may be determined that there is a change in the observer. Thereby, the change of the relative position of the observer can be appropriately detected based on the moving image.

  In the first embodiment and each modification, the relative distance between the image display unit and the observer may be obtained, and the enlargement ratio of the X-ray image may be adjusted according to the relative distance.

  This will be described as a fifth modified example based on the tablet terminal device 260 of the second modified example. As illustrated in FIG. 29, the tablet terminal device 260B includes the image display unit 61 and the image display unit 61 based on the captured image of the imaging unit 62. A distance specifying unit 262B for obtaining a relative distance to the observer is further provided. Then, the tablet terminal device 260B adjusts the enlargement ratio of the X-ray image according to the relative distance specified by the distance specifying unit 262B and displays it on the image display unit 61.

  The processing of the tablet terminal device 260B will be described with reference to the flowchart shown in FIG. In the flowchart shown in FIG. 30, steps S52 and S53 are added between step S47 and step S48 in the flowchart of the second modification (FIG. 25).

  After step S47, the tablet terminal device 260B obtains the relative distance between the image display unit 61 and the observer in step S52. For example, as shown in FIG. 31, the relative distance between the image display unit 61 and the observer can be determined based on the distance between the two eyes of the observer P in the captured image. In the captured image, if the relative distance is small, the distance between the two eyes is large, and if the relative distance is large, the distance between the two eyes is small. A table in which a relative distance is associated with a distance is created in advance, or a relational expression indicating an inverse correlation with a distance between two eyes as a variable is set in advance, so that the observer P in the captured image can be set. Based on the distance between the two eyes, the relative distance between the image display unit 61 and the observer can be obtained. The tablet terminal device 260B is provided with a plurality of image pickup units, picks up a three-dimensional image of the observer based on the image data from the plurality of image pickup units, and based on the three-dimensional image, the image display unit 61 and the observer You may obtain | require the relative distance.

  In the next step S53, the tablet terminal device 260B sets the enlargement ratio based on the relative distance. For example, the enlargement ratio is set to increase as the relative distance decreases. The setting of the enlargement ratio may be made based on, for example, a table in which a preset relative distance and an enlargement ratio are associated in advance, or the relative distance may be a variable. May be made based on a relational expression set in advance.

  In the next step S54, the X-ray image generated in step S47 is enlarged at the magnification set in step S53 and displayed on the image display unit 61. Thus, when the observer P approaches the image display unit 61, an image with greatly enlarged teeth is displayed as shown in FIG.

  Conversely, when the observer P moves away from the image display unit 61, the teeth may be greatly enlarged so that observation can be facilitated even from a distance.

  According to this modification, the enlargement ratio of the X-ray image can be easily adjusted according to the relative distance between the image display unit 61 and the observer P.

<Sixth Modification>
Further, in the first embodiment and each modification, a line-of-sight direction operation reception unit capable of receiving a line-of-sight direction setting operation in an arbitrary direction is added, and X-rays are received according to the setting operation reception in the line-of-sight direction reception unit. An image may be generated and the X-ray image may be displayed on the image display unit.

  This will be described as a sixth modified example based on the tablet terminal device 260 of the second modified example. As shown in FIG. 33 and FIG. 34, the tablet terminal device 260C accepts an operation for setting the line-of-sight direction in an arbitrary direction. A possible visual line direction operation reception unit 262C is provided. The line-of-sight direction operation reception unit 262C includes, for example, a selection switch 262Ca provided in the center and a rotation operation key 262Cb provided around the selection switch 262Ca and capable of detecting the amount of rotation operation. Then, the line-of-sight direction is adjusted by operating the rotation operation key, and then, by pressing the selection switch 262Ca, the adjusted line-of-sight direction is accepted as the line-of-sight direction in the set arbitrary direction. .

  Then, when the line-of-sight direction setting operation is received through the line-of-sight direction operation receiving unit 262C, the image processing unit 272 is set through the line-of-sight direction operation receiving unit 262C instead of the line-of-sight direction determined by the line-of-sight direction determining unit 270. In accordance with the line-of-sight direction, an X-ray image is generated based on the display direction setting image data 253d, and this X-ray image is displayed on the image display unit 61.

  Note that the line-of-sight receiving unit may receive the line-of-sight direction through the touch panel input unit 75, or may be one that receives the line-of-sight direction by other mechanical buttons such as a keyboard operation and a mouse operation. Good.

  According to this modification, an X-ray image in an arbitrary line-of-sight direction can be displayed on the image display unit 61. For example, it is possible to interrupt the manual line-of-sight direction operation while setting the line-of-sight direction via the imaging unit 62.

<Seventh Modification>
In the first embodiment and the like, the image processing unit has mainly been described as an example of generating an image projected in a direction corresponding to the line-of-sight direction acquired by the line-of-sight direction acquisition unit. Good. That is, in the first embodiment and each modification, when the X-ray image data includes at least one of X-ray CT imaging data and X-ray tomosynthesis imaging data, the X-ray CT imaging data, At least one type of line tomosynthesis imaging data is processed into image data indicating a three-dimensional distribution of CT values or density values. Image data such as this three-dimensional distribution may be called three-dimensional mesh data. Then, based on the image data, the image processing unit generates a tomographic image sliced in a tomographic direction corresponding to the visual line direction acquired by the visual line direction acquisition unit as the X-ray image, and displays it on the image display unit. Execute the process. Alternatively or additionally, a volume in which the image processing unit is a three-dimensional non-transparent image or semi-transparent image oriented in a direction according to the line-of-sight direction acquired by the line-of-sight direction acquisition unit based on the image data It may be configured to execute at least one of the processes for generating the rendered image as an X-ray image.

  This will be described as a seventh modified example based on the tablet terminal device 260 of the second modified example. For example, as shown in FIG. 35, “projection” display is performed on the image display unit 61 of the tablet terminal device 260D. A button 261a for effecting, a button 261b for effecting “tomographic” display, and a button 261c for effecting “VR” (volume rendering) display are displayed. When the observer P touches one of the buttons 261a, 261b, and 261c and touches the “display start” button, in the processing described in the first embodiment, the default image or the determined line-of-sight direction Accordingly, when generating an X-ray image, a projected image corresponding to the line-of-sight direction, a tomographic image sliced in a tomographic direction corresponding to the line-of-sight direction (a tomographic image viewed in the line-of-sight direction) (see FIG. 36), A process for generating any one of the three-dimensional volume rendering images (see FIG. 37, the surface indicating the target region or the like, or the image indicating the inside by translucent) directed in the corresponding direction is generated and generated. The displayed image is displayed on the image display unit 61.

  Further, when displaying a tomographic image, as shown in FIGS. 38 and 39, the tablet terminal device 260Da is configured to include a tomographic thickness receiving unit 262D capable of receiving the setting of the tomographic thickness of the tomographic interest. preferable. For example, the tomographic thickness receiving unit 262D displays the dental arch 270D and the tomographic area 272D on the image display unit 61, and also displays the input setting field 274D for designating the thickness of the tomographic area 272D. By inputting the thickness of the tomographic area of interest in 274D, the configuration of the tomographic thickness of the tomographic area 272D of interest can be accepted. For example, the X-ray CT image can be generated as a tomographic image having a thickness corresponding to one pixel, but can also be generated as a tomographic image having a thickness corresponding to a plurality of pixels.

  Then, the image processing unit 272 generates an X-ray image when generating a default X-ray image or in accordance with the determined line-of-sight direction when an operation for setting a tomographic thickness is accepted on the initial screen or the like. At the time of generation, an X-ray image is generated by the Ray-Sum method, the MIP method, or the like based on image data indicating a three-dimensional distribution of CT values in a space corresponding to the relevant fault thickness. Then, the X-ray image is displayed on the image display unit 61. The tomographic image obtained by slicing the three-dimensional mesh data may be sliced after the cross-sectional position is determined. However, the tomographic image sliced for each of a plurality of gaze directions is generated and combined into a group of slice images and prepared as image data. Thus, the X-ray image may be selectively displayed after the cross-sectional position is determined. In addition, a tomographic image obtained by slicing a large number of 3D mesh data in a certain direction is generated, grouped into a group of slice images, prepared as image data, and selectively displayed as an X-ray image after the cross-sectional position is determined. You may make it do. In this case, a group of slice images can be sliced in a plurality of directions, and can be combined into each direction into one aggregate, which corresponds to changes in the cross-sectional position in the depth direction in each line-of-sight direction. Is possible.

  The tomographic thickness accepting unit may accept a tomographic thickness setting operation by a mechanical button, for example, a keyboard operation or a mouse operation.

  According to this modification, an X-ray image having a desired tomographic thickness can be observed.

<Other variations>
When a plurality of observers are recognized by the imaging unit 62, the observer closest to the center of the captured image may be used as a reference, the observer that reflects the largest image may be used as a reference, or a plurality of observers may be used. An average value based on the above may be used as a reference.

  Moreover, although the said embodiment assumed and demonstrated the case where the observation position of a tooth | gear was changed to the width direction, it is applicable also when the observation position of a tooth | gear is changed to the up-down direction. For example, when the position of the observer with respect to the image display unit is such that the lower (or upper) tooth displayed on the image display unit is viewed from above, the lower (or upper) is displayed on the image display unit. ) May be generated in accordance with the line-of-sight direction when the teeth are viewed obliquely from above, and displayed on the image display unit 61. Further, when the position of the observer with respect to the image display unit is such that the lower (or upper) tooth displayed on the image display unit is looked up from below, the image display unit includes the lower (or upper) An X-ray image in which the teeth are viewed obliquely from below may be generated according to a line-of-sight direction in which the teeth are viewed obliquely from below and displayed on the image display unit 61.

  The configuration described in the first embodiment and the configuration described in each of the modifications can be combined as appropriate. For example, a plurality of combinations of the distance specifying unit, the line-of-sight direction operation receiving unit, and the tomographic thickness receiving unit may be mounted on the X-ray image display device.

{Second Embodiment}
An X-ray image display apparatus according to the second embodiment will be described. Here, an example in which an X-ray image display device is integrally combined as a display device of an X-ray imaging apparatus will be described first as in the first embodiment. In the description of the present embodiment, the same components as those described in the first embodiment and the like are denoted by the same reference numerals and the description thereof is omitted, and the differences from the first embodiment are mainly described. To do.

  FIG. 40 is a block diagram showing an electrical configuration of the X-ray imaging apparatus 510, and FIG. 41 is a functional block diagram of the X-ray imaging apparatus 510.

  In the present embodiment, the X-ray image display device 12 described in the first embodiment further includes a gyro sensor 570 and an acceleration sensor 572 as a posture acquisition unit that acquires the posture of the image display unit 61. The display image processing unit is configured to be able to execute processing for generating an X-ray image based on the display direction setting image data 53d in accordance with the attitude of the image display unit 61.

  That is, the overall configuration of the X-ray imaging apparatus 510 is the same as that of the X-ray imaging apparatus 10, and includes the imaging main body 20, the X-ray image processing apparatus 540, and the tablet terminal apparatus 560.

  The tablet terminal device 560 further includes a gyro sensor 570 and an acceleration sensor 572 in the tablet terminal device 60. The gyro sensor 570 is a vibration type gyro sensor or the like, and is a sensor that detects an angular velocity or an angular acceleration of an object. The acceleration sensor 572 is a semiconductor type acceleration sensor or the like, and is a sensor that detects the acceleration of an object.

  The storage unit 73 of the tablet terminal device 560 stores an instruction for obtaining output results from the gyro sensor 570 and the acceleration sensor 572 in the display program 73a and a display program 573a for transmitting the output results. Has been.

  In the storage unit of the X-ray image processing apparatus 540, in addition to determining the line-of-sight direction based on the image data obtained by the imaging unit 62 in the display image processing program 53b, the output results of the gyro sensor 570 and the acceleration sensor 572 The display image processing program 553b that determines the line-of-sight direction of the X-ray image to be displayed on the image display unit 61 is stored. Thereby, the X-ray image processing apparatus 540 should not only determine the line-of-sight direction based on the imaging data by the imaging unit 62 but also display it as an X-ray image based on the output results of the gyro sensor 570 and the acceleration sensor 572. A function as a line-of-sight direction determination unit 544 that determines the line-of-sight direction is provided.

  As shown in FIG. 42, the image display unit 61 of the tablet terminal device 560 has the line-of-sight direction of the X-ray image to be displayed on the image display unit 61 based on the actual line-of-sight direction of the observer P. In order to accept a selection operation to select whether to be in accordance with the inclination of the image display unit 61, a "line of sight" button 561a and a "posture" button 561b are displayed. The observer P selectively touches the “line-of-sight direction” button 561a and the “posture” button 561b to change the line-of-sight direction of the X-ray image to be displayed on the image display unit 61 to the above-described mode. You can choose what to do.

  As processing in the X-ray image processing apparatus 540 and the tablet terminal apparatus 560, as shown in FIG. 43, first, in step T1, the presence / absence of mode setting is determined. If it is determined that there is no mode setting, step T1 is repeated, and if the observer P selectively touches the “line of sight” button 561a and the “posture” button 561b, it is determined that the mode is set, and the process proceeds to step T2.

  In step T2, the accepted mode setting content is transmitted to the X-ray image processing apparatus 540.

  In the next step T3, if the line-of-sight direction mode is accepted, the process proceeds to step T4. If the posture mode is accepted, the process proceeds to step T5.

  The line-of-sight change mode process in step T4 is the process described in the first embodiment. The posture mode process in step T5 will be described later.

  Also, in step T11, the X-ray image processing apparatus 540 determines whether or not the mode setting content has been received from the tablet terminal apparatus 560. If it is determined that there is no reception, step T11 is repeated to determine that there is reception. Then, it progresses to step T12.

  In the next step T12, when the line-of-sight direction mode is accepted, the process proceeds to step T13, and when the posture mode is accepted, the process proceeds to step T14.

  The line-of-sight change mode process in step T13 is the process described in the first embodiment. The posture mode process in step T14 will be described later.

  Processing in the X-ray image processing device 540 and the tablet terminal device 560 when the posture mode is accepted will be described. The processing in this case is the same as the processing described with reference to FIG. 4 in the first embodiment except for the points described below, and is as shown in FIG. The difference is that instead of step S7, step S61 for obtaining output results from the gyro sensor 570 and acceleration sensor 572 is executed, and instead of step S8, step S62 for transmitting output data is executed, instead of step S25. In step S63, it is determined whether or not the output data has been received. Instead of step S26, the line-of-sight direction of the X-ray image to be generated is determined based on the output results from the gyro sensor 570 and the acceleration sensor 572. Step S64 is executed.

  Hereinafter, an example of the process (step S64) of determining the line-of-sight direction based on the output results of the gyro sensor 570 and the acceleration sensor 572 in the line-of-sight direction determination unit 544 will be described more specifically.

  That is, the tablet terminal device 560 is provided with a gyro sensor 570 and an acceleration sensor 572. Therefore, the direction of gravity can be detected based on the output result of the acceleration sensor 572, and the tilt of the tablet terminal device 560 can be detected based on the output result of the gyro sensor 570. Therefore, for example, the image display unit 61 of the tablet terminal device 560 can detect the inclination of the image display unit 61 with reference to a horizontal posture perpendicular to the direction of gravity. Therefore, the line-of-sight direction determination unit 544 can determine the line-of-sight direction based on the output results of the gyro sensor 570 and the acceleration sensor 572. Note that the output results of the gyro sensor 570 and the acceleration sensor 572 may be given to the line-of-sight direction determination unit 544 after being calculated as an output representing the tilt of the image display unit 61 in the tablet terminal device 560, or the gyro sensor The output results of 570 and the acceleration sensor 572 may be given to the line-of-sight direction determination unit 544 as they are, and the line-of-sight direction determination unit 544 may calculate a value representing the inclination of the image display unit 61.

  For example, since the tablet terminal device 560 often has a flat shape, the tablet terminal device 560 is often placed upward on a desk or the like. Therefore, the observer P usually sets the width direction of the image display unit 61 perpendicular to the direction of gravity. The image display unit 61 is observed in a horizontal posture. Therefore, if the width direction of the image display unit 61 is a horizontal direction, the line-of-sight direction determination unit 544 determines that the line-of-sight direction 585 of the X-ray image to be generated is a normal direction with respect to the width direction of the image display unit 61. To do.

  Here, since the observer P changes the observation direction of the three-dimensional object, the following operation is determined as an operation in which the observer P does not change his / her own line-of-sight direction but changes the inclination of the image display unit 61. Is done. The first is an operation in which the observer P changes the posture of the image display unit 61 with respect to his / her face assuming that a three-dimensional object is fixedly present on the image display unit 61. Second, it is assumed that a virtual imaging unit is provided on the opposite side of the image display unit 61, and that a three-dimensional object captured by the virtual imaging unit is displayed on the image display unit. This is an operation of changing or moving the position of the unit 61.

  In the case where both operations are assumed, the line-of-sight direction is determined by tilting to the opposite side according to the tilt of the tablet terminal device 560.

  To simplify the description, consider a triangular prism-shaped three-dimensional object 590 having a right-angled isosceles triangle as a base, as shown in FIG. Consider one first side surface 591 and the other second side surface 592 sandwiching a right angle portion among the three side surfaces around the three-dimensional object 590. In each of the following drawings, the first side surface 591 is hatched, and the second side surface 592 is latticed. In this case, as shown in FIG. 46, when the three-dimensional object 590 is viewed from the right-angled portion side (line-of-sight direction Da), the first side surface 591 is observed in the left half of the rectangular image Ia showing the three-dimensional object 590. The second side 592 is observed in the right half. When the three-dimensional object 590 is observed from a position on the left side (line-of-sight direction Db), in the rectangular image Ib showing the three-dimensional object 590, the first side surface 591 on the left side is observed in an area larger than the second side surface 592 on the right side. The When the three-dimensional object 590 is observed from the position on the right side (the line-of-sight direction Dc), the first side surface 591 on the left side is observed in a smaller area than the second side surface 592 on the right side in the rectangular image Ic showing the three-dimensional object 590. The

  Assuming that the three-dimensional object 590 is fixedly present on the image display unit 61 and the observer P observes the three-dimensional object 590 from the front, as shown in FIG. 47, as shown in FIG. (Shown) is located in front of the image display unit 61 extending in the normal direction, and the actual viewing direction 585R of the observer P is along the direction of gravity. The line-of-sight direction 585 of the three-dimensional object 590 displayed on the image display unit 61 is a direction in which the three-dimensional object 590 is viewed from the front.

  From the above state, when the observer P tries to observe the three-dimensional object 590 from the first side surface 591 side while keeping the actual line-of-sight direction 585R in the direction shown in FIG. 47, as shown in FIG. The observer P performs an operation of tilting the tablet terminal device 560 by + α degrees (in each drawing, clockwise is a positive rotation direction and counterclockwise is a negative rotation direction). In this assumption, the three-dimensional object 590 is conceptually fixed with respect to the image display unit 61. Therefore, when the image display unit 61 is tilted, for example, the three-dimensional object 590 is tilted accordingly. The observer P sees the tilted three-dimensional object 590 from the viewing direction 585. In this case, it is understood that the line-of-sight direction determination unit 544 may determine the direction of inclination of −α degrees with respect to the front direction of the three-dimensional object 590 as the line-of-sight direction 585.

  Contrary to FIG. 48, when the observer P tries to observe the three-dimensional object 590 from the second side surface 592 side, the observer P performs an operation of tilting the tablet terminal device 560 by −α degrees. In this case, the line-of-sight direction determination unit 544 may determine a direction inclined by α degrees with respect to the front direction of the three-dimensional object 590 as the line-of-sight direction.

  Assuming that a virtual imaging unit is provided on the opposite side of the image display unit 61 and a three-dimensional object captured by the virtual imaging unit is displayed on the image display unit, the orientation of the image display unit 61 is changed. Or when the operation | movement to which it moves is assumed, when the observer P observes the solid object 590 from the front, it will become the same as that of FIG.

  When the observer P tries to observe the three-dimensional object 590 from the first side surface 591 side from the above state, the observer P has the three-dimensional object 590 at a fixed position on the back side of the tablet terminal device 560 as shown in FIG. Assuming that the tablet terminal device 560 exists in a posture, the tablet terminal device 560 is tilted by −α degrees in order to face the back side of the tablet terminal device 560 toward the first side surface 591 of the three-dimensional object 590. In this assumption, assuming that the image display unit 61 is tilted assuming that the illustrated image display unit 62r is a virtual image capturing unit, the virtual image capturing unit 62r is opposite to the image display unit 61 of the tablet terminal device 560, that is, the back side. It is tilted by that amount. The virtual imaging unit 62r images the three-dimensional object 590 in the line-of-sight direction 585 in a state where the virtual imaging unit 62r is tilted. In this case, it is understood that the line-of-sight direction determination unit 544 may determine the direction of inclination of −α degrees with respect to the front direction of the three-dimensional object 590 as the line-of-sight direction 585.

  Conversely, when the observer P tries to observe the three-dimensional object 590 from the second side surface 592 side from the state shown in FIG. 49, the observer P performs an operation of tilting the tablet terminal device 560 + α degrees from the front view state. Is assumed. In this case, the line-of-sight direction determination unit 544 may determine a direction inclined + α degrees with respect to the front direction of the three-dimensional object 590 as the line-of-sight direction.

  Accordingly, an X-ray image can be generated based on the display direction setting image data 53d in accordance with the line-of-sight direction determined based on the tilt of the tablet terminal device 60, and can be displayed on the image display unit 61. . The direction of the line of sight may be set to any direction with respect to the inclination + α (or −α) of the tablet terminal device 60, and it is preferable that the direction can be selected by the operation setting of the observer P.

  According to this embodiment, the line-of-sight direction of the displayed X-ray image can be easily set according to the attitude of the image display unit 61.

  In the second embodiment, the configuration including both the gyro sensor 570 and the acceleration sensor 572 has been described. However, the image display unit is based on the detection result of the gyro sensor 570 with reference to the posture at the start of image display or the like. The inclination of 61 may be detected, and the line-of-sight direction may be determined based on the detection result. Further, the displacement of the image display unit 61 may be detected based on the detection result of the acceleration sensor 572 with reference to the posture at the start of image display or the like, and the line-of-sight direction may be determined based on the displacement. That is, at least one of the acceleration sensor 572 and the gyro sensor 570 is provided.

<Modifications Regarding Second Embodiment>
Also in the second embodiment, the contents described as the modified example related to the first embodiment can be applied alone or in combination as long as there is no contradiction.

  For example, also in the second embodiment, as in the first modification, the processing step as the line-of-sight direction determining unit is incorporated in the program of the tablet terminal device, and thus the tablet terminal device functions as the line-of-sight direction determining unit. You may have a part.

  Similarly to the second modified example, display direction setting image data 53d is stored in the storage unit 73 of the tablet terminal device 560B corresponding to the tablet terminal device 560, as in the eighth modified example of FIG. The processing step (see step S64) as the direction determining unit 544 may be incorporated in the program of the tablet terminal device 560B, and thus the tablet terminal device 560B may include the line-of-sight direction determining unit 544B.

  Similarly to the sixth modification, a gaze direction operation accepting unit capable of accepting a gaze direction setting operation in an arbitrary direction is added to the tablet terminal device, and the setting operation is accepted by the gaze direction accepting unit. Then, an X-ray image may be generated, and the X-ray image may be displayed on the image display unit.

  Furthermore, as in the seventh modification, when the image data includes at least one of X-ray CT imaging data and X-ray tomosynthesis imaging data, the tablet terminal device can accept the setting of the tomographic thickness of the fault of interest. The image processing unit may further include a receiving unit, and the image processing unit may generate an X-ray image based on the tomographic thickness of the fault of interest received by the tomographic thickness receiving unit and display the X-ray image on the image display unit.

{Third embodiment}
An X-ray image display apparatus according to the third embodiment will be described. Here, an example in which an X-ray image display device is integrally combined as a display device of an X-ray imaging apparatus will be described first as in the first embodiment. In the description of the present embodiment, the same components as those described in the first embodiment and the like are denoted by the same reference numerals and the description thereof is omitted, and the differences from the first embodiment are mainly described. To do.

  51 is a block diagram showing an electrical configuration of the X-ray imaging apparatus 710, and FIG. 52 is a functional block diagram of the X-ray imaging apparatus 710. In the present embodiment, as the line-of-sight direction acquisition unit, an imaging unit 62 (see the first embodiment) capable of observing an observer of the image display unit 61, and a gyro sensor as a posture acquisition unit that acquires the posture of the image display unit 61. 770 and an acceleration sensor 772 (see the second embodiment), and a line-of-sight direction determination unit 744 that determines the line-of-sight direction based on the detection results of the imaging unit 62, the gyro sensor 770, and the acceleration sensor 772. Then, according to the line-of-sight direction determined by the line-of-sight direction determination unit 744, an X-ray image from the line-of-sight direction is generated based on the display direction setting image data 53d, as in the first or second embodiment. .

  That is, the overall configuration of the X-ray imaging apparatus 710 is the same as that of the X-ray imaging apparatus 10, and includes an imaging main body unit 20, an X-ray image processing apparatus 740, and a tablet terminal device 760.

  The tablet terminal device 760 additionally includes a gyro sensor 770 and an acceleration sensor 772 in the tablet terminal device 60.

  In addition to transmitting the imaging instruction and imaging data to the imaging unit 62 in the display program 73a, the storage unit 73 of the tablet terminal device 760 acquires output results from the gyro sensor 770 and the acceleration sensor 772. A display program 773a configured to transmit an instruction and an output result thereof is stored.

  In the storage unit of the X-ray image processing device 740, in the display image processing program 53b, the line-of-sight direction is determined based on the imaging data from the imaging unit 62 and the output results of the gyro sensor 770 and the acceleration sensor 772. A display image processing program 753b is stored. Accordingly, the X-ray image processing apparatus 740 has a function as a gaze direction determining unit 744 that determines the gaze direction based on the imaging data of the imaging unit 62 and the output results of the gyro sensor 770 and the acceleration sensor 772.

  Schematic contents of processing in the X-ray image processing device 740 and the tablet terminal device 760 are obtained in step S7 by obtaining output results from the gyro sensor 770 and acceleration sensor 772, and in step S8 by the gyro sensor 770 and acceleration sensor 772. The output result is also transmitted, and in step S25, refer to FIG. 4 in the first embodiment, except that the line-of-sight direction is determined based on the imaging data of the imaging unit 62 and the output results of the gyro sensor 770 and the acceleration sensor 772. This is the same as the processing described above.

  Hereinafter, a processing example in which the gaze direction determination unit 744 determines the gaze direction based on the imaging data of the imaging unit 62 and the output results from the gyro sensor 770 and the acceleration sensor 772 will be described more specifically.

  The line-of-sight direction determination unit 744 can determine the actual line-of-sight direction of the observer based on the imaging data of the imaging unit 62 (see the first embodiment). The line-of-sight direction determination unit 744 can acquire the inclination of the image display unit 61 based on the output result of at least one of the gyro sensor 770 and the acceleration sensor 772. Various processes can be considered as the process for determining the line-of-sight direction of the X-ray image to be generated from the display direction setting image data 53d based on the actual line-of-sight direction of the observer and the inclination of the image display unit 61. Here, based on the observer's actual line-of-sight direction and the inclination of the image display unit 61, the absolute direction of the observer's actual line-of-sight direction (angle with respect to the vertical direction, which is the direction of gravity) should be generated. Determine the direction of the line of sight of the image Specifically, an angle obtained by adding the tilt of the image display unit 61 with respect to the horizontal direction to the tilt of the observer's actual gaze direction with respect to the normal direction of the image display unit 61 is defined as the tilt of the X-ray image with respect to the line of sight.

  That is, when the image display unit 61 is in a posture orthogonal to the gravity direction, the observer P observes the image display unit 61 in a horizontal posture in which the width direction of the image display unit 61 is perpendicular to the gravity direction. The case is the same as the case shown in FIG. 47 (however, the three-dimensional object is not assumed to be fixedly present in the image display unit 61, and is assumed not to be separated from the image display unit 61 and driven). Yes.) The line-of-sight direction determination unit 744 determines the direction having the inclination of 0 degree because the actual line-of-sight direction 785R of the observer P is a direction having an inclination of 0 degree and the image display part 61 is not inclined. The line-of-sight direction 785 is determined, and therefore a default X-ray image such as a positive radiation image is continuously displayed.

  From the above state, as shown in FIG. 53, it is assumed that the tablet terminal device 760 is tilted by + α degrees while the observer P is observing just below. Then, the inclination + α degree of the image display unit 61 is obtained based on the output results from the gyro sensor 770 and the acceleration sensor 772. Further, it is detected from the imaging data obtained by the imaging unit 62 that the actual line-of-sight direction 785R of the observer P is inclined by -α degrees. Accordingly, the line-of-sight direction determination unit 744 determines that 0 degree obtained by adding + α degrees to −α degrees is the angle of the line-of-sight direction 785. Thereby, although the tablet terminal device 760 is tilted, an image obtained by viewing the three-dimensional object 590 from the front is displayed on the image display unit 61.

  In the example of FIG. 53, as in FIG. 49, it is assumed that a virtual imaging unit 62r similar to FIG. 49 is provided on the opposite side of the image display unit 61 of the tablet terminal device 760, that is, the back surface.

  53, it is assumed that the observer P tilts the line-of-sight direction 785R by + α degrees with respect to the direction of gravity as shown in FIG. Then, from the imaging data obtained by the imaging unit 62, it is calculated that the line-of-sight direction by the observer P coincides with the normal direction of the image display unit 61. For this reason, the line-of-sight direction determination unit 744 determines that + α degrees obtained by adding + α degrees to 0 degrees is the angle of the line-of-sight direction 785. As a result, the image display unit 61 of the tablet terminal device 760 displays an image from a direction in which the three-dimensional object 590 is inclined + α degrees from the front.

  Also, as shown in FIG. 55, when the image display unit 61 of the tablet terminal device 760 is in a horizontal posture perpendicular to the direction of gravity, the observer P tilts the line-of-sight direction 785R by + α degrees with respect to the direction of gravity. To do. Then, based on the output results from the gyro sensor 770 and the acceleration sensor 772, the inclination of the image display unit 61 is 0 degree. Further, from the imaging data obtained by the imaging unit 62, it is calculated that the line-of-sight direction 785R by the observer P is inclined by + α degrees with respect to the normal direction of the image display unit 61. Therefore, the line-of-sight direction determination unit 744 determines that + α degrees obtained by adding 0 degree to + α degrees is the angle of the line-of-sight direction 785. Accordingly, an image of the three-dimensional object 590 from the line-of-sight direction tilted by + α degrees from the front is displayed on the image display unit 61 of the tablet terminal device 760.

  Note that when the actual line-of-sight direction of the observer P is tilted to -α degrees in the opposite direction, the three-dimensional object 590 from the opposite direction to the cases shown in FIGS. 54 and 55 is displayed.

  Of course, in the above example, the example in which the inclination of the image display unit 61 is the same as the actual inclination in the viewing direction 785R of the observer P has been described. As described above, an angle obtained by adding the inclination of the observer to the horizontal direction of the image display unit 61 to the inclination of the actual visual line direction of the observer with respect to the normal direction of the image display unit 61 may be the inclination of the X-ray image. it can.

  According to the third embodiment, the line-of-sight direction of the displayed X-ray image can be easily set according to the actual line-of-sight direction of the observer P imaged by the imaging unit 62 and the attitude of the image display unit. .

  In particular, according to the above example, the angle obtained by adding the tilt of the image display unit 61 to the horizontal direction to the tilt of the viewer's gaze direction with respect to the normal direction of the image display unit 61 is the tilt of the X-ray image. The inclination of the line-of-sight direction of the X-ray image can be determined based on a more absolute direction such as the direction of gravity. For this reason, even if the image display unit 61 of the tablet terminal device 760 is tilted, if the viewing direction of the observer P is oblique to the normal direction of the image display unit 61 and is along the direction of gravity, the image display unit 61 displays an X-ray image of the three-dimensional object 590 viewed from the front. Thereby, it is also possible to observe an image of the three-dimensional object 590 viewed from the front with respect to the tablet terminal device 760 from an oblique direction. On the other hand, when the observation direction of the observer P is tilted with reference to a more absolute direction such as a gravity direction, the line-of-sight direction of the three-dimensional object 590 displayed as an X-ray image changes. For this reason, since the line-of-sight direction of the three-dimensional object 590 displayed as an X-ray image can be changed according to the line-of-sight direction of the observer P, the observer P can easily grasp the stereoscopic effect.

  As described above, the display of the X-ray image from the line-of-sight direction is a problem regarding which direction the stereoscopic image data is viewed from, for example, if the X-ray CT image is a volume rendering image, In the case of a slice image, it is a problem in which direction to slice.

  As shown in FIGS. 49 and 53, when the observer P cannot view the image display unit 61 from the front, the displayed image is viewed from an oblique direction compared to a case where the apparent left and right widths are viewed from the image display unit 61. Therefore, the correction may be performed so that the apparent magnification is the same as when viewed from the front as shown in FIG. When applying this correction, for example, the center of the right and left of the screen may be set as the starting point of the correction.

  As shown in FIGS. 45 to 49 and 53 to 55, three-dimensional image data of a three-dimensional object such as X-ray CT image data or X-ray tomosynthesis image data is virtually arranged on the image display unit 61 to form a three-dimensional object. The processing for calculating the observed direction is called virtual three-dimensional image data display processing. As shown in FIG. 48, the three-dimensional image data of the three-dimensional object is in a fixed positional relationship with the image display unit 61. The configuration regarded as following is referred to as fixed virtual three-dimensional image data display processing, and the configuration regarded as not following the image display unit 61 because the three-dimensional image data of the three-dimensional object is separated from the image display unit 61. This may be referred to as fixed virtual three-dimensional image data display processing.

  Both fixed virtual three-dimensional image data display processing and non-fixed virtual three-dimensional image data display processing may be enabled and configured to be selectable.

{Other variations}
In the above-described embodiment, an example in which the present invention is applied to image data obtained by imaging teeth has been described. However, the present invention can be similarly applied to image data in which other human body parts (head, ear, chest) and the like are to be imaged. .

  As described above, the present invention has been described in detail. However, the above description is illustrative in all aspects, and the present invention is not limited thereto. It is understood that countless variations that are not illustrated can be envisaged without departing from the scope of the present invention.

10, 510, 710 X-ray imaging device 12, 112 X-ray image display device 20 Imaging main body 40, 140, 540, 740 X-ray image processing device 44, 144, 270, 544, 544B, 744 Gaze direction determination unit 45 Display Image processing section 50 Information processing main body section 53 Storage section 53b X-ray image display control program 253d, 53d Display direction setting image data 60, 160, 260, 260B, 260C, 260D, 560, 560B, 760 Tablet terminal device 61, 760 Image display section 62 Imaging section 73 Storage section 73a Display program 75 Touch panel input section 84, 84Ba, 84Bb Default line-of-sight direction 85, 85a, 85b Line-of-sight direction 90, 94 Teeth 262B Distance identification section 262C Line-of-sight operation reception section 262D Tomography thickness Reception part 272 image Physical unit 273a X-ray image display control program 360 Terminal device 361 Information processing terminal device 362 Imaging unit 363 Image display unit 364 Operation unit 553b Program 570, 770 Gyro sensor 572, 772 Acceleration sensor 573a Display program 585 Gaze direction 585R Gaze direction 590 Three-dimensional object 753b program 773a display program 785 viewing direction 785R viewing direction Da, Db, Dc viewing direction P, Pa, Pb observer

Claims (18)

A storage unit for processing image data acquired from a plurality of directions or storing image data including a plurality of X-ray image data acquired from a plurality of directions;
An image display unit for displaying an X-ray image generated for display from the image data;
A line-of-sight direction acquisition unit for acquiring a line-of-sight direction of an observer of the image display unit;
An image processing unit that generates the X-ray image based on the image data in accordance with the line-of-sight direction acquired by the line-of-sight acquisition unit, and displays the X-ray image on the image display unit;
An X-ray image display device comprising: The X-ray image display device according to claim 1,
The line-of-sight direction acquisition unit determines an relative position of the observer of the image display unit with respect to the image display unit based on an image pickup unit capable of imaging the observer of the image display unit and a captured image of the image pickup unit. And a line-of-sight direction determining unit that determines the line-of-sight direction of the observer. The X-ray image display device according to claim 1 or 2,
The image data includes X-ray CT image data as the image data obtained by processing X-ray image data obtained from a plurality of directions, and X-ray tomosynthesis image data as the image data obtained by processing X-ray image data obtained from a plurality of directions. X-ray including at least one kind of simple transmission X-ray image group data including a plurality of simple transmission X-ray image data photographed from a plurality of directions as the image data including a plurality of X-ray image data acquired from a plurality of directions Image display device. The X-ray image display device according to claim 3,
The image data includes at least one of the X-ray CT image data and the X-ray tomosynthesis image data as the image data obtained by processing X-ray image data acquired from a plurality of directions,
The X-ray image display device, wherein the image processing unit generates a tomographic image sliced in a tomographic direction corresponding to the line-of-sight direction acquired by the line-of-sight direction acquisition unit as the X-ray image and displays the X-ray image on the image display unit . The X-ray image display device according to claim 4,
It further comprises a fault thickness acceptance unit that can accept the setting of the fault thickness of the fault of interest,
The X-ray image display device, wherein the image processing unit generates the X-ray image based on the tomographic thickness of the tomographic fault received by the tomographic thickness receiving unit and displays the X-ray image on the image display unit. The X-ray image display device according to claim 3,
The image data is image data obtained by processing the X-ray CT imaging data or X-ray tomosynthesis imaging data,
The image processing unit performs image processing on the image data, generates a three-dimensional volume rendering image in a direction corresponding to the line-of-sight direction acquired by the line-of-sight direction acquisition unit as the X-ray image, and An X-ray image display device displayed on a display unit. The X-ray image display device according to claim 2,
When the change of the relative position of the observer of the image display unit is detected by the line-of-sight direction determination unit, the image processing unit determines the X based on the line-of-sight direction of the observer of the image display unit after the change. An X-ray image display device that generates a line image and displays the line image on the image display unit. The X-ray image display device according to claim 7,
The imaging unit images the observer of the image display unit with a moving image, and the line-of-sight direction determination unit is based on the moving image captured by the imaging unit, and the observer of the image display unit with respect to the image display unit An X-ray image display device that detects a change in the line-of-sight direction. The X-ray image display device according to any one of claims 2 to 8,
A distance specifying unit for obtaining a relative distance between the image display unit and the observer based on a captured image of the imaging unit;
The X-ray image display device, wherein the image processing unit adjusts an enlargement ratio of the X-ray image according to the relative distance obtained by the distance specifying unit. The X-ray image display device according to any one of claims 1 to 9,
The image processing unit generates a default X-ray image from a preset line-of-sight direction based on the image data, displays the default X-ray image on the image display unit, and then references the line-of-sight direction of the default X-ray image. As an X-ray image display device, an X-ray image is generated based on a viewing direction of an observer of the image display unit and is displayed on the image display unit. The X-ray image display device according to claim 1,
A posture acquisition unit for acquiring the posture of the image display unit;
The image processing unit is an X-ray image display device that generates an X-ray image based on the image data in accordance with the posture acquired by the posture acquisition unit. The X-ray image display device according to claim 11,
The posture acquisition unit is an X-ray image display device including at least one of an acceleration sensor and a gyro sensor. The X-ray image display device according to claim 11 or 12,
The line-of-sight direction acquisition unit is based on an imaging unit capable of imaging the observer of the image display unit, an image captured by the imaging unit, and a posture acquired by the posture acquisition unit. And a line-of-sight direction determining unit for determining
The X-ray image display device, wherein the image processing unit generates an X-ray image based on the image data in accordance with the line-of-sight direction determined by the line-of-sight direction determination unit. The X-ray image display device according to any one of claims 1 to 13,
A line-of-sight operation accepting unit capable of receiving a line-of-sight setting operation in an arbitrary direction;
The image processing unit generates an X-ray image based on the image data in response to acceptance of a gaze direction setting operation in the gaze direction operation accepting unit, and causes the image display unit to display the X-ray image. X-ray image display device. The X-ray image display device according to any one of claims 1 to 14,
The image display unit is an X-ray image display device which is an image display unit of a tablet terminal device.   An X-ray imaging apparatus comprising the X-ray image display apparatus according to any one of claims 1 to 15 as a display apparatus.   An X-ray image display device that processes X-ray image data acquired from a plurality of directions or includes a plurality of X-ray image data acquired from a plurality of directions, a storage unit that stores image data, and displays from the image data In accordance with the gaze direction acquired by the gaze direction acquisition unit, the gaze direction acquisition unit that acquires the gaze direction of the observer of the image display unit, and the gaze direction acquired by the gaze direction acquisition unit, An X-ray image display control program for generating an X-ray image based on image data and causing the X-ray image to be displayed on the image display unit. (a1) processing X-ray image data acquired from a plurality of directions, or storing image data in a storage unit, including a plurality of X-ray image data acquired from a plurality of directions;
(a2) obtaining an observer's line-of-sight direction of the image display unit;
(a3) generating an X-ray image based on the image data according to the line-of-sight direction of the observer acquired in step (a2);
(a4) displaying the X-ray image generated in (a3) on the image display unit;
A method of operating an X-ray image display device comprising:

Images