JP2018068362A - Measuring apparatus and measuring method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To grasp a measurement result easily.SOLUTION: A measuring apparatus 1 includes an imaging part 2 for imaging a back part of a subject H, a three-dimensional data acquisition part 3 for acquiring three-dimensional data on the back part of the subject H, a state detection part 4 for detecting a state of a feature site of the back part based on the three-dimensional data, and a display part 5 for displaying an actual image Im1 by the imaging part 2, a processing image Im2 on the basis of the three-dimensional data, and a detection result D1 by the state detection part 4.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a measuring apparatus and a measuring method.

  Scoliosis is a disease that causes the spine to bend and its cause has not been elucidated, so it is difficult to prevent it beforehand. Scoliosis, on the other hand, is said to have an incidence of about 1 in 100 people, and is one of the diseases with a very high incidence. For example, it is said that scoliosis is the most frequently occurring scoliosis in Japan and accounts for 80 to 90% of all scoliosis. Idiopathic scoliosis most often develops in adolescence, and often occurs in elementary school to middle school. It is said that the curvature of the spinal column becomes stronger at the most remarkable time of growth around 10 to 15 years old, and the progress of the curvature stops at around 17 to 18 after the growth period. The symptom of scoliosis is that the spine bends to the left and right, and at the same time, the spine twists, resulting in deformation of the ribs and bulges. Scoliosis is a disease in which cardiopulmonary function declines as deformation progresses, and daily life is significantly impaired by back and back pain. If scoliosis is detected early and device treatment is performed at an appropriate time, it is reported that 76% can make the progression of the deformation angle within 10 ° (Non-patent Document 1 below). . Furthermore, it has also been clarified that early detection and treatment of chiari malformation and spinal cavity identification are extremely important in preventing the progression of spinal deformity (Non-patent Document 2 below). In Japan, since 1979, vertebral column screening has been obligatory at elementary and junior high schools in accordance with the enforcement regulations of the School Health Law. It is necessary to examine a large number of subjects for screening at school, etc., and the conventional inspection and palpation by doctors has a problem in terms of convenience, etc., so a device for detecting spinal distortion is required. Has been.

  Conventionally, X-ray examination methods using an X-ray imaging apparatus are often used in scoliosis examination and the like. The X-ray examination method is a method in which the chest is imaged with X-rays and the degree of curvature of the spinal column is measured by a doctor's judgment, and the degree of curvature of the spinal column to the side can be grasped from the X-ray image. However, in a general X-ray inspection method, there is a problem that even if the degree of lateral curvature can be determined, the degree of unevenness on the body surface cannot be determined. Further, the number of X-ray imaging is limited from the viewpoint of human exposure, and the items that can be inspected are limited. Further, since the X-ray inspection method handles X-rays, a specialized engineer is required, and it is difficult to easily perform the inspection.

  In addition, as a method for detecting strain of the spine, measurement using a CT (Computed Tomography) apparatus is also conceivable. However, since the apparatus is expensive and large, there is a problem that it is difficult to apply in a small facility. In CT examination, it is necessary to consider exposure of the human body as in X-ray examination. In addition, scoliosis requires time series data in order to evaluate the degree of progression of symptoms, and the measurement data is required to be digitized. An example of a detection apparatus that can digitize measurement data without using an X-ray imaging apparatus or a CT apparatus is a technique using a three-dimensional sensor disclosed in Patent Document 1.

International Publication No. 2013/081030

Toru Momomura, Mizuho Yonezawa, J Spine Res, 2010, 1: 1960-1963 Nakahara D, Yonezawa I, J Spine Res, 2011, 36: E482-485

  By the way, an apparatus for detecting spinal distortion is required to be able to easily grasp a measurement result (result). The present invention has been made in view of the above circumstances, and an object thereof is to provide a measuring apparatus and a measuring method capable of easily grasping a measurement result.

  The measuring device according to the first aspect of the present invention includes an imaging unit that images the back of the subject, a three-dimensional data acquisition unit that acquires three-dimensional data of the back of the subject, and the state of the characteristic part of the back as three-dimensional data. A state detection unit that detects based on the image, a real image obtained by the imaging unit, a processed image based on three-dimensional data, and a display unit that displays a detection result of the state detection unit.

  The measurement method according to the second aspect of the present invention includes imaging the back of the subject, acquiring three-dimensional data of the back of the subject, and detecting the state of the characteristic part of the back based on the three-dimensional data. And displaying a processed image based on the real image and the three-dimensional data by the imaging unit on the display unit.

It is a conceptual diagram which shows the measuring apparatus which concerns on embodiment. It is a block diagram of the measuring device concerning an embodiment. It is a figure which shows the measuring apparatus which concerns on embodiment. It is a figure which shows the imaging part and three-dimensional data acquisition part which concern on embodiment. It is a side view which shows a positioner. It is a front view which shows the positioner of FIG. It is a figure which shows the image which shows a real image and three-dimensional data. It is a figure explaining a 1st spinal column detection part. It is a figure explaining a 2nd spinal column detection part. It is a figure which shows the display by a display part. It is a flowchart of the measuring method which concerns on embodiment. FIG. 12 is a flowchart of the measurement method following FIG.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. However, the present invention is not limited to this. Further, in the drawings, in order to describe the embodiment, a part or the whole is schematically described, and a part expressed by changing the scale as appropriate, such as a part being enlarged or emphasized, is included. In the following drawings, directions in the drawings will be described using an XYZ coordinate system. In this XYZ coordinate system, a plane parallel to the horizontal plane is defined as an XY plane. An arbitrary direction parallel to the XY plane is expressed as an X direction, and a direction orthogonal to the X direction is expressed as a Y direction. A direction perpendicular to the XY plane (up and down direction) is referred to as a Z direction. In each direction, the same side as the tip of the arrow is appropriately referred to as a + side (eg, + Z side), and the opposite side of the arrow is referred to as a − side (eg, −Z side). For example, in the vertical direction (Z direction), the upper side is the + Z side and the lower side is the -Z side.

  FIG. 1 is a conceptual diagram illustrating a measurement apparatus according to an embodiment. The measuring device 1 of the present embodiment includes an imaging unit 2 that images the back of the subject H, a three-dimensional data acquisition unit 3 that acquires three-dimensional data of the back of the subject H, and the state of the characteristic part of the back of the subject H. A state detection unit 4 that detects based on three-dimensional data, a real image Im1 obtained by the imaging unit 2, a processed image Im2 based on three-dimensional data, and a display unit 5 that displays a detection result D1 of the state detection unit 4 are provided. .

  FIG. 2 is a block diagram illustrating the measurement apparatus according to the embodiment. The measuring device 1 includes an imaging unit 2, a three-dimensional data acquisition unit 3, and a computer device CP. The imaging unit 2, the three-dimensional data acquisition unit 3 (three-dimensional sensor), the display unit 5, and the input unit 6 are each connected to the computer device CP so as to be communicable by wire or wirelessly. The computer device CP is a personal computer provided with a CPU and a memory. The computer device CP reads a program stored in the storage unit 16 and executes various processes according to the program.

  The computer device CP includes a state detection unit 4, an extraction unit 10, a midline detection unit 11, a feature part designation unit 12, an automatic evaluation unit 13, a display control unit 14, an operation unit 15, and a storage unit 16. And comprising. The program described above is a control unit that performs various controls on the computer, a processing unit PU (a state detection unit 4, an extraction unit 10, a midline detection unit 11, a feature part designation unit 12, an automatic evaluation unit 13) that performs various processes. Function as a unit CU (display control unit 14, operation unit 15).

  FIG. 3 is a perspective view showing the measuring apparatus 1 of the present embodiment. The measuring apparatus 1 shown in FIG. 3 shows a state in which the subject H in a standing position is measured. The measuring device 1 includes, for example, the imaging unit 2, the three-dimensional data acquisition unit 3, the computer device CP, the lower frame 21, the vertical frame 22, the support frame 23, the support column 25, the support unit 26, and the like. A table 27 and a plurality of wheels 28 are provided.

  The lower frame 21 is disposed at the lower part of the measuring apparatus 1. The vertical frame 22 extends in the vertical direction (Z direction) and is fixed to the upper portion of the lower frame 21. The support frame 23 is fixed to the vertical frame 22 and supports the column portion 25. The support column 25 extends in the vertical direction (Z direction) and can be expanded and contracted in the vertical direction (Z direction, vertical direction). The column part 25 includes, for example, an expandable part 25a that can be expanded and contracted (movable) in the vertical direction and an expandable part support part 25b that supports the expandable part 25a. FIG. 2 shows a state in which the column part 25 is extended (a state in which the expansion / contraction part 25a is moved upward). FIG. 3 shows a state in which the column part 25 is contracted (a state in which the expansion / contraction part 25a is moved downward). Moreover, the support | pillar part 25 can be further contracted rather than the state shown in FIG. 3, and the size of the measuring apparatus 1 can be made compact. The expansion / contraction part 25a and the expansion / contraction part support part 25b are provided with a space part (hollow part) (not shown) in the interior thereof. In this space part, each of the imaging unit 2 and the three-dimensional data acquisition unit 3 and a computer are provided. A cable 30 or the like for connecting the device CP is accommodated. The expansion / contraction part support part 25b can accommodate a part of the expansion / contraction part 25a therein, and supports the expansion / contraction part 25a so as to be movable in the vertical direction. The table 27 is provided on the upper part of the vertical frame 22. The table 27 can place an article on the upper surface. On the upper surface of the table 27, for example, a notebook computer device CP is placed. The table 27 is connected to the upper end of the vertical frame 22 and the side of the support column 25 and is supported by the vertical frame 22 and the support column 25. The computer device CP is connected to the three-dimensional data acquisition unit 3 by a cable 30.

  A support portion 26 is connected to the upper end (+ Z side) of the extendable portion 25a. The support unit 26 is provided with an attachment unit 32 for attaching the imaging unit 2 and the three-dimensional data acquisition unit 3 to the support unit 26. The support unit 26 supports the imaging unit 2 and the three-dimensional data acquisition unit 3 via the attachment unit 32. The imaging unit 2 and the three-dimensional data acquisition unit 3 contain a Kinect sensor S described later in a case, and this case is supported by the support unit 26. The support part 26 is connected to the expansion / contraction part 25a of the column part 25 so as to be rotatable around an axis AX1 parallel to the Y direction. That is, the support part 26 is movable in the direction approaching the support | pillar part 25, as shown in FIG. Thereby, the size of the measuring apparatus 1 can be made compact. The attachment unit 32 supports the imaging unit 2 and the three-dimensional data acquisition unit 3 so as to be rotatable with respect to the support unit 26. For example, in the example illustrated in FIG. 2, the attachment unit 32 supports the three-dimensional data acquisition unit 3 so as to be rotatable around an axis AX2 parallel to the X direction. Thereby, the directions of the imaging unit 2 and the three-dimensional data acquisition unit 3 can be changed. By changing the orientation of the imaging unit 2 and the three-dimensional data acquisition unit 3 downward, the measuring device 1 can measure the subject H in the lying state. In addition, when the orientation of the imaging unit 2 and the three-dimensional data acquisition unit 3 can be changed, the orientation of the imaging unit 2 and the three-dimensional data acquisition unit 3 can be more accurately directed toward the subject H.

  The plurality of wheels 28 are provided below the lower frame 21. The plurality of wheels 28 can move a unit (a structure above the lower frame 21) including at least the imaging unit 2 and the three-dimensional data acquisition unit 3. In this embodiment, the other part of the measuring device 1 is supported by the lower frame 21, and the measuring device 1 can travel on the floor as a whole.

  In addition, the structure shown in FIG. 3 is an example for the measuring apparatus 1, and another structure may be sufficient as it. For example, the configurations of the shape, size, and the like of the lower frame 21, the vertical frame 22, the support frame 23, the support column 25, the support unit 26, and the table 27 described above are not limited to those illustrated in FIG. Further, the computer apparatus CP is not limited to a notebook type, and an arbitrary one can be used. For example, the computer device CP may be a desktop type or a tablet type.

  Next, the imaging unit 2 and the three-dimensional data acquisition unit 3 will be described. FIG. 4 is a diagram illustrating the imaging unit 2 and the three-dimensional data acquisition unit 3 according to the present embodiment. The imaging unit 2 and the three-dimensional data acquisition unit 3 use, for example, a Kinect (registered trademark) (v2) sensor S (hereinafter, abbreviated as “Kinect sensor”). As the imaging unit 2 and the three-dimensional data acquisition unit 3, for example, a laser pattern projection type three-dimensional sensor (eg, Kinect sensor (v1)) may be used.

  As shown in FIG. 4, the Kinect sensor S includes an RGB camera Sa, an infrared laser light emitting unit Sb, and a measurement infrared camera Sc. The Kinect sensor S acquires an RGB color image (moving image) with the RGB camera Sa. The Kinect sensor S actively irradiates an object with near-infrared light (LED light) by the infrared laser emitting unit Sb and receives the light with the measuring infrared camera Sc, thereby measuring the flight time of the reflected light. Then, the distance to the object is measured based on this flight time. Thereby, the Kinect sensor S acquires three-dimensional data (three-dimensional depth data) of the object. The Kinect sensor S is a so-called TOF (Time of Flight) type three-dimensional sensor. The Kinect sensor S was originally a sensor for game machines, but can also be connected to a computer device (personal computer) CP (see FIG. 2) or the like via a USb terminal.

  The Kinect sensor S controls the Kinect sensor from the computer device CP using a program written in C language, for example, by using “Kinect for Windows (registered trademark) SDK (Software Development Kit)” provided by Microsoft Research. I can. In addition, software such as Point Cloud Library can be used for processing data output from the Kinect sensor S. As described above, when the Kinect sensor S is used, since the development environment and the data processing environment are prepared, a control program, an analysis program, and the like can be easily developed. In addition, since the Kinect sensor S can be obtained at low cost, the measurement apparatus 1 can be manufactured at a low cost when the Kinect sensor S is used as a three-dimensional sensor.

  The imaging unit 2 of the present embodiment is an RGB camera Sa of the Kinect sensor S. Thereby, the imaging unit 2 acquires an image (image data). Further, the three-dimensional data acquisition unit 3 of the present embodiment is an infrared laser emission unit Sb and a measurement infrared camera Sc. Thereby, the three-dimensional data acquisition unit 3 acquires the three-dimensional data of the object.

  Note that the imaging unit 2 and the RGB camera Sa may not use the Kinect sensor S, respectively. For example, the imaging unit 2 may use a video camera (digital video camera) that can capture an image. The three-dimensional data acquisition unit 3 may use a sensor or a 3D scanner that can acquire three-dimensional data of an object.

  In the present embodiment, the reference unit 31 is provided on the light incident side of the imaging unit 2. In FIG. 4, the reference portion 31 is indicated by a dotted line. The reference unit 31 gives a reference to the image acquired by the imaging unit 2. The reference part 31 has a cross-shaped center line 31a serving as a reference at the center of the surface of a translucent member such as glass or resin. The center line 31a is a straight line having a predetermined length parallel to the horizontal direction and a straight line having a predetermined length parallel to the vertical direction, which are orthogonal to each other. The reference (center line 31a) is set at a predetermined position of the acquired image or three-dimensional data, for example. In the present embodiment, the cross-shaped intersection of the center line 31a is set to be positioned at the center of the image acquired by the imaging unit 2. Thereby, the center line 31a (data of the center line 31a) is given to the center of the image acquired by the imaging unit 2. As described above, when the reference (center line 31a) is given to the center of the image acquired by the imaging unit 2, it is also possible to perform processing using the center line 31a in the image processing. Of the center line 31a (data of the center line 31a) assigned to the image, a line parallel to the vertical direction with respect to the floor surface may be referred to as “vertical center line”. The parallel lines are sometimes referred to as “left and right center lines”.

  Note that the setting position on the image of the reference unit 31 is not limited to the center position described above, and is arbitrary. For example, one or a plurality of reference portions 31 may be arranged at a predetermined distance from the center. Further, the shape of the reference portion 31 is not limited to the cross shape described above, and is arbitrary. For example, the shape of the reference portion 31 may be a point, a dotted line, a mark having a predetermined shape, or the like. Further, the reference unit 31 may be provided in each of the imaging unit 2 and the three-dimensional data acquisition unit 3. Further, whether or not the measuring apparatus 1 includes the reference unit 31 is arbitrary. In addition, at least one of the above-described upper and lower center lines and the left and right center lines may not be provided to the image by the reference unit 31. For example, at least one of the above-described vertical center line and the horizontal center line may be obtained based on an image acquired by the imaging unit 2.

  The imaging unit 2 images the back of the subject H. The imaging unit 2 captures the back of the subject H and acquires an image. The three-dimensional data acquisition unit 3 captures the back of the subject H and acquires three-dimensional data of the back. This three-dimensional data becomes the three-dimensional shape data of the back of the subject H. The measuring device 1 can measure the state of the back of the subject H using, for example, three-dimensional data.

  In addition, a back part is a test subject's H back part, and includes the part from a head to the front-end | tip of a leg | foot. The three-dimensional data is data including three-dimensional coordinates of a plurality of points on the surface of the back of the subject H, for example. For example, the three-dimensional data is data including data on relative coordinates of each point on the surface of the back of the subject. For example, the relative coordinate data is a relative coordinate with respect to a coordinate of a predetermined position (eg, a predetermined position of the back of the head) on the back of the subject H. When using relative coordinates, the surface shape of the back of the subject H can be acquired without using a reference member for calibration of the distance from the three-dimensional data acquisition unit 3 to each point on the back of the subject H. The three-dimensional data can be easily acquired. The coordinate data may be absolute coordinate data or relative coordinate data with respect to a reference other than the back of the subject H, in addition to the relative coordinate data of each point on the surface of the back of the subject H. The resolution of the three-dimensional data is, for example, 1 mm to 10 mm.

  The image captured by the imaging unit 2 and the 3D data acquired by the 3D data acquisition unit 3 are associated with each other, stored in the storage unit 16, and processed by the processing unit PU or the control unit CU. In this specification, an image captured by the imaging unit 2 is referred to as a “real image”. The real image may be a processed image obtained by processing an image captured by the imaging unit 2.

  FIG. 5 is a diagram showing a real image acquired by the imaging unit 2 and a processed image based on the three-dimensional data acquired by the three-dimensional data acquisition unit 3 (hereinafter referred to as “image showing three-dimensional data”). . In FIG. 5, an image Im1 acquired by the imaging unit 2 and an image Im2 indicating three-dimensional data are displayed on the display unit 5. The image Im1 is a part of the moving image acquired by the imaging unit 2. The image Im2 is an image obtained by processing a part of the three-dimensional data acquired continuously. The image Im1 acquired by the imaging unit 2 is a real image corresponding to the three-dimensional data acquired by the three-dimensional data acquisition unit 3, for example. The image Im1 includes the cross-shaped center line 31a of the reference portion 31 described above. The image Im2 is a processed image processed based on the three-dimensional data, and is an image indicating the three-dimensional data. The process of generating the image Im2 indicating the three-dimensional data is performed by the processing unit PU, for example. For example, the image Im2 indicating the three-dimensional data illustrated in FIG. 5 is a contour image including information regarding contour lines. The contour image can be generated, for example, by processing coordinate data of three-dimensional data.

  Note that the contour image is not limited to the image shown in FIG. 5 as long as it includes information on contour lines, and is arbitrary. For example, the contour image may represent contour lines at a predetermined interval in a linear form (eg, solid line, dotted line form), or may represent gradation information by converting the information indicating the height into a color or density, Other information (image) such as length or height other than information indicating contour lines may be included.

  The image Im1 and the image Im2 indicating three-dimensional data are subjected to predetermined processing and control by the processing unit PU or the control unit CU, and are displayed side by side on the display unit 5. In addition, the real image Im1 and the image Im2 are displayed adjacent to each other. The real image Im1 and the image Im2 are each displayed in real time. In the example shown in FIG. 5, the actual image Im1 and the image Im2 are processed so as to have the same size by the processing unit PU or the control unit CU, and are displayed on the display unit 5.

  6 and 7 are views showing an example of the positioner. FIG. 6 is a front view and FIG. 7 is a side view. The measuring device 1 includes a positioner 33. The positioner 33 supports the subject H during measurement by the measuring device 1. The positioner 33 includes a support part 34, a support member 35, a foot part support part 36, and a screen 37. The support unit 34 supports the subject H. The support unit 34 supports the back surface of the subject H or the front surface of the subject H. The foot support part 36 supports the foot of the subject H from below. The support part 34 has space parts 38a and 38b in a part corresponding to the center part in the left-right direction of the upper half of the subject H and a part corresponding to the toes of the subject H. When the subject H is supported by the support portion 34, the center portion and the tip of the left and right direction of the upper half of the subject H can be placed in the space portions 38a and 38b. In this case, the support part 34 can reduce the burden on the subject H when supported by the support part 34 and can support the subject H reliably.

  Further, as shown in FIG. 6, the support portion 34 is supported by the support member 35 from below, and is inclined at a predetermined angle with respect to the vertical direction. This inclination is set so as to incline about 10 ° with respect to the vertical direction, for example. At the time of measurement, the subject H is supported in a state in which the weight is applied to the support portion 34 and tilted with respect to the vertical direction. In addition, the foot part support part 36 is also arranged corresponding to the inclination of the support part 34 described above, and the support surface that supports the foot part of the subject H is orthogonal to the support surface that the support part 34 supports the human body. Are arranged to be.

  By the way, at the time of measurement by the measuring device 1, it is desirable that the subject H is in a stationary state, depending on the type of item to be measured. When the support part 34 is inclined at a predetermined angle with respect to the vertical direction as described above, the subject H can apply weight to the support part 34, so that the burden on the subject H when stationary during measurement is reduced. be able to. Moreover, since the measuring apparatus 1 supports and measures the subject H with the positioner 33, the subject H in a stationary state can be easily measured. When the subject H is a child or the like, the subject H may move during measurement, but the subject H can be easily stopped by using the positioner 33.

  A reference line 40 is provided on the surface of the support portion 34. For example, the reference line 40 is arranged at a predetermined height. The reference line 40 is provided so as to be imaged by the imaging unit 2. When there is such a reference line 40, it is possible to easily grasp the extension of the subject H. In addition, when the imaging unit 2 captures the subject H including the reference line 40, information regarding the reference line 40 can be added to the image acquired by the imaging unit 2. In this case, information regarding the reference line 40 can be used for image processing.

  The screen 37 is provided on the side opposite to the surface on which the support portion 34 supports the subject H. The screen 37 is provided at a predetermined position (distance, angle) with respect to the support portion 34. The screen 37 serves as a background in the image captured by the imaging unit 2. When there is the screen 37, it is possible to prevent the information captured by the imaging unit 2 or the 3D data acquired by the 3D data acquisition unit 3 from including information on an object other than the subject H. The accuracy of the three-dimensional data can be improved. Further, since the screen 37 is provided at a predetermined distance with respect to the support portion 34, the screen portion can be used as a reference in the three-dimensional data acquired by the three-dimensional data acquisition unit 3, thereby The accuracy of the dimension data can be improved.

  The configuration of the positioner 33 is not limited to the example shown in FIG. For example, the positioner 33 may not include the screen 37. Further, whether or not the measuring apparatus 1 includes the positioner 33 is arbitrary.

  Returning to the description of FIG. 2, the extraction unit 10 uses the three-dimensional data acquired by the three-dimensional data acquisition unit 3 (hereinafter referred to as “three-dimensional measurement data”) to obtain data relating to the surface shape of the subject H (hereinafter, surface shape data). Extract). For example, the extraction unit 10 stores a pattern of the back of the human body in the storage unit 16 or the like in advance, and performs a human body determination using a pattern matching process between the pattern and the three-dimensional measurement data. Extract surface shape data from For example, the extraction unit 10 extracts the outline (edge) of the subject H. For example, the extraction unit 10 detects the outline of the object represented by the three-dimensional measurement data or the object outline represented by the image data acquired by the imaging unit 2 (hereinafter, also simply referred to as “image data”). Extract lines. The extraction unit 10 extracts surface shape data from the three-dimensional measurement data based on the extracted outline. For example, the extraction unit 10 extracts data of the inner portion of the outline of the subject H as surface shape data from the three-dimensional measurement data. When the extraction unit 10 determines a human body, the subsequent processing can be automated. For example, the acquisition state of the three-dimensional measurement data by the three-dimensional data acquisition unit 3 is continued, and the subject H is determined to be a human body when taking a predetermined posture with the back facing the three-dimensional data acquisition unit 3 side. As a result, it is possible to automatically shift to subsequent processing, and to perform inspection efficiently. In addition, since the extraction unit 10 extracts data related to the surface shape of the subject H from the three-dimensional measurement data, the amount of data used for the processing can be reduced, so that subsequent processing (eg, various image processing, state detection unit) (Detection (calculation) of a state by 4 and detection of a center line by the midline detection unit 11) can be efficiently performed.

  In addition, the extraction part 10 may perform the process which deletes background data from at least one of 3D measurement data and image data, before extracting the data regarding the surface shape of the test subject H from 3D measurement data. For example, the extraction unit 10 may estimate a portion that is a predetermined distance or more away from the surface of the back of the subject H from the three-dimensional measurement data and delete it. For example, when the approximate distance between the three-dimensional data acquisition unit 3 and the subject H is known in advance, this distance can be used as the predetermined distance. Further, the extraction unit 10 may perform image processing such as noise reduction processing such as filtering and processing such as changing contrast and brightness on at least one of the three-dimensional measurement data and the image data. Note that the measurement device 1 may not include the extraction unit 10, and the extraction unit 10 may be provided in a device outside the measurement device 1. For example, the measurement apparatus 1 may perform various processes using data processed by the extraction unit 10 in the external apparatus.

  The midline detection unit 11 detects the midline on the back of the subject H based on the three-dimensional measurement data. The median line is a straight line extending vertically (vertical direction, height direction) from the top of the subject H, and is a center line of the subject H in the left-right direction (width direction). In the following description, a direction parallel to the midline is appropriately referred to as a midline direction. This midline is used, for example, as a reference for evaluation by dividing the back of the subject H into left and right. For example, the midline detection unit 11 detects the midline from the width (length in the left-right direction) of the back based on the outline of the back of the subject H described above. For example, the midline detection unit 11 acquires the width at each position of the back of the subject H based on the outline of the back of the subject H described above. For example, the midline detection unit 11 has a position that is ½ of the width (the center in the width direction of the back). Position) to the midline. The midline detected by the midline detection unit 11 may be displayed on the display unit 5.

  In addition, the method in which the midline detection part 11 detects the midline of the back part of the test subject H is not limited to the above example, but is arbitrary. For example, since the position of the spinal column is generally concave (indentation) on the back of the human body, for example, the midline detection unit 11 has a concave bottom (pole) at the approximate center in the unevenness data of the back. A line connecting the positions (value) or a line approximating this line with a straight line passing through the top of the head may be used as the midline. Further, the midline detection unit 11 may detect the midline on the back of the subject H using the image data acquired by the imaging unit 2. Further, the midline detection unit 11 detects the midline by superimposing the shape (image) represented by the X-ray image data of the back of the subject H and the shape (image) represented by the three-dimensional measurement data. May be. For example, when enhancing the accuracy of evaluation (detection), the midline detection unit 11 may determine (detect) the midline with reference to an X-ray image. Further, the midline detection unit 11 may detect the midline by superimposing the shape (image) represented by the moire image data on the back of the subject H and the shape (image) represented by the three-dimensional measurement data. For example, when improving the accuracy of evaluation (detection), the midline detection unit 11 may determine a midline with reference to a moire image. For example, the midline detection unit 11 affixes a marker composed of a reflective tape or the like in advance at a position indicating the spinal column of the subject H, detects the position of the marker from the image captured by the imaging unit 2, and determines the midline May be. Note that the measurement device 1 may not include the midline detection unit 11, and the midline detection unit 11 may be provided in a device outside the measurement device 1. For example, the measurement apparatus 1 may perform various processes using data processed by the midline detection unit 11 in the external apparatus.

  The feature site designation unit 12 designates a feature site to be measured on the back of the subject H. The feature part designation | designated part 12 designates the characteristic part which should be measured in the back part of the test subject H from 3D measurement data or the surface shape data extracted by the extraction part 10, for example. For example, the feature part designating unit 12 automatically detects and designates a feature part to be measured. For example, the feature site designation unit 12 registers data related to the feature site to be measured in advance in the storage unit 16 and detects the feature site based on the data. The feature part designation | designated part 12 performs the process which estimates each site | part of the back part of the test subject H based on three-dimensional measurement data, for example. For example, the characteristic part designating unit 12 automatically detects the position of the “seventh cervical vertebra” of the subject H based on the three-dimensional data or the image data obtained by the imaging unit 2 with the characteristic part as the “seventh cervical vertebra”. In the same manner as this, the feature part specifying unit 12 is “cervical vertebra”, “thoracic vertebra”, “lumbar vertebra”, “shoulder”, “scapula”, “lumbar”, “pelvis”, “heel”, “knee”. Etc. are detected as characteristic parts. In addition, each part detected by the characteristic part specifying unit 12 may be displayed on the display unit 5 by generating an image indicating each part.

  In addition, the characteristic part designation | designated part 12 may estimate these each part (each area | region) as a characteristic part. In addition, the characteristic site | part designation | designated part 12 is good also as the reference | standard of twist (distortion) estimating the position of a waist | hip | lumbar part or a buttocks. Generally, it can be considered that the waist and buttocks form a substantially horizontal plane, so this waist and buttocks should be used as a standard for the twisting (distortion) of characteristic parts such as the “seventh cervical vertebra” and “shoulder” Can do. Further, the feature part specifying unit 12 may automatically detect the feature part to be measured based on the median line detected by the median line detection unit 11. In addition, the site | part of the test subject H which the characteristic site | part designation | designated part 12 designates is not limited above, but is arbitrary.

  In addition, the feature site designation unit 12 can designate a feature site manually designated by the operator as a feature site to be measured. For example, an image corresponding to three-dimensional measurement data or image data is displayed on the display unit 5, and the operator selects a position on the image displayed on the display unit 5 using the input unit 6 such as a mouse or a touch pen. To do. The input unit 6 acquires information on the characteristic part designated by the user, and the characteristic part designation unit 12 designates (determines) the characteristic part based on this information. In addition, the characteristic site | part which should be measured in the test subject's H back in each state detection part 4 is demonstrated later.

  For example, the automatic evaluation unit 13 automatically evaluates the state of the characteristic part detected by each unit of the state detection unit 4 described later. For example, the automatic evaluation unit 13 automatically evaluates the state of the characteristic part detected by each unit of the state detection unit 4 by comparison with a preset threshold value. Thereby, the state of the characteristic site | part of the test subject H can be grasped | ascertained simply. As said threshold value, the value etc. which were detected by each part of state detection part 4 about a healthy person can be used, for example. For example, when the value detected by each part of the state detection unit 4 for the subject H exceeds the threshold value, the automatic evaluation unit 13 determines whether the value of the detected value for the subject H and the threshold value are different from each other. "Slight distortion is seen in the part of" "," Middle distortion is seen in the part of ... seems to be necessary "," Severe distortion is seen in the part of ... Or the like "may be displayed. Further, the automatic evaluation unit 13 compares the data indicating the state of the characteristic part obtained by the past measurement for the subject H with the data indicating the state of the characteristic part obtained by the current measurement for the subject H, The state of the part may be automatically evaluated. In this specification, the evaluation result of the automatic evaluation unit 13 is included in the detection result of the state detection unit 4.

  Note that the final judgment on the necessity of surgery or various treatments for body distortion (eg, scoliosis) is made by a doctor or the like (eg, a specialist). Further, the measuring device 1 may not include the automatic evaluation unit 13, and the automatic evaluation unit 13 may be provided in a device outside the measuring device 1. For example, in the above-described external device, the automatic evaluation unit 13 may automatically evaluate the state of the characteristic part using data indicating the state of the characteristic part obtained by the measuring device 1.

  Next, the state detection unit 4 will be described. The state detection unit 4 detects the state of the feature part specified by the feature part specification unit 12 based on the three-dimensional data acquired by the three-dimensional data acquisition unit 3. The state detection unit 4 of the present embodiment detects spinal distortion. The state detection unit 4 includes, for example, a first spine column detection unit 4a and a second spine column detection unit 4b. Note that the state detection unit 4 may detect a plurality of items (shoulder, scapula, waist, lower body, pelvis, and foot) related to the distortion of the back of the subject H.

  The first spine detection unit 4a detects the uneven state of the body surface in the left-right direction of the subject H as the state of the characteristic part. FIGS. 8A to 8D are diagrams for explaining the first spine detection unit 4a. FIG. 8A is a diagram showing a characteristic portion to be measured in the first spinal column detector 4a. The processed image based on the three-dimensional data in FIG. 8A is displayed on the display unit 5, for example. For example, the first spine detection unit 4a sets the characteristic site to be measured to a predetermined portion R1 from the cervical vertebra to the crotch in the direction of the midline, and in this predetermined portion R1, the left and right peaks with the midline as the boundary Information indicating the height difference of the position (hereinafter referred to as height difference information) is calculated.

  FIG. 8B is a diagram illustrating the shape of the body surface of the subject H in a plane orthogonal to the median line. In FIG. 8B, the symbol ML is a midline, the symbol PE1 is a peak on the left side (eg, local maximum) with respect to the median line ML, and the symbol PE2 is a peak on the right side (eg, with respect to the midline ML). Minimal). The first spine detection unit 4a, for example, for a predetermined portion R2 in a plane orthogonal to the midline, the height in one of the left and right regions (eg, the left region) having the midline as a boundary line. The difference between the local maximum value (the height of the peak PE1) and the local minimum value (the height of the peak PE2) in the other region (eg, the right region) is calculated as the height difference h. The height difference h is an example of the height difference information. Further, the first spine detection unit 4a calculates an angle θ1 at which the straight line L1 passing through the peak PE1 and the peak PE2 intersects the horizontal line HL. The angle θ1 is an example of the height difference information.

  The first spine detection unit 4a quantitatively detects the degree (level) of the spinal column distortion of the subject H in the left-right direction. For example, the first spine detection unit 4a has left and right peaks with respect to the midline ML as shown in FIG. 8B at a plurality of positions in the direction of the midline in the portion R1 shown in FIG. 8A. For example, the angle θ1 is calculated as the position difference information. FIG. 8C is a diagram showing a distribution in the direction of the median line of the angle θ1 calculated by the first spine detection unit 4a. The image in FIG. 8C is displayed on the display unit 5, for example. In FIG. 8C, the vertical axis is the position in the direction of the midline, and the horizontal axis is the angle θ1. The angle θ1 on the horizontal axis is positive (+) when the height decreases from left to right as shown by the straight line L1 in FIG. 8B, and negative (−) in the opposite case. Value.

  Further, the first spine detection unit 4a calculates the maximum value and the minimum value, for example, at the angle θ1 indicating the height difference of the peak position in the portion R1, and calculates the absolute value of the maximum value and the absolute value of the minimum value. Is calculated as “curvature”. This “curvature” is a value that quantitatively indicates the degree of lateral distortion of the spine of subject H. When the “curvature” calculated by the first spine detection unit 4a is used, for example, the degree of lateral distortion of the spine of the subject H can be easily and accurately evaluated.

  In the example shown in FIG. 8C, the maximum value of the positive angle (+ angle) is indicated by arrow B, and the minimum value of the negative angle (− angle) is indicated by arrow A. In FIG. 8A, the arrow A corresponds to the line AA, and the arrow B corresponds to the line BB. The AA line and the BB line are superimposed on the actual image and / or the image based on the three-dimensional data by the imaging unit 2 as a detection result of A of the first spinal column detection unit, and the display unit 5 Is displayed. Further, as shown in FIG. 8D, the first spine detection unit 4a shows the uneven state of the body surface at the AA line (indicated by reference numeral A) and the uneven state of the body surface at the BB line. It outputs as a detection result (it shows with the code | symbol B).

  FIG. 9 is a diagram for explaining the second spinal column detector 4b. FIG. 9A is a diagram showing a characteristic portion to be measured in the second spinal column detector 4b. The image in FIG. 9A is displayed on the display unit 5, for example. The second spine detection unit 4b detects the uneven state of the body surface in the front-rear direction (dorso-abdominal direction) of the subject H as the state of the characteristic part. For example, the second spine detection unit 4b quantitatively detects the degree of distortion in the front-rear direction of the spine of the subject H. For example, the second spine detection unit 4b sets a characteristic part to be measured in the back part R3 of the subject H, and detects the uneven state of the body surface at the characteristic part. The portion R3 is, for example, a portion corresponding to a line connecting the center positions in the width direction of the back of the subject H. The concavo-convex state of the body surface of the portion R3 reflects the position of the spinal column in the front-rear direction. Therefore, the second spine detection unit 4b can detect the distortion in the front-rear direction of the spine by detecting the uneven state of the body surface of the portion R3.

  FIG. 9B is a diagram illustrating an example of a detection result of the second spinal column detection unit 4b. The image of FIG. 9B is displayed on the display unit 5, for example. In FIG. 9B, the horizontal axis is the position of the body surface in the direction of the midline, and the horizontal axis is the position of the body surface in the front-rear direction. For example, the second spine detection unit 4b outputs a distribution of the position of the body surface in the front-rear direction with respect to the position of the body surface in the direction of the midline as a detection result. A symbol L2 in FIG. 9B indicates a line corresponding to the vertical direction of the subject. This distribution is used, for example, to evaluate the curvature of the spine in the front-rear direction. In addition, the characteristic site | part in the 2nd spinal column detection part 4b may not be the part R3 of the centerline of the back part of the test subject H, for example, may be a part parallel to the median line selected from the back part of the test subject H.

  As described above, the measuring apparatus 1 according to the present embodiment can easily and accurately detect the distortion of the spine of the subject H. Moreover, since the measuring apparatus 1 can detect the lateral distortion in the spine of the subject H, it can detect that the subject H has scoliosis. Moreover, since the measuring apparatus 1 can detect the distortion | strain of the front-back direction in the spinal column of the test subject H, it can detect that the test subject H has the lordosis or the kyphosis. Such a measuring apparatus 1 can be suitably used for scoliosis screening in school screening, detection of scoliosis in hospitals / clinics, and follow-up before and after scoliosis surgery.

  The first spine detection unit 4a and the second spine detection unit 4b described above detect the state using, for example, the image of the stationary subject H and the three-dimensional data, but the subject H performing a predetermined operation. Evaluation may be performed comprehensively using the moving image. Note that at least one of the first spine detection unit 4a and the second spine detection unit 4b may be omitted.

  Returning to the description of FIG. 2, the input unit 6 receives input of various operation commands from the user. As the input unit 6, for example, an input device such as a keyboard, a mouse, a button, a joystick, or a touch panel can be used.

  The storage unit 16 stores (stores) various programs and various data necessary for the operation of the computer apparatus CP. As the storage unit 16, for example, a storage device such as a hard disk or a flash memory can be used.

  The display unit 5 displays various information. For example, the display unit 5 includes the real image Im1 acquired by the imaging unit 2 illustrated in FIG. 5, the image Im2 indicating three-dimensional data, the detection result of the state detection unit 4, the evaluation result of the automatic evaluation unit 13, and the measurement device 1. Information related to the back of the subject H other than the operation unit 15 that performs the operation, information related to the operation of the measuring device 1, the real image Im1, the image Im2 that indicates three-dimensional data, and the detection result D1 of the state detection unit 4 (for example, the midline ML ( 8) and the like are displayed. As for the actual image Im1, an image including the above-described center line 31a is displayed.

  The display on the display unit 5 is controlled by the display control unit 14. The display control unit 14 causes the display unit 5 to display information to be displayed on the display unit 5 as described above. As the display unit 5, for example, a display device such as a display, a liquid crystal monitor, or a touch panel can be used. The display unit 5 may display the 3D data of the subject H as a 3D image using polygons, wire frames, or the like. Further, the viewpoint of the three-dimensional image may be switched by a button operation or a pointing device operation.

  FIG. 10 is a diagram illustrating a display example by the display unit. As shown in FIG. 10, the display unit 5 is controlled by the display control unit 14, the real image Im <b> 1 acquired by the imaging unit 2, the image Im <b> 2 indicating three-dimensional data, the detection result D <b> 1 of the state detection unit 4, and the measurement date / time D <b> 2. The name D3 of the subject H, the identification number (ID) D4 of the subject H, the operation menu M1 (operation unit 15), the information I on the back of the subject H, the evaluation result (not shown) of the automatic evaluation unit 13 described above, etc. indicate. The display unit 5 can display these pieces of information in real time.

  For example, the display unit 5 displays the actual image Im1 and the image Im2 indicating three-dimensional data side by side. For example, the display unit 5 displays the actual image Im1 and the image Im2 indicating three-dimensional data side by side with the same size. Further, the display unit 5 displays the center line 31a (left and right center lines and upper and lower center lines) superimposed on the actual image Im1.

  The detection result D1 of the state detection unit 4 is information indicating the detection result of the state detection unit 4 (the first spine detection unit 4a and the second spine detection unit 4b). For example, in the example shown in FIG. 10, the display unit 5 displays the detection result D1 of the state detection unit 4 in the direction of the midline of the angle θ1 calculated by the first spinal column detection unit 4a shown in FIG. An image Im3 indicating the distribution and a “curvature” D5 are displayed. As described above, the display unit 5 can display the detection result D1 of the state detection unit 4 side by side on the real image Im1 and the image Im2 indicating the three-dimensional data. In the present embodiment, the display unit 5 detects the uneven state of the body surface along the line AA shown in FIG. 8D and the uneven state of the body surface along the line BB shown in FIG. The distribution of the position of the body surface in the front-rear direction relative to the position of the body surface in the direction of the midline can also be displayed.

  The information I relating to the back of the subject H is arbitrary as long as it is information relating to the back of the subject H. For example, in the example illustrated in FIG. 10, the information I regarding the back of the subject H is the median line ML. The information I related to the back of the subject H includes information indicating each part detected by the characteristic part designating unit 12.

  The operation menu M1 is used as an operation unit 15 that performs various operations of the measuring apparatus 1. The operation menu M1 is displayed as a button on the display unit 5, for example. In the example shown in FIG. 10, the operation menu M1 is displayed as buttons for performing operations of “save”, “play / stop”, “compare”, “print”, “read”, “setting display”, and “end”. Is done. For example, “Save” performs an operation of saving the acquired image data and three-dimensional data. “Play / Stop” performs a display switching operation by displaying the image Im1 and the image Im2 in real time and reproducing the stored data. “Comparison” performs an operation of comparing a plurality of data. “Print” performs an operation of printing out the displayed image. “Setting display” is an operation for displaying the setting. “Read” performs an operation of reading various data (eg, real image, three-dimensional data) stored in the storage unit 16 and displaying the data on the display unit 5. “End” performs an operation to end the application. Thus, when the display unit 5 displays the operation unit 15, the user can easily operate. Note that the operation unit 15 illustrated in FIG. 10 is an example, and the present invention is not limited to this. For example, although not shown in the drawing, the operation unit 15 of the present embodiment can also change the scale of each image.

  As described above, in the present embodiment, the display unit 5 displays the actual image Im1, the image Im2 indicating three-dimensional data, and the detection result D1 of the state detection unit 4, so that the measurement result can be easily grasped. . Further, since the display unit 5 displays the real image Im1, the image Im2 indicating three-dimensional data, and the detection result D1 of the state detection unit 4 in real time, the measurement result can be grasped quickly and more easily.

  Further, since the display unit 5 displays the actual image Im1 and the image Im2 indicating three-dimensional data side by side, the measurement result can be easily grasped. Further, since the display unit 5 displays the actual image Im1, the image Im2 indicating three-dimensional data, and the detection result D1 of the state detection unit 4 side by side, the measurement result can be grasped more easily.

  In addition, since the display unit 5 displays the above-described real image Im1 and the image Im2 indicating the three-dimensional data side by side, the state (measurement state) of the subject H when the three-dimensional data is acquired can be more easily represented by the real image Im1. Can grasp. In this case, it can also be confirmed whether or not the imaging position of the imaging unit 2 is normal at the time of measurement. Further, in this case, it is usually difficult to identify the subject H only by the image showing the three-dimensional data, but the subject H can be identified by the actual image Im1.

  Further, since the display unit 5 displays the left and right center lines and the upper and lower center lines of the center line 31a so as to be superimposed on the actual image Im1, the imaging position (imaging range) by the imaging unit 2 when an image or three-dimensional data is acquired is displayed. ) Can be easily confirmed. In this case, at the time of measurement, it is possible to easily confirm and grasp whether or not the imaging position of the imaging unit 2 is normal, for example, whether or not the imaging unit 2 is tilted. Moreover, when the image Im1 has a left-right center line, the inclination of the subject H with respect to the left-right center line can be easily grasped.

  The display mode of the display unit 5 is not limited to the examples shown in FIGS. 10 and 11 and is arbitrary. For example, the display unit 5 may not display the real image Im1, the image Im2 indicating three-dimensional data, and the detection result D1 of the state detection unit 4 in real time. Further, for example, the display unit 5 may not display the actual image Im1 and the image Im2 indicating the three-dimensional data side by side, or may not display the same size. Further, the display unit 5 may not display the left and right center lines and the upper and lower center lines of the center line 31a so as to overlap the actual image Im1.

  The measuring device 1 also includes an output unit (not shown) that outputs various data (eg, various detection results (detection data)) to the outside. Examples of the output unit include a printer and a data output device (a data output interface such as a USb interface or a network interface).

  Next, the measurement method according to the present embodiment will be described based on the operation of the measurement apparatus 1 described above. The following description is an example of the measurement method according to the present embodiment, and the measurement method according to the present embodiment is not limited to this. 11 and 12 are flowcharts of the measurement method according to the embodiment.

  In this measurement method, the back of the subject H is imaged in step S1. For example, as described above, the imaging unit 2 images the back of the subject H. The image acquired by the imaging unit 2 is stored in the storage unit 16, and subsequent processing is performed.

  Subsequently, in step S2, three-dimensional data of the back of the subject H is acquired. For example, as described above, the three-dimensional data acquisition unit 3 acquires the three-dimensional data of the back of the subject H. The three-dimensional data acquired by the three-dimensional data acquisition unit 3 is stored in the storage unit 16, and subsequent processing is performed.

  In step S3, the extraction unit 10 extracts the surface shape data of the subject H from the three-dimensional measurement data. For example, in step S31 of step S3, the extraction unit 10 determines whether human body data is included in the three-dimensional measurement data. For example, the extraction unit 10 determines whether or not human body data is included in the three-dimensional measurement data by performing pattern matching or the like on the three-dimensional measurement data and the three-dimensional shape data of the human body prepared in advance.

  When the extraction unit 10 determines that the human body data is not included in the three-dimensional measurement data (step S31; No), the process returns to step S1 and the back of the subject H is imaged. When the extraction unit 10 determines that the human body data is included in the three-dimensional measurement data (step S31; Yes), noise is removed or reduced from the three-dimensional measurement data in step S32. For example, the extraction unit 10 removes noise from the three-dimensional measurement data by a process such as filtering.

  In step S33, the extraction unit 10 deletes the background data from the three-dimensional measurement data. For example, the extraction unit 10 estimates a portion where the distance from the three-dimensional data acquisition unit 3 is longer than a predetermined distance set in advance as a background, and removes data corresponding to the background.

  Subsequently, in step S34, the extraction unit 10 extracts the outline of the human body part. For example, the extraction unit 10 detects an edge of a human body part. For example, the extraction unit 10 extracts the outline of the subject H by detecting the outline of the object represented by the three-dimensional measurement data or the image data. The edge of the image is detected, and the outline of the back of the subject H is acquired. In step S35, the extraction unit 10 extracts data of the human body part. For example, the extraction unit 10 extracts data of the inner portion of the outline of the subject H as surface shape data from the three-dimensional measurement data. Note that whether or not to perform Step S31 to Step S35 is arbitrary.

  In step S <b> 4, the midline detection unit 11 detects the midline on the back of the subject H from the surface shape data extracted by the extraction unit 10. Note that whether or not to perform step S4 is arbitrary.

  In step S <b> 5, the feature site designation unit 12 designates a feature site to be measured on the back of the subject H from the surface shape data extracted by the extraction unit 10. Whether or not step S5 is performed is arbitrary.

  In step S6, the state detection unit 4 detects the state of the designated feature portion based on the three-dimensional data. In step S61 shown in FIG. 12A, spinal column distortion is detected. For example, in step S62, the first spinal column detection unit 4a detects, as a characteristic part state, distortion of the spinal column in the left-right direction of the subject based on the three-dimensional data with respect to the spine of the subject designated as the characteristic part. (See FIG. 8). In step S62, the second spine detection unit 4b detects the distortion of the spinal column in the front-rear direction of the subject H as the characteristic part state based on the three-dimensional data with respect to the spine of the subject designated as the characteristic part ( (See FIG. 9).

  Subsequently, in step S <b> 7 shown in FIG. 12B, the automatic evaluation unit 8 automatically evaluates the state of the characteristic part detected by the state detection unit 4. Whether or not step S8 is performed is arbitrary.

  Subsequently, in step S8, an actual image and an image showing three-dimensional data are displayed. For example, as described above, the display unit 5 displays the actual image Im1 and the image Im2 indicating the three-dimensional data. At this time, as described above, the display unit 5 may display the real image Im1, the image Im2 indicating three-dimensional data, and the detection result D1 of the state detection unit 4. The display unit 5 may display the real image Im1, the image Im2 indicating three-dimensional data, and the detection result D1 of the state detection unit 4 in real time. The display unit 5 may display the above-described actual image Im1 and the image Im2 indicating three-dimensional data side by side. The display unit 5 may display the actual image Im1, the image Im2 indicating three-dimensional data, and the detection result D1 of the state detection unit 4 side by side. The display unit 5 may display the left and right center lines and the upper and lower center lines of the center line 31a so as to overlap the actual image Im1.

  As described above, the measurement apparatus 1 and the measurement method of the present embodiment can easily grasp the measurement result.

  The technical scope of the present invention is not limited to the aspects described in the above-described embodiments. One or more of the requirements described in the above embodiments and the like may be omitted. In addition, the requirements described in the above-described embodiments and the like can be combined as appropriate. In addition, as long as it is permitted by law, the disclosure of all documents cited in the above-described embodiments and the like is incorporated as a part of the description of the text.

  In addition, about the display of a measurement result, the process which emphasizes the unevenness | corrugation of the body surface based on three-dimensional measurement data may be performed, and it may make it easy for an operator and a doctor to grasp | ascertain an uneven state. Moreover, it may be displayed so as to make it easier for the operator or doctor to grasp the uneven state by performing an appropriate coloring process on the uneven surface of the body based on the three-dimensional measurement data.

  For example, although the example in which the state detection unit 4 of the above-described embodiment is the first spine column detection unit 4a and the second spine column detection unit 4b has been described, the state detection unit 4 is not limited thereto, and is optional. is there. For example, as described in the international application PCT / JP2015 / 082887 by the inventors of the present application, the state detection unit 4 detects the inclination of the left and right shoulders with respect to the midline of the back of the subject H based on the three-dimensional data. Alternatively, the distortion of the left and right scapulas of the subject H may be detected, the distortion of the pelvis of the subject H may be detected, or when a desired position on the back of the subject H is marked The position and height of the portion where the marker is provided in the subject H may be detected.

DESCRIPTION OF SYMBOLS 1 ... Measuring apparatus 2 ... Imaging part 3 ... Three-dimensional data acquisition part 4 ... State detection part 4a ... 1st spinal column detection part (state detection part)
4b... Second spine detection unit (state detection unit)
5 ... Display unit 6 ... Input unit 8 ... Automatic evaluation unit 9 ... State detection unit 10 ... Extraction unit 11 ... Midline detection unit 12 ... Feature site designation unit 13 ··· Automatic evaluation unit 14 ··· Display control unit 15 ··· Operation unit 16 ··· Storage unit 31 ··· Reference unit 31a · · · Center line 33 · · · Positioner CP · · · Computer device CU ··· -Control unit PU ... Processing unit S ... Kinect sensor Sa ... RGB camera (imaging unit)
Sb: Infrared laser emission unit (three-dimensional data acquisition unit)
Sc: Infrared camera for measurement (three-dimensional data acquisition unit)
Im1 ... Real image (image)
Im2 ... image (image showing three-dimensional data)
M1 ... operation menu (operation unit)
D1 ... Detection result of the state detection unit

Claims (7)

An imaging unit for imaging the back of the subject;
A three-dimensional data acquisition unit for acquiring three-dimensional data of the back of the subject;
A state detector that detects the state of the characteristic part of the back based on the three-dimensional data;
A measurement apparatus comprising: a real image by the imaging unit; a processed image based on the three-dimensional data; and a display unit that displays a detection result of the state detection unit.   The measurement apparatus according to claim 1, wherein the state detection unit detects a distortion of the spine of the subject as the state of the characteristic part.   The measurement apparatus according to claim 1, wherein the display unit displays a contour image as a processed image based on the three-dimensional data.   The measurement device according to any one of claims 1 to 3, wherein the display unit displays the actual image and the processed image side by side with the same size.   The measurement device according to any one of claims 1 to 4, wherein the display unit displays a left and right center line and a vertical center line superimposed on a real image captured by the imaging unit.   The measurement device according to claim 1, wherein the display unit displays an operation unit that operates each unit of the measurement device. Imaging the subject's back,
Obtaining 3D data of the subject's back,
Detecting the state of the characteristic part of the back based on the three-dimensional data;
Displaying a real image by the imaging unit and a processed image based on the three-dimensional data on a display unit.