JP2021180904A - Measuring apparatus - Google Patents

Abstract

To provide a measuring apparatus which facilitates grasping a result of measuring backbone distortion, and a measuring method.SOLUTION: A measuring apparatus 1 includes an imaging unit 2 for imaging the back part of a subject H, a three-dimensional data acquisition unit 3 for acquiring three-dimensional data on the back part of the subject H, a state detection unit 4 for detecting the state of a feature site of the back part based on the three-dimensional data, and a display unit 5 for displaying an actual image Im1 captured by the imaging unit 2, a processing image Im2 based on the three-dimensional data, and a detection result D1 obtained by the state detection unit 4.SELECTED DRAWING: Figure 1

Description

The present invention relates to a measuring device and a measuring method.

Scoliosis is a disease in which the spine bends, and the cause has not been clarified, so it is difficult to prevent it in advance. Scoliosis, on the other hand, is said to have an incidence of about 1 in 100, and is one of the diseases with a very high incidence. For example, it is said that the most common scoliosis in Japan is idiopathic scoliosis, which accounts for 80 to 90% of all scoliosis. Idiopathic scoliosis most often develops during puberty, often from the upper grades of elementary school to junior high school. It is said that the curvature of the spinal column becomes stronger at the time of the most remarkable growth around the age of 10 to 15, and the progress of the curvature stops around 17 to 18 after the growth period. The symptom of scoliosis is that the spine bends from side to side and at the same time twists the spine, resulting in deformed ribs and ridges. Scoliosis is a disease in which cardiopulmonary function declines as the deformity progresses, and low back pain significantly impairs daily life. It has been reported that, if scoliosis is detected early and treatment with a device is performed at an appropriate time, 76% can make the progression of the deformation angle within 10 ° (Non-Patent Document 1 below). .. Furthermore, it has been clarified that early detection and treatment of chiari malformation and syringomyelia are extremely important for prevention of progression of spinal deformity (Non-Patent Document 2 below). In Japan, from 1979, elementary and junior high schools are obliged to have a spinal examination based on the enforcement regulations of the School Health Law. In school examinations, etc., it is necessary to examine a large number of subjects, and in the conventional inspection or palpation by a doctor, there is a problem in terms of convenience, etc., so a device for detecting spinal strain is required. Has been done.

Conventionally, in the examination of scoliosis and the like, an X-ray examination method using an X-ray imaging device is often used. The X-ray examination method is a method of photographing the chest with X-rays and measuring the degree of curvature of the spinal column by a doctor's judgment, and the degree of lateral curvature of the spinal column can be grasped from the X-ray photographed image. However, the general X-ray inspection method has a drawback that the degree of lateral curvature can be determined, but the degree of unevenness on the body surface cannot be determined. In addition, the number of X-rays taken is limited from the viewpoint of radiation exposure to the human body, and the items that can be inspected are limited. Further, since the X-ray inspection method handles X-rays, a specialized engineer is required, and it is difficult to carry out the inspection easily.

Further, as a method for detecting the distortion of the spine, measurement using a CT (Computed Tomography) device can be considered, but there is a problem that it is difficult to apply it in a small facility because the device is expensive and large. Moreover, in the CT examination, it is necessary to consider the exposure of the human body as in the X-ray examination method. In addition, for scoliosis, time-series data is required to evaluate the degree of symptom progression, and measurement data is also required to be quantified. As a detection device capable of digitizing measurement data without using an X-ray imaging device or a CT device, for example, a technique using a three-dimensional sensor disclosed in Patent Document 1 can be mentioned.

International Publication No. 2013/081030

Satoshi Hyakumura, Ikuho Yonezawa, J Spine Res, 2010, 1: 1960-1963 Nakahara D, Yonezawa I, J Spine Res, 2011, 36: E482-485

By the way, the device for detecting the strain of the spine is required to be able to easily grasp the measurement result (result). The present invention has been made in view of the above circumstances, and an object of the present invention is to provide a measuring device and a measuring method capable of easily grasping a measurement result.

The measuring device according to the first aspect of the present invention has an imaging unit that images the back of the subject, a three-dimensional data acquisition unit that acquires three-dimensional data on the back of the subject, and a state of a characteristic portion of the back as three-dimensional data. It includes a state detection unit for detecting based on, a processed image based on an actual image by an imaging unit and three-dimensional data, and a display unit for displaying the detection result of the state detection unit.

The measuring method of the second aspect of the present invention is to image the back of the subject, acquire three-dimensional data of the back of the subject, and detect the state of the characteristic portion of the back based on the three-dimensional data. And displaying the actual image by the imaging unit and the processed image based on the three-dimensional data on the display unit.

It is a conceptual diagram which shows the measuring apparatus which concerns on embodiment. It is a block diagram of the measuring apparatus which concerns on embodiment. It is a figure which shows the measuring apparatus which concerns on embodiment. It is a figure which shows the image pickup part and 3D data acquisition part which concerns on embodiment. It is a side view which shows the positioner. It is a front view which shows the positioner of FIG. It is a figure which shows the image which shows the real image and 3D data. It is a figure explaining the 1st spinal column detection part. It is a figure explaining the 2nd spinal column detection part. It is a figure which shows the display by a display part. It is a flowchart of the measurement method which concerns on embodiment. Following FIG. 11, it is a flowchart of the measurement method.

Hereinafter, embodiments of the present invention will be described with reference to the drawings. However, the present invention is not limited to this. Further, in the drawings, in order to explain the embodiment, a part or the whole is schematically described, and a part expressed by changing the scale as appropriate, such as describing a part in a large or emphasized manner, is included. In each of the following figures, the directions in the figure will be described using the XYZ coordinate system. In this XYZ coordinate system, a plane parallel to the horizontal plane is defined as an XY plane. An arbitrary direction parallel to the XY plane is referred to as an X direction, and a direction orthogonal to the X direction is referred to as a Y direction. Further, the direction perpendicular to the XY plane (vertical direction) is expressed as the Z direction. Further, in each direction, the same side as the tip of the arrow is referred to as a + side (eg, + Z side), and the side opposite to the tip of the arrow is referred to as a − side (eg, −Z side). For example, in the vertical direction (Z direction), the upper side is the + Z side and the lower side is the −Z side.

FIG. 1 is a conceptual diagram showing a measuring device according to an embodiment. The measuring device 1 of the present embodiment captures the state of the imaging unit 2 that images the back of the subject H, the three-dimensional data acquisition unit 3 that acquires the three-dimensional data of the back of the subject H, and the characteristic portion of the back of the subject H. It includes a state detection unit 4 that detects based on 3D data, a processed image Im2 based on the actual image Im1 by the imaging unit 2, a processed image Im2 based on the 3D data, and a display unit 5 that displays the detection result D1 of the state detection unit 4. ..

FIG. 2 is a block diagram showing a measuring device according to an embodiment. The measuring device 1 includes an imaging unit 2, a three-dimensional data acquisition unit 3, and a computer device CP. The image pickup unit 2, the three-dimensional data acquisition unit 3 (three-dimensional sensor), the display unit 5, and the input unit 6 are connected to the computer device CP so as to be communicable by wire or wirelessly, respectively. The computer device CP is a personal computer or the like including a CPU and a memory. The computer device CP reads out the program stored in the storage unit 16 and executes various processes according to this program.

The computer device CP includes a state detection unit 4, an extraction unit 10, a median line detection unit 11, a feature site designation unit 12, an automatic evaluation unit 13, a display control unit 14, an operation unit 15, and a storage unit 16. And. In the above program, the computer is controlled by a processing unit PU (state detection unit 4, extraction unit 10, median line detection unit 11, feature site designation unit 12, automatic evaluation unit 13) that performs various processes, and various controls. It functions as a unit CU (display control unit 14, operation unit 15).

FIG. 3 is a perspective view showing the measuring device 1 of the present embodiment. The measuring device 1 shown in FIG. 3 shows a state in which the subject H in a standing state is measured. The measuring device 1 includes, for example, the image pickup unit 2, the three-dimensional data acquisition unit 3, the computer device CP, the lower frame 21, the vertical frame 22, the support frame 23, the support column 25, and the support unit 26. A table 27 and a plurality of wheels 28 are provided.

The lower frame 21 is arranged at the lower part of the measuring device 1. The vertical frame 22 extends in the vertical direction (Z direction) and is fixed to the upper part of the lower frame 21. The support frame 23 is fixed to the vertical frame 22 and supports the support column 25. The strut portion 25 extends in the vertical direction (Z direction) and can be expanded and contracted in the vertical direction (Z direction, vertical direction). The support column 25 includes, for example, a stretchable portion 25a that can be expanded and contracted (movable) in the vertical direction, and a stretchable portion support portion 25b that supports the stretchable portion 25a. FIG. 2 shows a state in which the support column portion 25 is extended (a state in which the expansion / contraction portion 25a is moved upward). Further, FIG. 3 shows a state in which the strut portion 25 is contracted (a state in which the telescopic portion 25a is moved downward). Further, the support column portion 25 can be further contracted as compared with the state shown in FIG. 3, and the size of the measuring device 1 can be made compact. The expansion / contraction portion 25a and the expansion / contraction portion support portion 25b are provided with a space portion (cavity portion) (not shown) inside thereof, and in this space portion, each of the image pickup unit 2 and the three-dimensional data acquisition unit 3 and a computer. A cable 30 or the like for connecting to the device CP is accommodated. The stretchable portion support portion 25b can accommodate a part of the stretchable portion 25a inside, and supports the stretchable portion 25a so as to be movable in the vertical direction. The table 27 is provided on the upper part of the vertical frame 22. An article can be placed on the upper surface of the table 27. For example, a notebook computer device CP is placed on the upper surface of the table 27. The table 27 is connected to the upper end portion of the vertical frame 22 and the side of the support column 25, and is supported by the vertical frame 22 and the support column 25. The computer device CP is connected to the three-dimensional data acquisition unit 3 by the cable 30.

The support portion 26 is connected to the upper end (+ Z side) of the telescopic portion 25a. The support unit 26 is provided with an attachment unit 32 for attaching the image pickup unit 2 and the three-dimensional data acquisition unit 3 to the support unit 26. The support unit 26 supports the image pickup unit 2 and the three-dimensional data acquisition unit 3 via the mounting unit 32. The image pickup unit 2 and the three-dimensional data acquisition unit 3 accommodate a Kinect sensor S, which will be described later, in a case, and this case is supported by the support unit 26. The support portion 26 is rotatably connected to the telescopic portion 25a of the strut portion 25 around the axis AX1 parallel to the Y direction. That is, as shown in FIG. 3, the support portion 26 can move in the direction approaching the support portion 25. As a result, the size of the measuring device 1 can be made compact. The mounting unit 32 rotatably supports the image pickup unit 2 and the three-dimensional data acquisition unit 3 with respect to the support unit 26. For example, in the example shown in FIG. 2, the mounting unit 32 rotatably supports the three-dimensional data acquisition unit 3 around the axis AX2 parallel to the X direction. As a result, the orientations of the image pickup unit 2 and the three-dimensional data acquisition unit 3 can be changed. By changing the orientation of the image pickup unit 2 and the three-dimensional data acquisition unit 3 downward, the measuring device 1 can measure the subject H in the lying state. Further, when the orientations of the imaging unit 2 and the three-dimensional data acquisition unit 3 can be changed, the orientations of the imaging unit 2 and the three-dimensional data acquisition unit 3 can be more accurately directed with respect to the subject H.

The plurality of wheels 28 are provided at the lower part of the lower frame 21. The plurality of wheels 28 can move a unit (a structure above the lower frame 21) including at least the image pickup unit 2 and the three-dimensional data acquisition unit 3. In the present embodiment, another part of the measuring device 1 is supported by the lower frame 21, and the measuring device 1 can travel on the floor as a whole.

The configuration shown in FIG. 3 is an example of the measuring device 1, and other configurations may be used. For example, the configurations such as the shape and size of the lower frame 21, the vertical frame 22, the support frame 23, the support column 25, the support portion 26, and the table 27 described above are not limited to those shown in FIG. 3, and are arbitrary. Further, the computer device CP is not limited to the notebook type, and any computer device CP can be used. For example, the computer device CP may be a desktop type or a tablet type.

Next, the image pickup unit 2 and the three-dimensional data acquisition unit 3 will be described. FIG. 4 is a diagram showing an image pickup unit 2 and a three-dimensional data acquisition unit 3 according to the present embodiment. The image pickup unit 2 and the three-dimensional data acquisition unit 3 use, for example, a Kinect (registered trademark) (v2) sensor S (hereinafter, abbreviated as “Kinect sensor”). As the image pickup unit 2 and the three-dimensional data acquisition unit 3, for example, a laser pattern projection type three-dimensional sensor (eg, Kinect sensor (v1)) can also be used.

As shown in FIG. 4, the Kinect sensor S is equipped with an RGB camera Sa, an infrared laser light emitting unit Sb, and an infrared camera Sc for measurement. The Kinect sensor S acquires an RGB color image (moving image) with the RGB camera Sa. Further, the Kinect sensor S measures the flight time of the reflected light by actively irradiating the object with near infrared light (LED light) by the infrared laser light emitting unit Sb and receiving the light by the infrared camera Sc for measurement. Then, the distance to the object is measured based on this flight time. As a result, the Kinect sensor S acquires three-dimensional data (three-dimensional depth data) of the object. The Kinect sensor S is a so-called TOF (Time of Flight) type three-dimensional sensor. The Kinect sensor S was originally a sensor for a game machine, but it can also be connected to a computer device (personal computer) CP (see FIG. 2) or the like via a USb terminal.

Further, the Kinect sensor S controls the Kinect sensor from the computer device CP by a program written in C language by using, for example, "Kinect for Windows (registered trademark) SDK (Software Development Kit)" provided by Microsoft Research. Can be done. Further, software such as Point Cloud Library can be used for processing the data output by the Kinect sensor S. As described above, when the Kinect sensor S is used, since the development environment and the data processing environment are prepared, it is possible to easily develop a control program, an analysis program, and the like. Further, since the Kinect sensor S has a device and control software available at low cost, when the Kinect sensor S is used as the three-dimensional sensor, the measuring device 1 can be manufactured at low cost.

The image pickup unit 2 of the present embodiment is an RGB camera Sa of the Kinect sensor S. As a result, the image pickup unit 2 acquires an image (image data). Further, the three-dimensional data acquisition unit 3 of the present embodiment is an infrared laser light emitting unit Sb and an infrared camera Sc for measurement. As a result, the three-dimensional data acquisition unit 3 acquires the three-dimensional data of the object.

The image pickup unit 2 and the RGB camera Sa do not have to use the Kinect sensor S, respectively. For example, the image pickup unit 2 may use a video camera (digital video camera) capable of capturing an image. Further, the 3D data acquisition unit 3 may use a sensor or a 3D scanner capable of acquiring 3D data of an object.

Further, in the present embodiment, the reference unit 31 is provided on the incident side of the light of the image pickup unit 2. In FIG. 4, the reference portion 31 is shown by a dotted line. The reference unit 31 gives a reference to the image acquired by the image pickup unit 2. The reference portion 31 has a cross-shaped center line 31a as a reference at the center of the surface of a translucent member such as glass or resin. The center line 31a is a straight line having a predetermined length parallel to the horizontal direction and a straight line having a predetermined length parallel to the vertical direction, and these are orthogonal to each other at their centers. The reference (center line 31a) is set at a predetermined position of the acquired image or three-dimensional data, for example. In the present embodiment, the intersection of the cross-shaped center lines 31a is set to be located at the center of the image acquired by the image pickup unit 2. As a result, the center line 31a (data of the center line 31a) is added to the center of the image acquired by the image pickup unit 2. As described above, when the reference (center line 31a) is given to the center of the image acquired by the image pickup unit 2, the center line 31a can be used for the image processing. Of the center lines 31a (data of the center lines 31a) given to the image, the lines parallel to the vertical direction with respect to the floor surface may be referred to as "upper and lower center lines", and with respect to the floor surface. Lines that are parallel to each other are sometimes called "left and right center lines".

The setting position of the reference unit 31 on the image is not limited to the above-mentioned center position and is arbitrary. For example, the position of the reference unit 31 may be one or more at a predetermined distance from the center. Further, the shape of the reference portion 31 is not limited to the cross shape described above, and is arbitrary. For example, the shape of the reference portion 31 may be a point, a dotted line, a mark having a predetermined shape, or the like. Further, the reference unit 31 may be provided in each of the image pickup unit 2 and the three-dimensional data acquisition unit 3. Further, it is arbitrary whether or not the measuring device 1 includes the reference unit 31. Further, at least one of the above-mentioned vertical center line and left-right center line does not have to be attached to the image by the reference unit 31. For example, at least one of the above-mentioned vertical center line and left-right center line may be obtained based on the image acquired by the image pickup unit 2.

The imaging unit 2 images the back of the subject H. The image pickup unit 2 captures the back of the subject H and acquires an image. The three-dimensional data acquisition unit 3 photographs the back of the subject H and acquires the three-dimensional data of the back. This three-dimensional data becomes the three-dimensional shape data of the back of the subject H. The measuring device 1 can measure the state of the back of the subject H by using, for example, three-dimensional data.

The back portion is the dorsal portion of the subject H, and includes a portion from the head to the tip of the foot. The three-dimensional data is, for example, data including three-dimensional coordinates of a plurality of points on the surface of the back of the subject H. For example, the three-dimensional data is data including data on the relative coordinates of each point on the surface of the back of the subject. For example, the relative coordinate data is the coordinates relative to the coordinates of the predetermined position (eg, the predetermined position of the back of the head) on the back of the subject H. When relative coordinates are used, it is possible to acquire the surface shape of the back of the subject H without using a reference member for calibrating the distance from the three-dimensional data acquisition unit 3 to each point on the back of the subject H. It is possible to easily acquire three-dimensional data. In addition to the relative coordinate data of each point on the surface of the back surface of the subject H, the coordinate data may be absolute coordinate data or relative coordinate data with respect to a reference arranged outside the back of the subject H. The resolution of the three-dimensional data is, for example, a resolution of 1 mm to 10 mm.

The image captured by the imaging unit 2 and the three-dimensional data acquired by the three-dimensional data acquisition unit 3 are associated with each other, stored in the storage unit 16, and processed by the processing unit PU or the control unit CU. In the present specification, the image captured by the image pickup unit 2 is referred to as a “real image”. The actual image may be a processed image obtained by processing the image captured by the image pickup unit 2.

FIG. 5 is a diagram showing an actual image acquired by the imaging unit 2 and a processed image based on the three-dimensional data acquired by the three-dimensional data acquisition unit 3 (hereinafter, referred to as “an image showing the three-dimensional data”). .. FIG. 5 is an image in which the image Im1 acquired by the image pickup unit 2 and the image Im2 showing the three-dimensional data are displayed on the display unit 5. This image Im1 is a part of the moving image acquired by the imaging unit 2. The image Im2 is an image obtained by processing a part of continuously acquired three-dimensional data. The image Im1 acquired by the image pickup unit 2 is, for example, an actual image corresponding to the three-dimensional data acquired by the three-dimensional data acquisition unit 3. The image Im1 includes the cross-shaped center line 31a of the reference portion 31 described above. The image Im2 is a processed image processed based on the three-dimensional data, and is an image showing the three-dimensional data. The process of generating the image Im2 showing the three-dimensional data is performed by, for example, the processing unit PU. For example, the image Im2 showing the three-dimensional data shown in FIG. 5 is a contour line image including information about the contour lines. The contour image can be generated, for example, by processing the coordinate data of the three-dimensional data.

The contour image is not limited to the image shown in FIG. 5 and is arbitrary as long as it contains information about the contour lines. For example, the contour line image may show contour lines at predetermined intervals in a linear shape (eg, solid line, dotted line shape), or may convert height information into color or density and represent it as a gradation. Other information (image) other than the information indicating the contour lines, such as length or height, may be included.

The image Im1 and the image Im2 showing the three-dimensional data are subjected to predetermined processing and control by the processing unit PU or the control unit CU, and are displayed side by side on the display unit 5. Further, the actual image Im1 and the image Im2 are displayed adjacent to each other. Further, the actual image Im1 and the image Im2 are displayed in real time, respectively. Further, in the example shown in FIG. 5, the actual image Im1 and the image Im2 are processed by the processing unit PU or the control unit CU so as to have the same size, and are displayed on the display unit 5.

6 and 7 are views showing an example of a positioner, FIG. 6 is a front view, and FIG. 7 is a side view. The measuring device 1 includes a positioner 33. The positioner 33 supports the subject H during measurement by the measuring device 1. The positioner 33 includes a support portion 34, a support member 35, a foot portion support portion 36, and a screen 37. The support unit 34 supports the subject H. The support portion 34 supports the back surface of the subject H or the front surface of the subject H. The foot support portion 36 supports the foot of the subject H from below. The support portion 34 has spatial portions 38a and 38b in a portion corresponding to the central portion of the upper body of the subject H in the left-right direction and a portion corresponding to the toes of the subject H. When the subject H is supported by the support portion 34, the central portion and the toes of the upper body of the subject H in the left-right direction can be inserted into the space portions 38a and 38b. In this case, the support portion 34 can reduce the burden on the subject H when being supported by the support portion 34, and can reliably support the subject H.

Further, as shown in FIG. 6, the support portion 34 is supported by the support member 35 from below, and is arranged so as to be tilted at a predetermined angle with respect to the vertical direction. This inclination is set so as to be inclined by, for example, about 10 ° with respect to the vertical direction. At the time of measurement, the subject H is supported in a state of leaning with respect to the vertical direction by giving a weight to the support portion 34. The foot support portion 36 is also arranged corresponding to the inclination of the support portion 34 described above, and the support surface that supports the foot portion of the subject H is orthogonal to the support surface on which the support portion 34 supports the human body. Arranged to do.

By the way, at the time of measurement by the measuring device 1, it is desirable that the subject H is in a stationary state, although it depends on the type of the item to be measured. When the support portion 34 is tilted at a predetermined angle with respect to the vertical direction as described above, the subject H can give weight to the support portion 34, so that the burden when the subject H stands still at the time of measurement is reduced. be able to. Further, since the measuring device 1 supports the subject H with the positioner 33 and measures the subject H, the subject H in a stationary state can be easily measured. If the subject H is a child or the like, it may move at the time of measurement, but by using the positioner 33, the subject H can be easily stopped.

Further, a reference line 40 is provided on the surface of the support portion 34. The reference line 40 is arranged at a predetermined height, for example. The reference line 40 is provided so that it can be imaged by the image pickup unit 2. When there is such a reference line 40, the elongation of the subject H can be easily grasped. Further, when the image pickup unit 2 captures the subject H including the reference line 40, the image pickup unit 2 can add information about the reference line 40 to the image acquired by the image pickup unit 2. In this case, the information about the reference line 40 can be used for image processing.

The screen 37 is provided on the side opposite to the surface on which the support portion 34 supports the subject H. The screen 37 is provided at a predetermined position (distance, angle) with respect to the support portion 34. The screen 37 serves as a background in the image captured by the image pickup unit 2. When the screen 37 is present, it is possible to prevent the image captured by the imaging unit 2 or the three-dimensional data acquired by the three-dimensional data acquisition unit 3 from including information on an object other than the subject H, so that the image and the image and the three-dimensional data can be prevented from being included. The accuracy of 3D data can be improved. Further, since the screen 37 is provided at a predetermined distance from the support portion 34, the screen portion can be used as a reference in the three-dimensional data acquired by the three-dimensional data acquisition unit 3, whereby 3 The accuracy of dimensional data can be improved.

The configuration of the positioner 33 is not limited to the example shown in FIG. 5 and the like, and is arbitrary. For example, the positioner 33 does not have to include the screen 37. Further, it is arbitrary whether or not the measuring device 1 includes the positioner 33.

Returning to the explanation of FIG. 2, the extraction unit 10 obtains data regarding the surface shape of the subject H (hereinafter, surface shape data) from the three-dimensional data (hereinafter referred to as “three-dimensional measurement data”) acquired by the three-dimensional data acquisition unit 3. ) Is extracted. For example, the extraction unit 10 stores the pattern of the back of the human body in the storage unit 16 or the like in advance, determines the human body by using pattern matching processing between the pattern and the three-dimensional measurement data, and the three-dimensional measurement data. Extract surface shape data from. For example, the extraction unit 10 extracts the outline (edge) of the subject H. The extraction unit 10 detects the outline of the object represented by the three-dimensional measurement data or the image data acquired by the image pickup unit 2 (hereinafter, may be simply referred to as “image data”), thereby detecting the outline of the subject H. Extract the line. The extraction unit 10 extracts surface shape data from the three-dimensional measurement data based on the extracted outline. For example, the extraction unit 10 extracts the data of the inner portion of the outline of the subject H as the surface shape data from the three-dimensional measurement data. When the extraction unit 10 determines the human body, the subsequent processing can be automated. For example, when the subject H continues to acquire the three-dimensional measurement data by the three-dimensional data acquisition unit 3 and takes a predetermined posture with the back facing the three-dimensional data acquisition unit 3, it is determined to be a human body. As a result, it is possible to automatically shift to the subsequent processing, and the inspection can be performed efficiently. Further, since the extraction unit 10 can reduce the amount of data used for the processing by extracting the data related to the surface shape of the subject H from the three-dimensional measurement data, the subsequent processing (eg, various image processing, state detection unit). The state detection (calculation) by 4 and the detection of the center line by the median line detection unit 11) can be efficiently performed.

The extraction unit 10 may perform a process of deleting background data from at least one of the three-dimensional measurement data and the image data before extracting the data relating to the surface shape of the subject H from the three-dimensional measurement data. For example, the extraction unit 10 may estimate from the three-dimensional measurement data that the portion at least a predetermined distance with respect to the surface of the back of the subject H is the background data, and delete the portion. For example, when the approximate distance between the three-dimensional data acquisition unit 3 and the subject H is known in advance, this distance can be used as the above-mentioned predetermined distance. Further, the extraction unit 10 may perform image processing such as noise reduction processing such as filtering and processing for changing contrast and brightness on at least one of the three-dimensional measurement data and the image data. The measuring device 1 may not be provided with the extraction unit 10, and the extraction unit 10 may be provided in an external device of the measuring device 1. For example, the measuring device 1 may perform various processes using the data processed by the extraction unit 10 in the above-mentioned external device.

The median line detection unit 11 detects the median line on the back of the subject H based on the three-dimensional measurement data. The median line is a straight line extending vertically (vertical direction, height direction) from the crown of the subject H, and is a center line in the left-right direction (width direction) of the subject H. In the following description, the direction parallel to the median line is appropriately referred to as the median line direction. This median line is used, for example, as a reference for evaluating the back of the subject H by dividing it into left and right. The median line detection unit 11 detects the median line from, for example, the width (length in the left-right direction) of the back part based on the outline of the back part of the back part of the subject H described above. For example, the median line detection unit 11 acquires the width at each position of the back of the subject H based on the outline of the back of the subject H described above, and for example, the position of 1/2 of the width (the center in the width direction of the back). Position) is connected to form the median line. The median line detected by the median line detection unit 11 may be displayed on the display unit 5.

The method by which the median line detection unit 11 detects the median line on the back of the subject H is not limited to the above example and is arbitrary. For example, for example, since the position of the spinal column in the back of the human body is generally in a concave state (dent), the median line detection unit 11 has a concave bottom (pole) in the substantially center in the data of the uneven state of the back. A line connecting the positions of (value), or a line obtained by approximating this line with a straight line passing through the crown may be used as the median line. Further, the median line detection unit 11 may detect the median line on the back of the subject H by using the image data acquired by the image pickup unit 2. Further, the median line detection unit 11 detects the median line by superimposing the shape (image) represented by the X-ray photographed image data on the back of the subject H and the shape (image) represented by the three-dimensional measurement data. You may. For example, in order to improve the accuracy of evaluation (detection), the median line detection unit 11 may determine (detect) the median line by referring to the X-ray photographed image. Further, the median line detection unit 11 may detect the median line by superimposing the shape (image) represented by the moire image data on the back of the subject H and the shape (image) represented by the three-dimensional measurement data. For example, in order to improve the accuracy of evaluation (detection), the median line detection unit 11 may determine the median line with reference to the moire image. Further, for example, the median line detection unit 11 attaches a marker composed of a reflective tape or the like to a position indicating the spinal column of the subject H in advance, detects the position of the marker from the image captured by the image pickup unit 2, and determines the median line. You may. The measuring device 1 may not be provided with the median line detecting unit 11, and the median line detecting unit 11 may be provided in an external device of the measuring device 1. For example, the measuring device 1 may perform various processes using the data processed by the median line detection unit 11 in the above-mentioned external device.

The feature site designation unit 12 designates a feature site to be measured on the back of the subject H. The feature site designation unit 12 designates a feature site to be measured on the back of the subject H from, for example, three-dimensional measurement data or surface shape data extracted by the extraction unit 10. The feature site designation unit 12 automatically detects and designates a feature site to be measured, for example. For example, the feature site designation unit 12 registers data regarding the feature site to be measured in advance in the storage unit 16, and detects the feature site based on the data. The feature site designation unit 12 performs a process of estimating each site on the back of the subject H based on, for example, three-dimensional measurement data. For example, the feature site designation unit 12 automatically detects the position of the “7th cervical vertebra” of the subject H based on the three-dimensional data or the image data by the image pickup unit 2, with the feature site as the “7th cervical vertebra”. In the same manner as this, the feature site designation portion 12 has a "cervical spine", a "thoracic spine", a "lumbar spine", a "shoulder", a "scapula", a "lumbar", a "pelvis", a "heel", and a "knee". Each part (each area) such as is detected as a characteristic part. Each part detected by the feature part designation unit 12 may generate an image showing each part and display it by the display unit 5.

The feature site designation unit 12 may estimate each of these sites (each region) as a feature site. The feature portion designating portion 12 may estimate the positions of the waist and buttocks, and the portions may be used as a reference for twisting (distortion). In general, it can be considered that the waist and buttocks form a substantially horizontal plane, so this waist and buttocks should be used as a reference for the degree of twist (distortion) of characteristic parts such as the "7th cervical vertebra" and "shoulder". Can be done. Further, the feature portion designation unit 12 may automatically detect the feature portion to be measured based on the median line detected by the median line detection unit 11. The part of the subject H designated by the feature part designation unit 12 is not limited to the above and is arbitrary.

Further, the feature portion designation unit 12 can designate the feature portion manually designated by the operator as the feature portion to be measured. For example, an image corresponding to three-dimensional measurement data or image data is displayed on the display unit 5, and the operator selects a position on the image displayed on the display unit 5 by using an input unit 6 such as a mouse or a touch pen. do. The input unit 6 acquires the information of the feature portion designated by the user, and the feature portion designation unit 12 designates (determines) the feature portion based on this information. The characteristic sites to be measured on the back of the subject H in each state detection unit 4 will be described later.

The automatic evaluation unit 13 automatically evaluates, for example, the state of the feature portion detected by each unit of the state detection unit 4, which will be described later. The automatic evaluation unit 13 automatically evaluates the state of the feature portion detected by each unit of the state detection unit 4, for example, by comparing with a preset threshold value. Thereby, the state of the characteristic portion of the subject H can be easily grasped. As the above threshold value, for example, a value detected by each unit of the state detection unit 4 for a healthy person can be used. For example, when the value detected in each unit of the state detection unit 4 for the subject H exceeds the above threshold value, the automatic evaluation unit 13 "..." according to the difference between the detected value and the threshold value for the subject H. There is a slight distortion in the part of ... "," There is a moderate distortion in the part of ..., it seems that observation is necessary "," A severe distortion is seen in the part of ..., surgery It seems that treatment such as "I think it is necessary" may be displayed. Further, the automatic evaluation unit 13 compares the data indicating the state of the characteristic portion obtained by the past measurement with respect to the subject H and the data indicating the state of the characteristic portion obtained by the current measurement with respect to the subject H, and features. The condition of the site may be evaluated automatically. In this specification, the evaluation result of the automatic evaluation unit 13 is included in the detection result of the state detection unit 4.

The final judgment on the necessity of surgery and various treatments for body strain (eg, scoliosis) is made by a doctor or the like (eg, a specialist). Further, the measuring device 1 may not be provided with the automatic evaluation unit 13, and the automatic evaluation unit 13 may be provided in an external device of the measuring device 1. For example, in the above-mentioned external device, the automatic evaluation unit 13 may automatically evaluate the state of the feature portion using the data indicating the state of the feature portion obtained by the measuring device 1.

Next, the state detection unit 4 will be described. The state detection unit 4 detects the state of the feature portion designated by the feature portion designation unit 12 based on the three-dimensional data acquired by the three-dimensional data acquisition unit 3. The state detection unit 4 of the present embodiment detects the distortion of the spinal column. The state detection unit 4 includes, for example, a first spinal column detection unit 4a and a second spinal column detection unit 4b. The state detection unit 4 may detect a plurality of items (shoulder, scapula, lumbar region, lower body, pelvis, foot) related to the distortion of the back of the subject H.

The first spinal column detecting unit 4a detects the uneven state of the body surface in the left-right direction of the subject H as the state of the characteristic portion. 8 (A) to 8 (D) are diagrams for explaining the first spinal column detection unit 4a. FIG. 8A is a diagram showing a characteristic site to be measured in the first spinal column detection unit 4a. The processed image based on the three-dimensional data of FIG. 8A is displayed on, for example, the display unit 5. The first spinal column detection unit 4a sets, for example, a characteristic site to be measured at a predetermined portion R1 from the cervical spine to the crotch in the direction of the median plane, and in this predetermined portion R1, the left and right peaks with the midline as a boundary. Information indicating the height difference of the position (hereinafter referred to as height difference information) is calculated.

FIG. 8B is a diagram showing the shape of the body surface of the subject H on the plane orthogonal to the midline. In FIG. 8B, the reference numeral ML is the median line, the reference numeral PE1 is the peak on the left side with respect to the median line ML (eg, maximum), and the reference numeral PE2 is the peak on the right side with respect to the median line ML (eg, maximum). Very small). The first spinal column detection unit 4a is, for example, the height of a predetermined portion R2 in a plane orthogonal to the median plane in one of the left and right regions having the median plane as a boundary line (eg, the left region). The difference between the maximum value (height of the peak PE1) and the minimum value (height of the peak PE2) in the other region (eg, the right region) is calculated as the height difference h. The height difference h is an example of the above height difference information. Further, the first spinal column detection unit 4a calculates the angle θ1 at which the straight line L1 passing through the peak PE1 and the peak PE2 intersects the horizon HL. The angle θ1 is an example of the above-mentioned height difference information.

In addition, the first spinal column detection unit 4a quantitatively detects the degree (level) of distortion of the spinal column in the left-right direction of the subject H. The first spinal column detection unit 4a has, for example, left and right peaks with respect to the median line ML as shown in FIG. 8B at each of a plurality of positions in the direction of the median line in the portion R1 shown in FIG. 8A. For example, the angle θ1 is calculated as the height difference information of the position. FIG. 8C is a diagram showing the distribution of the angle θ1 calculated by the first spinal column detection unit 4a in the direction of the median plane. The image of FIG. 8C is displayed, for example, on the display unit 5. In FIG. 8C, the vertical axis is the position in the direction of the median line, and the horizontal axis is the angle θ1. The angle θ1 on the horizontal axis is positive (+) when the height decreases from left to right as in the straight line L1 in FIG. 8 (B), and negative (-) when the opposite is true. The value.

Further, the first spinal column detection unit 4a calculates the maximum value and the minimum value at the angle θ1 indicating the height difference of the peak position in the portion R1, and sets the absolute value of the maximum value and the absolute value of the minimum value. Is calculated as the "curvature". This "curvature degree" is a value that quantitatively indicates the degree of lateral distortion of the spinal column of the subject H. By using the "curvature degree" calculated by the first spinal column detecting unit 4a, for example, the degree of lateral distortion of the spinal column of the subject H can be evaluated easily and accurately.

In the example shown in FIG. 8C, the maximum value of the positive angle (+ angle) is indicated by the arrow B, and the minimum value of the negative angle (−-angle) is indicated by the arrow A. In FIG. 8A, the arrow A corresponds to the portion of the line AA, and the arrow B corresponds to the portion of the line BB. The AA line and the BB line are superimposed on the actual image and / or the image based on the three-dimensional data by the image pickup unit 2 as the detection result of A of the first spinal column detection unit, and the display unit 5 Is displayed in. Further, as shown in FIG. 8D, the first spinal column detection unit 4a determines the uneven state of the body surface on the AA line (indicated by the reference numeral A) and the uneven state of the body surface on the BB line. It is output as a detection result (indicated by reference numeral B).

FIG. 9 is a diagram for explaining the second spinal column detection unit 4b. FIG. 9A is a diagram showing a characteristic site to be measured in the second spinal column detection unit 4b. The image of FIG. 9A is displayed, for example, on the display unit 5. The second spinal column detecting unit 4b detects the uneven state of the body surface in the anteroposterior direction (dorsoventral direction) of the subject H as the state of the characteristic site. The second spinal column detection unit 4b quantitatively detects, for example, the degree of anterior-posterior distortion in the spinal column of subject H. The second spinal column detection unit 4b sets, for example, a characteristic portion to be measured on the back portion R3 of the subject H, and detects an uneven state of the body surface in this characteristic portion. The portion R3 is, for example, a portion corresponding to a line connecting the center positions in the width direction of the back of the subject H. The uneven state of the body surface of the portion R3 reflects the position of the spinal column in the anterior-posterior direction. Therefore, the second spinal column detecting unit 4b can detect the strain in the anterior-posterior direction in the spinal column by detecting the uneven state of the body surface of the portion R3.

FIG. 9B is a diagram showing an example of the detection result of the second spinal column detection unit 4b. The image of FIG. 9B is displayed on the display unit 5, for example. In FIG. 9B, the horizontal axis is the position of the body surface in the direction of the midline, and the horizontal axis is the position of the body surface in the front-back direction. The second spinal column detection unit 4b outputs, for example, the distribution of the position of the body surface in the anteroposterior direction with respect to the position of the body surface in the direction of the midline as a detection result. Reference numeral L2 in FIG. 9B indicates a line corresponding to the vertical direction of the subject. This distribution is used, for example, to evaluate the warp of the spine in the anterior-posterior direction. The characteristic portion of the second spinal column detection unit 4b does not have to be the portion R3 of the center line of the back of the subject H, and may be, for example, a portion parallel to the median plane selected from the back of the subject H.

As described above, the measuring device 1 of the present embodiment can easily and accurately detect the distortion of the spinal column of the subject H. Further, since the measuring device 1 can detect the strain in the spinal column of the subject H in the left-right direction, it can detect that the subject H has scoliosis. Further, since the measuring device 1 can detect the strain in the spinal column of the subject H in the anterior-posterior direction, it can detect that the subject H has kyphosis or kyphosis. Such a measuring device 1 can be suitably used for screening for scoliosis in school examinations, detection of scoliosis in hospitals / clinics, follow-up before and after scoliosis surgery, and the like.

The first spinal column detection unit 4a and the second spinal column detection unit 4b described above detect the state using, for example, an image of the subject H in a stationary state and three-dimensional data, but the subject H performs a predetermined operation. The evaluation may be performed comprehensively using the moving image of. It should be noted that at least one of the first spinal column detection unit 4a and the second spinal column detection unit 4b may not be present.

Returning to the description of FIG. 2, the input unit 6 receives input of various operation commands from the user. As the input unit 6, for example, an input device such as a keyboard, a mouse, a button, a joystick, and a touch panel can be used.

The storage unit 16 stores (stores) various programs and various data necessary for operating the computer device CP. As the storage unit 16, for example, a storage device such as a hard disk or a flash memory can be used.

The display unit 5 displays various information. For example, the display unit 5 includes an actual image Im1 acquired by the imaging unit 2 shown in FIG. 5, an image Im2 showing three-dimensional data, a detection result of the state detection unit 4, an evaluation result of the automatic evaluation unit 13, and a measurement device 1. Information on the back of the subject H other than the operation unit 15 that performs the operation, information on the operation of the measuring device 1, the actual image Im1, the image Im2 showing the three-dimensional data, and the detection result D1 of the state detection unit 4 (eg, midline ML (eg, midline ML). (See FIG. 8A))) and the like are displayed. As for the actual image Im1, an image including the center line 31a described above is displayed.

The display of the display unit 5 is controlled by the display control unit 14. The display control unit 14 causes the display unit 5 to display the information to be displayed on the display unit 5 as described above. As the display unit 5, for example, a display device such as a display, a liquid crystal monitor, or a touch panel can be used. Further, the display unit 5 may display the three-dimensional data of the subject H or the like as a three-dimensional image using polygons, wire frames, or the like. Further, the viewpoint of the three-dimensional image may be switched by operating a button or a pointing device.

FIG. 10 is a diagram showing a display example by the display unit. As shown in FIG. 10, the display unit 5 has an actual image Im1 acquired by the image pickup unit 2 under the control of the display control unit 14, an image Im2 showing three-dimensional data, a detection result D1 of the state detection unit 4, and a measurement date / time D2. , Subject H's name D3, subject H's identification number (ID) D4, operation menu M1 (operation unit 15), information I about the back of subject H, evaluation results of the above-mentioned automatic evaluation unit 13 (not shown), and the like. indicate. The display unit 5 can display these information in real time.

For example, the display unit 5 displays the actual image Im1 and the image Im2 showing the three-dimensional data side by side. For example, the display unit 5 displays the actual image Im1 and the image Im2 showing the three-dimensional data side by side in the same size. Further, the display unit 5 displays the center line 31a (left and right center lines and the upper and lower center lines) superimposed on the actual image Im1.

The detection result D1 of the state detection unit 4 is the information indicating the detection result D1 of the state detection unit 4 indicating the detection result of the state detection unit 4 (first spinal column detection unit 4a, second spinal column detection unit 4b). For example, in the example shown in FIG. 10, the display unit 5 uses the detection result D1 of the state detection unit 4 in the direction of the median line at an angle θ1 calculated by the first spinal column detection unit 4a shown in FIG. 8 (C). The image Im3 showing the distribution and the “curvature” D5 are displayed. In this way, the display unit 5 can display the detection result D1 of the state detection unit 4 side by side on the actual image Im1 and the image Im2 showing the three-dimensional data. In the present embodiment, the display unit 5 detects the uneven state of the body surface in the line AA shown in FIG. 8D and the unevenness state of the body surface in the line BB, and is shown in FIG. 9B. It is also possible to display the distribution of the position of the body surface in the anteroposterior direction with respect to the position of the body surface in the direction of the median line.

The information I regarding the back of the subject H is arbitrary as long as it is the information regarding the back of the subject H. For example, in the example shown in FIG. 10, the information I about the back of subject H is the median line ML. The information I regarding the back of the subject H includes information indicating each part detected by the characteristic part designation unit 12.

Further, the operation menu M1 is used as an operation unit 15 for performing various operations of the measuring device 1. The operation menu M1 is displayed as a button on the display unit 5, for example. In the example shown in FIG. 10, the operation menu M1 is displayed as a button for performing operations of "save", "play / stop", "comparison", "print", "load", "setting display", and "end". Will be done. For example, "save" performs an operation of saving the acquired image data and three-dimensional data. "Play / stop" performs an operation of switching between displaying the image Im1 and the image Im2 in real time and displaying the stored data by playing back the stored data. "Comparison" is an operation of comparing a plurality of data. "Print" is an operation to print out the displayed image. "Setting display" is an operation to display the settings. “Reading” is an operation of reading various data (eg, actual image, three-dimensional data) stored in the storage unit 16 and displaying the data on the display unit 5. "Exit" is an operation to terminate the application. In this way, when the display unit 5 displays the operation unit 15, the user can easily operate the operation unit 15. The operation unit 15 is an example, and the operation unit 15 shown in FIG. 10 is not limited thereto. For example, although not shown in the figure, the operation unit 15 of the present embodiment can change the scale of each image.

As described above, in the present embodiment, the display unit 5 displays the actual image Im1, the image Im2 showing the three-dimensional data, and the detection result D1 of the state detection unit 4, so that the measurement result can be easily grasped. .. Further, since the display unit 5 displays the actual image Im1, the image Im2 showing the three-dimensional data, and the detection result D1 of the state detection unit 4 in real time, the measurement result can be grasped more quickly and more easily.

Further, since the display unit 5 displays the above-mentioned actual image Im1 and the image Im2 showing the three-dimensional data side by side, the measurement result can be easily grasped. Further, since the display unit 5 displays the actual image Im1, the image Im2 showing the three-dimensional data, and the detection result D1 of the state detection unit 4 side by side, the measurement result can be grasped more easily.

Further, since the display unit 5 displays the above-mentioned real image Im1 and the image Im2 showing the three-dimensional data side by side, the state (measurement state) of the subject H when the three-dimensional data is acquired can be more easily measured by the real image Im1. Can be grasped. Further, in this case, it is possible to confirm whether or not the imaging position of the imaging unit 2 is normal at the time of measurement. Further, in this case, it is usually difficult to identify the subject H only from the image showing the three-dimensional data, but the subject H can be identified by the actual image Im1.

Further, since the display unit 5 displays the left-right center line and the upper and lower center lines of the center line 31a on the actual image Im1, the image pickup position (imaging range) by the image pickup unit 2 when the image or three-dimensional data is acquired. ) Can be easily confirmed. In this case, at the time of measurement, it is possible to easily confirm and grasp whether or not the imaging position of the imaging unit 2 is normal, for example, whether or not the imaging unit 2 is tilted. Further, when the image Im1 has the left and right center lines, the inclination of the subject H with respect to the left and right center lines can be easily grasped.

The display mode of the display unit 5 is not limited to the examples shown in FIGS. 10, 11 and the like, and is arbitrary. For example, the display unit 5 does not have to display the actual image Im1, the image Im2 showing the three-dimensional data, and the detection result D1 of the state detection unit 4 in real time. Further, for example, the display unit 5 may not display the actual image Im1 and the image Im2 showing the three-dimensional data side by side, or may not display them so as to have the same size. Further, the display unit 5 does not have to display the left and right center lines and the upper and lower center lines of the center line 31a on the actual image Im1.

Further, the measuring device 1 includes an output unit (not shown) that outputs various data (eg, various detection results (detection data)) to the outside. Examples of the output unit include a printer, a data output device (a data output interface such as a USb interface and a network interface), and the like.

Next, the measuring method according to the present embodiment will be described based on the operation of the measuring device 1 described above. The following description is an example of the measurement method according to the present embodiment, and the measurement method according to the present embodiment is not limited to this. 11 and 12 are flowcharts of the measurement method according to the embodiment.

In this measurement method, the back of the subject H is imaged in step S1. For example, as described above, the imaging unit 2 images the back of the subject H. The image acquired by the image pickup unit 2 is stored in the storage unit 16 and is processed later.

Subsequently, in step S2, three-dimensional data of the back of the subject H is acquired. For example, as described above, the three-dimensional data acquisition unit 3 acquires the three-dimensional data of the back of the subject H. The three-dimensional data acquired by the three-dimensional data acquisition unit 3 is stored in the storage unit 16 and is processed later.

In step S3, the extraction unit 10 extracts the surface shape data of the subject H from the three-dimensional measurement data. For example, in step S31 of step S3, the extraction unit 10 determines whether or not the three-dimensional measurement data includes the data of the human body. For example, the extraction unit 10 determines whether or not the three-dimensional measurement data includes the human body data by performing pattern matching or the like between the three-dimensional measurement data and the three-dimensional shape data of the human body prepared in advance.

When the extraction unit 10 determines that the three-dimensional measurement data does not include the human body data (step S31; No), the process returns to step S1 and the back of the subject H is imaged. When the extraction unit 10 determines that the three-dimensional measurement data includes the data of the human body (step S31; Yes), noise is removed or reduced from the three-dimensional measurement data in step S32. For example, the extraction unit 10 removes noise from the three-dimensional measurement data by processing such as filtering.

In step S33, the extraction unit 10 deletes the background data from the three-dimensional measurement data. For example, the extraction unit 10 estimates a portion where the distance from the three-dimensional data acquisition unit 3 is farther than a preset predetermined distance as the background, and removes the data corresponding to the background.

Subsequently, in step S34, the extraction unit 10 extracts the outline of the human body portion. For example, the extraction unit 10 detects the edge of the human body portion. For example, the extraction unit 10 extracts the outline of the subject H by detecting the outline of the object represented by the three-dimensional measurement data or the image data. The edge of the image is detected, and the outline of the back of the subject H is acquired. In step S35, the extraction unit 10 extracts the data of the human body part. For example, the extraction unit 10 extracts the data of the inner portion of the outline of the subject H as the surface shape data from the three-dimensional measurement data. It is arbitrary whether or not to perform steps S31 to S35.

In step S4, the median line detection unit 11 detects the median line on the back of the subject H from the surface shape data extracted by the extraction unit 10. It is optional whether or not step S4 is performed.

In step S5, the feature site designation unit 12 designates a feature site to be measured on the back of the subject H from the surface shape data extracted by the extraction unit 10. It is optional whether or not step S5 is performed.

In step S6, the state detection unit 4 detects the state of the designated feature portion based on the three-dimensional data. In step S61 shown in FIG. 12 (A), the strain of the spinal column is detected. For example, in step S62, the first spinal column detecting unit 4a detects the distortion of the spinal column in the left-right direction of the subject as the state of the characteristic site with respect to the spinal column of the subject designated as the characteristic site based on the three-dimensional data. (See FIG. 8). In step S62, the second spinal column detecting unit 4b detects the distortion of the spinal column in the anterior-posterior direction of the subject H as the state of the characteristic site for the spinal column of the subject designated as the characteristic site (based on the three-dimensional data). See FIG. 9).

Subsequently, in step S7 shown in FIG. 12B, the automatic evaluation unit 8 automatically evaluates the state of the characteristic portion detected by the state detection unit 4. It is optional whether or not step S8 is performed.

Subsequently, in step S8, an image showing a real image and three-dimensional data is displayed. For example, as described above, the display unit 5 displays the actual image Im1 and the image Im2 showing the three-dimensional data. At this time, as described above, the display unit 5 may display the actual image Im1, the image Im2 showing the three-dimensional data, and the detection result D1 of the state detection unit 4. Further, the display unit 5 may display the actual image Im1, the image Im2 showing the three-dimensional data, and the detection result D1 of the state detection unit 4 in real time. Further, the display unit 5 may display the above-mentioned actual image Im1 and the image Im2 showing the three-dimensional data side by side. Further, the display unit 5 may display the actual image Im1, the image Im2 showing the three-dimensional data, and the detection result D1 of the state detection unit 4 side by side. The display unit 5 may display the left and right center lines and the upper and lower center lines of the center line 31a on the actual image Im1.

As described above, the measuring device 1 and the measuring method of the present embodiment can easily grasp the measurement result.

The technical scope of the present invention is not limited to the embodiments described in the above-described embodiments. One or more of the requirements described in the above embodiments and the like may be omitted. Further, the requirements described in the above-described embodiments and the like can be appropriately combined. In addition, to the extent permitted by law, the disclosure of all documents cited in the above-mentioned embodiments and the like shall be incorporated as part of the description in the main text.

Regarding the display of the measurement result, a process of emphasizing the unevenness of the body surface based on the three-dimensional measurement data may be performed to make it easier for the operator or the doctor to grasp the unevenness state. Further, the unevenness of the body surface based on the three-dimensional measurement data may be appropriately colored and displayed so that the operator or the doctor can more easily grasp the unevenness state.

For example, the state detection unit 4 of the above-described embodiment has described an example in which the first spinal column detection unit 4a and the second spinal column detection unit 4b are described, but the state detection unit 4 is not limited to this, and is optional. be. For example, as described in the international application PCT / JP2015 / 082887 by the inventors of the present application, the state detection unit 4 detects the inclination of the left and right shoulders with respect to the midline of the back of the subject H based on the three-dimensional data. Alternatively, the strain of the left and right shoulder blades of the subject H may be detected, the strain of the pelvis of the subject H may be detected, and the marker is placed at a desired position on the back of the subject H. , The position and height of the portion where the sign is provided in the subject H may be detected.

1 ... Measuring device 2 ... Imaging unit 3 ... Three-dimensional data acquisition unit 4 ... State detection unit 4a ... First spinal column detection unit (state detection unit)
4b ... Second spinal column detection unit (state detection unit)
5 ... Display unit 6 ... Input unit 8 ... Automatic evaluation unit 9 ... State detection unit 10 ... Extraction unit 11 ... Median line detection unit 12 ... Feature site designation unit 13.・ ・ Automatic evaluation unit 14 ・ ・ ・ Display control unit 15 ・ ・ ・ Operation unit 16 ・ ・ ・ Storage unit 31 ・ ・ ・ Reference unit 31a ・ ・ ・ Center line 33 ・ ・ ・ Positioner CP ・ ・ ・ Computer device CU ・ ・・ Control unit PU ・ ・ ・ Processing unit S ・ ・ ・ Kinect sensor Sa ・ ・ ・ RGB camera (imaging unit)
Sb: Infrared laser light emitting unit (3D data acquisition unit)
Sc: Infrared camera for measurement (3D data acquisition unit)
Im1 ・ ・ ・ Actual image (image)
Im2 ... Image (image showing 3D data)
M1 ・ ・ ・ Operation menu (operation unit)
D1 ... Detection result of the state detection unit

The present invention relates to a measuring device.

The measuring device according to the aspect of the present invention is a measuring device provided with a positioner that supports the subject at the time of measurement, and images the back of the subject supported by the positioner to detect the distortion of the spinal column of the subject. It is set to be tilted with respect to the direction, and is provided with a support portion that supports the subject in a state of being tilted with respect to the vertical direction by giving the subject weight at the time of measurement.

Claims (7)

An imaging unit that captures the back of the subject and an imaging unit
A 3D data acquisition unit that acquires 3D data on the back of the subject,
A state detection unit that detects the state of the characteristic portion of the back based on the three-dimensional data, and a state detection unit.
A measuring device including a real image by the imaging unit, a processed image based on the three-dimensional data, and a display unit that displays the detection result of the state detection unit. The measuring device according to claim 1, wherein the state detecting unit detects the strain of the spinal column of the subject as the state of the characteristic portion. The measuring device according to claim 1 or 2, wherein the display unit displays a contour line image as a processed image based on the three-dimensional data. The measuring device according to any one of claims 1 to 3, wherein the display unit displays the actual image and the processed image side by side in the same size. The measuring device according to any one of claims 1 to 4, wherein the display unit displays the left and right center lines and the upper and lower center lines superimposed on the actual image captured by the image pickup unit. The measuring device according to any one of claims 1 to 5, wherein the display unit displays an operating unit that operates each part of the measuring device. Imaging the back of the subject and
Acquiring 3D data on the back of the subject and
To detect the state of the characteristic part of the back based on the three-dimensional data,
A measurement method including displaying an actual image by an imaging unit and a processed image based on the three-dimensional data on a display unit.

Images