JP2017015445A - Measurement method and measurement program by image processing - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a measurement method for attaching a mark to an object to be measured to perform image processing of a real image including the mark, and for calculating a measurement value related to the object to be measured.SOLUTION: A measurement method by image processing includes steps of: storing real size information by using either a target mark 30 or a reference mark 40 as a mark for correspondence ratio calculation; acquiring image data including the target mark and the reference mark; detecting the target mark and the reference mark from the image data; acquiring the pixel size information of the detected mark for correspondence ratio calculation; calculating a correspondence ratio between the pixel size and real size of the image data on the basis of the pixel size information and the real size information; and calculating and outputting a real gap between the reference mark and the target mark on the basis of a pixel gap calculated from the position information of the target mark and the position information of the reference mark and the correspondence ratio.SELECTED DRAWING: Figure 2

Description

  The present invention is based on image processing configured to capture a measurement object and a mark including an actual size mark in measurement such as survey in the field of construction and civil engineering, and obtain a measurement value from the image data. The present invention relates to a measurement method and a measurement program.

  Conventionally, in the field of construction and civil engineering, various measurements have been performed, such as measuring the strength of the ground before building the building and displacement monitoring measuring the deformation and distortion of structures such as tunnels and bridges. Yes. These measurements are very important for ensuring the safety of workers during construction and for safety management of buildings after completion of construction.

  As an example of such measurement, there is an intrusion test performed to investigate the strength of the ground when designing and constructing a civil engineering building structure. The penetration test is a test in which a rod-shaped member with a generally conical resistor attached to the tip is pushed into the ground, and the data used as an index of the strength of the ground is measured to determine the penetration resistance. There are a dynamic penetration test that measures by driving and a static penetration test that measures by gradually penetrating or rotating the resistor into the ground manually or by weight.

  As dynamic penetration tests, there are standard penetration tests, simple penetration tests, cone penetration tests, etc. Although the equipment used and measurement amount are different, the hammer (weight) is dropped and the resistor is penetrated by a certain amount. There is no change in the measurement method itself of measuring the required number of hits and the amount of penetration when hitting a predetermined number of times. In addition, as a static penetration test, for example, there is a Swedish sounding test that is often used for investigation of residential ground, and the amount of penetration of the resistor when the weight of the weight to be placed is increased and the resistance to which the weight is attached Measure the number of revolutions when the body penetrates a certain amount. These penetration tests are properly used depending on the type of structure to be constructed and the object to be measured.

  At the site where the penetration test is performed, for example, a predetermined position on the circumferential surface of the rod (300 mm from the ground in the case of a home run) is marked with a chalk, and one worker manually winds the rope. By dropping the hammer that was lifted by this, other workers confirmed the amount of rod penetration while counting the number of hits and wrote it down, and a report was created based on these values. For this reason, human error such as wrong count or wrong writing may occur.

  In order to prevent a human error, a measurement value may be obtained by performing an intrusion test using an apparatus provided with a measuring means. As a measurement control device for performing a penetration test, for example, Japanese Patent Application Laid-Open No. 2008-139140 “Simple Dynamic Cone Penetration Test Device” is disclosed, and includes a frame 12, a guide rod 16, a cone 18, and a knocking block 20. A drive hammer 22, a drive hammer moving means 24, an engagement / disengagement means 26, a movement amount detector 44, and an impact number detector 46. The drive hammer moving means 24 is capable of moving the drive hammer 22 up and down and dropping. The movement amount detector 44 detects the amount of movement of the guide rod 16 in the longitudinal direction relative to the frame 12, that is, the amount of penetration of the cone 18 that is pushed into the ground, and outputs a detection signal. 46 is a simple dynamic code which detects the number of times the drive hammer 22 strikes the knocking block 20 and outputs a detection signal. Down penetration test apparatus 10 has been proposed.

JP 2008-139140 A

  The “simple dynamic cone penetration test device” described in Patent Document 1 includes a movement amount detector and a hit number detector, and can output the movement amount and the hit number as a detection signal. It is possible to prevent accuracy and reduce human error. Moreover, if these detection signals are output to a personal computer wirelessly, time and labor are not required for wiring connection. However, in such a configuration, a movement amount detector and an impact number detector having an output unit for outputting a detection signal from the sensor and the sensor, a recording device for inputting the output detection signal, and the like are necessary. Therefore, there is a problem that the cost is increased and it takes time and labor to check and set the operation in the field. Further, not only the transportation and storage of the apparatus is expensive, but also maintenance of devices such as sensors is necessary.

  The present invention has been developed to solve such problems. That is, an object of the present invention is to mark a measurement object (or recognize the measurement object itself as a mark) when performing measurement in the field of architecture and civil engineering, and obtain image data of an actual image including this mark, A measurement method by image processing that enables calculation of a measurement value (for example, a movement amount of the measurement object) related to the measurement object by performing arithmetic processing based on the size information (physical quantity information) of the mark; To provide a measurement program.

  The measurement method using image processing according to the present invention provides target mark detection data for detecting a detection target mark corresponding to a target mark attached to a movable target from image data when performing measurement in the field of architecture and civil engineering. Any one of the step of storing, the step of storing the reference mark detection data for detecting the detection reference mark corresponding to the reference mark attached to the stationary reference object from the image data, and the target mark or the reference mark One of them as a corresponding ratio calculation mark, storing the actual size information, obtaining image data including the target mark and the reference mark, and based on the target mark detection data, from the image data Detecting the detection target mark; Acquiring position information of the detection target mark in a pixel coordinate system, detecting the detection reference mark from the image data based on the reference mark detection data, and detecting the detected reference mark Obtaining the position information in the pixel coordinate system, obtaining the pixel size information of the detected correspondence ratio calculation mark, and the pixel size information and the actual size information of the correspondence ratio calculation mark. Based on the step of calculating the correspondence ratio between the pixel size and the actual size of the image data, the pixel interval calculated from the position information of the detection target mark and the position information of the detection reference mark, and the correspondence ratio, To calculate the actual distance between the reference mark and the target mark. And a step of outputting, characterized in that.

  The measurement method using image processing according to the present invention is a target mark detection method for detecting a detection target mark corresponding to a target mark attached to a movable target from image data when performing measurement in the field of architecture and civil engineering. A step of storing data, a step of storing reference mark detection data for detecting a detection reference mark corresponding to the reference mark attached to the stationary reference object from the image data, the target mark and the reference mark Storing any one of them as a corresponding ratio calculation mark, storing the actual size information, acquiring the previous image data and the subsequent image data including the target mark and the reference mark, Based on the target mark detection data, the detection tag is determined from the image data. A step of detecting a get mark; a step of acquiring position information of each detected target mark in a pixel coordinate system; and the detection reference mark from each image data based on the reference mark detection data. A step of detecting, a step of obtaining positional information of each detected detection reference mark in a pixel coordinate system, a detection correspondence corresponding to the corresponding ratio calculation mark detected from the previous image data or the rear image data Obtaining the pixel size information of the ratio calculation mark, the pixel size and the actual size based on the pixel size information of the detection correspondence ratio calculation mark and the actual size information of the correspondence ratio calculation mark; And calculating the corresponding ratio, and the detection in the previous image data The actual movement of the target mark based on the position information of the target mark and the position information of the detection target mark, the position information of the detection target mark and the position information of the detection target mark in the post-image data, and the corresponding ratio And calculating and outputting the quantity.

The measurement method by image processing according to the present invention is a target mark detection method for detecting a detection target mark corresponding to a target mark attached to a measurement object from image data when performing measurement in the field of architecture and civil engineering. A step of storing data; a step of storing actual size information of the target mark; a step of acquiring pre-image data and post-image data that includes the target mark, and the target mark detection data; Based on the image data, detecting the detection target mark from each image data, obtaining the position information of each detected detection target mark in a pixel coordinate system, from the previous image data or the subsequent image data , Pixel size information of detected detection target mark Obtaining a corresponding ratio between the pixel size and the actual size based on the pixel size information of the detected target mark and the actual size information of the target mark; and Calculating and outputting an actual movement amount of the target mark based on the position information of the detection target mark, the position information of the detection target mark in the post-image data, and the corresponding ratio. It is characterized by.
The method may further comprise a step of specifying and outputting a moving direction of the target mark based on position information of the detection target mark in the previous image data and position information of the detection target mark in the subsequent image data.
It is also desirable that the target mark in a state attached to the measurement target is photographed to acquire image data, and the target mark detection data is created from the image data.

  In addition, the measurement method using image processing according to the present invention provides a detection correspondence corresponding to the correspondence ratio calculation mark from image data obtained by photographing a real image including the correspondence ratio calculation mark when performing the penetration test measurement. Test video shooting that detects a ratio calculation mark, acquires pixel size information thereof, and calculates a corresponding ratio based on the pixel size information of the detection corresponding ratio calculation mark and the actual size information of the corresponding ratio calculation mark Each detection target corresponding to the target mark is acquired from the image data including a preparation stage, a target mark attached to the movable measurement object, and a reference mark attached to the stationary measurement object. The position information is acquired by detecting the mark and each detection reference mark corresponding to the reference mark, and the detection target mark and the detection reference of the image data Based the position information of the over-click on the corresponding ratio, and a test measurement step for calculating and outputting the real distance of the target marks, characterized in that.

  In addition, the measurement method using image processing according to the present invention provides a detection correspondence corresponding to the correspondence ratio calculation mark from image data obtained by photographing a real image including the correspondence ratio calculation mark when performing the penetration test measurement. Test video shooting that detects a ratio calculation mark, acquires pixel size information thereof, and calculates a corresponding ratio based on the pixel size information of the detection corresponding ratio calculation mark and the actual size information of the corresponding ratio calculation mark Obtaining pre-image data and post-image data moving back and forth in time, including a preparation stage, a target mark attached to a movable measurement object and a reference mark attached to an immovable measurement object, and each image data Then, each detection target mark corresponding to the target mark and each detection reference mark corresponding to the reference mark are detected to acquire position information, and the previous image data is acquired. Test measurement that calculates and outputs the actual amount of movement of the target mark based on the position information of the detection target mark and the detection reference mark, the position information of the detection target mark and the detection reference mark of the subsequent image data, and the corresponding ratio A measurement method using image processing, characterized by comprising:

In addition, the measurement method using image processing according to the present invention provides a detection correspondence corresponding to the correspondence ratio calculation mark from image data obtained by photographing a real image including the correspondence ratio calculation mark when performing the penetration test measurement. Test video shooting that detects a ratio calculation mark, acquires pixel size information thereof, and calculates a corresponding ratio based on the pixel size information of the detection corresponding ratio calculation mark and the actual size information of the corresponding ratio calculation mark Each of the detection target marks corresponding to the target mark is acquired from the respective image data by acquiring the pre-image data and the post-image data including the target mark attached to the moving measurement object in the preparation stage. Is detected to obtain position information, and the position information of the detection target mark of the previous image data and the position information of the detection target mark of the subsequent image data On the basis of the corresponding ratio, and a test measurement step which calculates and outputs the actual amount of movement of the target mark, it is characterized.
The measurement object may be a penetration member in the penetration test, and the actual movement amount may be a penetration amount.
The measurement object may be a striking member in the penetration test, and the actual movement amount may include at least one of a penetration amount, a lifting amount, and a rebound amount.
The front image data and the rear image data are one image data in moving image data, and the front image data and the rear image data are based on position information of the detection target mark acquired in real time from the moving image data. The state of the measurement object can be determined and extracted.

  The present invention also provides an image processing measurement program characterized by causing a computer to execute the above-described image processing measurement method.

  According to the measurement method and the measurement program based on image processing of the present invention, an apparatus for performing measurement is unnecessary, so that the operation is easy and the cost can be reduced. Moreover, since a measured value can be obtained only by photographing, the work can be completed in a short time. Since the measurement value can be obtained without contact, it is effective for measurement in a dangerous place and measurement in a place where constant monitoring is required.

1 is a front view of a penetration test apparatus used in a standard penetration test. FIG. It is a schematic explanatory drawing explaining the condition at the time of performing a standard penetration test using the measuring method by the image processing which concerns on Example 1. FIG. FIG. 2 is a block diagram schematically illustrating an example of a hardware configuration of an information processing terminal for performing a measurement method by image processing in the first embodiment. It is a bitmap image obtained by arithmetically processing a video including a reference mark and converting it into a black and white binary image. It is a schematic explanatory drawing explaining an example of the auxiliary line which assists the setting of an imaging | photography range. 3 is a flowchart of a measurement method using image processing according to the first embodiment. 6 is a flowchart illustrating a test video shooting preparation setting stage according to the first embodiment. 3 is a flowchart showing a test measurement stage of Example 1. 3 is an example of a display screen that displays a measurement result for one hit in Example 1. FIG. It is an example of the display screen which displays the penetration test measurement result of Example 1. FIG. 6 is a graph schematically showing a change in position of each detection mark in the pixel coordinate system of Example 1. 10 is a flowchart of a measurement method using image processing according to the second embodiment. 10 is a flowchart showing a test measurement stage of Example 2. 6 is a graph schematically showing a change in position of a detection mark in a pixel coordinate system of Example 2. It is the schematic which shows the state which attached | subjected the measurement mark to the anti-gate arch of the tunnel.

  Hereinafter, the present invention will be described with reference to the drawings, and will be described with reference to a standard penetration test in a penetration test which is an example of a measurement survey in the fields of architecture and civil engineering.

First, the outline of the standard penetration test will be described.
In the standard penetration test, the drive hammer 14 (see FIG. 1; hereinafter referred to as the hammer 14) is automatically dropped to allow the resistor sampler 11 (see FIG. 1) to penetrate the ground, and the N value or penetration indicating the strength of the ground. It is a test aimed at collecting samples to measure the amount of soil and to determine the hardness and tightness of the ground and to grasp the soil layer structure. Since other penetration tests are not intended for sampling, instead of the sampler 11, a cone-shaped cone is used as the resistor in the simple penetration test and the cone penetration test, and a threaded cone is used as the resistor in the Swedish sounding. ing.

<Standard penetration testing equipment>
In the standard penetration test, a penetration test apparatus 10 as shown below is used. Here, the penetration test apparatus 10 will be described with reference to the drawings. FIG. 1 shows a front view of a penetration test apparatus 10 used in a standard penetration test. In the standard penetration test, first, a test hole having a predetermined depth and a hole diameter is excavated by the boring device 20 (the drill hole diameter needs to be recorded), and a substantially cylindrical casing 21 for preventing collapse is inserted into the inner wall surface. Thereafter, the sampler 11 is inserted into the test hole. In addition, the upper end portion of the casing 21 is provided with a protruding portion 21a that protrudes outward so as to be locked to the ground surface.

  As shown in FIG. 1, the penetration test apparatus 10 supports a sampler 11, a rod 12 to which the sampler 11 is attached at the lower end, a striking apparatus 13 attached to the upper side of the rod 12 for driving the sampler 11, and these. A support mechanism 18 is provided.

  The rod 12 is a substantially cylindrical member made of metal having a uniform cross section. The rod 12 is installed in the test hole so as to extend in the vertical direction after the sampler 11 is detachably attached to the lower end portion thereof. The sampler 11 is a substantially cylindrical member made of steel, and has a hollow truncated cone shape whose tip is cut off from the tip of the cone. Although not shown, the sampler 11 includes a shoe, a split barrel that can be divided into two, and a coupling, and is configured so that a sample collected in the hollow portion can be taken out.

  The striking device 13 includes a free-falling hammer 14, a knocking head (anvil) 15 that receives the free-falling hammer 14, a guide rod 16 that guides the hammer 14 to the knocking head 15, and the hammer 14 is pulled up to a predetermined height. And a hammer dropping mechanism 17 having a function of allowing it to fall freely. The guide rod 16 is a substantially columnar member having substantially the same diameter as the rod 12. The knocking head 15 has a substantially cylindrical portion (main body portion 15 a) whose cross section is larger than that of the rod 12 and the guide rod 16. The lower end side is the upper end of the rod 12, and the upper end side is the lower end of the guide rod 16. It is fastened to each. The hammer 14 is a cylindrical weight having a through hole formed in the center that is larger than the outer diameter of the guide rod 16 and smaller than the outer diameter of the main body portion 15a of the knocking head 15, and has a mass of approximately 63.5 kg ( 63.5 kg ± 0.5 kg). The hammer 14 is attached to the guide rod 16 so as to be movable up and down. The hammer 14 freely falls from above and collides with the knocking head 15 to allow the rod 12 and the sampler 11 to penetrate into the ground.

  The hammer dropping mechanism 17 is a semi-automatic dropping mechanism that lifts the hammer 14 and freely drops it from a height of approximately 760 mm (760 mm ± 10 mm). As shown in FIG. 1, a hammer rope 17b to which a hammer 14 and a catcher 17c are attached is hung on a pulley 17a supported by a support mechanism 18, which is a tower, and is wound up by a cone pulley 17d. The catcher 17c is configured such that when the hammer 14 reaches a height of approximately 760 mm, a claw (not shown) that grips the hammer 14 is automatically detached, and the hammer 14 freely falls from a height of approximately 760 mm. The knocking head 15 is hit.

  There are also a manual drop method and a cone pulley method (not shown). For example, in the tonbi method, a mark is made in advance at a position of 760 mm from the upper surface of the knocking head 15, and the hammer 14 is visually lifted to the mark position with a hammer rope hung on the pulley, and then manually operated. Pull the rope for the rope attached to it and let it fall freely.

<Standard penetration test method>
A standard penetration test is performed using the penetration test apparatus 10 described above, and the content of the test is as follows.
(1) Recording of self-sink amount First, the sampler 11 attached to the rod 12 is lowered to the bottom of the test hole, and when the striking device 13 is attached, the self-sink amount (rod self-sink amount and hammer self-sink amount) is recorded.
(2) Preliminary hammering After that, the hammer 14 is freely dropped from a height of approximately 760 mm, and preliminary hammering (including self-sinking) is performed from the bottom of the test hole to 150 mm.
(3) Final strike In the final strike after the preliminary strike, the hammer 14 is freely dropped from a height of approximately 760 mm and the knocking head 15 is hit until the sampler 11 penetrates 300 mm. Here, every time the knocking head 15 penetrates 100 mm, the number of hits is recorded, and the total number of hits required to penetrate 300 mm is taken as the N value of the test section. If the penetration amount does not reach 300 mm at a predetermined number of strikes (usually 50), the penetration amount relative to the number of strikes is recorded. If the penetration amount per strike exceeds 100 mm, the penetration amount is recorded. To do. Further, in the preliminary hit and the main hit, if the cumulative penetration amount is less than 10 mm for 50 hits, the penetration is impossible.
(4) Sample collection After the N-value measurement is completed, the sampler 11 is pulled up to the surface of the earth to observe the collected sample, and a representative sample is stored in a transparent container. In addition, 50 mm post-coating may be performed in order to reliably collect a sample of the main production.
(5) Preparation of test result report Based on the measured value (N value or penetration amount with respect to the number of hits, etc.) recorded on site, a report describing a predetermined item is prepared.

  Next, embodiments of the present invention will be described by way of example with reference to the drawings. Here, a measurement method and a measurement program by image processing in the fields of architecture and civil engineering will be described by taking as an example a case where it is applied to the standard penetration test, which is one of the penetration tests described above.

  FIG. 2 is a schematic explanatory diagram illustrating a situation when a standard penetration test is performed using the measurement method based on image processing according to the first embodiment of the present invention. In FIG. 2, for convenience, the hammer dropping mechanism 17 and the support mechanism 18 of the striking device 13 are omitted, and the penetration test apparatus 10 is shown in a simplified manner.

  As shown in FIG. 2, the measurement method by image processing according to the present embodiment has a penetration test apparatus 10 installed on a test hole, and a movable movable object that is an investigation target (target) in the penetration test is used as a reference. A stationary reference object is used as a measurement target (measurement target object), and a first target mark 31, a second target mark 32 (hereinafter referred to as a target mark 30 as appropriate), and a reference mark 40 are attached thereto. . In addition, an image including the target mark 30 and the reference mark 40 (hereinafter, referred to as measurement marks 30 and 40 as appropriate) is imaged in a range where the moving target mark 30 can be tracked while satisfying a predetermined resolution (resolution). Therefore, the information processing terminal 50 is installed so that it can be adjusted and fixed to a desired position, height, and angle. In this embodiment, a tripod is used as an example of the installation apparatus, but the present invention is not limited to this. When the information processing terminal 50 is equipped with a gyro function, the information processing terminal 50 is inclined with respect to the gravity line in the test video shooting preparation setting stage (S2) to be described later. It is desirable to install so that there is no.

  In the present embodiment, as shown in FIG. 2, the hammer 14, the knocking head 15, and the casing 21 are the measurement objects. The hammer 14 that is a striking member is provided with a first target mark 31 for measuring the lifting amount and the rebound amount of the hammer 14, and the knocking head 15 has a second target mark for measuring the penetration amount. A target mark 32 is attached. A reference mark 40 is attached to the protruding portion 21a of the casing 21 fixed to the test hole (ground). Since the reference mark 40 does not move even when the hammer 14 is hit, it can be used as a reference for specifying the position of the moving target (target mark 30). Note that the rebound amount is a rebound amount that collides with the knocking head 15 and rebounds (rebounds) when the hammer 14 is automatically dropped, and is a measure that indicates the hardness of the ground. In this embodiment, the rebound amount is measured for the first rebound in one hit, but the total number of rebounds in each hit and each rebound amount may be measured.

  The target marks 30 (31, 32) are strip-shaped seal members E1, E2 (hereinafter, appropriately referred to as seals E1, E2) that are attached so as to surround the periphery of the target (hammer 14, knocking head 15). The seal E1 and the seal E2 have different widths, and each target can be identified by the difference in width when wound around the target. The seals E1 and E2 themselves constitute the target marks 31 and 32. The reference mark 40 is a trapezoidal seal member E4 (hereinafter, appropriately referred to as a seal E4) that is affixed to a location facing the information processing terminal 50 on the outer wall surface of the protruding portion 21a. 30.

  Although details will be described later, according to the measurement method based on image processing according to the present embodiment, a video image captured by the information processing terminal 50 including the first target mark 31, the second target mark 32, and the reference mark 40 is displayed. Image data is acquired, and based on actual size (physical quantity) information (hereinafter referred to as actual size information as appropriate) of at least one of the first target mark 31, the second target mark 32, and the reference mark 40. By calculating the image data, the actual interval (actual interval) of any two of the first target mark 31, the second target mark 32, and the reference mark 40, the first target mark 31 and the second target mark Measurement values such as the actual movement amount (actual movement amount) of the target mark 32 can be calculated.

  In the present embodiment, the second target mark 32 is attached to the knocking head 15. However, as described above, the sampler 11, the rod 12, and the knocking head 15, which are penetration members, are integrally formed by hitting the hammer 14. Since it penetrates into the ground, it may be attached to a member other than the knocking head 15. Further, the reference mark 40 is not limited to the casing 21 as long as it does not move in the penetration test. For example, the reference mark 40 may be attached to the support mechanism 18 or the like, or an object with the reference mark 40 is newly installed. You may do it. Note that the center of the reference mark 40 is located on the same straight line as the centers of the first target mark 31 and the second target mark 32 as viewed from the information processing terminal 50 from the viewpoint of the calculation processing speed of the image data. Is desirable.

<Hardware configuration of information processing terminal>
FIG. 3 is a block diagram schematically showing an example of the hardware configuration of the information processing terminal 50 for implementing the measurement method by image processing in the present embodiment. The information processing terminal 50 has an image display function, a camera function, an application software use function, and the like in order to make a program for executing a measurement method by image processing function. Specifically, the information processing terminal 50 has a display unit (display screen) 55 that can display an image on a liquid crystal screen and the like, and an imaging device equipped with a CCD sensor, a CMOS sensor, or the like for taking a photograph or moving image. The device 57 and the like are mounted, and by starting the application software, it is possible to acquire image data including the measurement marks 31, 32, and 40 of the measurement object and perform arithmetic processing. The information processing terminal 50 is, for example, a tablet terminal, a smartphone, a laptop computer, or the like having a camera function with excellent portability possessed by an operator, and a worker (user) conducts an investigation (for example, a penetration test) at the site. Used when.

  As shown in FIG. 3, the information processing terminal 50 includes a CPU (Central Processing Unit) 51, a ROM (Read Only Memory) 52, a RAM (Random Access Memory) 53, an auxiliary storage device 54, a display unit 55, An operation unit 56, an imaging device 57, a USB I / F 58, a network communication unit 59, and a sound output unit 60 are provided. The system bus interconnects the CPU 51, ROM 52, RAM 53, auxiliary storage device 54, display unit 55, operation unit 56, imaging device 57, USB I / F 58, network communication unit 59, and sound output unit 60. Each configuration will be described below.

  The CPU 51 performs overall control of the entire information processing terminal 50 and executes various arithmetic processes. The ROM 52 stores various programs necessary for the operation of the information processing terminal 50 such as an OS (Operating System). The RAM 53 functions as a temporary storage area in arithmetic processing and the like. The RAM 53 temporarily stores image data captured from a CCD or the like and digitized and input to an image processor (image processing engine).

  The auxiliary storage device (recording medium) 54 is a rewritable nonvolatile memory (EEPROM or the like) for storing system programs, application programs, various data, and the like. Image data (still image data, moving image data, moving image data with sound) processed by the image processor after imaging, and a measurement value calculated by calculation processing are stored in the auxiliary storage device 54 as appropriate.

  The display unit (display screen) 55 that forms the core of the display function is configured by a display using a liquid crystal display panel, an organic EL panel, or the like. When the operation system or application software is executed under the control of the CPU 51, It displays various information such as data input screens, calculation processing results, data files such as images, photos, and texts in the auxiliary storage device 54, and results of calling data stored in various databases.

  The operation unit 56 is configured by, for example, using the display unit 55 as a multi-touch display (touch screen / touch panel). A signal based on a user operation is input to the CPU 51, and an input operation can be performed by touching the display screen with a fingertip. Note that part or all of the operation unit 56 may be configured independently of the display unit 55 (in FIG. 3, the operation unit 56 is configured to be independent).

  The imaging device 57 that forms the core of the camera function is for realizing a shooting function of a general digital camera, and includes an imaging unit 57a, an image processing unit 57b, a sound collecting unit 57c, a sound processing unit 57d, and sound reproduction. Part 57e and the like. Under the control of the CPU 51, it is activated by execution of the application software for photographing, and a real image of the space in the rear direction of the display screen (display unit) 55 is captured by the real image (the imaging device 57 is captured by automatic focus and automatic exposure, for example). Image data such as still image data, moving image data, moving image data with sound, etc. from the actual image at the moment or continuous time based on the input operation to the operation unit 56 by the user. Can be generated and stored as a digital image in the RAM 53 or / and the auxiliary storage device 54 in the information processing terminal 50.

  The imaging unit 57a is for imaging a subject, and includes a lens (optical system) and an imaging device that receives light from the subject coming through the lens and obtains an image signal. The image processing unit 57b is for generating image data. For example, if a CCD sensor (CCD) is used as an image sensor, A / D conversion for digitizing an image signal from the CCD is performed. And an image processor for image processing (for example, color tone correction, resolution change, etc.) of the image data from the CCD driver, and a captured image signal output from the imaging device of the imaging unit 57a. The image processing is performed. The sound collection unit 57c collects sound with a microphone, and the collected sound is processed by the sound processing unit 57d. The sound reproduction unit 57e reproduces stored sound data under the control of the CPU 51. When the sound-added moving image data is reproduced by the sound reproducing unit 57e, the sound attached to the sound-added moving image data can be reproduced in synchronization with the display of the moving image and output from the sound output unit 60.

  The information processing terminal 50 also includes a USB I / F 58 and a network communication unit 59. The USB I / F 58 is an interface for connecting an external connection device such as a USB device. The network communication unit 59 is an interface for enabling wireless network connection to a mobile communication network compliant with, for example, IMT2000. For example, a communication interface compatible with the W-CDMA system is used. The information processing terminal 50 can transmit and receive data to and from other information processing apparatuses via the network by the network communication unit 59.

  Therefore, for example, measurement data (photographed image data and measurement values obtained during or after the calculation processing), and a survey report created based on the measurement data, USB I / F 58 or network The data can be transmitted to an external device (printer or the like) connected by the communication unit 59 and output. Further, in another information processing apparatus, it is possible to further perform calculation processing on the measurement data and output the result. Of course, the auxiliary storage device 54 in which the measurement data is stored can be appropriately taken out and another information processing device can be inserted.

  Although not shown, the information processing terminal 50 also has a GPS function, a timer function, a tilt detection function, and the like. The GPS function is realized by a GPS antenna and a GPS receiver that has map information and detects the current position, and the timer function is realized by a real time clock (RTC) for generating a time measuring function. When a video is shot by the GPS function and the timer function, the image data is stored in association with information indicating the shooting location and the shooting date and time. The tilt detection function is realized by incorporating a gyro sensor, and can detect the tilt state of the information processing terminal 50. In addition, it is good also as a structure which has a near field communication function. The short-range wireless communication function is, for example, a short-range wireless communication unit such as a communication interface compatible with Bluetooth (registered trademark), and directly communicates with other devices wirelessly without using a mobile communication network. be able to. Note that it is not an indispensable condition for the information processing terminal to have the gyro sensor and the short-range wireless communication function in carrying out the measurement method by image processing of the present invention.

  An application program for realizing the measurement method by image processing according to the present embodiment is stored in the auxiliary storage device 54. In addition to the application software stored in the auxiliary storage device 54 that performs its function by being executed by hardware such as the CPU 51, the program is a logic circuit that can perform an equivalent function. Because of this concept, it is possible to substitute such a logic circuit in place of the application software stored in the auxiliary storage device 54. The application program may be stored in a computer-readable recording medium such as a portable recording medium such as a CD-ROM, a DVD disk, or a USB memory, and the CPU 51 reads the application program from the auxiliary storage device 54. This is executed by deploying to the RAM 53.

  As shown in FIG. 3, the auxiliary storage device 54 includes a detection database including a first target mark detection database 71, a second target mark detection database 72, and a reference mark detection database 74, and an actual size database 80. The penetration test type database 90 and the like are stored, and are referred to as appropriate when an application program for realizing the measurement method by image processing according to the present embodiment is executed. Hereinafter, each database will be described.

<First target mark detection database>
The first target mark detection database 71 is for detecting the first target mark 31 attached to the hammer 14 which is a survey target (target) and a movable measurement target from the generated image data (bitmap format). This is a dictionary database that stores a large number of sample data. By detecting the first target mark 31 using this dictionary database, the position and size (pixel size) of the first target mark 31 in the pixel coordinate system can be specified.

  Here, the pixel coordinate system is obtained by capturing bitmap-format image data (bitmap image) in a two-dimensional coordinate system. A bitmap image is an image expressed as a set of rectangular pixels (pixels) having color information, which is the smallest unit of an image, arranged vertically and horizontally. In the pixel coordinate system, for example, the coordinate origin (0, 0) is the upper left of the screen, the horizontal direction (horizontal direction) is the X axis, and the vertical direction (vertical direction) is the Y axis. This is expressed in coordinates as in y), and the details will be described later. Note that the arithmetic processing may be performed using another coordinate system instead of the pixel coordinate system.

<Second target mark detection database>
The second target mark detection database 72 detects, from the generated image data (bitmap format), the second target mark 32 attached to the knocking head 15 that is a survey target (target) and is a movable measurement target. This is a dictionary database in which a large number of sample data are accumulated. By detecting the second target mark 32 using this dictionary database, the position and size (pixel size) of the second target mark 32 in the pixel coordinate system can be specified.

<Reference mark detection database>
The reference mark detection database 74 accumulates a large number of sample data for detecting the reference mark 40 attached to the casing 21 that is a stationary measurement object as a reference from the generated image data (bitmap format). It is a dictionary database. By detecting the reference mark 40 using this dictionary database, the position of the casing 21 and its size (pixel size) in the pixel coordinate system can be specified.

<Actual size database>
The actual size database 80 is a database that stores information related to physical quantities (actual sizes) of the measurement marks 30 and 40. Specifically, the actual size information 84 of the reference mark 40 which is a correspondence ratio calculation mark and the actual size information 81 and 82 of the seal width of the target marks 31 and 32 are stored. Here, the correspondence ratio calculation mark is a measurement mark used when calculating the ratio between the actual size and the number of pixels in the pixel coordinate system in the image data (hereinafter referred to as the correspondence ratio). In this embodiment, the reference mark 40 is selected as the correspondence ratio calculation mark. However, the present invention is not limited to this, and at least one of the first target mark 31, the second target mark 32, and the reference mark 40 is selected. Thus, the correspondence ratio may be calculated. The actual size information 81 and 82 of the target mark 30 is referred to when detecting the detected target mark 30P from the image data, and details thereof will be described later.

<Detection of measurement mark and calculation of corresponding ratio>
Here, before describing the penetration test type database 90, the detection method of the reference mark 40 will be mainly described as the detection method of the measurement marks 30 and 40. An example of the calculation method of the correspondence ratio and the resolution when the reference mark 40 is used as the correspondence ratio calculation mark will be described in order with reference to the drawings, and then the calculation executed based on the image data. Processing will also be described. FIG. 4 is a bitmap image obtained by performing arithmetic processing on the actual image of the reference mark 40 and converting it into a monochrome binary image. The bitmap image is image data generated so that the reference mark 40 can be recognized by performing processing by an image processor on the image signal from the image sensor.

<Reference mark detection method>
The reference mark 40 corresponds to the reference mark 40 in the bitmap image as shown in FIG. 4 by extracting a part of the bitmap image and comparing it with each sample data in the reference mark detection database 74. To be detected as a pixel group (hereinafter referred to as a detection reference mark 40P as appropriate). Then, the position and size of the detection reference mark 40P in the pixel coordinate system P (hereinafter, appropriately referred to as a position or the like) are specified. In the bitmap image shown in FIG. 4, there are four detection reference marks 40P, P ₁ (536, 1871), P ₂ (549, 1871), P ₃ (553, 1886), and P ₄ (532, 1886). It is a trapezoidal pixel group surrounded by pixels, and is located in the range of 1871 pixels to 1886 pixels in the Y-axis direction, and its height corresponds to 16 pixels.

<Compatibility ratio, resolution calculation method>
The reference mark 40 is a correspondence ratio calculation mark, and the actual size information 84 is stored in the actual size database 80. Therefore, the correspondence ratio is calculated from the size (number of pixels) of the detection reference mark 40P detected as described above and the actual size information 84 in the actual size database 80. Specifically, the number of pixels in the height direction (size in the Y-axis direction) of the detection reference mark 40P is 16 pixels. For example, the actual size information of the corresponding ratio calculation mark stored in the actual size database 80 84, when the actual length (actual length) of the reference mark 40 in the height direction is 32 mm, the size (number of pixels in the height direction) of the detection reference mark 40P, From the size of the reference mark 40 (the actual length in the height direction), it is calculated that one pixel corresponds to 2 mm. Further, it is calculated from this correspondence ratio that the resolution in this measurement is 2 mm. In this way, the corresponding ratio indicating the ratio of the actual size to one pixel based on the size (number of pixels) of the detection reference mark 40P in the pixel coordinate system and the corresponding actual size information 84 in the actual size database 80. And the resolution can be calculated. In this embodiment, the correspondence ratio is calculated based on the size of the correspondence ratio calculation mark in the height direction. However, the present invention is not limited to this, and the correspondence ratio is appropriately compared with the number of pixels. As long as it can be calculated.

<Target mark detection method>
The first target mark 31 and the second target mark 32 differ from the reference mark 40 in that the size in the horizontal direction in the real image differs depending on the diameter of the wound hammer 14 and the knocking head 15. Therefore, when the first target mark 31 is detected, first, the first target mark 31 in the bitmap image is based on the actual size information 81 in the actual size database 80 and the correspondence ratio calculated as described above. The number of pixels in the width direction (Y-axis direction) of the pixel group (see FIG. 5A, hereinafter referred to as “detected first target mark 31P”) is calculated. Then, after the sample data in the first target mark detection database 71 is narrowed down in advance based on the number of pixels, the pixel corresponding to the first target mark 31 in the bitmap image is collated with these sample data. The group is detected, and the position in the pixel coordinate system P is specified. Since the second target mark 32 is substantially the same as the first target mark 31, the details are omitted, but the second target mark narrowed down based on the actual size information 82 in the actual size database 80 and the corresponding ratio. A pixel group corresponding to the second target mark 32 in the bitmap image (see FIG. 5A, hereinafter referred to as a detection second target mark 32P as appropriate) is detected by collating with the sample data in the detection database 72. Then, the position in the pixel coordinate system P is specified.

<Calculation processing based on one image data>
The pixel coordinates of each of the detection first target mark 31P, the detection second target mark 32P, and the detection reference mark 40P (hereinafter referred to as detection marks 31P, 32P, and 40P as appropriate) from one image data by the arithmetic processing as described above. The position (coordinates) in the system P and the corresponding ratio are derived. Therefore, in one image data, the detection mark positions such as the distance between the detection marks (31P, 32P, 40P) corresponding to two of the measurement marks 31, 32, 40 (for example, the center points of the detection marks). If the number of pixels is calculated at a predetermined interval for recognizing the image, the actual interval (actual interval) between the two marks can be calculated using the correspondence ratio. In the present embodiment, since the reference mark 40 affixed to the non-animal is also a measurement target, the actual position (actual position) of the hammer 14 and the knocking head 15 that are movable objects can be grasped using this reference position. .

<Calculation processing based on two image data>
Further, the actual amount of change of the first target mark 31 and the second target mark 32 that fluctuate based on two pieces of image data (hereinafter, referred to as pre-image data and post-image data as appropriate) taken before and after the time. (Actual change amount) can also be calculated. For example, from the values (number of pixels or actual interval) calculated from the positions of the detection first target mark 31P and the detection reference mark 40P in the previous image data and the positions of the detection first target mark 31P and the detection reference mark 40P in the subsequent image data. Based on the difference from the calculated value (number of pixels or actual interval), the actual change amount of the first target mark 31 can be calculated. Here, since the reference mark 40 does not move, the actual change amount is the actual movement amount (actual movement amount) of the first target mark 31 (hammer 14). Therefore, although details will be described later, by tracking the change in the actual movement amount of the hammer 14, it is possible to analyze the movement (state) of the hammer 14 and determine whether or not there is a hit. The lift amount can be calculated from the data, and the rebound amount can be calculated from the image data before and after the rebound. Similarly, when the detection first target mark 31P described above is replaced with the detection second target mark 32P, the actual change amount is the actual movement amount of the second target mark 32 (knocking head 15 or the like), and the collision ( (Penetration) The penetration amount of the knocking head 15 or the like can be calculated from the image data before and after.

<Penetration test type database>
Here, the description returns to the penetration test type database 90 stored in the auxiliary storage device 54.
The penetration test type database 90 stores basic data (such as test contents) related to each penetration test method in association with each type of penetration test. The basic data includes data related to the measurement method (the amount of lifting of the hammer 14 when hitting, the total penetration amount (upper limit total penetration amount) and the total number of hits that are the upper limit values for preliminary hits, final hits and post hits, respectively) Data on (total upper limit number of impacts), data on cumulative penetration amount (upper limit cumulative penetration amount) and cumulative impact number (upper limit cumulative impact number) that are the upper limit required from the start to completion of test measurement, necessary Data related to resolution), data related to measurement items, data related to the format of measurement result output (template format such as a survey report), and the like. The basic data is referred to when assisting the shooting range setting before the test measurement (test video shooting), setting the timing of the end of the test measurement (test video shooting), and creating the investigation report. In the case of the standard penetration test, as described above, the upper limit penetration amount of the preliminary hit is 150 mm, the upper limit penetration amount of the main strike is 300 mm, the upper limit number of hits is 50 times, and the upper limit penetration amount of the post strike is 50 mm. The upper limit cumulative penetration amount is 500 mm. The upper limit cumulative number of hits is the total number of preliminary hits and final hits, which is 50 times.

<Display of auxiliary lines>
The shooting range setting is assisted in a test video shooting preparation setting step S2 (described later) before test video shooting, and the target (hammer 14 and knocking head 15) is set between the start and end of test video shooting. This assists the operator in setting the shooting range of the imaging device 57 so that the target mark 30 and the reference mark 40 of the reference object (casing 21) can be kept within the shooting range. Specifically, an auxiliary line indicating a photographing range necessary for the test measurement is displayed as an upper layer of the actual image displayed as a finder on the display screen 55 of the imaging device 57.

  FIGS. 5A and 5B are schematic explanatory diagrams for explaining an example of auxiliary lines for assisting in setting the photographing range. FIG. 5A shows a pixel coordinate system P, and FIG. 5B shows a display screen 55 of the information processing terminal 50. 5, for the sake of convenience, the penetration test apparatus 10 is omitted, and only the measurement marks 31, 32, 40 and the detection marks 31P, 32P, 40P are shown. The auxiliary line is, for example, a rectangular enclosing frame F as shown in FIG. 5, and the operator can use the information processing terminal 50 as necessary so that the enclosing frame F appears on the display screen 55 without being missing. The position and height, the zoom state of the imaging device 57, and the like are adjusted as appropriate, and preparation settings for appropriate test measurement (test video shooting) are performed.

  The positions of the upper frame F1 and the lower frame F2 of the surrounding frame F are the three detections detected as described above (see paragraphs 0053 to 0056) from the image data of the captured real image in the test video shooting preparation setting step S2. It is calculated based on the positions of the marks 31P, 32P, 40P, the corresponding ratio, the lifting amount of the hammer 14 and the upper limit cumulative penetration amount in the test method determined in the test method selection / determination step S1 described later. Based on the correspondence ratio calculated by the correspondence ratio calculation mark, the lifting amount pixel number Pa corresponding to the lifting amount of the hammer 14, the upper limit cumulative penetration pixel number Pb corresponding to the upper limit cumulative penetration amount, or a predetermined preliminary penetration amount. A corresponding preliminary penetration amount pixel number Pc is calculated. The preliminary penetration amount is preliminarily provided assuming that the cumulative penetration amount exceeds the upper limit cumulative penetration amount.

  In this embodiment, as shown in FIG. 5A, the position of the upper frame F1 of the surrounding frame F is calculated based on the position of the detection mark 31P and the lifting amount pixel number Pa, and the lower frame of the surrounding frame F The position of F2 is a position calculated on the basis of the position of the detection mark 32P, the upper limit cumulative penetration amount pixel number Pb, the preliminary penetration amount pixel number Pc, and the position of the detection mark 40P. It assists to image the changing target 30 (detection marks 31P, 32P) so that it can be tracked without moving the information processing terminal 50. When the detection marks 31P, 32P, and 40P cannot be detected from the image data, or the interval Pd between the detection mark 32P and the detection mark 40P is smaller than the total number of the upper limit cumulative penetration amount pixel number Pb and the preliminary penetration amount pixel number Pc. In some cases, it is desirable to emit a warning sound for alerting or display an error on the display screen 55 as appropriate.

  The left frame F3 and the right frame F4 of the enclosing frame F make it easy for the operator to recognize the upper frame F1 and the lower frame F2 of the enclosing frame F on the display screen 55, and the actual images of the measurement marks 31, 32, and 40. Is displayed in order to guide it to the center of the display screen 55 in the short direction. The positions of the left frame F3 and the right frame F4 of the surrounding frame F are, for example, a predetermined range (m × 2) with the center line L of the display screen 55 as the center, as shown in FIG. When the measurement marks 31, 32, and 40 are guided so as to enter the frame F and the range of the pixel coordinate system to be collated to detect them is limited to the central portion of the display screen 55, The calculation processing speed is increased. The range (m × 2) is set in advance based on the horizontal size of the three assumed measurement marks 31, 32, and 40.

  When displaying the auxiliary line (enclosed frame) F, resolution resolution information indicating whether or not the resolution of the actual image satisfies the resolution necessary for the test measurement is also displayed based on the calculated correspondence ratio. Specifically, for example, by changing the color of the enclosing frame F, a case where it is satisfied and a case where it is not satisfied is displayed. When the zoom function is used, the resolution is displayed by calculating the corresponding ratio based on the zoom state.

  The operator makes preparations for shooting using the auxiliary line (enclosed frame) F displayed on the display screen 55, and confirms the state after setting to an appropriate shooting state. And test measurement can be appropriately performed by starting test measurement, holding it. Note that the image data is subjected to arithmetic processing in real time, and when the photographing preparation state of the information processing terminal 50 is changed, the arithmetic processing as described above is performed again, and new auxiliary lines F and resolution information are displayed.

<Set timing of test measurement end>
The timing setting of the test measurement is based on the acquisition of the measurement value necessary for the test measurement based on the penetration amount and the upper limit value of the number of hits in the test method determined in the test method selection / determination stage (S1) described later. It is determined whether or not the measurement has been completed and the operator can set the measurement to be completed at an appropriate timing. Specifically, when either the cumulative penetration amount or the cumulative number of hits reaches or exceeds the upper limit value (the upper limit cumulative penetration amount or the upper limit cumulative hit count), for example, that fact is displayed on the display unit 55. The operator is prompted to end the test measurement. In addition, if either the total penetration amount or the total number of hits reaches or exceeds the upper limit value (the upper limit total penetration amount or the upper limit total hit count) at each of the preliminary hit, final hit, and post-attack stages, For example, the fact is displayed on the display unit 55 to notify the operator that the next step is to be performed.

<Measurement Method by Image Processing of the Present Invention Using the System>
Next, a measurement method using image processing according to the present invention using the present system will be described. FIG. 6 is a flowchart of a measurement method using image processing according to the first embodiment.
This system executes a program installed in advance and includes images including measurement marks 30 and 40 attached to the measurement object (a plurality of image data (moving images) that move back and forth in time, including moving images with sound) It is possible to obtain a desired measurement value by photographing. At the time of installation, a necessary database is also stored in the auxiliary storage device 54. In order to realize such a function, this system uses the information processing terminal 50 having the above-described configuration, and as shown in FIG. 6, a test method selection / determination stage (S1), a test video shooting preparation setting stage (S2), Each of the test measurement stage (S3) and the investigation report creation stage (S4) is executed. Note that data and values necessary for executing the program are appropriately stored in the RAM 53 and the auxiliary storage device 54.

[Test Method Selection / Confirmation Stage (Step S1)]
In this stage, the test method selected by the operator (user) is determined.
An operator who wants to perform a penetration test first activates and executes the application software of the present invention, and selects the type of test method. For example, according to the guidance, a list of test method types such as a standard penetration test, a simple penetration test, a cone penetration test, and a Swedish sounding test is displayed from the designation of “selection of test method type” displayed on the display screen 55. So choose one of them. Thereafter, on the display screen 55, based on the type of the test method selected by the operator, the above-described basic data (test contents) associated therewith is read from the penetration test type database 90 and displayed. . The worker confirms the content of the displayed basic data and changes a part or all of these as necessary to determine the test method and test content (hereinafter referred to as test method, etc.). For example, in the case where the “test method” is a simple penetration test, if the penetration depth of the basic data is 30 cm, it can be changed to 20 cm by an input from the operation unit 56 of the operator. is there. The test method determined by the operator is stored in the auxiliary storage device 54.

  At this stage, a storage area for counting the number of hits and the amount of penetration is set. Specifically, according to the determined test method and test content, the penetration amount storage area for storing the total penetration amount at each strike stage and the cumulative penetration amount at all stages, the total number of hits at each strike stage, A strike counter that counts the number of cumulative strikes at each stage is created, and an initial value (for example, “0”) is set.

  At this stage, the basic data of the penetration test type database 90 includes other information necessary for creating a survey report, such as instrument information of the hammer 14 to be used, and is displayed on the display screen 55. It may be configured so that the operator can select according to the guidance provided. Further, information related to the creation of the investigation report, such as a worker list, can be registered in advance in the auxiliary storage device 54 as report creation related data (not shown) separately from the penetration test type database 90. Thus, it is also preferable to be able to select according to the guidance as in the test method described above.

[Test video shooting preparation setting stage (step S2)]
This stage is a stage in which preparations are made for appropriately taking test video images in accordance with the test method determined in the test method selection / determination stage (S1). FIG. 7 is a flowchart showing the test video shooting preparation setting stage (S2). In the test video shooting preparation setting stage (S2), the following steps S21 to S24 are executed, and the auxiliary line F that leads the test video to be shot within an appropriate range and the resolution that leads to satisfy the necessary resolution. Information is displayed on the display screen 55.

In step S21, a preparation setting shooting button is displayed.
After the test method is selected at the above test method selection stage and the test content is confirmed, guidance for starting video shooting for preparation of test video shooting and its start button (hereinafter referred to as preparation setting shooting start button) Is displayed on the screen.

In step S22, a preparation setting shooting image is acquired.
The preparation setting shooting is started by the operator's operation of the preparation setting shooting start button, the imaging device 57 is activated to display the real image on the display screen 55 as a viewfinder, and the image data of the real image is acquired.

In step S23, an auxiliary line or the like is displayed.
The image data of the real image is subjected to the arithmetic processing as described above (see paragraphs 0048 to 0062, paragraphs 0053 to 0056, etc.), and the measurement mark 40 is detected in real time as the detection mark 40P. The size is specified, and the correspondence ratio is calculated based on the number of pixels of the detection mark 40P and the actual size information in the actual size database 80. Then, the measurement marks 31 and 32 are detected as detection marks 31P and 32P based on the correspondence ratio and the like, and their position and size in the pixel coordinate system are specified. Thereafter, based on the test method determined in the test method selection / determination step S1, the calculation process as described above (see paragraphs 0059 to 0066, etc.) is performed, and the surrounding frame F which is the auxiliary line and resolution information is displayed on the display screen. 55, a shooting preparation setting confirmation button for confirming the shooting preparation setting is displayed. It should be noted that the operator adjusts the information processing terminal 50 side (such as adjusting the installation position (location, height, etc.) of the information processing terminal 50 and adjusting the use state of the zoom function) based on the display of the auxiliary line and resolution information. ) Is performed, and it is recognized that there is a change in the detection position and size of the detection mark 40P and the like, the above-described calculation process is performed again, and the surrounding frame F is newly displayed (updated).

In step S24, the shooting preparation setting is confirmed.
When the shooting preparation setting confirmation button displayed on the display screen 55 is operated by the operator, the shooting preparation setting is confirmed and the test video shooting preparation setting step (S2) is ended. At this time, information on the determined shooting preparation setting (information detected or / and calculated in step S23, for example, the positions of the detection marks 31P, 32P, and 40P when the confirm button is operated, and the calculated correspondence) The ratio and the like are stored in the same file in the auxiliary storage device 54 in which the test method determined in the test method selection / determination stage (step S1) is stored.

[Test measurement stage (step S3)]
At this stage, a penetration test video, that is, a video of a penetration test in which an operator performs a hitting action by free-falling after lifting a hammer is taken, and the image data of the shot test video is processed and measured. Is calculated, displayed, and stored together with the image data. FIG. 8 is a flowchart showing the test measurement stage (S3). In the test measurement stage (S3), the following steps S31 to S40 are executed. In step S32 to step S38 in this stage, a forced end button for forcibly ending the shooting is displayed in a small size at the corner of the display screen 55.

In step S31, a test video shooting start button is displayed.
After shooting preparation setting is completed in the floor test video shooting preparation setting stage (S2), a start button (hereinafter referred to as a test video shooting start button) for starting test measurement is displayed on the screen.

In step S32, a test video is acquired.
When the operator operates the test video shooting start button, shooting of the test video is started, the imaging device 57 is activated to display a real image on the display screen 55 as a viewfinder, and image data of the real image is acquired. The image data is provided with position data (shooting position information) of measurement points by the GPS function and measurement time data (shooting time information) by the timer function.

In step S33, a measurement mark is detected.
The obtained image data is processed in real time in substantially the same manner as described above (see paragraphs 0048 to 0056 etc.) to detect the measurement marks 31, 32, and 40 as detection marks 31P, 32P, and 40P, and these in the pixel coordinate system. Specify the position and size of. Although the measurement mark 40 attached to the casing 21 does not move at any stage, the measurement mark 31 attached with the hammer 14 is attached to the knocking head 15 in the vertical direction at this stage where the batting action is performed. The measured measurement mark 32 moves downward. Therefore, when detecting the detection marks 31P and 32P, the positions of the detection marks 31P and 32P determined in the test video shooting preparation setting stage (S2) are set as initial positions, and the test video shooting preparation setting stage (S2). By using the sample data based on the sizes of the detection marks 31P and 32P determined in step 1, the collation direction is limited to the position in the previous image data and its vertical and downward directions, thereby increasing the calculation processing speed. it can. Further, the detection mark 40P is calculated by using the position of the detection mark 40P determined in the test video shooting preparation setting stage (S2) as an initial position and collating based on the initial position and the position in the previous image data. Speed can be increased.

In step S34, it is determined whether or not there is a batting action.
The presence / absence of a striking action by the hammer 14 is determined based on a change in the position of the detected target mark 32P in temporally changing image data (pixel coordinate system P). Details of this determination will be described later (see paragraphs 0089 to 0092 etc.).

In step S35, a measured value is calculated.
When it is determined that the batting action has been performed, a predetermined batting number counter is appropriately incremented, and a display indicating that the measurement value is being calculated is displayed so that the next batting is not performed. Then, as described above (see paragraphs 0057 to 0058, etc.), two image data are extracted from the created image data and compared, and the correspondence ratio determined in the test video shooting preparation setting stage (S2) is determined. The amount of lifting of the hammer 14 (the actual free fall distance), the amount of rebound, and the amount of penetration of the knocking head 15 and the like are calculated. The method for extracting the two image data will be described later (see paragraphs 0089, 0093 to 0095, etc.).

In step S36, the value of the penetration amount storage area is updated.
If necessary, the value of the predetermined penetration amount storage area is updated to a value obtained by adding the penetration amount value calculated in S35 and stored.

In step S37, a measured value or the like for one hit is displayed.
Measurement values and the like for this hit are displayed on the display screen 55. FIG. 9 is an example of a display screen 55 that displays the result of the final hit. As shown in FIG. 9, in step S35, the hitting stage is indicated and the calculated lifting amount, rebound amount, penetration amount, and the like are displayed. In addition, the value of each strike counter and the value of each penetration amount storage area at the time of the end of this strike are displayed together with the upper limit value. These measurement values and the like are associated with time information such as display time and position information, and are stored as test measurement values in the file of the auxiliary storage device 54 described above.

In step S38, it is determined whether or not it is the timing of the strike stage / end of test measurement.
As described above (paragraphs 0059 and 0067), based on the upper limit values (upper limit total penetration amount, upper limit cumulative penetration amount, upper limit total hit count, upper limit cumulative hit count) determined in the test method selection / determination step (S1). Etc.), whether to end the current striking stage and move to the next striking stage or not to end the test measurement. When the test measurement is finished, the process proceeds to S39, and when the test measurement is continued, a display for notifying the operator so as to know whether the current hitting stage is continued or the next hitting stage is started. After displaying on the display screen 55 for a predetermined time (for example, 5 seconds), the process returns to S33, and the obtained image data is calculated. Note that an input operation means (confirmation button) indicating that the operator has confirmed the display may be provided, and the process may proceed to the next step based on the input operation.

In step S39, the test measurement result is displayed.
The final test results (measured values such as cumulative penetration amount and N value) are displayed on the display screen 55, and a test measurement end button for ending the test measurement is displayed. FIG. 10 is an example of a display screen 55 that displays the penetration test measurement result. As shown in FIG. 10, the calculated cumulative penetration amount and N value (final test measurement value) are displayed as the overall result of the penetration test.

In step S40, test data is stored.
When the operator operates the test measurement end button, shooting of the test video ends. Then, in the same file of the auxiliary storage device 54 in which the test method determined in the test method selection / determination stage (S1) is stored, image data acquired by photographing, final test measurement obtained by arithmetic processing Save the values as test data in a batch.

[Investigation report preparation stage (step S4)]
This stage is a stage in which a survey report is created based on test data stored after completion of test measurement. Specifically, based on the test method determined in the test method selection / determination stage (S1), the corresponding data and measurement values are applied to predetermined positions of the template of the survey report.

<Determining the presence or absence of batting action and extracting image data>
Here, the method for determining the presence or absence of a striking action by the hammer 14 executed in step S34 and the extraction of image data executed in step S35 will be described with reference to the drawings. FIG. 11 is a graph schematically showing an example of position changes of the center points A, B, and C of the detection marks 31P, 32P, and 40P when the batting action is performed. The horizontal axis of the graph is the elapsed time from the start of shooting the test video, and the vertical axis is the y coordinate of the pixel coordinate system P. That is, the vertical positions of the center points of the detection marks 31P, 32P, and 40P in a plurality of image data photographed before and after time are arranged in order in the X-axis direction and connected smoothly.

<Determining whether or not there is a beating action>
As shown in FIG. 11, the hammer 14 (the center point A of the detected first target mark 31P) is in contact with the knocking head 15 before the batting action is started, and the lifting operation is performed at time t _1. increases from a position a ₁ and. When removed from the catcher at the position A ₂ to time t _2, the falls freely to the position A ₁ until the time t ₃ collides with the knock head 15. Then, the knocking head 15 is penetrated into the ground by moving to the position A ₃ by the impact force until time t ₄ . Then, the hammer 14 is in rebound of the impact of the striking, the position A ₄ at time t _5, the position A _5, the time t ₇ to the time t ₆ rebounds to gradually attenuate with the position A _6, time the movement to t ₈ is stopped at the position a _3.

Knocking head 15 (the center point B of the detector the second target marks @ 32 P), the until time t ₃ when colliding hammer 14 at a position B ₁ is a position before the striking action starting position until the time t ₄ by collision Penetrate to B ₂ and stop. Casing 21 (the center point C of the detection reference mark 40P) is immobile, does not move from the position C _1.

  In the present embodiment, the presence / absence of the striking action is determined by tracking the movement of the center point B (knocking head 15) of the detected second target mark 32P in real time. When the knocking head 15 penetrates, it is determined that there has been a striking action. In addition, it is not limited to this determination method, and it can be determined by providing a determination criterion for the presence or absence of a batting action based on the position change of the detection target marks 31P and 32P due to the batting action. Further, the presence or absence of a striking action may be determined by using a striking sound generated by a collision (or by using supplementary use). In this case, for example, the sound data collected by the sound collection unit 57c is stored in a sound database (not shown) stored in the auxiliary storage device 54 in advance for the sound data or the sound comparison of the sound and the frequency of the sound. Sample data is accumulated and analyzed based on these data to determine the presence or absence of a batting action.

<Extraction of image data>
When it is determined that there has been a batting action, image data is extracted as follows in order to calculate the measurement value. First, the time that is the first peak of the y-coordinate of the center point A when the predetermined time T ₁ is traced back from the time t ₃ when the position of the center point B has changed is obtained by analyzing it by calculation processing. . Is the time t ₂ in this embodiment. In addition, the time that is the first bottom of the y coordinate of the center point A when the predetermined time T ₂ has passed from the time t ₃ when the position of the center point B has changed is obtained by analysis through arithmetic processing. In this embodiment, it is time t ₄ . Further, the time at which the y-coordinate of the center point A is the first peak after a predetermined time T ₂ is analyzed and obtained by calculation processing. In this embodiment, it is time t ₅ .

Then, the lifting amount of the hammer 14 is calculated by extracting the image data at time t _{2 and} the image data at time t ₃ . The rebound amount of the hammer 14 is calculated by extracting image data at time t ₄ and image data at time t ₅ . The penetration amount of the knocking head 15 is calculated by extracting image data at time t ₂ and image data at time t ₃ + T ₂ . Note that the time T ₁ and the time T ₂ refer to the amount of lifting of the hammer 14 in the test method or the like determined in the test method selection / determination step S1, and the time taken for the free fall before the collision and the rebound after the collision. It is a value calculated based on the time to be settled.

  By such an extraction method, the hammer 14 cannot be lifted smoothly, or an accident (for example, the hammer 14 is dropped during the lifting, or it is caught before colliding even if the catcher is removed). In the case of occurrence of a hitting action, the presence or absence of a striking action can be accurately determined, and the free fall distance (lifting amount) of the hammer 14 that is a measure of the impact force at the time of collision can be accurately measured. be able to.

As described above, the measurement method and the measurement program by image processing according to the first embodiment which is an exemplary embodiment of the present invention have been described, but the present invention is not limited to the specifically disclosed embodiment. Various modifications and changes can be made without departing from the scope of the present invention.
In the present embodiment, the correspondence ratio and the like are calculated based on the actual measurement value of the reference mark 40 and the number of pixels of the image data corresponding to the actual measurement value. Anything that uses the image data may be used. For example, in the present embodiment, when the first target mark 31 is a corresponding ratio calculation mark, the seal E1 is a belt-like seal member (seal E1) that is wound around and adhered to the peripheral surface of the hammer 14 as described above. Therefore, the correspondence ratio is calculated based on the size in the width direction (length in the vertical direction).

  Further, the target marks 31 and 32 and the reference mark 40 are not limited to the sealing members as described above, but may be any ones that have features in configuration, outline, brightness, and the like and can be detected from captured image data. For example, it is a seal member displaying an arbitrary shape or pattern, a shape displayed on the seal member, a shape of the measurement object itself, or attached to the measurement object itself by printing or surface processing. Or a light emitting member such as an LED. Further, “attach” is not limited to sticking or the like, and any means may be used as long as it can be attached to the surface of the measurement object.

  In the present embodiment, the target mark 31, the target mark 32, and the reference mark 40 are configured to have different shapes. However, the present invention is not limited to this, and the target mark 31, the target mark 32, and the reference mark 40 are attached to any of a plurality of measurement objects. What is necessary is just to be comprised so that it can identify. For example, since the vertical position relationship of the measurement object does not change during the test measurement (see FIG. 11), the target marks 31 and 32 and the reference mark 40 are detected as measurement marks having the same shape, and then based on the vertical position relationship. Then, the measurement mark of which measurement object is identified may be configured to perform the arithmetic processing. With such a configuration, it is possible to reduce the amount of sample data in the detection database and to speed up the arithmetic processing. Further, in the present embodiment, the moving direction of the measurement object is fixed, but the position of the detection mark corresponding to the measurement object is specified by coordinates (x, y), so any arbitrary Of course, not only the moving amount but also the moving direction can be calculated for the measurement object moving in the direction. In addition, when performing a Swedish sounding test that also measures the number of revolutions, in addition to the seal E1, for example, a plurality of triangular seals or the like are affixed symmetrically in a plane view to the clamp serving as a weight receiving tray. The rotation can be tracked and measured.

  In the present embodiment, it is configured to determine whether or not there is a hit from the acquired image data without dividing the test measurement shooting for each shot, and continuously shooting until all the test measurements are completed. However, for example, as shown in Example 2 to be described later, the worker operates the batting action start button and the batting action end button for each batting, and in one batting based on these input operations. You may comprise so that a measured value may be calculated. In addition, in order to inform the worker of the timing of performing the striking action in an easy-to-understand manner, it is desirable not only to display on the display screen 55 but also to output sound.

  Each stage and each step can be executed by appropriately changing the order. After displaying the test measurement result (S39), image data such as the collected sample and the sampler and rod status after the measurement are captured to obtain image data, and the test data is saved in the same file in S40. It is also possible to configure. Further, in order to ensure that the image data can be acquired, if the measurement marks 30 and 40 cannot be recognized due to an operator moving to the actual image, the operator is warned with sound or light. Is also desirable. Further, when the information processing terminal 50 has a gyro function, the detected detection is performed when the inclination state of the installed penetration test apparatus 10 is confirmed to correct the inclination, or when the penetration direction does not become the vertical direction. It is also possible to grasp the inclination state based on the position information (coordinates) of the target mark 30P and to correct the measurement value.

  According to the measurement method and measurement program based on image processing of this embodiment, image data is used, and therefore a measuring device such as a sensor is not necessary. Moreover, since the test measurement can be performed by installing an application program for detecting the marks 30 and 40 in the information processing terminal 50 carried by the user, it is not necessary to purchase an apparatus for measurement. Therefore, it is possible to reduce the cost of maintenance of the measuring instrument and purchase of the device. Since only the information processing terminal 50 is installed so that image data can be acquired, the burden of transportation and installation work is small, and a storage place is unnecessary.

  Since not only the knocking head 15 that moves due to the striking action but also the hammer 14 is acquired and imaged, the calculation processing is performed not only for the penetration amount of the knocking head 15 but also for the lifting amount and the rebound amount of the hammer 14. be able to. Even when an error occurs during work, for example, when the hammer 14 is accidentally dropped while being lifted by a predetermined amount, the lift amount of the hammer 14 can be specified and reported to the orderer.

  In Example 1, it is configured to determine the presence / absence of hitting from the acquired image data without dividing test measurement shooting for each hit, and continuously from the start of the test measurement to the end of all the test measurements. Take a picture and save it. Not only the state of the test measurement remains as a moving image, but also the evidence capability is high because position information by the GPS function and measurement date information by the timer function are added. It is possible to re-verify using the image data stored again after the test is completed, or to obtain a new analysis value by performing other arithmetic processing.

  Since the target marks 31 and 32 are belt-like seal members (seal E1 and E2) that can be attached to the hammer 14 or the like having a circular cross section as in the present embodiment, the target marks 31 and 32 are rotated by a striking operation or the like. However, it is possible to continue shooting the target marks 31 and 32 without moving the information processing terminal 50 fixed in a desired state in advance. Further, by using a strip-shaped seal member (seal E1, E2) having a predetermined width, even if it is an penetration test apparatus of a different model, it can be wound and measured, and is versatile.

  In the test video shooting preparation setting stage (S2), the correspondence ratio is calculated by the correspondence ratio calculation mark, sample data to be collated is extracted, and the detection target mark 30P is detected based on the extracted sample data. Can speed up. Further, by displaying the surrounding frame F, it is possible to assist the photographing of the test video with an appropriate photographing range and resolution. In the test measurement stage (S3), detection (collation) and measurement values are calculated based on the correspondence ratio calculated in the test video shooting preparation setting stage (S2) and the initial positions of the detected detection marks 30P and 40P. Therefore, it is possible to display the measurement values and the like instantaneously by increasing the calculation processing speed, and the operator can smoothly perform the work while checking the measurement values and the like.

  When there is an accident that causes the position of the information processing terminal 50 to move by providing the reference mark 40 as a reference position (for example, the information processing terminal 50 falls down), the operator's forced termination button The test measurement is forcibly terminated by the input operation, and the test measurement is newly performed from the test video shooting preparation setting stage (S2), so that it can be easily compared with the test data before the movement (before the forced termination) (movement) (Quantity) etc. can be calculated. If it is determined that the position of the information processing terminal 50 has moved by determining whether the position of the information processing terminal 50 has moved by the presence or absence of a change in the position of the reference mark 40 that is continuously tracked (detected), Then, it may be configured to return to the test video shooting preparation setting stage (S2).

<Modification of Example 1>
In Example 1 described above, a high evidence capability function is provided by storing, as test data, moving images that are continuously captured from the start to the end of the test. However, in the penetration test, it is only necessary to measure the N value and the penetration amount, that is, the number of hitting actions and the penetration quantity for each hitting action. Of course, it is also possible to measure the amount of penetration by acquiring data. Specifically, for example, in the test measurement stage (S3), a still image before the hitting action is taken by the operator's input operation, and after one hitting action by the operator's input operation (or hitting sound). The intrusion amount is calculated based on the image data before and after the hitting action. Also, the lifting amount is calculated based on the image data immediately before and after the lifting. And it can also comprise so that the lifting amount, penetration amount, accumulation penetration amount, accumulation hit number, etc. of the impact time may be displayed.

  Next, a measurement method by image processing and a measurement program thereof according to Embodiment 2 of the present invention will be described. In the measurement method using image processing according to the second embodiment, the processing speed is further increased by reducing the amount of arithmetic processing. In the following description, a configuration different from the first embodiment will be described, and a configuration that is basically the same as that of the first embodiment will be omitted because it is an overlapping description.

  In the second embodiment, unlike the first embodiment, a measurement mark (first target mark 31, seal E1) is attached only to the hammer 14, and this is used as a corresponding ratio calculation mark. Then, a test measurement value is calculated from the position change of the detected first target mark 31P corresponding to the measurement mark 31 in the image data photographed before and after the time. Therefore, the second target mark 32 (seal E2) and the reference mark 40 (seal E4) of the first embodiment, and the second target mark detection database 72 and the reference mark detection database 74 stored for detecting them are as follows. It is unnecessary. Further, in the actual size database 80, the actual size information of the second target mark 32 (seal E2) and the reference mark 40 (seal E4) is also unnecessary.

FIG. 12 is a flowchart of a measurement method using image processing according to the second embodiment.
In the first embodiment, a dictionary database (first target mark detection database 71) in which a plurality of sample data for detecting the first target mark 31 is stored in the auxiliary storage device 54 in advance. 2, as shown in FIG. 12, after the test method selection / determination stage (step S <b> 1), a detection database creation stage (S <b> 1 ′) for taking a real image of the first target mark 31 and creating sample data is performed. Have.

<Detection database creation stage (S1 ')>
More specifically, the first target mark 31 (seal E1) attached to the hammer 14 is photographed and its shape is taken in, for example, sample data similar to this is created, and the dictionary database. The first target mark detection database 71 is created and stored. The aspect ratio (ratio between width and length in the horizontal direction) is specified by photographing the attached real image. Therefore, the number of sample data can be reduced as compared with the first target mark detection database 71 of the first embodiment, the calculation process can be speeded up, and more accurate detection can be performed. Note that the shape of the first target mark 31 may be specified on the display screen 55 using a touch pen or the like.

  In the test video shooting preparation setting stage (S2) of the second embodiment, unlike the first embodiment, in step S23, the detected first target mark 31P is detected based on the created sample data, and the number of pixels in the width direction (Y The correspondence ratio and resolution are calculated from the size in the axial direction) and the actual size information 81 in the actual size database 80. Based on the position information of the detected first target mark 31P, the lifting amount of the hammer 14 and the upper limit cumulative penetration amount in the test method determined in the test method selection / determination step (S1), from the start to the end of test video shooting. In the meantime, the positions of the upper frame F1 and the lower frame F2 of the enclosing frame F are calculated so that the hammer 14 (or the hammer 14 and the knocking head 15) can be kept within the photographing range. The positions of the left frame F3 and the right frame F4 of the surrounding frame F are calculated from the aspect ratio specified in the first target mark detection database creation stage (S1 ′) and the number of pixels of the detected first target mark 31P. May be.

<Test measurement stage (S3 ')>
FIG. 13 is a flowchart illustrating the test measurement stage (S3 ′) of the second embodiment.
In the test measurement stage (S3 ′) of the second embodiment, the presence / absence of hitting is determined based on the input operation of the worker. Specifically, step S33 ′, step S34 ′, and step S35 ′ are executed instead of step S33, step S34, and step S35 described above. In Example 2, the batting action start button and the batting action end button operated by the worker for each batting operation are operated, and the measurement value in one batting is based on the image data acquired during these operations. Is calculated.

In step S33 ′, the operation time of the batting action start button is acquired.
In step S33 ′, a striking action start button is displayed, and by the operation of the striking action start button by the operator, time information when the button is operated is stored and a striking action end button is displayed. The worker operates the hitting action start button before starting the hitting action.

In step S34 ′, the operation time of the batting action end button is acquired.
In step S34 ′, by the operation of the hitting action end button by the operator, the time information at which the button is operated is saved, the test video is shot, and a display indicating that the measurement data is being calculated is displayed. The worker operates the batting action end button after performing the batting action once.

In step S35 ′, a calculated value is calculated.
In step S35 ′, based on the time information stored in step S33 ′ and step S34 ′, for each image data from the operation of the batting action start button to the operation of the batting action end button, the measurement mark (first target mark) ) 31 is detected as a detection mark (detection first target mark) 31P, these positions in the pixel coordinate system are specified, and a measurement value in the actual hitting action is calculated. A method for calculating the measurement value will be described later (see paragraphs 0118 to 0119).

In step S38 ′, it is determined whether or not the striking stage / test measurement has ended.
In step S38 ′, it is basically the same as in the first embodiment, and it is determined whether or not it is the timing of the striking stage / end of test measurement. However, when the test measurement is continued, the process returns to step S32 to capture the test video again.

Next, a calculation value calculation method executed in step S35 ′ of the second embodiment will be described. First, image data for calculating a measurement value is extracted.
FIG. 14 is a graph schematically showing a change in the position of the detection mark in the pixel coordinate system according to the second embodiment. The extraction of the image data in the second embodiment is basically the same as that of the first embodiment except for the method for calculating the collision time (t ₃ ) between the hammer 14 and the knocking head 15 and the method for calculating the penetration amount of the knocking head 15. In the second embodiment, only the detected first target mark 31P is detected as shown in FIG. Therefore, the change in the position of the y coordinate of the detected first target mark 31P is tracked, and the time when the value of the y coordinate becomes larger than the value A ₁ when the batting action start button is operated (time t ₀ ) (in this embodiment) , Time t ₃ ) is determined as the collision time. Further, the penetration amount is calculated as follows by extracting image data at the time of operation of the hitting action start button (time t ₀ ) and image data at the time of operation of the hitting action end button (time t ₉ ). To calculate.

  With respect to the two pieces of image data extracted as described above, changes in the position (coordinates) of the detected first target mark 31P in the pixel coordinate system P are compared. Specifically, for the detected first target mark 31P, a change amount (number of pixels) that is a difference between a position (coordinate) in the pixel coordinate system P in the previous image data and a position (coordinate) in the pixel coordinate system P in the subsequent image data. From this, the actual movement amount of the first target mark 31 is calculated based on the correspondence ratio. Here, by tracking the movement of the detected first target mark 31P, the amount of lifting and rebounding of the hammer 14, the amount of penetration of the knocking head 15, etc. (the hammer 14 is in contact with the knocking head 15 after the end of the striking action). It is possible to calculate

  As described above, the measurement method and the measurement program by image processing according to the second embodiment which is an exemplary embodiment of the present invention have been described, but the present invention is not limited to the specifically disclosed embodiment. Various modifications and changes can be made as in the first embodiment without departing from the gist thereof. In the detection database creation stage (S1 ′), by reading this as a configuration to which information (identification symbol or the like) about the test instrument such as the hammer 14 used for the first target mark 31 (seal E1) is given, For example, information on the test equipment used such as the standard (type and mass) of the device stored in the penetration test type database 90 may be obtained and used when creating a survey report.

  According to the measurement method and the measurement program by image processing of the present embodiment, there are the following effects in addition to the effects shown in the first embodiment. The calculation processing speed can be further increased by using one measurement mark and creating the sample data. In this embodiment, the test video is shot for each striking action, but the image data when the striking action end button is operated and the image data when the striking action start button is operated for the next striking action. By showing consistency, it has evidence capacity. Further, in the event of an accident such as the information processing terminal 50 falling down, it is also possible to analyze the moving action action video later.

  In addition, the measurement method and measurement program by image processing of this invention will measure not only a penetration test but the penetration amount of the foundation pile of the pile driving work in the field of civil engineering, etc., if it is necessary to measure a penetration amount. It can also be used for occasions. In the field of construction, it is also possible to monitor structures such as viaducts, bridges and tunnels under construction or after construction. FIG. 15 is a schematic view showing a state in which triangular measurement marks 33 and 41 are attached to the anti-gate arch of the tunnel. For example, image data including the measurement marks 33 and 41 is photographed at a predetermined time or a predetermined time interval. Then, appropriate calculation processing is performed, such as calculating the amount of change in the position of the measurement mark 33 (movement direction, size thereof, etc.) using the two measurement marks 41 attached to the base side of the anti-gate arch as a reference (reference line). By doing so, abnormalities such as distortion can be measured. If the measurement mark is a seal-like member or the like, it can be retrofitted to any location according to the situation at the site. Note that only one measurement mark 33 may be attached, and the amount of change in the position may be calculated from images moving back and forth in time.

  In this way, the measurement mark is attached to the measurement object, and the image data is calculated based on the physical quantity, so that not only the penetration amount but also the measurement value (interval, inclination angle, and change thereof) regarding the measurement object. Quantity etc.) can be obtained without contact using a sensor or the like. Therefore, the measurement method and the measurement program according to the present invention are also effective for measurement at a dangerous place, measurement at a place where constant monitoring is required, and the like.

  The present invention can be photographed and can be photographed with a measurement mark for calculating the ratio between image data and physical quantity, and is not limited to the field of civil engineering and architecture. It can be used by applying to the field.

DESCRIPTION OF SYMBOLS 10 Penetration test apparatus 11 Sampler 12 Rod 13 Impact apparatus 14 Hammer 15 Knocking head 16 Guide rod 17 Hammer dropping mechanism 17
18 Support Mechanism 20 Boring Device 21 Casing 21a Protrusion 30 Target Mark 31 First Target Mark 32 Second Target Mark 40 Reference Mark 50 Information Processing Terminal 51 CPU
52 ROM
53 RAM
54 Auxiliary storage device 55 Display unit 56 Operation unit 57 Imaging device 58 USB I / F
59 Network communication unit 60 Sound output unit 71 First target mark detection database 72 Second target mark detection database 74 Reference mark detection database 80 Actual size database 90 Penetration test type database E1 Seal E2 Seal E4 Seal F Box P Pixel Coordinate system 31P Detection first target mark 32P Detection second target mark 40P Detection reference mark

Claims (12)

When measuring in the field of architecture and civil engineering,
Storing target mark detection data for detecting a detection target mark corresponding to the target mark attached to the movable target from the image data;
Storing reference mark detection data for detecting a detection reference mark corresponding to the reference mark attached to the stationary reference object from the image data;
Storing one of the target mark and the reference mark as a corresponding ratio calculation mark and storing the actual size information;
Obtaining image data including the target mark and the reference mark;
Detecting the detection target mark from the image data based on the target mark detection data;
Obtaining positional information of the detected target mark in a pixel coordinate system;
Detecting the detection reference mark from the image data based on the reference mark detection data;
Obtaining positional information of the detected detection reference mark in a pixel coordinate system;
Obtaining pixel size information of the detected corresponding ratio calculation mark;
Calculating a correspondence ratio between the pixel size and the actual size of the image data based on the pixel size information and the actual size information of the correspondence ratio calculation mark;
Calculating and outputting an actual interval between the reference mark and the target mark based on the pixel interval calculated from the position information of the detection target mark and the position information of the detection reference mark and the corresponding ratio; The measuring method by the image processing characterized by comprising. When measuring in the field of architecture and civil engineering,
Storing target mark detection data for detecting a detection target mark corresponding to the target mark attached to the movable target from the image data;
Storing reference mark detection data for detecting a detection reference mark corresponding to the reference mark attached to the stationary reference object from the image data;
Storing one of the target mark and the reference mark as a corresponding ratio calculation mark and storing the actual size information;
Obtaining pre-image data and post-image data, which include the target mark and the reference mark, which are temporally mixed, and
Detecting the detection target mark from the image data based on the target mark detection data;
Obtaining position information in a pixel coordinate system of each detected target mark detected;
Detecting the detection reference mark from the image data based on the reference mark detection data;
Obtaining position information in the pixel coordinate system of each detected reference mark detected;
Obtaining pixel size information of the detection corresponding ratio calculation mark corresponding to the corresponding ratio calculation mark detected from the previous image data or the subsequent image data;
Calculating a correspondence ratio between the pixel size and the actual size based on the pixel size information of the detection correspondence ratio calculation mark and the actual size information of the correspondence ratio calculation mark;
Based on the position information of the detection target mark and the position information of the detection target mark in the previous image data, the position information of the detection target mark and the position information of the detection target mark in the subsequent image data, and the corresponding ratio And a step of calculating and outputting an actual movement amount of the target mark. When measuring in the field of architecture and civil engineering,
Storing target mark detection data for detecting a detection target mark corresponding to the target mark attached to the measurement object from the image data;
Storing the actual size information of the target mark;
Acquiring the pre-image data and the post-image data that include the target mark and that are temporally mixed,
Detecting the detection target mark from the image data based on the target mark detection data;
Obtaining position information in a pixel coordinate system of each detected target mark detected;
Obtaining pixel size information of the detected target mark detected from the previous image data or the subsequent image data;
Calculating a correspondence ratio between the pixel size and the actual size based on the pixel size information of the detected target mark and the actual size information of the target mark;
Calculating and outputting the actual movement amount of the target mark based on the position information of the detection target mark in the previous image data, the position information of the detection target mark in the subsequent image data, and the corresponding ratio; And a measurement method by image processing, characterized by comprising:   Characterized in that it comprises the step of identifying and outputting the moving direction of the target mark based on the positional information of the detected target mark in the previous image data and the positional information of the detected target mark in the subsequent image data. The measurement method by image processing according to claim 3.   The target mark in a state attached to a measurement object is photographed to acquire image data, and the target mark detection data is created from the image data. A measurement method by image processing described in 1. When measuring the penetration test,
The detection correspondence ratio calculation mark corresponding to the correspondence ratio calculation mark is detected from the image data obtained by photographing the real image including the correspondence ratio calculation mark, and the pixel size information is acquired, and the detection correspondence ratio calculation is performed. A test video shooting preparation stage for calculating a correspondence ratio based on the pixel size information of the mark and the actual size information of the mark for calculating the correspondence ratio;
Image data including a target mark attached to a movable measurement object and a reference mark attached to a stationary measurement object is acquired, and each detection target mark corresponding to the target mark and the reference are obtained from the image data Position information is obtained by detecting each detection reference mark corresponding to the mark, and an actual interval between the target marks is calculated based on the detection target mark of the image data, the position information of the detection reference mark, and the correspondence ratio. And a test measurement stage for outputting the output, and a measurement method using image processing. When measuring the penetration test,
The detection correspondence ratio calculation mark corresponding to the correspondence ratio calculation mark is detected from the image data obtained by photographing the real image including the correspondence ratio calculation mark, and the pixel size information is acquired, and the detection correspondence ratio calculation is performed. A test video shooting preparation stage for calculating a correspondence ratio based on the pixel size information of the mark and the actual size information of the mark for calculating the correspondence ratio;
Before and after image data including a target mark attached to a movable measurement object and a reference mark attached to an immovable measurement object is acquired, and the target data is acquired from each image data. Position information is obtained by detecting each detection target mark corresponding to the mark and each detection reference mark corresponding to the reference mark, and the position information of the detection target mark and the detection reference mark of the previous image data and the subsequent image data And a test measurement step of calculating and outputting an actual movement amount of the target mark based on the position information of the detection target mark and the detection reference mark and the corresponding ratio, and a measurement method using image processing . When measuring the penetration test,
The detection correspondence ratio calculation mark corresponding to the correspondence ratio calculation mark is detected from the image data obtained by photographing the real image including the correspondence ratio calculation mark, and the pixel size information is acquired, and the detection correspondence ratio calculation is performed. A test video shooting preparation stage for calculating a correspondence ratio based on the pixel size information of the mark and the actual size information of the mark for calculating the correspondence ratio;
Obtain the pre-image data and post-image data that includes the target mark attached to the moving measurement object, and detect each detection target mark corresponding to the target mark from the image data. Acquires position information, and calculates and outputs the actual movement amount of the target mark based on the position information of the detection target mark of the previous image data, the position information of the detection target mark of the subsequent image data, and the corresponding ratio. A measurement method using image processing, comprising: a test measurement stage.   The measurement method according to any one of claims 6 to 8, wherein the measurement object is a penetration member in the penetration test, and the actual movement amount is a penetration amount.   The measurement object is a striking member in the penetration test, and the actual movement amount includes at least one of a penetration amount, a lifting amount, and a rebound amount. 8. A measuring method by image processing of any one of 8.   The front image data and the rear image data are each one image data in the moving image data, and the front image data and the rear image data are included in position information of the detection target mark acquired in real time from the moving image data. 10. The measurement method according to claim 5, wherein the state of the measurement object is determined and extracted based on the image processing.   A measurement program by image processing, which causes a computer to execute the measurement method by image processing according to any one of claims 1 to 11.

Images