JP2020094469A - Construction machine management system, construction machine management program, construction machine management method, construction machine and external management device of construction machine - Google Patents

Abstract

To easily and accurately monitor a construction point formed by a construction machine by autonomously monitoring the construction point from the construction machine.SOLUTION: A construction machine management system comprises: a detection sensor unit 11 mounted to a construction machine 2 which is movable in a construction site area 1; and a position recognition unit 13a for recognizing the position information of a construction point formed by a movable working tool 3 in the construction site area 1 on the basis of a detection result of the detection sensor unit 11 with respect to an external index 1a installed in the construction site area 1, and a detection result of the detection sensor unit 11 with respect to a movable index 3a added to the movable working tool 3 possessed by the construction machine 2.SELECTED DRAWING: Figure 1

Description

The present invention relates to a construction machine management system, a construction machine management program, a construction machine management method, a construction machine, and an external management device for the construction machine.

2. Description of the Related Art In recent years, at a construction construction site, an electronic device is used to monitor a construction site of a construction machine used in the construction site area. This is because if the construction site by the construction machine can be recognized, for example, the work management during construction can be performed by collating the recognition result with the topographical data.

Conventionally, the monitoring of the construction site by the construction machine is performed by, for example, the Total Station
ation, hereinafter also referred to as “TS”. ) Is installed in the construction site area, and the laser light emitted by the laser light emitting device is used (see, for example, Patent Document 1). In addition, for example, a Global Positioning Satellite System (hereinafter also referred to as “GNSS”) represented by GPS (Global Positioning System) may be used (for example, Patent Document 2). reference).

JP, 2002-340556, A Japanese Patent Publication No. 09-500700

In the above-mentioned conventional technique, the construction site is monitored by the construction machine by using TS or GNSS. That is, while using the TS or GNSS which is an external system from the viewpoint of the construction machine, the monitoring of the construction machine is heterogeneously performed.

However, a heterogeneous monitor using an external system may have the following problems. For example, since TS or GNSS is generally expensive and requires specialized knowledge to use it, it cannot always be said that monitoring of construction machines can be performed easily. Also,
Depending on the environment and conditions of the construction site area where the external system is used, laser light or satellite radio waves that should reach the construction machine may be blocked, which may adversely affect the monitoring accuracy.

Therefore, it is an object of the present invention to provide a technology that enables the construction site to be monitored easily and accurately by monitoring the construction site of the construction machine autonomously as viewed from the construction machine.

The present invention has been devised to achieve the above object, and one mode thereof is as follows.

According to one aspect of the invention,
A detection sensor unit mounted on a construction machine that can move in the construction site area,
Based on the detection result of the detection sensor section for the external index installed in the construction site area, and the detection result of the detection sensor section for the movable index attached to the movable work tool of the construction machine A position recognition unit that recognizes position information of a construction site by the movable work tool in the construction site area,
A construction machine management system is provided.

According to the present invention, by utilizing the detection sensor unit mounted on the construction machine, the construction site of the construction machine can be autonomously monitored, so that the monitoring can be performed easily and highly accurately.

It is a figure explaining the basic technical idea of this invention, and is a functional block diagram which shows the schematic structural example of the construction machine management system to which the said technical idea is applied. It is explanatory drawing which shows typically the schematic structural example of the backhoe which is an example of the construction machine used in the construction site area in 1st embodiment of this invention. It is explanatory drawing which shows the example of the two-dimensional pattern of the marker figure used with the construction machine management system which concerns on 1st embodiment of this invention, (a) is a figure which shows a specific example of a marker figure, (b) is a marker. It is a figure which shows the other specific example of a figure. It is a block diagram showing an example of composition of a construction machine management system concerning a first embodiment of the present invention. It is a flow figure showing an example of a flow of a processing procedure of a construction machine management method concerning a first embodiment of the present invention. It is explanatory drawing which shows the outline|summary of the surveying technique by 2 camera images used by 1st embodiment of this invention. It is explanatory drawing which shows the outline of the position recognition model of the bucket construction location used by 1st embodiment of this invention. It is explanatory drawing which shows the example of the operation guidance information which the construction machine management system which concerns on 1st embodiment of this invention outputs, (a) is a figure which shows one specific example of operation guidance information, (b) is operation guidance information. It is a figure which shows the other specific example of. It is a side view which shows typically the basic structural example of the slip foam machine which is an example of the construction machine used in the construction site area in 2nd embodiment of this invention. It is explanatory drawing which shows the construction condition of the slip-form construction method performed using the slip-form machine in 2nd embodiment of this invention. It is explanatory drawing which shows typically the structural example of the front part cutting machine which comprises the slip form machine in 2nd embodiment of this invention, (a) is the figure seen from the front, (b) is a principal part from a side surface. It is the figure seen. It is explanatory drawing which shows typically the structural example of the back molding machine which comprises the slip foam machine in 2nd embodiment of this invention, (a) is the figure seen from the front, (b) sees the principal part from a side surface. It is a figure. It is a perspective view which shows typically the schematic structural example of the slip foam machine which is an example of the construction machine used in the construction site area in 2nd embodiment of this invention. It is a block diagram showing an example of composition of a construction machine management system concerning a second embodiment of the present invention. It is a flow figure showing an example of a flow of a processing procedure of a construction machine management method concerning a second embodiment of the present invention. It is explanatory drawing which shows the outline of the surveying technique used by 2nd embodiment of this invention, (a) is a figure which shows the relationship between a camera and a marker figure, (b) is a figure explaining the vector of a camera coordinate system, 3C is a diagram modeled to obtain the height, and FIG. 3D is a diagram in which FIG. 3C is seen through in the direction of OO′. It is explanatory drawing which shows the example of the operation guidance information which the construction machine management system which concerns on 2nd embodiment of this invention outputs.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.

<1. Overview of basic technical ideas>
First, an outline of the basic technical idea of the present invention will be described.
FIG. 1 is a functional block diagram showing a schematic configuration example of a construction machine management system to which the basic technical idea of the present invention is applied.

(System overview)
The construction machine management system of the illustrated example monitors the construction location of the construction machine 2 used in the construction site area 1 of the construction construction site by the movable work implement 3 included in the construction machine 2 and displays the monitoring result (that is, construction). It is configured to acquire the recognition result) about the location. Further, when the monitoring result of the construction site by the construction machine 2 is acquired, the work management during the construction can be performed based on the monitoring result.

Here, the construction site area 1 is an area to be constructed using the construction machine 2. Construction refers to construction or processing performed using the construction machine 2. The content (type) of construction is not particularly limited as long as the construction machine 2 is used.
In addition, for the construction site area 1, it is assumed that construction plan data corresponding to design data regarding a state after construction (for example, topography after construction) is prepared in advance. The construction plan data is not particularly limited in data format as long as it can specify the post-construction state.
Note that the pre-construction state or the construction-in-progress state in the construction site area 1 and the post-construction state specified by the construction plan data correspond to each other, for example, by using the reference point set in the construction site area 1. It is designed to be attached.

The construction machine 2 that performs construction on the construction site area 1 is configured to be movable to an arbitrary position within the construction site area 1. The movement within the construction site area 1 may be self-propelled or may use another power source. Further, the construction machine 2 has a movable work tool 3 that can be operated during a stopped state or during movement, and by operating the movable work tool 3, it is possible to perform construction on the construction site area 1. It is configured. In such a construction machine 2, the construction site of the movable work tool 3 is actually the work (
For example, it will be a place that contacts the ground).

As a typical example of such a construction machine 2, a construction machine for civil engineering such as a hydraulic excavator or a bulldozer can be given. For example, in the case of a hydraulic excavator, a bucket (excavator) attached to the tip of the arm corresponds to the movable work implement 3. However, the construction machine 2 here is not limited to civil engineering applications, and includes various work machines in a broad sense as long as the construction machine 2 has the movable work tool 3 and is movable. Be done. For example,
The construction machine 2 here includes, in addition to civil engineering machines such as hydraulic excavators and bulldozers, transport machines such as trucks and loaders, cargo handling machines such as cranes, foundation construction machines, punching machines, tunnel construction machines, and crushing machines. This includes concrete machines such as machines, paving machines, road maintenance machines, etc., and may also include snow plows and self-propelled mowers.

(Findings obtained by the inventor)
By the way, when monitoring the construction site by the movable work tool 3 of the construction machine 2, it is preferable that the monitoring can be performed easily and with high accuracy. However, the monitor according to the above-described conventional technique does not necessarily perform monitoring easily and with high accuracy because it is performed heterogeneously using an external system.

The monitoring of the construction site is performed, for example, to enable work management during construction based on the monitoring result. Therefore, the position recognition of the construction site by the monitor needs to be performed with high accuracy of at least several cm, which is not enough with the accuracy of several m. When monitoring with such high accuracy, it is possible to use TS or GNSS, which is very expensive,
Since it is very expensive, it is not always easy to introduce. Moreover, TS or G
Since it requires specialized knowledge to use NSS, it is difficult to use it. That is, T
When an external system such as S or GNSS is used to perform monitoring with high accuracy, the monitoring cannot always be said to be simple.

Further, it is assumed that the construction site area 1 is set under various environments or conditions. Specifically, for example, the construction site area 1 is set in a place where the irradiation of laser light should be refrained from, such as an urban area, or the construction site area 1 is set in a place where satellite radio waves cannot reach, such as an underground space. It is possible. Therefore, when monitoring is performed using an external system, laser light or satellite radio waves may be blocked depending on the environment and conditions of the construction site area 1, which may adversely affect the monitoring accuracy.

As a result of earnestly studying on the basis of these things, the inventor of the present application uses the detection sensor unit 11 mounted on the construction machine 2 to autonomously see the construction site of the construction machine 2 from the viewpoint of the construction machine 2. The idea that it becomes possible to perform the monitoring simply and with high accuracy by performing the automatic monitoring has been obtained. In other words, the basic technical idea explained here is
It was devised on the basis of a new idea that the construction machine 2 autonomously monitors the construction site of the construction machine 2, rather than a heterogeneous monitor using an external system.

(Example of system configuration)
Specifically, as shown in FIG. 1, the construction machine management system has the following configuration. That is, the construction machine management system includes at least the detection sensor section 11 mounted on the construction machine, the information communication section 12 for exchanging information with the external management apparatus 20, and the detection sensor section 1.
1 and a computer unit 13 connected to the information communication unit 12.

The detection sensor unit 11 includes a position of the construction machine 2 or a movable work tool 3 of the construction machine 2,
It is used to detect a posture or an azimuth. The position here is a coordinate position when the construction site area 1 is considered as a three-dimensional coordinate space. The posture is the amount of inclination with respect to the horizontal plane. The azimuth is the direction of movement or movement.
As such a detection sensor unit 11, for example, an image sensor (camera), an inclinometer,
At least one of an acceleration sensor and a gyro sensor (angular acceleration sensor), and preferably a combination of these may be used. It is also possible to use a plurality of single measurement type GPS devices as the detection sensor unit 11.

The information communication unit 12 is for establishing communication with the external management device 20. As such an information communication unit 12, for example, an LTE (Long Term Evolution) line, Wi-
A known wireless communication technique such as Fi (Wireless Fidelity) or Bluetooth (registered trademark) may be used to establish communication with the external management device 20.
Examples of the external management device 20 that is a communication partner of the information communication unit 12 include a computer device that is arranged apart from the construction machine 2 (whether inside the construction site area 1 or outside the construction site area 1). Be done. However, the present invention is not limited to this, and a tablet terminal having portability may be used as long as it has a function that can be regarded as a computer device.
It may be 0. When the external management device 20 is portable, a person who has the external management device 20 can use the external management device 20 even when the external management device 20 is on the construction machine 2.

The computer unit 13 is, for example, a so-called single board computer.
Computer, hereinafter also referred to as "SBC". ) Is used to implement the functions described below by executing a predetermined program set in advance. That is, the computer unit 13 includes hardware resources as a computer, and by executing a predetermined program, the program (software) and the hardware resources cooperate with each other, and the position recognition unit 13a and the data acquisition unit. Unit 13b, difference information extraction unit 13
c, the guidance output unit 13d, the operation plan generation unit 13e, and the operation instruction unit 13f.

The position recognition unit 13a detects the detection result of the external index 1a installed in the construction site area 1 by the detection sensor unit 11 and the detection sensor unit of the movable index 3a attached to the movable work tool 3 of the construction machine 2. It is a function of recognizing the position information of the construction site by the movable work implement 3 of the construction machine 2 in the construction site area 1 based on the detection result of 11.
As the external index 1a, for example, a staff installed at a reference point in the construction site area 1 or something similar thereto is used. A single external index 1a may be installed in the construction site area 1, or a plurality of external indexes 1a may be installed.
As the detection sensor unit 11 that detects the external index 1a, for example, an image sensor (camera) that captures an image of the external index 1a is used. In that case, the external index 1a includes a two-dimensional marker figure identified by an image pattern, a light emitter having a two-dimensional light emitting surface identified by a light emitting pattern, or a blinking pattern as an example of a light emitting pattern. It is preferable that a light-emitting device having a point light source identified by is attached because it facilitates identification of the external index 1a. However, if the external index 1a can be detected, the detection sensor unit 11 other than the image sensor 11
May be used.
Further, the movable index 3a is assumed to be attached to the movable work tool 3 of the construction machine 2 in advance.
The movable work tool 3 is detected by, for example, the movable work tool 3 as in the case of the external index 1a.
An image sensor (camera) that captures an image of the image is used. In that case, the movable work implement 3
In addition, as the movable index 3a, a two-dimensional marker figure having a pattern different from that of the external index 1a, or a light emitter having a two-dimensional light emitting surface having a pattern different from that of the external index 1a, or different from the external index 1a. It is preferable to additionally provide a light emitting device having a point light source with a blinking pattern, because detection of the movable work tool 3 and identification of the movable index 3a become easy. Further, the detection of the movable index 3a may be performed using the detection sensor unit 11 other than the image sensor, as in the case of the external index 1a.

Then, the position recognition unit 13a uses at least the movable technique 3 of the construction machine 2 based on the detection result of the external index 1a and the detection result of the movable index 3a, for example, using a surveying technique described in detail later. Recognize the position of the construction site. As a result, it is possible to recognize the coordinate position in the construction site area 1 (three-dimensional coordinate space) for the construction site by the movable work implement 3.
The position recognition unit 13a may recognize the posture or orientation of the construction machine 2 based on the detection result of the detection sensor unit 11 such as an inclinometer or a gyro sensor in addition to the position of the construction site. Good. That is, it is assumed that the position information recognized by the position recognizing unit 13a includes at least information regarding the position of the construction machine 2, and more preferably includes information such as posture and orientation in addition to the position.

The data acquisition unit 13b has a function of acquiring construction plan data (design data) for the construction site area 1. The method of acquiring the construction plan data is not particularly limited. For example, the construction plan data may be acquired by storing the construction plan data in a storage area of the computer unit 13 in advance, or through the information communication unit 12 to the outside. May be obtained from

The difference information extraction unit 13c uses the recognition result of the position recognition unit 13a as the movable work implement 3 of the construction machine 2.
Is obtained as a monitoring result of the construction site, and the monitoring result is compared with the construction plan data acquired by the data acquisition unit 13b, and the difference of the construction site by the movable work implement 3 with respect to the construction plan data is extracted as difference information. It is a function. The method for extracting the difference information is not particularly limited, and for example, a known calculation method may be used.

The guidance output unit 13d has a function of generating operation guidance information of the movable work implement 3 based on the difference information extracted by the difference information extraction unit 13c, and outputting the generated operation guidance information. The operation guidance information is information for guiding an operation required on the construction machine 2 in order to match the construction site of the movable work implement 3 of the construction machine 2 with the construction plan data. Generation and output of such operation guidance information may be performed using a known technique known as so-called machine guidance in the technical field of construction machinery. The output destination of the operation guidance information may be, for example, an operation panel operated by an operator of the construction machine 2 or something similar thereto, but is not limited to this, and the information communication unit 1 may be used.
2 may be output to the external management device 20.

The motion plan generation unit 13e has a function of generating motion plan information of the movable work implement 3 in the construction machine 2 based on the difference information extracted by the difference information extraction unit 13c. The motion plan information is information that specifies how to move the movable work tool 3 in order to match the construction site of the movable work tool 3 of the construction machine 2 with the construction plan data. In other words, the operation plan information is
This is information necessary to realize automatic control of operation of the construction machine 2 (automation of operation).
It should be noted that the automatic control here may be realized by using a known technique known as so-called machine control in the technical field of construction machinery.

The operation instruction unit 13f is a function that gives an operation instruction to the drive control unit 4 included in the construction machine 2 based on the operation plan information generated by the operation plan generation unit 13e. When the operation instruction section 13f gives an operation instruction, in the construction machine 2, the drive control section 4 operates the movable work implement 3 while following the operation instruction. The operation instruction to the construction machine 2 plays a part of the automatic control described above, and may be realized by using a known technique known as so-called machine control.

The functions of the respective units 13a to 13f described above are realized by the computer unit 13 executing a predetermined program. That is, the predetermined program that realizes the functions of the units (each unit) 13a to 13f corresponds to an embodiment of the "construction machine management program" according to the present invention. In that case, the predetermined program that realizes each function is the computer unit 13
May be provided by being stored in a recording medium (for example, a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc.) that can be read by the computer unit 13 as long as it can be installed in It may be provided from the outside through a network such as the Internet or a dedicated line.

Note that, here, the case where the computer unit 13 has all of the functions as the respective units 13a to 13f is taken as an example, but the present invention is not limited to this, and the computer unit 13 is at least the position recognition unit 13a. Anything can be used as long as it has the function as. Functions other than the position recognition unit 13a, such as the units 13b to 13f, may be included in the external management device 20 instead of the computer unit 13, or may be included in the computer unit 13 and the external management device 20. Alternatively, neither the computer unit 13 nor the external management device 20 may be provided.

(Example of processing operation)
Next, a processing operation in the construction machine management system having the above-mentioned configuration will be described. The processing operation described here as an example corresponds to a specific example of a construction machine management method.

When performing construction using the construction machine 2 in the construction site area 1, first, at the position after the movement of the construction machine 2, the detection sensor unit 11 mounted on the construction machine 2 causes The external index 1a installed at the reference point is detected. For example, if an image sensor is used as the detection sensor unit 11, the external index 1a is continuously detected until an image of the external index 1a can be captured. When a plurality of external indexes 1a are installed, at least one external index 1a is detected.

Further, the detection sensor unit 11 detects not only the external index 1a but also the movable index 3a at the position after the construction machine 2 is moved.

Then, when the detection sensor unit 11 detects the external index 1a and the movable index 3a, based on these detection results, for example, using a surveying technique described later in detail, the construction location of the movable work tool 3 of the construction machine 2 is determined. Recognize position. As a result, the position recognition unit 13a recognizes the position (three-dimensional coordinate value) in the construction site area 1 with respect to the construction site by the movable work tool 3. At this time, the position recognition unit 13a also recognizes the posture or orientation of the movable work tool 3 as necessary.

According to the recognition result obtained in this way, regarding the construction site by the movable work tool 3 of the construction machine 2, the absolute position in the construction site area 1 when the reference point is used as a reference (posture as necessary Or including the direction) can be specified. That is, by utilizing the detection sensor unit 11 mounted on the construction machine 2 and performing recognition processing by the position recognition unit 13a based on the detection results of the external index 1a and the movable index 3a, an external system such as TS or GNSS can be installed. It becomes possible to autonomously monitor the construction site by the construction machine 2 as viewed from the construction machine 2 without needing to do so.

When the monitoring result of the construction site by the movable work implement 3 of the construction machine 2 is obtained through the recognition processing by the position recognition unit 13a, the difference information extraction unit 13c causes the data acquisition unit 13b to acquire the monitoring result. In contrast to this, the difference information with the construction plan data is extracted. When the difference information extracting unit 13c extracts the difference information, the following machine guidance processing operation or machine control processing operation can be performed.

When performing the machine guidance processing operation, the guidance output unit 13d generates operation guidance information based on the difference information extracted by the difference information extraction unit 13c. Then, the generated operation guidance information is output by, for example, the operation panel of the construction machine 2 or something similar thereto. Thereby, the operator of the construction machine 2 refers to the output content of the operation panel,
It is possible to operate the construction machine 2 (that is, its own machine) while grasping the construction contents based on the construction plan data, the posture and movement of the construction machine 2, and the like. Therefore, it is very convenient for the operator to match the construction site of the movable work implement 3 of the construction machine 2 with the construction plan data. The output destination of the operation guidance information may be the external management device 20 connected via the information communication unit 12. In that case, for example, even if the operator who actually operates the construction machine 2 is an unskilled person, a skilled person who refers to the output content of the external management device 20 arranged apart from the construction machine 2 may It becomes feasible to give an operation advice to an unskilled person while grasping the situation of construction by the machine 2.

When performing the machine control processing operation, the operation plan generation unit 13e generates the operation plan information based on the difference information extracted by the difference information extraction unit 13c so as to reduce the difference due to the difference information. Then, the operation instruction unit 13f gives an operation instruction to the drive control unit 4 of the construction machine 2 based on the operation plan information generated by the operation plan generation unit 13e. As a result, the construction machine 2 is automatically operated in terms of operation, posture, etc. of the construction machine 2 (that is, its own machine) so that the construction site by the movable work implement 3 matches the construction plan data. Construction machine 2
In the case of performing the automatic driving of the above, the difference information extracted by the difference information extraction unit 13c and the operation plan generation unit 13
The operation plan information and the like generated by e are output to the external management device 20 connected via the information communication unit 12, so that the operation and posture of the construction machine 2 can be supplementarily controlled from the external management device 20. You can With this configuration, for example, an expert operating the external management device 20 can appropriately correct the control content for the construction machine 2 while grasping the status of the construction by the construction machine 2, The accuracy and reliability of the automatic operation of the construction machine 2 can be improved.

(Effect)
In the construction machine management system described above, the detection sensor unit 11 mounted on the construction machine 2 is used, the detection results of the external index 1a and the movable index 3a are combined, and the position recognition unit 13a based on these detection results is used. By performing the recognition process in 1., the monitoring result of the construction site by the movable work tool 3 of the construction machine 2 is obtained. Therefore, it becomes possible to autonomously monitor the construction site by the movable work implement 3 of the construction machine 2 without requiring an external system such as TS or GNSS.

If it is an autonomous monitor using the detection sensor unit 11, TS or G which is very expensive
Compared to the case of using NSS, it can be easily introduced. This is because a widely available product such as an image sensor (camera) or an inclinometer can be used as the detection sensor unit 11. Moreover, since it does not require specialized knowledge like TS or GNSS, it is also excellent in convenience. In other words, if it is an autonomous monitor using the detection sensor unit 11, TS or G
The monitoring can be performed more easily than when using an external system such as NSS.

Further, if an autonomous monitor using the detection sensor unit 11 does not require external laser light or satellite radio waves, the construction site area 1 should be set under various environments and conditions. Even if it is assumed, it is possible to deal with this flexibly and appropriately. For example, even if the construction site area 1 is set in a place where the irradiation of laser light should be refrained from, such as an urban area, or the construction site area 1 is set in a place where satellite radio waves do not reach, such as an underground space, construction machinery It is possible to flexibly and appropriately monitor the construction site by the movable work tool 2 of No. 2, and the monitoring accuracy is not adversely affected.

Further, even when performing autonomous monitoring using the detection sensor unit 11, the detection sensor unit 11 and the setting of the external index 1a or the like to be detected, and the position recognition unit 13a.
Depending on the setting of the recognition processing algorithm in the above, the monitor can be performed with high accuracy on the order of several cm. That is, even with an autonomous monitor using the detection sensor unit 11,
It is possible to highly accurately recognize the position, posture, etc. of a construction site of the construction machine 2 by the movable work implement 3.

As described above, according to the technical idea of the present embodiment, by using the detection sensor unit 11 mounted on the construction machine 2, the construction site of the movable work implement 3 of the construction machine 2 can be autonomously monitored. Therefore, the monitor can be performed easily and with high accuracy.

<2. First embodiment>
Next, an embodiment in which the above-mentioned technical idea is embodied will be described with a specific example.
First, a case where the construction machine 2 is a backhoe which is a type of hydraulic excavator will be described as a first embodiment.

(Construction machinery)
FIG. 2 is an explanatory diagram schematically showing a schematic configuration example of a backhoe that is an example of a construction machine used in a construction site area in the first embodiment.
The backhoe 2, which is an example of a construction machine, is a construction machine called a hydraulic excavator in which a bucket (excavator) is attached to the operator side, and is mainly used for excavating the construction site area 1. More specifically, the backhoe 2 has a right endless track 2a and a left endless track 2b as traveling devices, and is configured to be movable within the construction site area 1. Further, the backhoe 2 has a turntable machine base 2c supported by a traveling device, and is configured such that an operator rides on the machine base 2c to perform an operation (steering).

On the machine base 2c of the backhoe 2, a first arm 3b and a second arm 3c as movable work tools 3 are provided.
Also, a bucket 3d is attached, and by operating these, construction such as excavation is performed on the ground surface. That is, the sword tip position of the bucket 3d corresponds to the construction site of the bucket 3d.

Further, the backhoe 2 has an image sensor (for detecting an image) as a detection sensor unit 11.
Cameras 11a and 11b and a tilt sensor 11c capable of detecting tilts in two axial directions (specifically, tilts in the left-right direction and the front-back direction) are mounted. Image sensor 11a, 11
b is composed of a plurality of (for example, two) cameras 11a and 11b arranged side by side in the same direction at a location (for example, a ceiling surface or a front surface of the machine base 2c) having an excellent visual field in the backhoe 2. There is.
Further, a tilt sensor 11d capable of detecting the direction (tilt) of the bucket 3d is attached to the movable work implement 3 included in the backhoe 2.
Known cameras may be used for the cameras 11a and 11b and the tilt sensors 11c and 11d. In addition to these, the backhoe 2 may be further provided with another detection sensor unit 11.

In the construction site area 1 in which such a backhoe 2 is used, a staff as an external index 1a or something similar thereto is erected at a position serving as a reference point (position where coordinates are specified in advance). A two-dimensional marker figure 1b identified by the image pattern is attached to the external index 1a. It should be noted that the external index 1a has, instead of the marker graphic 1b, a light-emitting device having a two-dimensional light-emitting surface identified by a light-emitting pattern, or light emission having a point light source identified by a blinking pattern as an example of a light-emitting pattern. A container may be attached. External indicator 1a
The marker graphic 1b in (1) is an object to be imaged by the cameras 11a and 11b.

When a plurality of reference points are set in the construction site area 1, the external index 1a and the marker graphic 1b may be arranged at each reference point. That is, the external index 1a and the marker graphic 1b may be individually installed at different positions in the construction site area 1.

Further, the movable work implement 3 included in the backhoe 2 is provided with a marker graphic 3a as a movable index, for example, at a position in the second arm 3c near the bucket 3d. A light emitting device having a two-dimensional light emitting surface identified by a light emitting pattern instead of the marker figure 3a, or
A light emitter having a point light source identified by a blinking pattern as an example of the light emission pattern may be additionally provided. The marker figure 3a as the movable index is the marker figure 1 in the external index 1a.
Similar to b, it is an object to be imaged by the cameras 11a and 11b.

However, it is preferable that the marker graphic 3a as the movable index and the marker graphic 1b of the external index 1a are configured by different two-dimensional patterns. In the case of the light emitting device, it is preferable that the light emitting pattern or the blinking pattern be different from each other.
FIG. 3 is an explanatory diagram showing an example of a two-dimensional pattern of a marker figure used in the construction machine management system according to this embodiment.
For example, when the two-dimensional pattern shown in FIG. 3A is used as the marker figure 1b, it is possible to use the two-dimensional pattern shown in FIG. 3B as the marker figure 3a. This makes it possible to easily and accurately identify each of the marker figures 1b and 3a even if the detection is performed using the same image sensor (camera) 11a and 11b.

(Example of system configuration)
Next, a configuration example of the construction machine management system in the first embodiment will be described.
FIG. 4 is a block diagram showing a configuration example of the construction machine management system according to the first embodiment.

The construction machine management system according to the first embodiment includes cameras 11a and 11b as the detection sensor unit 11 mounted on the backhoe 2 and tilt sensors 11c and 11d, and an SBC 13 connected to these. The SBC 13 functions as the computer unit 13 described above.

The external management device 20 is connected to the SBC 13 via the data communication terminal 12 as the information communication unit 12. A tablet terminal 32 is connected to the SBC 13 via a Wi-Fi terminal 31. The tablet terminal 32 is used by the operator of the backhoe 2 and corresponds to the operation panel of the backhoe 2. The tablet terminal 32 may be omitted if the operation panel of the backhoe 2 has a function of displaying an image.

Further, the SBC 13 has a mechanism control unit 4a as the drive control unit 4 included in the backhoe 2.
And the hydraulic control unit 4b is connected. The mechanism control unit 4a moves forward and backward on the right endless track 2a,
It controls forward/backward movement of the left endless track 2b, turning of the machine base 2c, and the like. The hydraulic control unit 4b controls the operations of the first arm 3b, the second arm 3c, and the bucket 3d that form the movable work implement 3.

The SBC 13 is connected to the outside by, for example, USB (Universal Serial Bus) or I.
2C (Inter-Integrated Circuit) may be used, but the present invention is not limited to this, and other known communication methods may be used.

(Example of processing operation)
Next, an example of the processing operation in the construction machine management system having the above-mentioned configuration, that is, the construction machine management method in the first embodiment will be described.
FIG. 5 is a flowchart showing an example of the flow of processing procedures of the construction machine management method according to the first embodiment.

In the construction machine management system having the above-described configuration, when monitoring the construction site by the backhoe 2, first, the marker recognition is performed on the external index 1a installed at the reference point of the construction site area 1 (step 101, the step "S" below). ". Specifically, the external indicator 1a
An image of the marker graphic 1b attached to the image is captured by the cameras 11a and 11b to obtain a captured image of the marker graphic 1b. The imaging at this time is performed by a plurality (for example, two) of cameras 11a, 1
Since 1b is used, if any one of the marker figures 1b arranged in the construction site area 1 is used, it is possible to perform position recognition using a surveying technique described later. If a plurality of marker figures 1b are arranged in the construction site area 1, even if there is a shield between one certain marker figure 1b and the backhoe 2, a captured image of another marker figure 1b is obtained. Therefore, the marker recognition of the external index 1a is not hindered.

The marker recognition is performed not only for the marker graphic 1b of the external index 1a but also for the marker graphic 3a as a movable index attached to the movable work tool 3 of the backhoe 2 (S101). Specifically, the marker graphic 3a attached to the movable work implement 3 is imaged by the cameras 11a and 11b, and a captured image of the marker graphic 3a is obtained. At this time, if the images of the respective marker figures 1b and 3a are taken by using the same cameras 11a and 11b, it is possible to prevent the configuration of the detection sensor unit 11 from becoming complicated.

Further, in the construction machine management system, the tilt sensor 11c recognizes the tilt of the backhoe 2 itself, and the tilt sensor 11d recognizes the tilt of the bucket 3d of the movable work implement 3 (S102).

When the marker recognition and the tilt recognition are performed, the construction machine management system subsequently proceeds to SBC13.
The function as the position recognition unit 13a in (1) performs position determination (position recognition) on the construction site by the bucket 3d of the backhoe 2 (S103).

At the time of position determination, the position recognition unit 13a performs a first recognition process and a second recognition process.
First, as the first recognition processing, based on the imaging result of the marker figure 1b of the external index 1a,
The position information of the backhoe 2 in the construction site area 1 is recognized. Specifically, the imaging result obtained by the one camera 11a, the imaging result obtained by the other camera 11b, and the cameras 11a, 11
Based on the positional relationship between b, the positional relationship between the marker graphic 1b and the cameras 11a and 11b is recognized by using a surveying technique using two camera images described below.

FIG. 6 is an explanatory diagram showing an outline of the surveying technique by the two-camera image used in the first embodiment.
In the figure, A and B are the positions of the cameras 11a and 11b, T is the position of the survey target (for example, the marker graphic 1b), and AA' and BB' are the optical axes of the cameras 11a and 11b, respectively. It represents. Further, Q represents the midpoint of AB, and Q′ represents the midpoint of A′B′. Therefore, the relationship of AQ=BQ, A'Q'=B'Q', AA'|QQ'||, and BB' is established. The points A′, O, Q′, and B′ are virtual points on the plane perpendicular to QQ′, and
′ And B′ correspond to the center points (origins) of the captured images obtained by the cameras 11a and 11b.

Here, for example, the actual distance between the points I and J is expressed as IJ, the pixel distance on the image between the points I and J is expressed as IJp, and the distance from the size of the subject and the pixel distance of the subject to the subject. Let us consider a case in which the characteristic value of the cameras 11a and 11b that can be measured in advance for determining is k. In that case, the following relational expressions hold.

Based on the above relational expression, from the positional relationship of A and B for the cameras 11a and 11b and the positional relationship of each point of A′, O, Q′, and B′ in the captured images, the survey target It is possible to obtain the distance QT between the optical axis plane, the distance QO to the survey target on the optical axis plane, and the height distance OT from the optical axis plane to the survey target. Further, the distance from the point T to the point Q and the elevation angle can be obtained from the detection result of the elevation angle of the line segment QO from the horizontal plane by the tilt sensor 11c. Further, for example, the absolute coordinates of the point Q can be obtained by measuring the distance to the two marker figures 1b and the elevation angle.

That is, the position recognizing unit 13a uses a surveying technique based on the two-camera image described above, and a predetermined portion of the backhoe 2 (for example, each of the cameras 11a and 11b) that serves as a reference for specifying the position of the backhoe 2. For the point Q, which is the midpoint of the installation point, the three-dimensional coordinate position with respect to the marker graphic 1b (that is, the reference point within the construction site area 1) is calculated and recognized. The three-dimensional coordinate position recognized in this way corresponds to the absolute position of the predetermined portion of the backhoe 2 in the construction site area 1.

At this time, the position recognition unit 13a identifies the position of the reference point where the external index 1a is installed based on the imaging result of the marker graphic 1b, so that the orientation of the backhoe 2 in the construction site area 1 (that is, the machine stand). 2c) can be recognized. Furthermore, the position recognition unit 13a can also recognize the posture of the backhoe 2 itself (that is, the state of the tilt in the construction site area 1) based on the detection result of the tilt sensor 11c.

When the above-described first recognition processing is performed in the position determination, the position recognition unit 13a subsequently performs the second recognition processing. In the second recognition processing, the position information of the construction site by the bucket 3d is recognized based on the imaging result of the marker figure 3a as the movable index. Specifically, the imaging result obtained by one camera 11a, the imaging result obtained by the other camera 11b, the positional relationship between the marker graphic 3a and the bucket 3d, and further the tilt sensor 11d for the bucket 3d. Based on the detection result, the positional relationship between the marker graphic 3a and the cameras 11a and 11b is recognized while using the above-described surveying technique using the two-camera image, and then the marker graphic 3a and the bucket 3 are further detected.
Recognize the positional relationship with the construction site by d.

FIG. 7 is an explanatory diagram showing an outline of the position recognition model of the bucket construction location used in the first embodiment.
In the figure, S is the size of the first arm 3b, R is the size of the second arm 3c, P is the size of the bucket 3d, and R1 and R2 are the positions of the marker graphic 3a on the second arm 3c, respectively. Both are known values when the backhoe 2 is used. Therefore, the tilt sensor 11d is used after recognizing the horizontal distance M and the vertical distance H from the point Q on the AB optical axis planes of the cameras 11a and 11b to the marker figure 3a while using the above-described surveying technique using two camera images. If the rotation angle (tilt) of the bucket 3d is known on the basis of the detection result by, the tertiary of the blade tip position of the bucket 3d with respect to the point Q (that is, a predetermined portion of the backhoe 2 that serves as a reference for specifying the position of the backhoe 2) The original coordinate position can be calculated and recognized. Bucket 3
The sword tip position of d corresponds to the position of the construction site of the bucket 3d. That is, the three-dimensional coordinate position recognized in this way is the backhoe 2 for the construction site by the bucket 3d.
Corresponds to the relative position with respect to a predetermined portion of the.

At this time, the position recognizing unit 13a also recognizes the attitude or azimuth of the movable work tool 3 by reflecting the recognition result of the attitude or the like of the backhoe 2 in the first recognition processing. Thereby, the position recognition unit 13a can correctly recognize the sword tip position of the bucket 3d on the backhoe 2 even when the backhoe 2 is tilted or the like.

By combining the absolute position recognition result in the first recognition process and the relative position recognition result in the second recognition process obtained in this way, the position recognition unit 13a causes the bucket 3d of the backhoe 2 to move.
It is possible to obtain an absolute position monitoring result in the construction site area 1 when the reference point is used as a reference for the construction point.

Then, as shown in FIG. 5, in the construction machine management system, the function as the difference information extracting unit 13c in the SBC 13 is such that the backhoe 2 for the construction plan data of the construction site area 1 is used.
Posture recognition is performed (S104). Specifically, the monitor result of the construction site by the bucket 3d of the backhoe 2 is compared with the coordinate value of the corresponding position in the construction plan data of the construction site area 1 to extract the difference information between them.

After the difference information is extracted, in the construction machine management system, the function of the guidance output unit 13d in the SBC 13 performs the machine guidance processing operation and outputs the operation guidance information, so that the operator of the backhoe 2 is notified of the backhoe 2. Posture display (
S105). At this time, the operation guidance information may be output by the external management device 20. That is, the posture of the backhoe 2 may be displayed to a center expert who handles the external management device 20 (S106).

The operation guidance information is output in the following manner, for example.
FIG. 8 is an explanatory diagram illustrating an example of operation guidance information output by the construction machine management system according to the first embodiment.

It is conceivable that the operation guidance information is output, for example, on a display screen 41 as shown in FIG. The display screen 41 of the illustrated example shows a bucket 3d of the backhoe 2 for a construction surface 41a in which a three-dimensional shape is drawn in a wire frame format based on construction plan data.
An image 41b representing “” is displayed and configured at a position where the extracted difference information is reflected. In the display screen 41, a guide line (for guiding the current position of the bucket 3d to the construction surface 41a (
The guidance curve) 41c may be displayed. Furthermore, in the display screen 41, the related numerical value (
For example, the coordinate value) may be displayed.

The output of the operation guidance information does not necessarily have to be performed by the three-dimensional display screen 41, but may be performed by the two-dimensional display screen 42 shown in FIG. 8B, for example. It is possible to switch between a three-dimensional format and a two-dimensional format according to the above.

If the operation guidance information is output by such display screens 41 and 42, it will be very convenient for the operator in matching the construction site of the bucket 3d of the backhoe 2 with the construction plan data. .. Further, if the external management device 20 outputs the operation guidance information, for example, even if the operator who actually operates the backhoe 2 is an unskilled person, a center expert at a remote location can use the backhoe 2 to operate. It is possible to give advice to the unskilled person on the operation while grasping the construction situation.

In the construction machine management system, in addition to the machine guidance processing operation described above, or in addition to the machine guidance processing operation, the functions of the operation plan generation unit 13e and the operation instruction unit 13f in the SBC 13 perform the machine control processing operation. It may be one. Specifically, as shown in FIG. 5, first, the motion plan generation unit 13e performs a process of generating a movement curve that moves the bucket 3d to the construction surface as motion plan information (that is, posture control in the drawing). At the same time (S107), the movement for performing the movement includes hydraulic movement of the first arm 3b, hydraulic movement of the second arm 3c, hydraulic movement of the bucket 3d, forward and backward movement of the right endless track 2a or the left endless track 2b, Processing (that is, control generation in the drawing) that is configured in each sequence of the turning operation of the machine base 2c is performed (S108). Then, the operation instruction unit 13f performs a process of giving an operation instruction according to each sequence to the mechanism control unit 4a and the hydraulic pressure control unit 4b (that is, a control instruction in the drawing) (S109). In response to this operation instruction, the mechanism control unit 4a operates the right endless track 2a, the left endless track 2b or the machine base 2c as necessary (S110), and the hydraulic control unit 4b causes the first arm 3b to operate as necessary. The bucket 3d of the backhoe 2 is guided to a predetermined position by operating the second arm 3c or the bucket 3d (S111).

By performing such a machine control processing operation, the position of the backhoe 2 can be automatically adjusted so that the bucket 3d moves along the construction surface. That is, the operation, posture, and the like of the backhoe 2 are automatically operated so that the construction site by the bucket 3d matches the construction plan data.

In the case of performing the machine control processing operation, the posture control (S107
), the control generation (S108) and the control instruction (S109) are performed by the SBC 13, but these processes may be performed by the external management device 20 having a higher processing capacity than the SBC 13.

Further, the motion plan information (movement curve, etc.) generated in the attitude control (S107) may be output by the external management device 20 and used for control monitoring by the external management device 20 (
S112). With this configuration, for example, the operation and posture of the backhoe 2 can be supplementarily controlled by the external management device 20. Therefore, a center expert at a remote location
Since it is possible to appropriately modify the control content for the backhoe 2 while grasping the status of construction by the backhoe 2, it is possible to improve the accuracy and reliability of the automatic operation of the backhoe 2.

(Effect)
According to the first embodiment described above, by using the detection sensor unit 11 mounted on the backhoe 2, the construction site of the bucket 3d of the backhoe 2 can be autonomously monitored, so that the monitor is simple and high. It can be done with precision.

Further, according to the first embodiment, the monitoring result of the construction site by the bucket 3d is
By comparing with the construction plan data of the construction site area 1, the difference between them is extracted as difference information. Therefore, the machine guidance processing operation or the machine control processing operation can be performed based on the extracted difference information, which is very suitable for effectively utilizing the monitoring result obtained by the backhoe 2 autonomously.

Further, as described in the first embodiment, if the machine guidance processing operation or the machine control processing operation is performed based on the autonomous monitoring result, it is very convenient for the operator of the backhoe 2. Will be things. Moreover, since these processing operations are performed based on the autonomous monitoring result (that is, the monitoring result that can be easily and accurately obtained), the reliability of the processing operation can be ensured.

Further, as described in the first embodiment, if the difference information or the operation plan information, which is the derived information from the difference information, is exchanged with the external management device 20, the center expert at a remote location can Advice and auxiliary control are possible. Therefore, it is very convenient for the operator, the expert in the center, and the like, and the construction accuracy, efficiency, reliability, etc. of the backhoe 2 can also be made very excellent.

In addition, in the first embodiment, the backhoe 2 includes an image sensor (detection sensor unit 11).
Cameras 11a, 11b are mounted, and recognition processing is performed on the images obtained by the image sensors 11a, 11b to recognize the absolute position of the backhoe 2 and the relative position of the bucket 3d. In this way, if the position recognition is performed using the cameras 11a and 11b, it can be introduced more easily than in the case of using a very expensive TS or GNSS, and it is possible to use a specialized device such as TS or GNSS. Since it does not require detailed knowledge, it is also convenient in terms of convenience, and as a result, the system can be easily constructed. Moreover, the cameras 11a and 11b
Since the position recognition is performed by analyzing the image obtained in step 1, it is possible to perform the position recognition with necessary and sufficient position accuracy (for example, high accuracy on the order of several cm) depending on the setting of the analysis algorithm.

In the first embodiment, the detection of the marker graphic 1b in the external index 1a and the detection of the marker graphic 3a as the movable index in the second arm 3c are performed by the same image sensor (camera) mounted on the backhoe 2. ) 11a, 11b. Therefore, in recognizing the absolute position of the backhoe 2 and the relative position of the bucket 3d, the marker graphic 1
Even when it is necessary to detect b and the marker figure 3a, it is not necessary to separately provide an image sensor (camera) corresponding to each, and it is possible to prevent the sensor configuration from becoming complicated. This leads to a reduction in sensor introduction cost, a reduction in processing load for image processing, and the like, which is also suitable for simplifying system construction.

Further, in the first embodiment, a plurality of image sensors arranged in parallel in the same direction (for example,
It is composed of two cameras 11a and 11b. That is, one marker figure 1b
, 3a, a plurality of (for example, two) captured images are obtained. Therefore, for example, it is possible to use a surveying technique using two camera images, and it is possible to perform highly accurate position recognition even if the number of marker figures 1b and 3a to be detected is singular.

In addition, in the first embodiment, a two-dimensional pattern marker figure 1b (or a light emitter) is attached to the external index 1a. Therefore, when the image sensors (cameras) 11a and 11b are used to detect the external index 1a, it becomes possible to use the pattern recognition technique, so that the marker graphic 1b included in the captured image can be easily and accurately identified and extracted. Can be done.
Furthermore, in the first embodiment, since the marker graphic 3a (or light emitter) as a movable index is attached to the second arm 3c of the backhoe 2, the marker graphic 1b in the external index 1a is attached.
As in the case of, the marker graphic 3a can be identified and extracted easily and accurately.
Moreover, if the marker figure 3a has a different pattern from the marker figure 1b, they will not be confused.

<3. Second embodiment>
Next, a case where the construction machine 2 is a slip foam machine used in a so-called slip foam construction method will be described as a second embodiment. Note that here, differences from the first embodiment will be mainly described, and description of the same contents as in the first embodiment will be omitted.

(Construction machinery)
FIG. 9: is a side view which shows typically the basic structural example of the slip foam machine which is an example of the construction machine used in the construction site area in 2nd embodiment.
The slip-form machine 2, which is an example of a construction machine, has at least a front cutting machine (hereinafter, simply referred to as “cutting machine”) 2d arranged on the front side in the traveling direction and a rear cutting machine on the rear side in the traveling direction. And a rear molding machine (hereinafter, also simply referred to as “molding machine”) 2e. The cutting machine 2d and the molding machine 2e are connected to each other and move integrally, but they may be configured to move as separate machines.

Here, a slip-form construction method performed using the slip-form machine 2 will be briefly described.
FIG. 10: is explanatory drawing which shows the construction condition of the slip-form construction method performed using a slip-form machine.
In the construction by the slip form method, first, an excavation step of excavating a groove using the cutting machine 2d is performed. After forming the excavation groove, subsequently, a steel frame (mold) included in the molding machine 2e is placed in the excavation groove. Then, a molding step is performed in which the fresh concrete is put into the mold, and the fresh concrete is compacted into a predetermined shape and molded therein. These steps are performed while moving the cutting machine 2d and the molding machine 2e.
As described above, in the slip-form construction method, a concrete structure (for example, U-shaped groove) having the same cross section is continuously placed using a slip-form machine having a self-propelled function.
The concrete structure may have a reinforcing bar laid inside. In that case, the cutting machine 2d and the molding machine 2e may be arranged apart from each other, and the reinforcing bar may be laid between the cutting machine 2d and the molding machine 2e.

In order to perform the construction by such a slip-form construction method, the cutting machine 2d and the molding machine 2e in the slip-form machine 2 are each configured as described below.

FIG. 11: is explanatory drawing which shows typically the structural example of the front part cutting machine which comprises the slip foam machine in 2nd embodiment.
As shown in FIG. 11(a), the cutting machine 2d has a traveling device 2f such as an endless track (crawler) and tires, and a vehicle body portion 2g supported by the traveling device 2f. It is configured to be movable. Via the actuator 2h, which operates hydraulically, to the vehicle body 2g,
An upper casing 3e as a movable working tool 3 and a drilling drum 3f are attached. The excavating drum 3f is rotatably supported by the upper housing 3e, and a plurality of cutter bits 3g is provided on the outer peripheral surface thereof.
In the cutting machine 2d having such a configuration, the actuator 2h moves the upper casing 3e, thereby controlling the position and the posture of the excavating drum 3f. In addition, FIG.
As shown in (), the excavation drum 3f is rotated to excavate the ground surface. In addition, excavated objects (earth, sand, stone,
The asphalt piece or the like) is transported by the transport conveyor 2i extending to the front side.

In other words, in the cutting machine 2d, the upper casing 3e, the excavation drum 3f, and the cutter bit 3g that move when moving are equivalent to the movable working tool 3 of the construction machine 2. Further, the tip end position of the cutter bit 3g provided on the outer peripheral surface of the rotating excavating drum 3f corresponds to the construction site of the movable work implement 3.

FIG. 12 is an explanatory diagram schematically showing a configuration example of a rear molding machine that constitutes the slip foam machine according to the second embodiment.
As shown in FIG. 12( a ), the molding machine 2 e is similar to the cutting machine 2 d described above in that the traveling device 2
j and a vehicle body portion 2k supported by the traveling device 2j, and is configured to be movable in the construction site area. An upper housing 3h as a movable work tool 3 and a mold 3i are attached to the vehicle body portion 2k via an actuator 21 that operates by hydraulic pressure.
As shown in FIG. 12(b), the mold 3i is connected to a concrete injector 2m for pouring ready-mixed concrete into the mold. Further, the mold 3i is provided with a vibrator 3j for filling the mold with fresh concrete by vibration.
In the molding machine 2e having such a configuration, the actuator 2l moves the upper housing 3h, thereby controlling the position and the posture of the mold 3i. Further, while pouring concrete into the mold 3i whose position and orientation are controlled and moving the mold 3i in the traveling direction, concrete structures having the same cross section are continuously poured.

That is, in the molding machine 2e, the upper housing 3h and the mold 3i that move as they move are
It corresponds to the movable working tool 3 of the construction machine 2. Further, the position where the mold 3i is arranged corresponds to the construction site of the movable work tool 3.

By the way, in the second embodiment described here, the slip sensor 2 is equipped with the detection sensor unit 11.
FIG. 13: is a perspective view which shows typically the schematic structural example of the slip foam machine which is an example of the construction machine used in the construction site area in 2nd embodiment.
The slip-form machine 2 is equipped with image sensors (cameras) 11e to 11h for picking up images and tilt sensors 11i and 11j capable of detecting tilts as the detection sensor unit 11. The image sensors 11e to 11h include a plurality of (for example, two) cameras 11e and 11f that are arranged side by side on the side surface of the upper housing 3e of the cutting machine 2d so as to face downward, and the molding machine 2e.
The plurality of (for example, two) cameras 11g and 11h are arranged in parallel on the side surface of the upper housing 3h facing downward. When the cutting machine 2d and the molding machine 2e are connected, the camera 11f in the upper housing 3e of the cutting machine 2d and the camera 11g in the upper housing 3h of the molding machine 2e do not necessarily have to be provided separately. Alternatively, one camera may be shared. Further, the inclination sensors 11i and 11j are the upper housing 3e of the cutting machine 2d.
And the upper housing 3h of the molding machine 2e, respectively.
Known cameras may be used for the cameras 11e to 11h and the tilt sensors 11i and 11j. In addition to these components, the slip foam machine 2 may be provided with another detection sensor unit 11.

In the construction site area 1 in which such a slip-form machine 2 is used, a two-dimensional marker figure identified as an external index 1a by an image pattern is provided at a position serving as a reference point (position where coordinates are specified in advance). 1c is arranged. The marker figure 1c includes cameras 11e to 11h.
It is assumed that a plurality of objects are to be imaged, and a plurality of them are arranged at predetermined intervals along the traveling direction of the slip foam machine 2. Instead of the marker graphic 1c, a light emitting device having a two-dimensional light emitting surface identified by a light emitting pattern or a light emitting device having a point light source identified by a blinking pattern may be arranged.

Further, the cameras 11e to 11h in the upper housing 3e that configures the movable work tool 3 of the cutting machine 2d and the upper housing 3h that configures the movable work tool 3 of the molding machine 2e respectively correspond to each other. Further, a marker figure 3k as a movable index is attached. The marker graphic 3k is an object to be imaged by the cameras 11e to 11h, like the marker graphic 1c as the external index 1a. Therefore, it is preferable that the marker graphic 3k be configured by a two-dimensional pattern different from the marker graphic 1c. Instead of the marker graphic 3k, a light emitting device having a two-dimensional light emitting surface identified by a light emitting pattern or a light emitting device having a point light source identified by a blinking pattern may be attached.

(Example of system configuration)
Next, a configuration example of the construction machine management system in the second embodiment will be described.
FIG. 14 is a block diagram showing a configuration example of the construction machine management system according to the second embodiment.

The construction machine management system according to the second embodiment includes cameras 11e and 11f as a detection sensor unit 11 and an inclination sensor 11i mounted on an upper housing 3e of a cutting machine 2d, and a molding machine 2e.
The cameras 11g and 11h as the detection sensor unit 11 mounted on the upper housing 3h and the tilt sensor 11j, and the SBC 13 connected to them are provided. The SBC 13 may be mounted on at least one of the cutting machine 2d and the molding machine 2e, and functions as the computer unit 13 described above.

The external management device 20 is connected to the SBC 13 via the data communication terminal 12, and Wi
-The point that the tablet terminal 32 is connected via the Fi terminal 31 is similar to the case of the first embodiment.

Further, the SBC 13 is connected to a hydraulic control unit 4c as a drive control unit 4 of the slip foam machine 2. The hydraulic control unit 4c uses the actuator 2h in the cutting machine 2d.
It also controls the operation of the actuator 2l in the molding machine 2e.

(Example of processing operation)
Next, an example of the processing operation in the construction machine management system having the above-described configuration, that is, the construction machine management method in the second embodiment will be described.
FIG. 15 is a flowchart showing an example of the flow of processing procedures of the construction machine management method according to the second embodiment.

In the construction machine management system having the configuration described above, when monitoring the construction site by the slip foam machine 2, first, the marker figure 1c installed in the construction site area 1 is recognized and the upper housings 3e and 3h are attached. Marker recognition is performed on the generated marker figure 3k (S201). Specifically, the marker figures 1c and 3k are picked up by the cameras 11e to 11h to obtain picked-up images of the marker figures 1c and 3k. The imaging at this time is performed such that at least two marker figures 1c and one marker figure 3k are included in one image in each of the cameras 11e to 11h. If at least two marker figures 1c and one marker figure 3k are imaged, it is possible to perform position recognition using the surveying technique described later in each of the imaging results of the cameras 11e to 11h. Therefore, it is assumed that the marker figures 1c are arranged at predetermined intervals set in consideration of the angle of view of each of the cameras 11e to 11h.

Further, in the construction machine management system, the tilt sensor 11i recognizes the tilt of the upper housing 3e of the cutting machine 2d, and the tilt sensor 11j recognizes the tilt of the upper housing 3h of the molding machine 2e (S202).

When the marker recognition and the tilt recognition are performed, the construction machine management system subsequently proceeds to SBC13.
The function of the position recognizing unit 13a in (1) performs position determination (position recognition) of the construction site by the slipform machine 2 (S203).

At the time of position determination, the position recognition unit 13a recognizes each of the construction site by the cutting machine 2d and the construction site by the molding machine 2e based on the captured images of the marker figures 1c and 3k.
Specifically, for each of the cameras 11e to 11h, the positions of the upper housings 3e and 3h in which the cameras 11e to 11h are mounted are recognized by using the surveying technique described below, based on the imaging result obtained by each camera. To do.

FIG. 16 is an explanatory diagram showing an outline of the surveying technique used in the second embodiment.
Here, as shown in FIG. 16A, a technique for measuring the lateral distance and height of the upper casing 3e of the cutting machine 2d based on the imaged images of the marker figures 1c and 3k captured by the camera 11e. explain. Needless to say, the same surveying technique can be applied to the images captured by the other cameras 11f to 11h.
In FIG. 16A, P is the position of the camera 11e, and A and B are the two marker figures 1c.
, And R represents the position of the marker graphic 3k. It is assumed that the distance AB between the marker figures 1c is defined and known when these are installed. Camera 11
It is assumed that the distance PR between the e and the marker graphic 3k is measured and known at the time of installation in the upper housing 3e. The camera 11e is mounted on the upper housing 3e in an adjusted state so that the optical axis extends along the vertical direction when the upper housing 3e is horizontal and the optical axis passes near the center of the marker graphic 3k. It is assumed to be installed.

16(b) to 16(d), O represents the center of the image captured by the camera 11e,
d represents the inclination angle of the upper housing 3e (0 in the horizontal state, + in the direction inclined to the marker graphic 1c side).

Here, for example, the actual distance between the points I and J is expressed as IJ, the pixel distance on the image between the points I and J is expressed as IJp, and the distance from the size of the subject and the pixel distance of the subject to the subject. Let us consider a case in which the characteristic value of the camera 11e that can be measured in advance to obtain is k. Also, the camera 11
When e is installed, an arbitrary vector in the camera coordinate system that is orthogonal to the camera installation surface of the upper housing 3e on the horizontal plane and faces the marker graphic 1c from the upper housing 3e is obtained as a vector S. C is the intersection of the straight line in the vector S direction from R and the line segment AB on the camera coordinates. Further, the foot of the perpendicular line from O to the line segment RC on the camera coordinates is O′.
Then, the actual coordinates C are obtained from A and B by the proportional division between ACP and BCP. Note that ∠ACO′ is θ on the camera coordinates. Further, the projection of R on the plane perpendicular to the optical axis PO and containing C is R′. O'is also treated on the same side.
In that case, the following relational expressions hold.

Based on the above relational expressions, the upper housing 3e in which the camera 11e is installed is determined from the relationship between the position of one camera 11e, the positions of the two marker figures 1c, and the position of the one marker figure 3k. It becomes possible to obtain the lateral distance CD and the height PD for the position of.
Then, if the distance CD and the height PD are known, the point R, which is the position of the marker graphic 3k, can be obtained based on these. The point R, which is the position of the marker figure 3k, is on a straight line forming an angle θ with the line segment AB from the point C toward the upper housing 3e, and at a distance CD-PRsin(d) from the point C toward the upper housing 3e. It is located at the height PD-PRcos(d) from the point C.

In other words, the position recognizing unit 13a uses the surveying technique described above while using the marker graphic 1c.
The points A and B are regarded as absolute positions, and the point R of the marker graphic 3k relative to them is regarded as a relative position,
Based on these detection results, a predetermined portion of the upper housing 3e that serves as one of the references for specifying the position of the upper housing 3e (specifically, the position of the point R with the marker graphic 3k) Is calculated and recognized.

The position recognition unit 13a performs the above position recognition processing not only on the detection result by the camera 11e but also on the detection results by the other cameras 11f to 11h. As a result, the position recognition unit 13a causes the upper housing 3e corresponding to each of the cameras 11e to 11h.
, 3h, the recognition result of the three-dimensional coordinate position is obtained.

Upon obtaining the position recognition results for the corresponding portions of the cameras 11e to 11h in the position determination, the position recognition unit 13a then combines these position recognition results to form the upper housing 3e.
, 3h position information is recognized.

Specifically, for example, in the case of the upper housing 3e, two marker figures in the upper housing 3e are determined from the position recognition result based on the detection result of the camera 11e and the position recognition result based on the detection result of the camera 11f. Since the respective 3D coordinate positions of 3k (point R) are specified, the position recognition unit 13a determines the upper housing 3 in the construction site area 1 based on these 3D coordinate positions.
The position, azimuth, attitude (state of inclination), etc. of e are recognized. At this time, the position recognition unit 13a recognizes the posture of the upper housing 3e based on the detection result of the tilt sensor 11i.

In this way, the position recognition unit 13a combines the position recognition result based on the detection result of the camera 11e and the position recognition result based on the detection result of the camera 11f, and further, the tilt sensor 11i.
The position information of the upper housing 3e is recognized based on the detection result by the. Thereby, in the cutting machine 2d, the construction site area when the position of the marker figure 1c which is the reference point is used as the reference for the construction location of the upper casing 3e as the movable work tool 3, the excavation drum 3f and the cutter bit 3g. It is possible to obtain the monitoring result of the absolute position within 1.

Further, for example, in the case of the upper housing 3h, two three-dimensional coordinate positions in the upper housing 3h are determined from the position recognition result based on the detection result of the camera 11g and the position recognition result based on the detection result of the camera 11h. Since it is specified, the position recognition unit 13a recognizes the position, orientation, attitude (inclined state), etc. of the upper housing 3h in the construction site area 1 based on these three-dimensional coordinate positions. At this time, the position recognition unit 13a recognizes the posture of the upper housing 3h based on the detection result of the tilt sensor 11j.

In this way, the position recognition unit 13a combines the position recognition result based on the detection result of the camera 11g and the position recognition result based on the detection result of the camera 11h, and further, the tilt sensor 11j.
The position information of the upper housing 3h is recognized based on the detection result by the. As a result, regarding the molding machine 2e, the absolute location within the construction site area 1 when the position of the marker figure 1c, which is the reference point, is used as the reference for the installation location of the upper housing 3h as the movable work tool 3 and the mold 3i. It is possible to obtain monitoring results at various positions.

Thereafter, as shown in FIG. 15, in the construction machine management system, the function of the difference information extraction unit 13c in the SBC 13 performs posture recognition of the slipform machine 2 with respect to the construction plan data of the construction site area 1 (S204). Specifically, the monitoring result of the construction site by the cutting machine 2d and the molding machine 2e of the slip foam machine 2 is compared with the coordinate value of the corresponding position in the construction plan data of the construction site area 1, and the difference between the two is compared. Extract information.

After the difference information is extracted, in the construction machine management system, the function as the guidance output unit 13d in the SBC 13 performs the machine guidance processing operation and outputs the operation guidance information, so that it can be applied to the field worker who handles the slipform machine 2. Then, the posture of the slipform machine 2 is displayed (S205).

The operation guidance information is output in the following manner, for example.
FIG. 17 is an explanatory diagram illustrating an example of operation guidance information output by the construction machine management system according to the second embodiment.

It is conceivable that the operation guidance information is output on the display screen 43 as shown in FIG. 17, for example. The display screen 43 of the illustrated example is configured such that an image 43b representing the slipform machine 2 is displayed on a construction surface 43a drawn based on the construction plan data at a position where the extracted difference information is reflected. ing. A guide line (guide curve) 43c for guiding the current positions of the cutting machine 2d and the molding machine 2e of the slipform machine 2 to the construction surface 43a may be displayed on the display screen 43. Furthermore, in the display screen 43, a related numerical value (for example,
The coordinate value) may be displayed.

If the operation guidance information is output on the display screen 43 as described above, it is very convenient for the site worker to match the construction site by the cutting machine 2d and the molding machine 2e of the slipform machine 2 with the construction plan data. It has excellent properties.

Note that, as shown in FIG. 15, the external management device 20 performs the posture recognition of the slipform machine 2 for the construction plan data (S206) and the posture display of the slipform machine 2 by the output of the operation guidance information (S207). You may do it. If the operation management information is output by the external management device 20, for example, even if the field worker who actually operates the slip-form machine 2 is an unskilled worker, a center expert who is at a remote location can slip. It is possible to provide an operation advice to a non-skilled person while grasping the situation of construction by the foam machine 2.

Further, the external management device 20 may perform a machine control processing operation separately from or in addition to the machine guidance processing operation. Specifically, the external management device 20 performs a process of generating a movement curve for moving the cutting machine 2d and the molding machine 2e of the slipform machine 2 to the construction surface (that is, attitude control in the figure) (
(S208), processing for configuring the operation for performing the movement in each sequence such as hydraulic operation of the actuators 2h, 2l (that is, control generation in the figure) is performed (S209). And
A process of giving an operation instruction according to each sequence to the hydraulic control unit 4c (that is, a control instruction in the drawing) is performed (S210). In response to this operation instruction, the hydraulic control unit 4c operates the actuators 2h and 2l as needed (S211), and thereby the upper housing 3e of the cutting machine 2d.
, The excavating drum 3f and the cutter bit 3g, and the upper casing 3h of the cutting machine 2e.
And the mold 3i is guided to a predetermined position.

By performing such a machine control processing operation, the upper casing 3e in the cutting machine 2d, the excavating drum 3f and the cutter bit 3g, and the upper casing 3h and the mold 3i in the cutting machine 2e move along the construction surface. In addition, it is possible to automatically adjust the positions of the cutting machine 2d and the molding machine 2e. That is, the operation, posture, and the like of the slip-form machine 2 are automatically operated so that the construction sites of the cutting machine 2d and the molding machine 2e match the construction plan data.

In the case where the machine control processing operation is performed, the posture control (S208) is performed here.
), the control generation (S209) and the control instruction (S210) are performed by the external management device 20 as an example, but these processes may be performed by the SBC 13 of the slipform machine 2.

Further, the motion plan information (movement curve, etc.) generated in the attitude control (S208) may be used for control monitoring in the external management device 20 (S212). If you do this,
For example, the operation and posture of the slip foam machine 2 can be supplementarily controlled from the external management device 20. Therefore, it becomes possible for a center expert at a remote location to appropriately correct the control content for the slipform machine 2 while grasping the situation of the construction by the slipform machine 2, and thus the slipform machine 2 is automatically operated. The accuracy and reliability of driving can be improved.

(Effect)
According to the second embodiment described above, the detection sensor unit 11 mounted on the slip foam machine 2 is used to autonomously monitor the construction site of the cutting machine 2d and the molding machine 2e of the slip foam machine 2. Since this is obtained, substantially the same operational effects as in the case of the above-described first embodiment can be obtained.

Further, in the second embodiment, as the detection sensor unit 11, a plurality of cameras 11e and 11f are mounted on the upper housing 3e of the cutting machine 2d, and a plurality of cameras 11g are also mounted on the upper housing 3h of the molding machine 2e.
, 11h are installed. Each of the cameras 11e to 11h targets at least two marker figures 1c and one marker figure 3k as detection targets. That is, the image sensor is configured by a plurality (for example, two per one housing) of cameras 11e to 11h arranged in parallel in the same direction, and each of the cameras 11e to 11h has a plurality of indices (specifically, , Two marker figures 1c and one marker figure 3k) are detected. Then, at the time of position determination, the position recognition unit 13a individually recognizes the positions of the detection results of the cameras 11e to 11h, and appropriately combines these position recognition results to recognize the position information of the upper housings 3e and 3h. To do. Therefore, in the second embodiment, for each of the upper housings 3e and 3h, not only the three-dimensional coordinate position but also the azimuth, posture (inclined state), etc. are detected from the detection results of the cameras 11e to 11h. The recognition can be performed, and the recognition can be performed with high accuracy.

Further, in the second embodiment, a plurality of marker figures 1c arranged at predetermined intervals are used as the external index 1a. Therefore, it is very suitable when applied to the case where a long concrete structure is continuously placed using the slip-form machine 2 having a self-propelled function. For example, in the slipform construction method, a sensor line composed of a long continuous body may be laid along the traveling direction of the slipform machine 2, and the slipform machine 2 may be moved along the sensor line. On the other hand, if a plurality of marker figures 1c are used as the external index 1a, it is possible to move the slipform machine 2 with high accuracy by interspersing the marker figures 1c without laying a continuum. It will be possible. Moreover, unlike the case of the sensor line, it is possible to recognize the posture (inclination). Therefore, it is very suitable to be applied in the case where construction is performed while moving the construction machine in a predetermined direction like the slip-form construction method.

<4. Other Embodiments>
Although the embodiments of the present invention have been specifically described above, the technical scope of the present invention is not limited to the above-described embodiments, and various modifications can be made without departing from the scope of the invention.

For example, the backhoe 2 in the first embodiment and the slip foam machine 2 in the second embodiment are exemplified as the construction machine, but the technical scope of the present invention is not limited thereto. That is, the present invention is a civil engineering machine, a transport machine, a cargo handling machine, a foundation construction machine, a drilling machine, a tunnel construction machine, a concrete machine such as a crusher, a paving machine, a road maintenance machine, a snow plow, a self-propelled type It can be applied to various types of construction machines such as mowers.
When the construction machine is a snow plow, for example, by arranging an external index on the slope of the ski resort, the snow plow can autonomously monitor the construction site (snow plow) by the blade of the snow plow. Will be possible. In addition, when the construction machine is a self-propelled mower, for example, by arranging an external index on the course of the golf course, the construction site (cutting place) by the cutter blade of the self-propelled mower The self-propelled mower can be autonomously monitored.

In the first embodiment, the case where the marker figure 1b is attached to the external index 1a is described as an example, but the technical scope of the present invention is not limited to this. That is, the marker graphic 1b
Even if the external indicator 1a is not attached, for example, if a staff or a similar one is used as the external index 1a, the position of the reference point where the external index 1a is arranged can be determined by analyzing the image of the scale or the like of the staff. It is possible to specify.

In each of the first and second embodiments, the case where the image sensors (cameras) 11a, 11b, and 11e to 11h are used as the detection sensor unit 11 has been described as an example, but the technical scope of the present invention is not limited to this. It is not limited to this. That is, the detection sensor unit 11 may use another sensor instead of the image sensor or in addition to the image sensor as long as it can at least recognize the position of the construction machine.
For example, it is possible to use an infrared camera or an infrared sensor as another sensor. If infrared rays are used, even in a special environment such as at night or in a tunnel construction site, it is possible to perform highly accurate position recognition while suppressing the influence of lighting and the like.
Further, as another sensor capable of recognizing the position, for example, a plurality of single measurement type GPS devices may be used. By using a plurality of GPS devices, the inexpensive single-measurement type GPS devices are in circulation in recent years, and the relative positions of the GPS devices can be recognized with high accuracy. It becomes possible to perform highly accurate position recognition on the order of at least several cm.

In each of the first and second embodiments, the image sensor (camera) 11a, 11b, 11e to 11h and the tilt sensors 11c, 11d, 1 are used as the detection sensor unit 11.
The case where 1i and 11j are used in combination has been described as an example, but the technical scope of the present invention is not limited to this. For example, even if the detection sensor unit 11 is composed of only an image sensor (camera), it is possible to perform position recognition based on the detection result. However, as described in the first embodiment and the second embodiment, if the image sensor (camera) and the tilt sensor are used in combination, it is possible to prevent the configuration of the detection sensor unit 11 from becoming complicated, It becomes feasible to perform highly accurate position recognition.

Further, in the first embodiment, the case where the position of the construction site is recognized by the bucket 3d based on the imaging result of the marker figure 3a as the movable index in the second recognition process is described as an example. If an inclination sensor is provided on each of 3b, the second arm 3c, and the bucket 3d, the position may be recognized using the detection result of each inclination sensor. This is because the sword tip position of the bucket 3d can be specified by combining the detection results of the rotation angles of the first arm 3b, the second arm 3c, and the bucket 3d.

Further, in the second embodiment, a concrete structure (for example, U
Although the example of the case of placing a gutter) was given, in addition to the U-shaped gutter, curbs, gutters, circular waterways, protective fences,
Even when the road surface pavement or the like is used as the construction object, the present invention can be applied in exactly the same manner.
In the second embodiment, the case where the cutting machine 2d and the molding machine 2e are mainly linked has been described, but the cutting machine 2d and the molding machine 2e may be operated as separate construction machines. In that case, the machine guidance processing operation and the machine control processing operation are performed separately for each.
In the second embodiment, the actuator 2h is used for the machine control processing operation.
, 2l is used as an example to control the hydraulic operation and the like, but, for example, the traveling device 2f of the cutting machine 2d is used.
Alternatively, the operation control of the traveling device 2j of the molding machine 2e or the like may be performed.
Further, in the second embodiment, the case where the present invention is applied to the slipform machine 2 used in the slipform construction method is taken as an example, but if it is a construction machine that performs construction while moving in the traveling direction, for example, open Like the front and rear housings of shield machines (open pit machines),
The present invention can be similarly applied to a construction machine used in another method.

Further, in each of the above-described embodiments, the case where the technical idea of the present invention is embodied as the “construction machine management system” has been described as an example, but the invention is not necessarily limited to this.
For example, the present invention can be realized as a “construction machine management program” that causes a computer to execute the autonomous monitoring process of the construction machine described in each embodiment. That is, the present invention is
"A computer connected to the detection sensor unit mounted on the construction machine that can move in the construction site area,
Based on the detection result of the detection sensor section for the external index installed in the construction site area, and the detection result of the detection sensor section for the movable index attached to the movable work tool of the construction machine , Position recognition means for recognizing position information of a construction site by the movable work tool in the construction site area,
Construction machine management program to function as. Can also be established.

Further, for example, the present invention can be realized as a “construction machine management method” that performs the autonomous monitoring process of the construction machine described in each embodiment. That is, the present invention is
"Using the detection sensor unit mounted on the construction machine that can move in the construction site area,
Based on the detection result of the detection sensor section for the external index installed in the construction site area, and the detection result of the detection sensor section for the movable index attached to the movable work tool of the construction machine A construction machine management method for recognizing position information of a construction site by the movable work tool in the construction site area. Can also be established.

Further, for example, the present invention can be realized as a “construction machine” having the function of performing the autonomous monitor processing described in each embodiment. That is, the present invention is
"A construction machine that can move in the construction site area,
A detection sensor unit mounted on the construction machine,
A computer unit connected to the detection sensor unit,
The computer unit detects the detection result of the external index installed in the construction site area by the detection sensor unit and the detection sensor unit of the movable index attached to the movable work tool of the construction machine. A construction machine having a position recognition unit for recognizing position information of a construction site by the movable work tool in the construction site area based on the result. Can also be established.

In addition, for example, the present invention is configured to exchange information with a construction machine and to perform the autonomous monitoring process of the construction machine described in each embodiment. It can also be established as an "external management device". That is, the present invention is
“An external management device for a construction machine, which is arranged apart from a construction machine that is movable in a construction site area and is configured to exchange information with the construction machine,
Using the detection sensor unit mounted on the construction machine that can move in the construction site area,
Based on the detection result of the detection sensor section for the external index installed in the construction site area, and the detection result of the detection sensor section for the movable index attached to the movable work tool of the construction machine , About the recognition result of recognizing the position information of the construction site by the movable work tool in the construction site area,
At least one of the recognition result and the derived information from the recognition result is configured to be output,
External management equipment for construction machinery. Can also be established.

1... Construction site area, 1a... External index, 1b, 1c... Marker figure, 2... Construction machine (backhoe, slipform machine), 2a... Right endless track, 2b... Left endless track, 2c... Machine stand, 2
d... front cutting machine, 2e... rear molding machine, 2f... running device, 2g... vehicle body part, 2h... actuator, 3... movable work tool, 3a, 3k... movable index (marker figure), 3b... first arm, 3c
...Second arm, 3d...bucket, 3e...upper casing, 3f...drilling drum, 3g...cutter bit, 3h...upper casing, 3i...mold, 3j...vibrator, 11...detection sensor unit, 1
1a, 11b, 11e to 11h... Image sensor (camera), 11c, 11d, 11i,
11j... Inclination sensor, 12... Information communication unit (data communication terminal), 13... Computer unit (S
BC), 13a... Position recognition unit, 13b... Data acquisition unit, 13c... Difference information extraction unit, 13d
... Guidance output unit, 13e... Operation plan generation unit, 13f... Operation instruction unit, 20... External management device

Claims (13)

A detection sensor unit mounted on a construction machine that can move in the construction site area,
Based on the detection result of the detection sensor section for the external index installed in the construction site area, and the detection result of the detection sensor section for the movable index attached to the movable work tool of the construction machine , Performing a survey calculation using the positional relationship between the position of each of the external index and the movable index and the position of the detection sensor unit to obtain a three-dimensional coordinate value of a construction site by the movable work tool in the construction site area. A position recognition unit that recognizes position information including
Construction machine management system equipped with. The position recognition unit, through the first recognition process for recognizing the position information of the construction machine, and the second recognition process for recognizing the position information of the construction site by the movable work tool, the three-dimensional coordinates for the construction site. The construction machine management system according to claim 1, wherein position information including a value is recognized. The construction machine management system according to claim 1, wherein the detection sensor unit is mounted on the construction machine that performs construction while moving in a predetermined direction. The construction machine management system according to any one of claims 1 to 3, wherein the position information recognized by the position recognition unit includes at least one of a posture and an orientation of the movable work tool. The difference information extraction part which compares the recognition result by the said position recognition part with the construction plan data about the said construction site area, and extracts the difference of the said construction location with respect to the said construction plan data as difference information. The construction machine management system according to any one of 1. The construction machine management system according to claim 5, further comprising: a guidance output unit that outputs operation guidance information of the movable work tool generated based on the difference information extracted by the difference information extraction unit. Based on the difference information extracted by the difference information extraction unit, a motion plan generation unit that generates motion plan information of the movable work tool for matching the construction location with the construction plan data,
An operation instruction section for giving an operation instruction to the drive control section of the construction machine, based on the operation plan information generated by the operation plan generation section;
The construction machine management system according to claim 5, further comprising: An information communication unit for exchanging information between the construction machine and an external management device arranged apart from the construction machine,
The construction according to any one of claims 5 to 7, wherein the information transmitted and received by the information communication unit includes at least one of difference information extracted by the difference information extraction unit and derivation information from the difference information. Machine management system. The detection sensor unit has an image sensor for capturing an image,
The construction machine management system according to any one of claims 1 to 8, wherein the position recognition unit is configured to perform position information recognition by performing recognition processing on an image obtained by the image sensor. A computer connected to the detection sensor unit mounted on the construction machine that can move in the construction site area,
Based on the detection result of the detection sensor section for the external index installed in the construction site area, and the detection result of the detection sensor section for the movable index attached to the movable work tool of the construction machine , Performing a survey calculation using the positional relationship between the position of each of the external index and the movable index and the position of the detection sensor unit to obtain a three-dimensional coordinate value of a construction site by the movable work tool in the construction site area. Position recognition means for recognizing position information including
Construction machine management program to function as. Using the detection sensor unit mounted on the construction machine that can move in the construction site area,
Based on the detection result of the detection sensor section for the external index installed in the construction site area, and the detection result of the detection sensor section for the movable index attached to the movable work tool of the construction machine , Performing a survey calculation using the positional relationship between the position of each of the external index and the movable index and the position of the detection sensor unit to obtain a three-dimensional coordinate value of a construction site by the movable work tool in the construction site area. A construction machine management method that recognizes location information including. A construction machine that can be moved in the construction site area,
A detection sensor unit mounted on the construction machine,
A computer unit connected to the detection sensor unit,
The computer unit detects the detection result of the external index installed in the construction site area by the detection sensor unit and the detection sensor unit of the movable index attached to the movable work tool of the construction machine. Based on the result, by performing a survey calculation using the positional relationship between each position of the external index and the movable index and the position of the detection sensor unit, of the construction site by the movable work tool in the construction site area A construction machine having a position recognition unit that recognizes position information including three-dimensional coordinate values. An external management device for a construction machine, which is arranged apart from a construction machine that can move a construction site area, and is configured to exchange information with the construction machine,
Using the detection sensor unit mounted on the construction machine that can move in the construction site area,
Based on the detection result of the detection sensor section for the external index installed in the construction site area, and the detection result of the detection sensor section for the movable index attached to the movable work tool of the construction machine , Performing a survey calculation using the positional relationship between the position of each of the external index and the movable index and the position of the detection sensor unit to obtain a three-dimensional coordinate value of a construction site by the movable work tool in the construction site area. About the recognition result of recognizing the location information including
At least one of the recognition result and the derived information from the recognition result is configured to be output,
External management equipment for construction machinery.