KR20160110642A - Monitoring apparatus for work status of construction equipment and method thereof - Google Patents
Monitoring apparatus for work status of construction equipment and method thereof Download PDFInfo
- Publication number
- KR20160110642A KR20160110642A KR1020150033030A KR20150033030A KR20160110642A KR 20160110642 A KR20160110642 A KR 20160110642A KR 1020150033030 A KR1020150033030 A KR 1020150033030A KR 20150033030 A KR20150033030 A KR 20150033030A KR 20160110642 A KR20160110642 A KR 20160110642A
- Authority
- KR
- South Korea
- Prior art keywords
- construction equipment
- image
- images
- camera
- monitoring
- Prior art date
Links
- 238000010276 construction Methods 0.000 title claims abstract description 131
- 238000000034 method Methods 0.000 title claims abstract description 41
- 238000012544 monitoring process Methods 0.000 title claims abstract description 41
- 230000002194 synthesizing effect Effects 0.000 claims description 4
- 238000012806 monitoring device Methods 0.000 claims description 2
- 238000010586 diagram Methods 0.000 description 8
- 230000008569 process Effects 0.000 description 4
- 230000009466 transformation Effects 0.000 description 4
- PXFBZOLANLWPMH-UHFFFAOYSA-N 16-Epiaffinine Natural products C1C(C2=CC=CC=C2N2)=C2C(=O)CC2C(=CC)CN(C)C1C2CO PXFBZOLANLWPMH-UHFFFAOYSA-N 0.000 description 2
- 230000004888 barrier function Effects 0.000 description 2
- 230000015572 biosynthetic process Effects 0.000 description 2
- 230000006872 improvement Effects 0.000 description 2
- 230000002093 peripheral effect Effects 0.000 description 2
- 238000003786 synthesis reaction Methods 0.000 description 2
- 208000019901 Anxiety disease Diseases 0.000 description 1
- 230000004913 activation Effects 0.000 description 1
- 230000036506 anxiety Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
- G06Q50/08—Construction
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
- G06Q50/10—Services
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
Landscapes
- Business, Economics & Management (AREA)
- Engineering & Computer Science (AREA)
- Tourism & Hospitality (AREA)
- Human Resources & Organizations (AREA)
- Primary Health Care (AREA)
- Health & Medical Sciences (AREA)
- Economics (AREA)
- General Health & Medical Sciences (AREA)
- Theoretical Computer Science (AREA)
- Marketing (AREA)
- General Physics & Mathematics (AREA)
- Strategic Management (AREA)
- Physics & Mathematics (AREA)
- General Business, Economics & Management (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Closed-Circuit Television Systems (AREA)
- Component Parts Of Construction Machinery (AREA)
Abstract
Description
The present invention relates to an apparatus and method for monitoring the operation status of a construction equipment, and more particularly, to a system and method for monitoring the operation status of a construction equipment by converting a top-view image without a blind spot of a construction equipment through a plurality of cameras and sensors, To a pilot of a construction equipment, and a method thereof.
Generally, large-scale construction equipment such as dozer, loader, excavator, and grader is mainly used in earthwork environment. Of these, excavators have a wide range of work to be done compared to the size of equipment, and the disadvantages of such excavator characteristics (boom, arm, bucket) .
As a result, excavators cause frequent safety accidents due to blind spots, crashes and disturbances due to blind spots during driving, and the efficiency of equipment operation is greatly degraded due to anxiety about accidents. Especially, the construction equipment operator is classified as 3D job and the input of new manpower is very low. Therefore, the absence of a skilled operator deepens these problems.
Therefore, it is urgent to develop a device to enable the equipment operator to grasp the status of the earthwork environment in real time when operating the equipment.
The technique of the present invention is disclosed in Korean Patent Laid-Open Publication No. 2014-0026690 (published on April 03, 2016).
SUMMARY OF THE INVENTION The present invention has been made in order to solve the above-mentioned problems, and an object of the present invention is to provide a method and apparatus for converting a top-view image without a blind spot of a construction equipment through a plurality of cameras and sensors, Which is provided to a pilot of a construction equipment, and a method thereof.
An apparatus according to an embodiment of the present invention includes a photographing unit having a plurality of first cameras for photographing front, back, left and right sides of a construction equipment, and a second camera for photographing the front of the construction equipment; A sensor unit including a plurality of sensors for recognizing an obstacle in a setting area behind the construction equipment; An image converting unit for generating a plurality of corrected images by correcting the images photographed by the plurality of first cameras, and synthesizing the plurality of corrected images by an overlay method to convert the images into a top view type image; A control unit for generating obstacle information and operation status images around the construction equipment by reflecting the data recognized by the plurality of sensors and the image captured by the second camera on the top view type image; And a display unit for displaying the obstacle information and the operation status image around the construction equipment.
Also, the first camera may be a CCD camera provided on the front, rear, left, and right sides of the construction equipment such that the front, back, left, and right sides of the construction equipment are all photographed.
Also, the image converter may synthesize the plurality of corrected images in an overlay method based on the mask image including the information on the shooting area of each first camera and the weight information on the pixels forming each shooting area, May be converted into the top view type image.
In addition, the sensor is a laser sensor provided at both rear sides of the construction equipment, and can recognize the position, type, moving direction, and moving speed of an obstacle including an object and a person in the setting area separately.
In addition, the second camera is a stereo vision camera provided in front of the construction equipment, and the ground surface of the construction equipment front work area can be photographed in 3D image.
In addition, the control unit may generate the job status image as a 3D image so that the pre-stored job plan image and the image captured by the second camera can be compared with each other.
A method of monitoring a work status using an apparatus for monitoring work status of a construction equipment according to an embodiment of the present invention includes generating a plurality of corrected images by correcting images photographed from a plurality of first cameras that photograph front, Synthesizing the image data in an overlay manner, and converting the synthesized image into a top view image; Receiving data recognized from a plurality of sensors for recognizing an obstacle in a setting area behind the construction equipment and images photographed by a second camera for photographing the front of the construction equipment; Reflecting the data and the image on an image of the top view type to generate obstacle information and a work status image around the construction equipment; And displaying the obstacle information and the operation status image around the construction equipment.
The apparatus and method for monitoring the operation status of a construction equipment according to the present invention convert a top-view image of a construction equipment into a top-view image through a plurality of cameras and sensors, Thereby contributing to the improvement of safety and work efficiency of the construction equipment.
In addition, the present invention can provide a suitable surround view for a construction equipment operator by installing a CCD camera, a 2D laser sensor, and a stereo vision camera in a suitable position of a construction equipment, thereby eliminating a blind spot And it is possible to prevent a safety accident and to maximize the efficiency of operation of the equipment by easily recognizing the movement of the obstacles and the worker.
Further, the present invention can lower the entry barriers of the construction equipment operators and contribute to the activation of the construction equipment industry.
1 is a block diagram illustrating an apparatus for monitoring the operation status of a construction equipment according to an embodiment of the present invention.
2 is a view for explaining a position where a photographing unit of a construction equipment monitoring apparatus for construction equipment according to an embodiment of the present invention is installed.
3 is a flowchart illustrating an operational flow of a method of monitoring the operation status of a construction equipment according to an embodiment of the present invention.
4 is a conceptual diagram of a top view type image converted by a CCD camera of an apparatus for monitoring the operation status of construction equipment according to an embodiment of the present invention.
5 is a conceptual diagram of data recognized by a laser sensor of an apparatus for monitoring the operation status of construction equipment according to an embodiment of the present invention.
6 and 7 are conceptual diagrams of an image captured by a stereo vision camera of an apparatus for monitoring the operation status of construction equipment according to an embodiment of the present invention.
FIG. 8 and FIG. 9 show an example of a screen displayed through the display unit of the apparatus for monitoring the operation status of construction equipment according to the embodiment of the present invention.
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An apparatus and method for monitoring the operation status of construction equipment according to an embodiment of the present invention will be described with reference to the accompanying drawings. In this process, the thicknesses of the lines and the sizes of the components shown in the drawings may be exaggerated for clarity and convenience of explanation.
Further, the terms described below are defined in consideration of the functions of the present invention, which may vary depending on the intention or custom of the user, the operator. Therefore, definitions of these terms should be made based on the contents throughout this specification.
FIG. 1 is a block diagram illustrating an apparatus for monitoring the operation status of a construction equipment according to an embodiment of the present invention. FIG. 2 is a view for explaining a position where a photographing unit of the apparatus for monitoring the operation status of a construction equipment according to an embodiment of the present invention is installed FIG.
1 and 2, an
The photographing
2, the
That is, the four
2, the
That is, the
The
In detail, a plurality of correction images are synthesized in an overlay method based on a mask image including photographing area information for each
More specifically, the
In this way, the
The
2, the
That is, the two
The
That is, the
The
Hereinafter, a method of monitoring the operation status of the construction equipment using the operation status monitoring device will be described in detail.
FIG. 3 is a flowchart illustrating an operational flow of a method of monitoring the operation status of a construction equipment according to an embodiment of the present invention, and a specific operation of the present invention will be described with reference to FIG.
First, the operation
More specifically, the photographing area information for each
More specifically, images photographed from a plurality of
4 is a conceptual diagram of a top view type image converted by a CCD camera of an apparatus for monitoring the operation status of construction equipment according to an embodiment of the present invention.
As shown in FIG. 4, the four correction images are synthesized in the overlay method, and 360 ° of the peripheral equipment of the
At this time, the four
The operation
At this time, the
That is, the two
5 is a conceptual diagram of data recognized by a laser sensor of an apparatus for monitoring the operation status of construction equipment according to an embodiment of the present invention.
5, the
The
That is, the
6 to 7 are conceptual diagrams of an image captured by a stereo vision camera of an apparatus for monitoring the operation status of construction equipment according to an embodiment of the present invention.
In detail, as shown in FIG. 6, the state of the progress of work is photographed through a stereo vision camera which takes a 3D image of the ground in the work area in front of the
In addition, as shown in FIG. 7, the pre-stored task plan image and the image photographed from the
Then, the operation
That is, a person, a material, a truck, and the like recognized from the plurality of
In operation S340, the operation
Accordingly, it is possible to grasp the obstacle information around the
Then, the operation
At this time, the
FIG. 8 and FIG. 9 show an example of a screen displayed through the display unit of the apparatus for monitoring the operation status of construction equipment according to the embodiment of the present invention.
8 and 9, the
As described above, the apparatus and method for monitoring the operation status of the construction equipment according to the embodiment of the present invention converts a top-view image without a blind spot of the construction equipment through a plurality of cameras and sensors, By providing information on the status to pilots of construction equipment, it is possible to contribute to improvement of safety and work efficiency of construction equipment.
In addition, by installing CCD camera, 2D laser sensor and stereo vision camera in the proper position of the construction equipment, it is possible to provide the optimum view to the construction equipment operator, thereby eliminating the blind spot that can occur in construction equipment operation, By easily grasping obstacles and movement of workers, safety accidents can be prevented beforehand and the efficiency of equipment operation can be maximized.
In addition, it can lower the entry barriers of construction equipment operators and contribute to the revitalization of the construction equipment industry.
While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it will be understood by those skilled in the art that various changes and modifications may be made without departing from the scope of the invention as defined by the appended claims. will be. Accordingly, the true scope of the present invention should be determined by the following claims.
110: photographing unit 111: first camera
113: second camera 120: image conversion unit
130: sensor unit 131: sensor
140: control unit 150: display unit
200: Construction equipment
Claims (12)
A sensor unit including a plurality of sensors for recognizing an obstacle in a setting area behind the construction equipment;
An image converting unit for generating a plurality of corrected images by correcting the images photographed by the plurality of first cameras, and synthesizing the plurality of corrected images by an overlay method to convert the images into a top view type image;
A control unit for generating obstacle information and operation status images around the construction equipment by reflecting the data recognized by the plurality of sensors and the image captured by the second camera on the top view type image; And
And a display unit for displaying the obstacle information and the operation status image around the construction equipment.
Wherein the first camera comprises:
Wherein the construction equipment is mounted on the front, rear, left, and right sides of the construction equipment such that the front, back, left, and right sides of the construction equipment are all photographed.
The image converter may include:
A plurality of correction images are synthesized in an overlay manner on the basis of a mask image including shooting area information of each first camera and weight information of pixels constituting each shooting area, A monitoring device for monitoring the operation status of the construction equipment converting the image into the top view type image.
The sensor includes:
And a laser sensor provided at both sides of the rear portion of the construction equipment, wherein the laser sensor senses a position, a type, a moving direction, and a moving speed of an obstacle including an object and a person in the setting area.
Wherein the second camera comprises:
A stereo vision camera provided in front of the construction equipment, and monitoring the operation status of the construction equipment for photographing the ground surface of the construction equipment in a 3D image.
Wherein,
A monitoring unit for monitoring the operation status of the construction equipment to generate the operation status image using the 3D image so that the pre-stored operation plan image and the image captured by the second camera can be compared.
Generating a plurality of corrected images by correcting the images photographed by the plurality of first cameras that photograph the front, back, left, and right sides of the construction equipment, synthesizing the corrected images by an overlay method, and converting the combined images into a top view type image;
Receiving data recognized from a plurality of sensors for recognizing an obstacle in a setting area behind the construction equipment and images photographed by a second camera for photographing the front of the construction equipment;
Reflecting the data and the image on an image of the top view type to generate obstacle information and a work status image around the construction equipment; And
And displaying the obstacle information and the operation status image around the construction equipment.
Wherein the first camera comprises:
And monitoring the operation status of the construction equipment such that the front, back, left, and right sides of the construction equipment are respectively photographed.
The step of converting into the top view type image
A plurality of correction images are synthesized in an overlay manner on the basis of a mask image including shooting area information of each first camera and weight information of pixels constituting each shooting area, And monitoring the operation status of the construction equipment converting the image into the top view type image.
The sensor includes:
And a laser sensor provided at both sides of the rear portion of the construction equipment, wherein the laser sensor senses a position, a type, a moving direction, and a moving speed of an obstacle including an object and a person in the setting area.
Wherein the second camera comprises:
And a stereo vision camera provided in front of the construction equipment, the method comprising the steps of: capturing a 3D image of the ground surface of the work area in front of the construction equipment;
The step of generating the job status image
A method of monitoring the operation status of a construction equipment, which generates the operation status image as a 3D image so that a pre-stored job plan image and an image photographed from the second camera can be compared.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020150033030A KR20160110642A (en) | 2015-03-10 | 2015-03-10 | Monitoring apparatus for work status of construction equipment and method thereof |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020150033030A KR20160110642A (en) | 2015-03-10 | 2015-03-10 | Monitoring apparatus for work status of construction equipment and method thereof |
Publications (1)
Publication Number | Publication Date |
---|---|
KR20160110642A true KR20160110642A (en) | 2016-09-22 |
Family
ID=57102429
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
KR1020150033030A KR20160110642A (en) | 2015-03-10 | 2015-03-10 | Monitoring apparatus for work status of construction equipment and method thereof |
Country Status (1)
Country | Link |
---|---|
KR (1) | KR20160110642A (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11076130B2 (en) | 2017-07-14 | 2021-07-27 | Komatsu Ltd. | Operation information transmission device, construction management system, operation information transmission method, and program |
KR20230089493A (en) * | 2021-12-13 | 2023-06-20 | 한남대학교 산학협력단 | Multi-camera fire detector |
-
2015
- 2015-03-10 KR KR1020150033030A patent/KR20160110642A/en not_active Application Discontinuation
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11076130B2 (en) | 2017-07-14 | 2021-07-27 | Komatsu Ltd. | Operation information transmission device, construction management system, operation information transmission method, and program |
KR20230089493A (en) * | 2021-12-13 | 2023-06-20 | 한남대학교 산학협력단 | Multi-camera fire detector |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP2978213B1 (en) | Perimeter monitoring device for work machine | |
KR101123738B1 (en) | System and method for monitoring safe operation of heavy machinery | |
EP2833162B1 (en) | Perimeter-monitoring device for operating machine | |
KR101787897B1 (en) | Monitoring apparatus for work information of excavator based on around view monitoring and method thereof | |
JP6541734B2 (en) | Shovel | |
US10527413B2 (en) | Outside recognition device | |
JP6386213B2 (en) | Excavator | |
US10044933B2 (en) | Periphery monitoring device for work machine | |
JP2010204821A (en) | Working machine equipped with periphery monitoring device | |
JP6045865B2 (en) | Excavator | |
KR20130069912A (en) | Apparatus and method for displaying operation guide information of construction equipment | |
JPWO2016140016A1 (en) | Vehicle surroundings monitoring device | |
JP6378801B2 (en) | Excavator | |
JP5805574B2 (en) | Perimeter monitoring equipment for work machines | |
KR20160110642A (en) | Monitoring apparatus for work status of construction equipment and method thereof | |
JP6091821B2 (en) | Excavator | |
JP6257919B2 (en) | Excavator | |
JP2019004484A (en) | Shovel | |
JP2018186575A (en) | Shovel | |
JP7296340B2 (en) | Excavator | |
JP7130547B2 (en) | Excavator and perimeter monitoring device for excavator | |
JP7237882B2 (en) | Excavator | |
WO2014148204A1 (en) | Periphery monitoring device for work machine | |
JP2019071677A (en) | Shovel | |
KR20210099271A (en) | Image processing apparatus for excavator and method for processing image |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
A201 | Request for examination | ||
E902 | Notification of reason for refusal | ||
E601 | Decision to refuse application |