WO2015162800A1 - 周辺監視システム、作業車両、及び周辺監視方法 - Google Patents
周辺監視システム、作業車両、及び周辺監視方法 Download PDFInfo
- Publication number
- WO2015162800A1 WO2015162800A1 PCT/JP2014/061801 JP2014061801W WO2015162800A1 WO 2015162800 A1 WO2015162800 A1 WO 2015162800A1 JP 2014061801 W JP2014061801 W JP 2014061801W WO 2015162800 A1 WO2015162800 A1 WO 2015162800A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- detection
- radar
- dump truck
- area
- detection area
- Prior art date
Links
- 238000012544 monitoring process Methods 0.000 title claims abstract description 54
- 238000000034 method Methods 0.000 title claims description 5
- 238000001514 detection method Methods 0.000 claims abstract description 331
- 238000003384 imaging method Methods 0.000 claims description 198
- 230000002950 deficient Effects 0.000 claims description 42
- 238000012790 confirmation Methods 0.000 claims description 37
- 238000007689 inspection Methods 0.000 claims description 26
- 230000002093 peripheral effect Effects 0.000 claims description 6
- 238000011156 evaluation Methods 0.000 abstract 2
- 238000012795 verification Methods 0.000 abstract 1
- 230000005856 abnormality Effects 0.000 description 52
- 238000010586 diagram Methods 0.000 description 39
- 240000004050 Pentaglottis sempervirens Species 0.000 description 15
- 235000004522 Pentaglottis sempervirens Nutrition 0.000 description 15
- 230000002159 abnormal effect Effects 0.000 description 8
- 230000015572 biosynthetic process Effects 0.000 description 7
- 238000012545 processing Methods 0.000 description 7
- 238000003786 synthesis reaction Methods 0.000 description 7
- 230000006870 function Effects 0.000 description 6
- 230000004397 blinking Effects 0.000 description 5
- 238000002485 combustion reaction Methods 0.000 description 4
- 230000001681 protective effect Effects 0.000 description 4
- 239000004575 stone Substances 0.000 description 4
- 230000007935 neutral effect Effects 0.000 description 3
- 238000010248 power generation Methods 0.000 description 3
- XEEYBQQBJWHFJM-UHFFFAOYSA-N Iron Chemical compound [Fe] XEEYBQQBJWHFJM-UHFFFAOYSA-N 0.000 description 2
- 238000006243 chemical reaction Methods 0.000 description 2
- 238000004590 computer program Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 229910052782 aluminium Inorganic materials 0.000 description 1
- XAGFODPZIPBFFR-UHFFFAOYSA-N aluminium Chemical compound [Al] XAGFODPZIPBFFR-UHFFFAOYSA-N 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 238000009833 condensation Methods 0.000 description 1
- 230000005494 condensation Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000007599 discharging Methods 0.000 description 1
- 229910052742 iron Inorganic materials 0.000 description 1
- 230000007257 malfunction Effects 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 229910052751 metal Inorganic materials 0.000 description 1
- 239000002184 metal Substances 0.000 description 1
- 238000005065 mining Methods 0.000 description 1
- 238000012806 monitoring device Methods 0.000 description 1
- 229920000515 polycarbonate Polymers 0.000 description 1
- 239000004417 polycarbonate Substances 0.000 description 1
- 238000003825 pressing Methods 0.000 description 1
- 230000001012 protector Effects 0.000 description 1
- 239000011435 rock Substances 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 239000000126 substance Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 239000000725 suspension Substances 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- E—FIXED CONSTRUCTIONS
- E02—HYDRAULIC ENGINEERING; FOUNDATIONS; SOIL SHIFTING
- E02F—DREDGING; SOIL-SHIFTING
- E02F9/00—Component parts of dredgers or soil-shifting machines, not restricted to one of the kinds covered by groups E02F3/00 - E02F7/00
- E02F9/26—Indicating devices
- E02F9/267—Diagnosing or detecting failure of vehicles
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
- B60R1/20—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
- B60R1/22—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle
- B60R1/23—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view
- B60R1/27—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view providing all-round vision, e.g. using omnidirectional cameras
-
- E—FIXED CONSTRUCTIONS
- E02—HYDRAULIC ENGINEERING; FOUNDATIONS; SOIL SHIFTING
- E02F—DREDGING; SOIL-SHIFTING
- E02F9/00—Component parts of dredgers or soil-shifting machines, not restricted to one of the kinds covered by groups E02F3/00 - E02F7/00
- E02F9/24—Safety devices, e.g. for preventing overload
-
- E—FIXED CONSTRUCTIONS
- E02—HYDRAULIC ENGINEERING; FOUNDATIONS; SOIL SHIFTING
- E02F—DREDGING; SOIL-SHIFTING
- E02F9/00—Component parts of dredgers or soil-shifting machines, not restricted to one of the kinds covered by groups E02F3/00 - E02F7/00
- E02F9/26—Indicating devices
- E02F9/261—Surveying the work-site to be treated
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
- G01S13/88—Radar or analogous systems specially adapted for specific applications
- G01S13/93—Radar or analogous systems specially adapted for specific applications for anti-collision purposes
- G01S13/931—Radar or analogous systems specially adapted for specific applications for anti-collision purposes of land vehicles
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
- G06V20/58—Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N7/181—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
- B60R2300/80—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement
- B60R2300/802—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement for monitoring and displaying vehicle exterior blind spot views
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
- B60R2300/80—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement
- B60R2300/8093—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement for obstacle warning
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/02—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S13/00
- G01S7/04—Display arrangements
- G01S7/06—Cathode-ray tube displays or other two dimensional or three-dimensional displays
- G01S7/10—Providing two-dimensional and co-ordinated display of distance and direction
- G01S7/12—Plan-position indicators, i.e. P.P.I.
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/02—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S13/00
- G01S7/40—Means for monitoring or calibrating
Definitions
- the present invention relates to a periphery monitoring system, a work vehicle, and a periphery monitoring method.
- An object of an aspect of the present invention is to provide a periphery monitoring system, a work vehicle, and a periphery monitoring method that can support recognition of the state of a detection device.
- a first aspect of the present invention is a detection device that is arranged on a work vehicle and can detect an object around the work vehicle, and an acquisition unit that acquires a command signal indicating an operation confirmation mode for checking the detection device.
- a determination unit that determines whether the operation state of the detection device is good or not based on a detection result of the detection device after obtaining the command signal; and a detection unit that determines that the operation state is defective by the determination unit.
- a periphery monitoring system including a display device that displays identification information.
- a plurality of the detection devices are arranged so that different regions around the work vehicle are detected, and the determination unit determines whether the operation state is good or not for each of the plurality of detection devices. It is preferable to do.
- the identification information includes a detection area of the detection device determined to be defective, and the display device displays the work vehicle on a screen and the periphery of the work vehicle on the screen. It is preferable to display the detection area.
- WHEREIN It is arrange
- a plurality of the detection devices are arranged so that different regions around the work vehicle are detected, and the determination unit determines whether the operation state is good or not for each of the plurality of detection devices.
- the display device displays a detection area of the detection device determined to be defective and does not display a detection area of the detection device determined to be good.
- the display device displays a detection area of each of the plurality of detection devices, and the detection device is determined to be in a good operating state by the determination unit. It is preferable to erase the detection area.
- the operation confirmation mode is started when the command signal is acquired when the work vehicle is in a parking state, and the operation confirmation mode is ended when the parking state is released. It is preferable to provide a part.
- the display device displays warning information indicating the presence of the detection device determined to be defective in the operation check mode.
- the display device is determined to be defective in the identification information of the detection device that detected the object in the normal work state before or after the operation check mode is started and in the operation check mode. It is preferable to display the identification information of the detection device in a different form.
- WHEREIN It is preferable to provide the memory
- the second aspect of the present invention provides a work vehicle including the periphery monitoring system according to the first aspect.
- an object is arranged in a detection area of the detection device after the start of an operation confirmation mode for inspection of a detection device arranged on the work vehicle and capable of detecting an object around the work vehicle. Determining the quality of the operating state of the detection device based on the detection result of the detection device, displaying the work vehicle on a screen of a display device disposed on the work vehicle, and displaying the work on the screen Displaying a detection area of the detection device in which the operation state is determined to be poor around a vehicle.
- recognition of the state of the detection device can be supported.
- FIG. 1 is a perspective view illustrating an example of a work vehicle according to the present embodiment.
- FIG. 2 is a diagram illustrating an example of a cab according to the present embodiment.
- FIG. 3 is a block diagram illustrating an example of the periphery monitoring system according to the present embodiment.
- FIG. 4 is a diagram illustrating an arrangement position of the imaging device provided in the dump truck.
- FIG. 5 is a diagram illustrating an arrangement position of the radar device provided in the dump truck.
- FIG. 6 is a diagram showing a specific arrangement of the radar device that detects the front of the vehicle body.
- FIG. 7 is a diagram showing a specific arrangement of the radar device that detects the left side of the vehicle body.
- FIG. 1 is a perspective view illustrating an example of a work vehicle according to the present embodiment.
- FIG. 2 is a diagram illustrating an example of a cab according to the present embodiment.
- FIG. 3 is a block diagram illustrating an example of the periphery monitoring system according to the
- FIG. 8 is a diagram showing a specific arrangement of the radar device that detects the right side of the vehicle body.
- FIG. 9 is a diagram showing a specific arrangement of the radar device that detects the rear of the vehicle body.
- FIG. 10 is a diagram illustrating an irradiation state of the left side surface of the vehicle main body and the radar device.
- FIG. 11 is a diagram illustrating the irradiation state of the rear of the vehicle body and the radar device.
- FIG. 12 is a plan view schematically illustrating an example of an imaging apparatus and a radar apparatus according to the present embodiment.
- FIG. 13 is a schematic diagram illustrating an example of an imaging area and an overhead image of the imaging apparatus according to the present embodiment.
- FIG. 14 is a diagram illustrating an example of a radar apparatus according to the present embodiment.
- FIG. 15 is a diagram illustrating an example of a radar apparatus according to the present embodiment.
- FIG. 16 is a schematic diagram illustrating an example of a detection area of the radar apparatus according to the present embodiment.
- FIG. 17 is a diagram illustrating an example of the display device according to the present embodiment.
- FIG. 18 is a diagram illustrating an example of the display device according to the present embodiment.
- FIG. 19 is a diagram illustrating an example of a display device according to the present embodiment.
- FIG. 20 is a flowchart illustrating an example of inspection work of the radar apparatus according to the present embodiment.
- FIG. 21 is a diagram illustrating an example of the display device according to the present embodiment.
- FIG. 22 is a schematic diagram illustrating an example of an object used in the inspection work according to the present embodiment.
- FIG. 23 is a schematic diagram illustrating an example of inspection work according to the present embodiment.
- FIG. 24 is a diagram illustrating an example of a display device according to the present embodiment.
- FIG. 25 is a diagram illustrating an example of a display device according to the present embodiment.
- FIG. 26 is a diagram illustrating an example of the display device according to the present embodiment.
- FIG. 27 is a diagram illustrating an example of the display device according to the present embodiment.
- FIG. 28 is a flowchart illustrating an example of the operation of the periphery monitoring system according to the present embodiment.
- FIG. 29 is a diagram illustrating an example of the display device according to the present embodiment.
- FIG. 30 is an example of the display device according to the present embodiment, and is a schematic diagram showing that the detection area blinks.
- FIG. 31 is a timing chart for explaining the operation of the display device according to the present embodiment.
- FIG. 32 is a diagram illustrating an example of a display device according to the present embodiment.
- front, rear, left, and right are based on the driver's seat.
- the front is in front of the line of sight of the operator seated on the driver's seat and is the direction from the driver's seat toward the steering wheel.
- the rear is the direction opposite to the front and is the direction from the steering wheel toward the driver's seat.
- the vehicle width direction of the work vehicle coincides with the left-right direction of the work vehicle.
- FIG. 1 is a perspective view showing an example of a work vehicle 1 according to the present embodiment.
- the work vehicle 1 is a dump truck (off-road dump truck) 1
- the dump truck 1 is a self-propelled vehicle used for work in a mine.
- the dump truck 1 may be a rigid frame type or an articulate type.
- the dump truck 1 supports a vehicle body 2, a cab 3 provided on the vehicle body 2, a vessel 4 supported by the vehicle body 2 and loaded with a load, and a vehicle body 2. And a movable traveling device 5.
- the dump truck 1 includes a periphery monitoring system 7 for monitoring the periphery of the dump truck 1 and making the operator recognize the state of the periphery of the dump truck 1.
- the traveling device 5 has a front wheel 5A and a rear wheel 5B.
- the traveling device 5 is operated by power generated by a power generation device provided in the dump truck 1.
- the power generation device includes at least one of an internal combustion engine such as a diesel engine and an electric motor.
- the dump truck 1 adopts a diesel electric drive system.
- the dump truck 1 has a diesel engine, a generator driven by power generated by the diesel engine, and an electric motor driven by electric power generated by the generator.
- the traveling device 5 travels with the power transmitted from the electric motor.
- the traveling device 5 may travel by transmitting the power generated by the internal combustion engine to the traveling device 5 through the power train.
- the electric motor may be driven by the electric power supplied from the overhead line via the trolley, and the traveling device 5 may travel by the power transmitted from the electric motor.
- the vehicle body 2 includes an upper deck 2b and a frame 2f arranged in the front-rear direction.
- the frame 2f supports the power generation device and the traveling device 5 including the front wheels 5A and the rear wheels 5B.
- the frame 2f has a lower deck 2a and an upper deck 2b.
- the dump truck 1 has a double deck structure having a lower deck 2a and an upper deck 2b.
- the lower deck 2a is arranged at the lower part of the front surface of the frame 2f.
- the upper deck 2b is disposed above the lower deck 2a.
- a movable ladder 2c is disposed below the lower deck 2a.
- An oblique ladder 2d is disposed between the lower deck 2a and the upper deck 2b.
- a radiator is disposed between the lower deck 2a and the upper deck 2b.
- a handrail 2e is disposed on the upper deck 2b.
- Cab 3 is a cab where the driver's seat is located.
- the cab 3 is disposed on the upper deck 2b.
- An operator gets on the cab 3.
- Various operating devices arranged in the cab 3 are operated by an operator.
- Vessel 4 carries the load.
- a load such as crushed stone is loaded into the vessel 4 at a mine loading site.
- the vessel 4 can be moved up and down by an actuator such as a hydraulic cylinder.
- the actuator is disposed between the vehicle main body 2 and the vessel and can move the vessel 4 up and down.
- the vessel 4 is adjusted to at least one of the loading posture and the standing posture by the operation of the actuator.
- the loading posture is a posture in which the front portion of the vessel 4 is disposed on the upper portion of the cab 3.
- the standing posture is a dumping posture for discharging the load.
- the dump truck 1 is a rear dump system, and the load is discharged from the vessel 4 by tilting the vessel 4 backward.
- the dump truck 1 may be a side dump system in which the load is discharged from the vessel 4 by tilting the vessel 4 to the left and right sides.
- the vessel 4 has a flange 4F called a protector.
- the flange portion 4F is disposed at the front portion of the vessel 4 and can be disposed above the cab 3.
- the flange portion 4F protects the cab 3 by being disposed above the cab 3.
- FIG. 2 is a diagram illustrating an example of the cab 3 according to the present embodiment.
- the cab 3 has a ROPS (Roll-Over Protection System) including a plurality of columns 3 a, 3 b, 3 c, 3 d.
- ROPS Roll-Over Protection System
- the ROPS protects the operator of the cab 3.
- Driver's seat 31, steering wheel 32, dash cover 33, radio device 34, accelerator pedal 35A, brake pedal 35Bf, secondary brake pedal 35Bs, retarder 36, shift lever 37, shift lever position sensor 37S, parking brake operation switch 37P, dump lever 38, operation panel 8, and controller 100 are arranged.
- the operator sits in the driver's seat 31.
- the steering wheel 32 is operated by an operator of the driver seat 31.
- the traveling direction (path) of the traveling device 5 is adjusted.
- the shift lever 37 is operated by the operator of the driver seat 31.
- the traveling direction (forward or reverse) of the dump truck 1 is switched. Further, the speed stage is switched by operating the shift lever 37.
- the operation panel 8 includes an input device 80 including a plurality of operation buttons and a display device 50 such as a flat panel display.
- the display device 50 may be referred to as a monitor.
- a command signal (input signal, operation signal) generated by operating the input device 80 is output to the controller 100.
- the display device 50 displays information output from the controller 100.
- the periphery monitoring system 7 includes a controller 100, an input device 80, and a display device 50.
- the operation panel 8 may be disposed on the dash cover 33, may be disposed on the dash cover 33, or may be suspended from the ceiling of the cab 3.
- the operation panel 8 may be arranged at a position where the operator can operate the input device 80 and the display device 50 can be visually recognized.
- the position where the controller 100 is arranged is also arbitrary.
- the shift lever position sensor 37S detects the position of the shift lever 37.
- the detection result of the shift lever position sensor 37S is output to the controller 100.
- the controller 100 acquires information related to the traveling state (traveling mode) of the dump truck 1 based on the detection result of the shift lever position sensor 37S.
- the traveling state of the dump truck 1 includes at least one of a forward traveling state, a reverse traveling state, a neutral state, a parking (parking) state, and a shift stage state.
- the parking brake operation switch 37P is operated to operate the parking brake when the dump truck 1 is parked.
- the command signal generated by operating the parking brake operation switch 37P is output to the controller 100.
- the controller 100 acquires information related to the traveling state of the dump truck 1 (whether it is in a parking state) based on a command signal from the parking brake operation switch 37P.
- FIG. 3 is a block diagram illustrating an example of the periphery monitoring system 7 according to the present embodiment.
- the periphery monitoring system 7 monitors the periphery of the dump truck 1 and makes the operator recognize the situation around the dump truck 1.
- the periphery monitoring system 7 includes, for example, a controller 100, an input device 80 connected to the controller 100, a shift lever position sensor 37S connected to the controller 100, a parking brake operation switch 37P connected to the controller 100, a controller A display device 50 connected to 100, an imaging device 10 (11 to 16) connected to the controller 100 for capturing an image around the dump truck 1, and an object around the dump truck 1 connected to the controller 100. And a detection device 20 (21 to 28) capable of non-contact detection.
- the shift lever position sensor 37S, the parking brake operation switch 37P, and the input device 80 of the operation panel 8 function as an input unit that can generate a command signal (input signal, operation signal) for the controller 100.
- the imaging device 10 is disposed on the dump truck 1 and includes a camera that captures an image around the dump truck 1.
- the periphery monitoring system 7 includes a plurality of imaging devices 10 so that different areas around the dump truck 1 are imaged.
- six imaging devices 10 are arranged on the dump truck 1.
- each of the six imaging devices 10 is appropriately referred to as an imaging device 11, an imaging device 12, an imaging device 13, an imaging device 14, an imaging device 15, and an imaging device 16.
- the imaging devices 11 to 16 are collectively referred to as the imaging device 10 as appropriate.
- the periphery monitoring system 7 can acquire images of different areas around the dump truck 1.
- the detection device 20 includes a radar device that is disposed on the dump truck 1 and can detect an object around the dump truck 1 in a non-contact manner.
- the periphery monitoring system 7 includes a plurality of detection devices (radar devices) 20 so that different regions around the dump truck 1 are detected.
- eight radar devices 20 are arranged on the dump truck 1.
- each of the eight radar devices 20 is appropriately referred to as a radar device 21, a radar device 22, a radar device 23, a radar device 24, a radar device 25, a radar device 26, a radar device 27, and a radar device 28. Called.
- the radar devices 21 to 28 are collectively referred to as the radar device 20 as appropriate.
- the periphery monitoring system 7 can detect objects existing in different areas around the dump truck 1.
- FIG. 4 is a diagram illustrating an example of an arrangement position of the imaging device 10 (11 to 16) according to the present embodiment.
- each of the imaging devices 11 to 16 is attached to the outer peripheral portion of the dump truck 1 in order to acquire an image in the range of 360 degrees around the dump truck 1.
- Each of the imaging devices 11 to 16 has a visual field range of 120 degrees in the left-right (horizontal) direction and 96 degrees in the height (vertical) direction.
- the imaging device 11 is a camera that captures an image of the front of the vehicle body 2, and is arranged at the lower part of the uppermost landing part of the oblique ladder 2d as shown in FIG.
- the imaging device 11 is fixed toward the front of the vehicle main body 2 via a bracket attached to the upper deck 2b.
- the imaging range of the imaging device 11 is a range that extends in front of the vehicle body 2.
- the imaging device 12 is a camera that images the right front side of the vehicle body 2 and is disposed near the right end portion of the front side surface of the upper deck 2b as shown in FIG.
- the imaging device 12 is fixed toward the right front side of the vehicle body 2 via a bracket attached to the upper deck 2b.
- the imaging range of the imaging device 12 is a range that extends diagonally forward to the right of the vehicle body 2.
- the imaging device 13 is a camera that images the left front side of the vehicle body 2, and as shown in FIG. 4, the vehicle body via a bracket attached to the imaging device 12 in a bilaterally symmetrical position, that is, the upper deck 2b. 2 is fixed toward the left front side.
- the imaging range of the imaging device 13 is a range that extends diagonally to the left of the vehicle body 2.
- the imaging device 14 is a camera that captures an image of the rear side of the vehicle body 2 obliquely to the right side, and is disposed in the vicinity of the front end of the right side surface of the upper deck 2b as shown in FIG.
- the imaging device 14 is fixed toward the diagonally right rear of the vehicle body 2 via a bracket attached to the upper deck 2b.
- the imaging range of the imaging device 14 is a range that extends obliquely to the right rear of the vehicle body 2.
- the imaging device 15 is a camera that captures an image of the vehicle body 2 obliquely to the left side of the left side, and as shown in FIG. 4, the vehicle body via a bracket attached to the imaging device 14 in a laterally symmetrical position, that is, the upper deck 2b. 2 is arranged obliquely rearward to the left.
- the imaging range of the imaging device 15 is a range that extends obliquely to the left rear of the vehicle body.
- the imaging device 16 is a camera that images the rear of the vehicle body 2, and as shown in FIG. 4, at the rear end of the frame 2f, above the rear axle that connects the two rear wheels 5B, and the vessel 4 It is arrange
- the imaging range of the imaging device 16 is a range that extends rearward of the vehicle body 2.
- each of the imaging devices 11 to 16 outputs the captured image to the controller 100.
- the imaging devices 11 to 16 are provided in the upper deck 2b and the cross member at a high position of the frame 2f. For this reason, each of the imaging devices 11 to 16 can obtain a captured image looking down on the ground from above, and can capture obstacles existing on the ground in a wide range. In addition, even when the viewpoint conversion is performed when the overhead image is formed, since the image captured from above is used, the degree of deformation of the three-dimensional object can be suppressed.
- FIG. 5 is a diagram showing an example of an arrangement position of the radar apparatus 20 (21 to 28) according to the present embodiment.
- the radar devices 21 to 28 have a detection angle of 80 degrees ( ⁇ 40 degrees) in the azimuth (horizontal) direction, 16 degrees ( ⁇ 8 degrees) in the vertical (vertical) direction, and a UWB (Ultra Wide) with a maximum detection distance of 15 m or more.
- the relative positions of objects (obstacles) existing all around the dump truck 1 are detected by the installed radar devices 21 to 28.
- the radar devices 21 to 28 are arranged on the outer periphery of the dump truck 1.
- the detection angle in the azimuth (horizontal) direction of each of the radar apparatuses 21 to 28 is 80 degrees ( ⁇ 40 degrees), but may have a detection angle larger than this.
- the radar devices 21 and 22 will be described with reference to FIG. 5 and FIG. 6 of the front view of the dump truck 1.
- the radar devices 21 and 22 are provided on the lower deck 2a which is about 1 m above the ground and below the oblique ladder 2d, which is located below the upper deck 2b where the imaging device 11 that mainly captures the front of the vehicle body 2 is provided. It is done.
- Radar devices 21 and 22 are mounted symmetrically with respect to vehicle center plane C via brackets B21 and B22, respectively.
- the radar device 22 is disposed so as to face diagonally forward left, and the radar device 21 is disposed so as to face diagonally forward right.
- the horizontal irradiation center axis of the radar device 22 is tilted 45 degrees to the left of the vehicle body 2 with respect to the traveling direction axis of the vehicle center plane C, and the horizontal irradiation center axis of the radar device 21. Is inclined 45 degrees to the right side of the vehicle body 2 with respect to the axis of the vehicle center plane C in the traveling direction, and the respective irradiation center axes intersect. Further, each irradiation center axis in the vertical direction of the radar devices 21 and 22 has a depression angle of about 5 degrees. As a result, all objects in the area ahead of the front end of the vehicle body 2 can be detected.
- the radar device 28 and the radar device 23 at a symmetrical position of the vehicle center plane C are shown in FIG. 5, FIG. 7 as viewed from the left side of the dump truck 1, and as viewed from the right side of the dump truck 1. Explanation will be made with reference to FIG.
- the radar device 28 is provided in the vicinity of the left end portion of the lower deck 2a and the upper end portion of the movable ladder 2c, which are located below the upper deck 2b provided with the imaging devices 13 and 15 that mainly image the left side of the vehicle body 1.
- the radar device 28 is attached to the lower deck 2b via a bracket B28, and is disposed toward the left side outside of the vehicle body 2.
- the radar device 23 is installed in a side view from the left side of the dump truck 1 and is located symmetrically with respect to the radar device 28 with respect to the vehicle center plane C.
- the radar device 23 is movable on the right side of the lower deck 2 a located below the upper deck 2 b provided with the imaging devices 12 and 14 that mainly image the right side of the vehicle body 2, and on the right side of the vehicle body 2. It is provided in the expression ladder 2c.
- the radar device 23 is attached to the lower deck 2b via a bracket B23 and a bracket B23 provided symmetrically with respect to the vehicle center plane C, and is disposed toward the right side outside of the vehicle body 2.
- the horizontal irradiation center axis of the radar device 23 is tilted 70 degrees to the right of the vehicle body 2 with respect to the backward axis of the vehicle center plane C, and the horizontal irradiation center axis of the radar device 28 is the vehicle central plane. It is tilted 70 degrees to the left of the vehicle body 2 with respect to the axis of the backward direction of C. Further, each irradiation center axis in the vertical direction of the radar devices 23 and 28 has a depression angle of about 5 degrees.
- Radar devices 23 and 28 enable detection of an object on the side of the dump truck 1, particularly on the front side of the front wheels 5A and the rear wheels 5B.
- the radar devices 23 and 28 are located below the vessel 4 and the upper deck 2b, and are not affected by flying stones that jump out of the vessel 4 when loaded.
- FIG. 5 is a side view of the radar device 27 at a symmetrical position with respect to the radar center 27 and the vehicle center plane C
- FIG. 7 is a side view from the left side of the dump truck 1
- FIG. Explanation will be made with reference to FIG.
- the radar device 27 protrudes laterally from the front fender 2g on the left side of the vehicle extending toward the lower deck 2a located below the upper deck 2b on which the imaging devices 13 and 15 that mainly image the left side of the vehicle body 2 are provided. It is arrange
- the radar device 27 is attached to the front fender 2g rearward via a bracket B27.
- the height of the radar device 27 is about 2.5 m from the ground.
- the radar device 24 is installed in a side view from the left side of the dump truck 1 and is located symmetrically with the radar device 27 with respect to the vehicle center plane C as a reference.
- the radar device 24 mainly extends from the front fender 2g on the right side of the vehicle extending toward the lower deck 2a positioned below the upper deck 2b provided with the imaging devices 12 and 14 for imaging the right side of the vehicle body 2 to the right side. It arrange
- the radar device 24 is attached to the front fender 2g rearward via a bracket B24.
- the horizontal irradiation center axis of the radar device 24 is inclined 30 degrees to the right side of the vehicle body 2 with respect to the backward axis of the vehicle center plane C, and the horizontal irradiation center axis of the radar device 27 is the vehicle central plane. It is tilted 30 degrees to the left side of the vehicle body 2 with respect to the axis in the backward direction of C. Further, each irradiation center axis in the vertical direction of the radar devices 24 and 27 has a depression angle of about 15 degrees.
- the radar devices 24 and 27 enable detection of obstacles in the lateral rear region corresponding to the rear side of the central axis of the front wheel 5A and the rear wheel 6B on the side of the dump truck 1 and particularly corresponding to the entire side of the vessel side. .
- the radar devices 24 and 27 are located below the vessel 4 and the upper deck 2b, and are not affected by flying stones that jump out of the vessel 4 when loaded.
- the radar devices 25 and 26 will be described with reference to FIG. 5 and FIG. 9 which is a rear view of the dump truck 1.
- the radar devices 25 and 26 are about 2 m above the ground, and the rear side of the case of the rear axle 71 of the drive shaft of the rear wheel 5B located below the cross member 70 where the imaging device 16 of the vessel 4 is installed. Placed in.
- Radar devices 25 and 26 are mounted symmetrically with respect to vehicle center plane C via brackets B25 and B26, respectively.
- the radar devices 25 and 26 are provided between the joints 73 of the rear suspension cylinder 72.
- the radar device 26 is disposed so as to be directed rearward and obliquely right, and the radar device 25 is disposed so as to be directed obliquely rearward and leftward.
- the horizontal irradiation center axis of the radar device 26 is inclined 45 degrees to the right side of the vehicle body 2 with respect to the backward axis of the vehicle center plane C, and the horizontal irradiation center axis of the radar device 25 is the vehicle central plane. It is inclined 45 degrees to the left side of the vehicle with respect to the axis in the backward direction of C, and each irradiation center axis intersects on the vehicle center plane C below the vessel 4. Further, each irradiation center axis in the vertical direction of the radar devices 25 and 26 has a depression angle of 0 to 10 degrees in the depression direction, and about 5 degrees in this embodiment.
- each radar device 25, 26 Since each radar device 25, 26 is mounted symmetrically with respect to the vehicle center plane C and installed so that the respective irradiation center axes intersect, it detects all objects in the rear area from the rear end of the vehicle body 2. can do.
- the radar devices 25 and 26 are arranged with a small depression angle in the case of the rear axle 71 that is positioned lower than the cross member 70. As shown in FIGS. 10 and 11, an object hidden behind the vehicle body 2 and behind the vessel 4 can be detected simultaneously by the radar devices 25 and 26 installed at a low position on the vehicle body 2 with a small depression angle. .
- the horizontal irradiation center axis of the radar device 25 and the horizontal irradiation center axis of the radar device 26 are 45 degrees with respect to the vehicle center plane C, but may be 45 degrees or less, for example, 30 degrees. It may be. This value may be determined by the degree of rearward protrusion of the radar devices 25 and 26 with respect to the rear end of the wheel 5B.
- the radar devices 21 to 28 that detect obstacles in each direction of the vehicle body 2 are attached to members at positions lower than the imaging devices 11 to 16 that capture the direction of each vehicle body 2 in order to generate an overhead image. Even if a radar device having a small angle in the vertical direction is used, the obstacle information detected by the radar device can be seen from the overhead image even if the radar device is installed at a position lower than the imaging device. It is possible to display inside.
- FIG. 12 is a plan view schematically showing an example of the imaging device 10 and the radar device 20 according to the present embodiment.
- FIG. 13 shows an example of the imaging area 10C (11C to 16C) imaged by the plurality of imaging devices 10 (11 to 16) and the overhead image 200 generated based on the image information captured by the plurality of imaging devices 10. It is a schematic diagram shown.
- the imaging device 10 (11 to 16) is arranged on the dump truck 1 and images the periphery of the dump truck 1.
- the imaging device 10 images the periphery of the dump truck 1 and outputs image information to the controller 100.
- the imaging device 10 is, for example, a wide dynamic range (WDR) camera.
- the wide dynamic range camera is a camera having a function that can be adjusted so that a dark part can be brightly corrected and the whole part can be visually recognized while keeping a bright part at a level where the bright part can be visually recognized.
- Each of the imaging devices 10 is disposed on the outer peripheral portion of the dump truck 1 in order to capture an image in a range of 360 degrees around the dump truck 1.
- the imaging device 11 is disposed in the front part of the dump truck 1.
- the imaging device 11 images the imaging area 11 ⁇ / b> C that is a part of the area around the dump truck 1, and outputs image information of the imaging area 11 ⁇ / b> C to the controller 100.
- the imaging area 11 ⁇ / b> C is an area that extends in front of the vehicle body 2 of the dump truck 1.
- the imaging device 12 is disposed at the right end of the front portion of the dump truck 1 in the left-right direction.
- the imaging device 12 images an imaging area 12C that is a part of the area around the dump truck 1, and outputs image information of the imaging area 12C to the controller 100.
- the imaging area 12 ⁇ / b> C is an area that extends obliquely forward to the right of the vehicle body 2 of the dump truck 1.
- the imaging device 13 is disposed at the left end of the front portion of the dump truck 1 in the left-right direction.
- the imaging device 13 images an imaging area 13C that is a part of the area around the dump truck 1, and outputs image information of the imaging area 13C to the controller 100.
- the imaging area 13 ⁇ / b> C is an area that extends diagonally to the left of the vehicle body 2 of the dump truck 1.
- the imaging device 14 is disposed on the right side of the dump truck 1 in the left-right direction.
- the imaging device 14 images an imaging area 14 ⁇ / b> C that is a part of the area around the dump truck 1, and outputs image information of the imaging area 14 ⁇ / b> C to the controller 100.
- the imaging area 14 ⁇ / b> C is an area that extends obliquely to the right rear of the vehicle body 2 of the dump truck 1.
- the imaging device 15 is disposed on the left side of the dump truck 1 in the left-right direction.
- the imaging device 15 images the imaging area 15C that is a part of the area around the dump truck 1, and outputs image information of the imaging area 15C to the controller 100.
- the imaging area 15 ⁇ / b> C is an area that extends diagonally to the left of the vehicle body 2 of the dump truck 1.
- the imaging device 16 is disposed at the rear part of the dump truck 1.
- the imaging device 16 images an imaging area 16C that is a part of the area around the dump truck 1, and outputs image information of the imaging area 16C to the controller 100.
- the imaging area 16 ⁇ / b> C is an area that extends to the rear of the vehicle body 2 of the dump truck 1.
- the plurality of imaging areas 11C to 16C are different areas around the dump truck 1.
- the periphery monitoring system 7 can capture an image of 360 degrees around the dump truck 1 and acquire the image information.
- the imaging areas 11C to 16C are collectively referred to as the imaging area 10C as appropriate.
- the periphery monitoring system 7 uses a wide dynamic range camera for the imaging device 10. For this reason, the imaging apparatus 10 can brightly correct a dark portion such as a shaded portion of the dump truck 1 while maintaining a level where the bright portion can be visually recognized. Therefore, the image captured by the image capturing apparatus 10 is less likely to be crushed black and overexposed, and as a whole is more easily understood. As a result, the periphery monitoring system 7 including the imaging device 10 can display the overhead image 200 on the display device 50 in which an object such as a vehicle existing in the shadowed area of the dump truck 1 is easily visible.
- the periphery monitoring system 7 monitors the periphery of the dump truck 1 using the image captured by the imaging device 10, an overhead image of objects around the dump truck 1 is obtained even in an environment where the contrast difference between light and dark is large. 200 can be displayed. As a result, the operator of the dump truck 1 can surely visually recognize an object existing around the dump truck 1, particularly in a shadow area, regardless of the environment.
- the surroundings monitoring system 7 can generate the bird's-eye view image 200 that reliably displays objects around the dump truck 1 even in an environment where the contrast difference between light and dark is large. Can be reliably recognized by the bird's-eye view image 200. Therefore, the periphery monitoring system 7 is very effective in monitoring the periphery of the very large dump truck 1 used in the mine as described above.
- the dump truck 1 may form a very large shadow area, move while creating the shadow area itself, and the shadow area greatly changes as the vessel 4 moves up and down. The area that becomes a blind spot is large.
- the periphery monitoring system 7 In such a dump truck 1, the periphery monitoring system 7 generates a bird's-eye view image 200 that reliably displays objects around the dump truck 1, and gives the operator of the dump truck 1 accurate information around the dump truck 1. Can be provided. In addition, the periphery monitoring system 7 provides the operator of the dump truck 1 around the dump truck 1 with respect to the dump truck 1 that operates in a place where the illuminance difference between the sun and the shade is very large, such as immediately below the equator. Provide accurate information.
- FIG. 12 is a plan view schematically showing an example of the imaging device 10 and the radar device 20 according to the present embodiment.
- FIG. 14 is a diagram illustrating an example of the radar apparatus 20.
- FIG. 15 is a diagram illustrating an example of the radar apparatus 20.
- FIG. 16 is a schematic diagram illustrating an example of a detection area 20C (21C to 28C) detected by a plurality of radar devices 20 (21 to 28).
- the radar device 20 (21 to 28) is disposed on the dump truck 1 and can detect objects around the dump truck 1.
- the radar device 20 detects a relative position between an object existing around the dump truck 1 and the dump truck 1.
- the radar apparatus 20 detects an object around the dump truck 1 in a non-contact manner, and outputs the detection result to the controller 100.
- the radar apparatus 20 has, for example, a detection angle of 80 degrees ( ⁇ 40 degrees) in the azimuth (horizontal) direction and 16 degrees ( ⁇ 8 degrees) in the vertical (vertical) direction, and a UWB (Ultra Wide) with a maximum detection distance of 15 m or more. Band) radar (ultra-wide band radar).
- Each of the radar devices 20 is disposed on an outer peripheral portion of the dump truck 1 in order to detect an object in a range of 360 degrees around the dump truck 1.
- the radar device 20 includes a launching unit that can emit radio waves and a receiving unit that can receive radio waves. At least a part of the radio wave emitted from the emission unit of the radar apparatus 20 and applied to the object is reflected by the object.
- the radar apparatus 20 receives the radio wave from the object reflected by the reflecting unit at the receiving unit.
- the radar apparatus 20 receives radio waves from the object and detects the relative position between the radar apparatus 20 and the object.
- the radar apparatus 20 is fixed to the dump truck 1 via a bracket. By detecting the relative position between the radar device 20 and the object, the relative position between the dump truck 1 and the object is detected.
- the radar apparatus 20 includes a radar main body 81 having a launching section and a receiving section, and a protection member 83 that is a hood surrounding the radar main body 81.
- the protective member 83 has a cutout portion where the cable 82 is pulled out.
- the radar apparatus 20 includes a protection member 84 that covers an opening of a space surrounded by the protection member 83, that is, an opening on the launch side.
- This protection member 84 protects the front surface and has strength, but it is necessary that the protection member 84 be a member through which a radar signal is transmitted. Moreover, it is preferable that it is a transparent member. This is because if it is transparent, condensation on the surface of the radar main body 81 can be visually confirmed.
- the protective member 84 is formed of, for example, polycarbonate.
- Radar device 21 is arranged in front of dump truck 1.
- the radar device 21 is disposed on the left side of the center portion of the dump truck 1 in the left-right direction.
- the radar apparatus 21 can detect an object in the detection area 21 ⁇ / b> C that is a part of the area around the dump truck 1.
- the radar apparatus 21 outputs the detection result to the controller 100.
- the detection area 21 ⁇ / b> C is an area that extends diagonally forward to the right from the front portion of the vehicle main body 2 of the dump truck 1.
- Radar device 22 is arranged at the front of dump truck 1.
- the radar device 22 is arranged on the right side of the center portion of the dump truck 1 in the left-right direction.
- the radar apparatus 22 can detect an object in the detection area 22 ⁇ / b> C that is a part of the area around the dump truck 1.
- the radar apparatus 22 outputs the detection result to the controller 100.
- the detection area 22 ⁇ / b> C is an area that extends diagonally forward left from the front portion of the vehicle body 2 of the dump truck 1.
- Radar device 23 is disposed on the right side of dump truck 1.
- the radar apparatus 23 can detect an object in the detection area 23 ⁇ / b> C that is a part of the area around the dump truck 1.
- the radar apparatus 23 outputs the detection result to the controller 100.
- the detection area 23C is an area extending from the right side of the vehicle main body 2 of the dump truck 1 to the right side.
- Radar device 24 is disposed on the right side of dump truck 1.
- the radar device 24 is disposed behind the radar device 23.
- the radar device 24 can detect an object in the detection area 24 ⁇ / b> C that is a part of the area around the dump truck 1.
- the radar device 24 outputs the detection result to the controller 100.
- the detection area 24C is an area extending from the right side of the vehicle main body 2 of the dump truck 1 to the right side.
- the detection area 24C is located behind the detection area 23C.
- the radar device 25 is disposed at the rear part of the dump truck 1.
- the radar device 25 is disposed on the right side of the center portion of the dump truck 1 in the left-right direction.
- the radar apparatus 25 can detect an object in the detection area 25 ⁇ / b> C that is a part of the area around the dump truck 1.
- the radar device 25 outputs the detection result to the controller 100.
- the detection area 25 ⁇ / b> C is an area that extends diagonally left rearward from the rear portion of the vehicle body 2 of the dump truck 1.
- the radar device 26 is disposed at the rear part of the dump truck 1.
- the radar device 26 is arranged on the left side of the central portion of the dump truck 1 in the left-right direction.
- the radar apparatus 26 can detect an object in the detection area 26 ⁇ / b> C that is a part of the area around the dump truck 1.
- the radar apparatus 26 outputs the detection result to the controller 100.
- the detection area 26 ⁇ / b> C is an area extending diagonally right rearward from the rear part of the vehicle body 2 of the dump truck 1.
- Radar device 27 is arranged on the left side of dump truck 1.
- the radar device 27 can detect an object in the detection area 27 ⁇ / b> C that is a part of the area around the dump truck 1.
- the radar device 27 outputs the detection result to the controller 100.
- the detection area 27C is an area that extends from the left side of the vehicle main body 2 of the dump truck 1 to the left side.
- Radar device 28 is disposed on the left side of dump truck 1.
- the radar device 28 is disposed in front of the radar device 27.
- the radar apparatus 28 can detect an object in the detection area 28 ⁇ / b> C that is a part of the area around the dump truck 1.
- the radar device 28 outputs the detection result to the controller 100.
- the detection area 28 ⁇ / b> C is an area extending from the left side of the vehicle main body 2 of the dump truck 1 to the left side.
- the detection area 28C is located in front of the detection area 27C.
- the plurality of detection areas 21C to 28C are different areas around the dump truck 1.
- the periphery monitoring system 7 can detect an object having an entire circumference of 360 degrees of the dump truck 1 and acquire the object information.
- the detection areas 21C to 28C are collectively referred to as the detection area 20C as appropriate.
- the radar device 20 is disposed at a position lower than the imaging device 10.
- the imaging device 10 is disposed at a high position in order to generate the overhead view image 200.
- the controller 100 includes a memory such as a CPU (Central Processing Unit) and a VRAM (Video Random Access Memory) which are arithmetic devices.
- the controller 100 displays the presence or absence of an object around the dump truck 1 on the display device 50 using the imaging device 10 and the radar device 20.
- the controller 100 includes an overhead image synthesis unit 110 that generates an overhead image 200, an acquisition unit 120 that acquires a command signal (input signal, operation signal), and positional information that generates positional information of an object.
- the generation unit 130 the display control unit 140 that controls the display device 50, the mode control unit 150 that sets the mode of the dump truck 1, the determination unit 210 that determines whether the operating state of the radar device 20 is good, and the radar device 20
- a processing unit 220 that processes the detection results of the detection, an abnormality detection unit 230 that detects an abnormality of the radar device 20, a storage unit 160, and a timer 170.
- the overhead image synthesis unit 110 acquires image information from the imaging device 10.
- the overhead image synthesis unit 110 synthesizes the acquired plurality of pieces of image information to generate an overhead image 200 around the dump truck 1.
- the overhead image synthesis unit 110 performs coordinate conversion of each of the plurality of pieces of image information, and generates overhead image information for displaying the overhead image 200.
- the position information generation unit 130 acquires the position information of the object from the radar device 20. In the normal work state, the position information generation unit 130 generates object position information to be displayed together with the overhead image 200 from the position information of the object acquired from the radar device 20 and outputs the object position information to the display control unit 140.
- the display control unit 140 acquires various types of information from the imaging device 10, the overhead image synthesis unit 110, and the position information generation unit 130.
- the display control unit 140 generates the overhead image 200 including the position information of the object based on the overhead image information from the overhead image synthesis unit 110 and the object position information from the position information generation unit 130.
- the display control unit 140 can display the overhead image 200 on the display device 50.
- the display control unit 140 can cause the display device 50 to display an index MK indicating the object position information.
- the display control unit 140 can cause the display device 50 to display the index MK and the bird's-eye view image 200 so that they overlap on the screen of the display device 50.
- the display control unit 140 can display the image of the imaging area 10 ⁇ / b> C on the display device 50 based on the image information from the imaging device 10.
- the display control unit 140 can switch the display mode of the display device 50 based on a command signal from the input device 80.
- the display control unit 140 can display both the image of the dump truck 1 and the bird's-eye view image 200 around the dump truck 1 and the index MK at the same time, or can display only the bird's-eye view image 200.
- the display control unit 140 can switch the display mode of the display device 50 based on a command signal from the shift lever position sensor 37S. Based on the command signal from the shift lever position sensor 37S, the display control unit 140 displays information related to the traveling state of the dump truck 1 (at least one of a forward state, a reverse state, a neutral state, a parking state, and a gear stage state). get.
- the display control unit 140 can switch the imaging area 10C (11C to 16C) displayed on the display device 50 in accordance with the operation of the shift lever 37. For example, when the shift lever 37 is operated so that the dump truck 1 is in the reverse drive state, the display control unit 140 displays an image of the imaging area 16C behind the dump truck 1 based on the detection result of the shift lever position sensor 37S. Is displayed. When the shift lever 37 is operated so that the dump truck 1 is in the forward state, the display control unit 140 displays an image of the imaging area 11C in front of the dump truck 1 based on the detection result of the shift lever position sensor 37S. To do.
- the acquisition unit 120 receives a command signal (input signal, operation signal) from the input device 80, a command signal (input signal, operation signal) from the shift lever position sensor 37S, and a command signal (input signal) from the parking brake operation switch 37P. , Operation signal). Acquisition unit 120 outputs control information corresponding to the command signal to mode control unit 150.
- the mode control unit 150 acquires control information from the acquisition unit 120.
- the mode control unit 150 switches between the normal work state and the operation check mode for the dump truck 1 based on the control information from the acquisition unit 120.
- the operation confirmation mode is a mode for checking the radar apparatus 20.
- the normal work state is a state in which the dump truck 1 is normally operated (running), and is a state other than the operation confirmation mode being executed.
- the operation confirmation mode is a mode for confirming whether the operation state of the radar apparatus 20 is good or not while the dump truck 1 is in the parking state before the work of the dump truck 1 is started (before operation).
- the mode control unit 150 does not execute the operation confirmation mode.
- the mode control unit 150 can determine whether or not the vehicle is in the parking state based on the input signal from the parking brake operation switch 37P.
- the mode control unit 150 may determine whether or not the vehicle is in the parking state based on an input signal from the shift lever position sensor 37S.
- the mode control unit 150 can determine that the dump truck 1 has changed from the parking state to the non-parking state based on the input signal from the shift lever position sensor 37S.
- the non-parking state includes at least one of a forward state, a reverse state, and a neutral state.
- the storage unit 160 stores a computer program for executing control of the dump truck 1 in each of the normal work state and the operation confirmation mode, data necessary for the control, and the like.
- the controller 100 reads out and executes the computer program stored in the storage unit 160, or reads out data necessary for control, and executes control.
- Timer 170 measures the elapsed time from the reference time.
- the time measurement result of the timer 170 is output to the mode control unit 150, the storage unit 160, and the like.
- the storage unit 160 refers to the output from the timer 170 and stores the operation confirmation mode implementation timing and the detection result of the radar device 20 in the operation confirmation mode.
- the determination unit 210 is connected to the radar device 20.
- the determination unit 210 acquires the detection result of the object in the detection area 20C (21C to 28C) of the radar device 20 (21 to 28).
- the determination unit 210 determines whether the operating state of the radar apparatus 20 is good or not based on the detection result of the radar apparatus 20.
- the determination unit 210 outputs the position information of the object acquired from the radar apparatus 20 to the processing unit 220.
- the processing unit 220 outputs the position information of the object acquired from the radar device 20 to the position information generation unit 130.
- FIG. 17 is a diagram illustrating an example of an image displayed on the display device 50 by the display control unit 140 of the controller 100.
- the display device 50 can perform color display.
- the symbol UP indicates the upper side of the display device 50.
- the symbol UN indicates the lower side of the display device 50.
- a symbol L indicates the left side of the display device 50.
- the symbol R indicates the right side of the display device 50.
- Reference symbol F indicates the front side of the dump truck 1.
- a symbol B indicates the rear side of the dump truck 1.
- the dump truck 1 is displayed on the display device 50 such that the upper side of the display device 50 is the front side of the dump truck 1 and the lower side of the display device 50 is the rear side of the dump truck 1.
- FIG. 17 shows an image of the display device 50 when the radar device 20 is operating normally in the normal working state.
- an image in the normal work state is displayed on the display device 50 during a period in which the dump truck 1 is in a non-parking state and is traveling at a low speed.
- an image in the normal working state is displayed on the display device 50 during a low-speed traveling period in which the traveling speed of the dump truck 1 is a predetermined threshold (for example, 15 km / h) or less.
- the display device 50 does not perform display based on the imaging result of the imaging device 10.
- the display based on the imaging result of the imaging device 10 includes at least one of the overhead image 200 and the image of the imaging area 10 ⁇ / b> C captured by the imaging device 10.
- the input device 80 includes an operation button (forced display button) that causes the display device 50 to perform display based on the imaging result of the imaging device 10 even during a high-speed traveling period.
- the display control unit 140 can display an image on the display device 50 even during a high-speed traveling period.
- the display control unit 140 sets the first image area 50 ⁇ / b> A, the second image area 50 ⁇ / b> B, and the third image area 50 ⁇ / b> C on the screen of the display device 50 by starting the normal work state. To do.
- the first image area 50A, the second image area 50B, and the third image area 50C are set on the same screen. Separate images (independent images) are displayed in the first image area 50A, the second image area 50B, and the third image area 50C.
- the first image area 50A an overhead image 200 generated based on the imaging result of the imaging device 10 is displayed.
- the first image area 50A includes a line L0 indicating the position of the edge of the vehicle main body 2, a line L1 indicating a position of 3 meters from the edge of the vehicle main body 2, and a line indicating a position of 5 meters from the edge of the vehicle main body 2.
- L2 and a line L3 indicating a position 7 meters from the edge of the vehicle main body 2 are displayed.
- Line L0, line L1, line L2, and line L3 are displayed in different colors. For example, the line L0 is displayed in white, the line L1 is displayed in red, the line L3 is displayed in yellow, and the line L4 is displayed in black.
- the dump truck 1 is displayed in yellow, for example.
- the first image area 50A has a center line C1 that passes through the center of the vehicle body 2 in the left-right direction and extends in the front-rear direction, and a center that passes through the center of the vehicle body 2 in the front-back direction and extends in the left-right direction.
- a line C2 is displayed.
- the center line C1 and the center line C2 are parallel to the horizontal plane.
- the second image area 50B images picked up by one selected image pickup device 10 among the plurality of image pickup devices 10 (11 to 16) are displayed.
- an image of the imaging area 11C in front of the vehicle body 2 is displayed.
- a part of the vehicle main body 2 is reflected in an image captured by the imaging device 10 (see reference numeral 2IM).
- the display control unit 140 has one imaging area 10C out of the plurality of imaging areas 10C (11C to 16C) based on the operation of the shift lever 37 (operation signal of the shift lever position sensor 37S). Selected.
- the display control unit 140 moves the front of the dump truck 1 based on the detection result of the shift lever position sensor 37S.
- the image of the imaging area 11C is displayed in the second image area 50B.
- the display control unit 140 displays the image of the imaging area 16C behind the dump truck 1 based on the detection result of the shift lever position sensor 37S.
- the image is displayed in the two-image area 50B.
- the imaging area 10 ⁇ / b> C displayed on the display device 50 is switched by operating the shift lever 37.
- one imaging area 10C may be selected from the plurality of imaging areas 10C (11C to 16C), and the selected imaging area 10C may be displayed on the display device 50. That is, the imaging area 10 ⁇ / b> C displayed on the display device 50 may be switched by operating the input device 80.
- Various icons are displayed in the third image area 50C.
- the icon 51 indicating the imaging area 10C displayed in the second image area 50B and the operating states of the radar apparatus 20 (21 to 28) are displayed.
- An icon 52 is displayed.
- the icon 52 is displayed in a predetermined color (in this example, green).
- the icon 52 is lit in green (continuously lit) without blinking.
- three image areas are set on the screen of one display device 50.
- one image area may be set on the screen of one display device 50, two image areas may be set, or four or more image areas may be set. Good.
- FIG. 18 shows a display example of the display device 50 when the radar device 20 detects an object while the radar device 20 is operating normally. For example, when an object is present in the detection area 23C of the radar device 23 among the plurality of radar devices 20 (21 to 28), the radar device 23 detects the object. The detection result of the radar device 23 is output to the processing unit 220.
- the processing unit 220 outputs the detection result of the radar device 23 to the position information generation unit 130.
- the position information generation unit 130 generates object position information indicating the position information of the object acquired by the radar device 23 and outputs the object position information to the display control unit 140.
- the display control unit 140 displays an index MK indicating an object on the display device 50 based on the object position information acquired from the position information generation unit 130. As illustrated in FIG. 18, the display control unit 140 displays the index MK on the overhead image 200 generated based on the imaging result of the imaging device 10.
- the display control unit 140 displays identification information for identifying the detection area 20C where the object is present in the vicinity of the dump truck 1 based on the detection result of the radar device 20.
- identification information for identifying the radar device 20 that detected the object among the plurality of radar devices 20 is displayed on the display device 50.
- the identification information is, for example, the imaging area 10C (or the detection area 20C), characters, numbers, icons, or a combination thereof displayed around the dump truck 1 on the screen of the display device 50.
- identification information for identifying the radar device 20 that detected the object is displayed in association with the imaging area 10C. That is, the identification information for identifying the radar device 20 that detected the object among the plurality of radar devices 20 is not displayed in association with the detection area 20C, but is displayed in association with the imaging area 10C.
- the radar device 23 detects an object, and the object exists in an overlapping portion between the detection area 23C and the imaging area 12C. Therefore, as illustrated in FIG. 18, the display control unit 140 displays a frame image indicating the outer shape of the imaging area 12C. Note that when the radar device 23 detects an object and the object exists in an overlapping portion of the detection area 23C and the imaging area 14C, the display control unit 140 shows the outer shape of the imaging area 14C as shown in FIG. Display a frame image.
- the frame image in which the index MK is arranged on the inner side may blink or may be displayed in a highlighted color such as red.
- the display device 50 displays the detection result of the object (position of the index MK) by the radar device 20 using the imaging area 10C without using the detection area 20C.
- FIG. 20 is a flowchart illustrating an example of inspection work of the radar device 20.
- the inspection work includes a step (step SP1) of operating the electronic equipment of the dump truck 1 including the radar device 20 and the controller 100 when the dump truck 1 is in the parking state, and an input device in the parking state.
- step SP2 is operated to generate a command signal indicating an operation confirmation mode (starting inspection mode) for inspection of the radar apparatus 20 (step SP2), and the object is moved around the dump truck 1 to move the radar apparatus 20 In the detection area 20C (step SP3), on the basis of the detection result of the radar apparatus 20 (step SP4), on the basis of the detection result of the radar apparatus 20, and on the radar in which the operation state is determined to be defective
- step SP5 includes a step of terminating the operation check mode (step SP6), the.
- the operator activates the electric system of the dump truck 1 using, for example, an ignition key (step SP1).
- an ignition key By operating the ignition key, the above-described internal combustion engine may be activated, or the internal combustion engine may not be activated, and only the accessory power supply may be activated.
- the dump truck 1 including the controller 100, the display device 50, the input device 80, the shift lever position sensor 37S, the parking brake operation switch 37P, the imaging device 10, the radar device 20, and the like.
- the electronic device starts up.
- the inspection work is performed while the dump truck 1 is parked.
- the dump truck 1 is parked by the operation of the parking brake operation switch 37P.
- the inspection work is performed in a wide area where no other object such as an obstacle exists around the dump truck 1.
- the inspection work is performed in an empty state where there is no load on the vessel 4.
- the inspection work is performed with the vessel 4 loaded.
- the inspection work may be performed in a loaded state in which there is a load on the vessel 4.
- the inspection work may be performed with the vessel 4 standing upright. When the vessel 4 is in the standing posture, the operations of the radar device 25 and the radar device 26 for detecting the rear of the vehicle body 2 are stopped.
- the operation confirmation mode is a mode for performing an inspection of the radar device 20.
- the operation confirmation mode is started by operating the input device 80. For example, among the plurality of operation buttons of the input device 80, the start of the operation confirmation mode is instructed by simultaneously pressing and holding the display mode changeover switch on the screen of the display device 50 and the obstacle confirmation clear button for 3 seconds or more simultaneously. A command signal for generating is generated.
- the command signal indicating the operation confirmation mode generated by operating the input device 80 is output to the acquisition unit 120.
- the acquisition unit 120 transmits the command signal to the mode control unit 150.
- the mode control unit 150 sets the dump truck 1 to the operation confirmation mode. As a result, the operation confirmation mode is activated (started).
- the operation check mode is started when the acquisition unit 120 of the controller 100 acquires the command signal while the dump truck 1 is in the parking state.
- FIG. 21 shows an example of display on the display device 50 immediately after the operation check mode is started.
- the mode control unit 150 outputs a start command signal for the operation check mode to the display control unit 140.
- the display control unit 140 displays the dump truck 1 in the first image area 50A of the screen of the display device 50, and detects the dump truck 1 around the dump truck 1 in the first image area 50A of the screen.
- Area 20C (21C to 28C) is displayed.
- the display device 50 displays the detection area 20C (21C to 28C) of each of the plurality of radar devices 20 (21 to 28) along with the dump truck 1 in the vicinity of the dump truck 1.
- the display control unit 140 displays the overhead view image 200 around the dump truck 1 generated based on the imaging result of the imaging device 10. At 50, the information is displayed around the dump truck 1.
- the display control unit 140 displays the detection area 20C (21C to 28C) so as to overlap the overhead image 200.
- a graphic showing the detection area 20C is displayed.
- the entire detection area 20C is displayed, for example, colored yellow.
- a frame image indicating the outer shape of the detection area 20C may be displayed, or the detection area 20C may be viewed so that both the detection area 20C and the overhead image 200 can be viewed in a state where the detection area 20C and the overhead image 200 overlap. It may be displayed semi-transparently.
- an icon 53M indicating the operation check mode period is displayed in the third image area 50C.
- the icon 53M is displayed in yellow.
- the icon 53M blinks.
- the icon 53M may be continuously lit.
- step SP3 After the operation confirmation mode is started and the display device 50 displays the display shown in FIG. 21, the operator moves the object around the dump truck 1 (step SP3).
- FIG. 22 is a schematic diagram showing an example of an object used in the inspection work.
- a reflecting member 300 called a corner reflector is used as an object used in the inspection work.
- the reflection member 300 is supported by a support member 301 such as a tripod.
- the support member 301 may not be provided.
- the reflecting member 300 is a triangular pyramid member made of metal such as iron or aluminum.
- the reflecting member 300 has a reflecting portion (reflecting surface) that can reflect the radio wave emitted from the radar device 20.
- the reflectance (reflection intensity) of the reflecting portion of the reflecting member 300 with respect to the radio wave is higher than the reflectance (reflection intensity) of an object around the reflecting member 300.
- Objects around the reflecting member 300 include mine rocks and the like.
- FIG. 23 is a schematic diagram illustrating an example of a state in which the operation of moving the reflecting member 300 around the dump truck 1 is performed.
- the operator WM makes a round around the dump truck 1 while holding the reflecting member 300.
- the operator WM moves while holding the reflecting member 300 so that the reflecting member 300 is arranged in each of the plurality of detection areas 20C.
- the detection results of each of the plurality of radar devices 20 are output to the determination unit 210 of the controller 100.
- the determination unit 210 determines whether the operating state of the radar apparatus 20 is good or not based on the detection result of the radar apparatus 20 (step SP4).
- the determination unit 210 determines whether the operating state is good or not for each of the plurality of radar devices 20.
- the determination unit 210 determines that the radar device 20 is normal (the operation state is good) when the detection value (signal intensity) of the radar device 20 exceeds a predetermined threshold value. On the other hand, when the detection value of the radar device 20 is equal to or less than a predetermined threshold, the determination unit 210 determines that the radar device 20 is abnormal (the operating state is defective).
- the determination result of the determination unit 210 is output to the display control unit 140.
- the display control unit 140 displays, on the display device 50, the detection area 20C of the radar device 20 in which the operation state is determined to be defective by the determination unit 210 among the plurality of radar devices 20, and the radar in which the operation state is determined to be good.
- the detection area 20C of the device 20 is not displayed (step SP5).
- all of the detection areas 20C (21C to 28C) of the plurality of radar devices 20 (21 to 28) are displayed on the display device 50.
- the display control unit 140 deletes the detection area 20C of the radar device 20 that has been determined to be good by the determination unit 210 from the screen of the display device 50, and the detection area 20C of the radar device 20 that has been determined to be defective. Is left on the display device 50 without being erased (the display is continued).
- FIG. 24 shows a display example of the display device 50 when the reflecting member 300 is moving around the dump truck 1 in the operation confirmation mode.
- the reflecting member 300 is sequentially arranged in the plurality of detection areas 20C (21C to 28C).
- the detection member 20C is erased from the display device 50 by arranging the reflecting member 300 in the detection area 20C.
- the operator WM installs the reflective member 300 shown in FIG. 22 in the order of, for example, the detection area 21C, the detection area 22C, and the detection area 23C, the detection area 21C, the detection area 22C, and the detection where the reflective member 300 is installed.
- the area 23C is erased sequentially from the display device 50.
- FIG. 25 shows a display example of the display device 50 after it has been determined that the operation state of all the radar devices 20 is good because the reflecting member 300 makes a round around the dump truck 1 in the operation check mode.
- the detection area 20C is not displayed in the first image area 50A of the display device 50.
- an icon 53F indicating that the operating state of all the radar devices 20 is good is displayed in the third image area 50C.
- the icon 53F is displayed in a different form from the icon 53M.
- the icon 53F is, for example, green and is continuously lit.
- FIG. 26 shows the state after the reflecting member 300 makes a round around the dump truck 1 in the operation confirmation mode, and it is determined that the operating state of the radar device 23 among the plurality of radar devices 20 (21 to 28) is defective.
- the example of a display of the display apparatus 50 is shown. As shown in FIG. 26, the detection area 23 ⁇ / b> C is displayed in the first image area 50 ⁇ / b> A of the display device 50.
- the display control unit 140 displays the dump truck 1 on the screen of the display device 50, and displays the detection area 23 ⁇ / b> C of the radar device 23 determined to be defective around the dump truck 1 on the screen of the display device 50.
- the operator WM who has finished the work of moving the reflecting member 300 around the dump truck 1 gets on the cab 3.
- the operator WM can recognize whether or not the operating states of all the radar devices 21 to 28 are good by looking at the display device 50.
- the parking state is released by operating the shift lever 37 by the operator WM. That is, when the shift lever 37 is operated so that the dump truck 1 is in the forward traveling state or the reverse traveling state, the parking state is released.
- An operation signal indicating the operation of the shift lever 37 is output from the shift lever position sensor 37S to the acquisition unit 120 and the display control unit 140.
- the acquisition unit 120 outputs the operation signal to the mode control unit 150.
- the mode control unit 150 receives the operation signal, the mode control unit 150 ends the operation check mode and starts a normal work state (step SP6). As described above, in the present embodiment, when the parking state is released by the operation of the shift lever 37, the operation check mode is ended and the normal working state is started.
- the operator WM when the operator WM recognizes that all the operating states of the plurality of radar devices 20 are good via the display device 50, the operator WM starts normal work. May be.
- the operator WM starts traveling the dump truck 1 while confirming whether or not an object exists around the dump truck 1 based on the detection result (index MK) of the radar apparatus 20 displayed on the display device 50. can do.
- the display device 50 displays an image as described with reference to FIGS. 17 and 18. indicate. Accordingly, it is possible to smoothly check the safety of the surroundings when the dump truck 1 starts or runs at a low speed. As shown in FIGS.
- the icon (53F) indicating the operation confirmation mode is displayed. Then, it is erased from the screen of the display device 50.
- the traveling speed of the dump truck 1 exceeds a threshold (for example, 15 km / h)
- a threshold for example, 15 km / h
- an image based on the imaging result of the imaging device 10 such as the overhead image 200 is not displayed on the display device 50.
- the traveling speed of the dump truck 1 exceeds a threshold (for example, 15 km / h)
- the operation of the radar device 20 is stopped, and the indicator MK based on the detection result of the radar device 20 is not displayed on the display device 50.
- the detection area 23 ⁇ / b> C that is the identification information of the radar device 23 determined to be defective by the determination unit 210 is displayed on the display device 50. If the operator WM recognizes the user, a predetermined measure is taken. For example, measures such as a serviceman dispatch request and repair or replacement of the radar device 23 are taken.
- the operation check mode is ended by operating the shift lever 37 and the normal working state is started. .
- the operator WM can start normal work.
- FIG. 27 shows a display example of the display device 50 when the dump truck 1 is in a normal working state when it is determined that some of the plurality of radar devices 20 are in an operating state. .
- the icon 53M is displayed as shown in FIG.
- the icon 53M is displayed in a form different from the icon 53F.
- the icon 53M is, for example, yellow and blinks.
- the display device 50 displays the icon 53M that is warning information indicating the presence of the radar device determined to be defective in the operation check mode.
- the determination unit 210 does not arrange the reflection member 300. It is determined that the operating state of the radar device 20 in the detection area 20C is defective. Even in such a case, in the normal work state after the end of the operation check mode, the display device 50 displays the icon 53M that is warning information indicating the presence of the radar device 20 determined to be defective in the operation check mode.
- the execution time of the operation check mode and the detection result (the quality of the operation state) of the radar device 20 in the operation check mode are stored in the storage unit 160.
- the controller 100 has a timer 170 and stores in the storage unit 160 the timing for performing the operation check mode (inspection work) and the detection result of the radar device 20 in the operation check mode (operating state pass / fail) in association with the time. . Thereby, the performance analysis of the radar apparatus 20 etc. can be performed using the memory
- the timer 170 has a calendar clock function.
- the calendar clock function is a function for counting year, month, day, hour, minute, and second.
- FIG. 28 is a flowchart showing an example of the operation of the periphery monitoring system 7 when an abnormality occurs in the radar apparatus 20. As shown in FIG. 28, a step of detecting an abnormality of the radar device 20 (step SQ1) and a step of displaying the detection area 20C of the radar device 20 where the abnormality has occurred on the display device 50 (step SQ2) are executed.
- step SQ1 a step of detecting an abnormality of the radar device 20
- step SQ2 a step of displaying the detection area 20C of the radar device 20 where the abnormality has occurred on the display device 50
- an abnormality may occur in the radar device 20 for some reason.
- the abnormality of the radar device 20 includes a failure or breakage of the radar device 20.
- abnormalities in the radar device 20 include malfunctions due to temperature abnormalities, voltage abnormalities, noise (internal noise and external noise), and hardware failures (damage) such as semiconductor chips. including.
- the abnormality of the radar device 20 includes disconnection of an electric cable connected to the radar device 20.
- the temperature abnormality can be detected by a temperature sensor provided in the radar device 20.
- the voltage abnormality can be detected with a voltmeter that can detect the voltage applied to the radar device 20.
- the controller 100 includes an abnormality detection unit 230.
- the abnormality detection unit 230 can detect the above-described abnormality and can acquire abnormality information. If the abnormality detection unit 230 determines that an abnormality has occurred in the radar apparatus 20, the abnormality detection unit 230 outputs an abnormality signal indicating the abnormality to the display control unit 140 (step SQ1).
- FIG. 29 shows a display example of the display device 50 when an abnormality has occurred in the radar device 20.
- the display control unit 140 displays the dump truck 1 in the first image area 50A of the screen of the display device 50, and displays the detection area 20C of the radar device 20 in which an abnormality has occurred in the display device 50. Displayed around the dump truck 1 on the screen.
- an abnormality occurs in the radar device 21, the radar device 22, the radar device 23, and the radar device 24, and the radar device 21, the radar device 22, the radar device 23, and the detection area 21C of the radar device 24 in which the abnormality has occurred.
- An example in which the detection area 22C, the detection area 23C, and the detection area 24C are displayed around the dump truck 1 on the screen of the display device 50 is shown.
- the display control unit 140 displays a bird's-eye view image 200 around the dump truck 1 around the dump truck 1 and overlaps the bird's-eye view image 200 with a detection area 21C, a detection area 22C, The detection area 23C and the detection area 24C are displayed on the display device 50.
- the display control unit 140 blinks the detection area 21C, the detection area 22C, the detection area 23C, and the detection area 24C on the screen of the display device 50.
- the display control unit 140 displays the detection area 21C, the detection area 22C, the detection area 23C, and the detection area 24C in a color different from that in the operation check mode.
- the detection area of the radar apparatus 20 that is determined to be defective in the operation check mode is displayed in yellow, and the detection area 20C of the radar apparatus 20 that is determined to have an abnormality is red. Is displayed.
- the blinking of the detection area 21C, the detection area 22C, the detection area 23C, and the detection area 24C indicates the display operation for displaying the detection area 21C, the detection area 22C, the detection area 23C, and the detection area 24C, and the detection area 21C and the detection area 22C.
- the display operation period in the display device 50, a part of the bird's-eye view image 200 is hidden by the detection area 21C, the detection area 22C, the detection area 23C, and the detection area 24C (becomes invisible).
- the overhead image 200 hidden in the detection area 21C, the detection area 22C, the detection area 23C, and the detection area 24C is displayed (becomes visible) on the display device 50.
- FIG. 31 is a timing chart showing an example of a non-display operation that does not display the detection area 21C, the detection area 22C, the detection area 23C, and the detection area 24C, and a display operation that displays.
- the non-display operation period T1 is longer than the display operation period T2.
- the period during which a part of the overhead image 200 is hidden by the detection area 21C, the detection area 22C, the detection area 23C, and the detection area 24C is shortened, and the detection area 21C, the detection area 22C, the detection area 23C, and the detection area 24C Even in the displayed state, it is easy to visually recognize the overhead image 200.
- FIG. 32 shows a display example of the detection area 21C, the detection area 22C, the detection area 23C, and the detection area 24C of the radar apparatus 21, the radar apparatus 22, the radar apparatus 23, and the radar apparatus 24 in which an abnormality has occurred.
- the display control unit 140 detects the detection area 21C, the detection area 22C, the detection area 23C, and the detection area 24C and the detection area 24C in a state where the detection area 24C and the overhead image 200 overlap on the screen of the display device 50.
- the detection area 21C, the detection area 22C, the detection area 23C, and the detection area 24C may be displayed semi-transparently on the screen of the display device 50 so that both the detection area 24C and the overhead image 200 are visually recognized. . This also makes it easy to view the overhead image 200 in a situation where the detection area 21C, the detection area 22C, the detection area 23C, and the detection area 24C are displayed.
- the display control unit 140 displays an icon 54 and an icon 55 indicating that an abnormality has occurred in the third image area 50C. Further, the display control unit 140 sets the fourth image area 50D, displays the icon 56 in the fourth image area 50D, and displays the error code 57.
- ER01 indicated by the error code 57 is an example in which the content of the abnormal phenomenon and the part where the abnormality has occurred are coded.
- the radar device 21, the radar device 22, the radar device 23, and the radar device 24 are abnormal in the normal working state, the radar device 25, the radar device 26, the radar device 27, and the radar are detected.
- Device 28 is normal. Therefore, for example, when the radar device 27 detects an object, as shown in FIG. 33, the display device 50 includes a detection area 21C, a detection area 22C, a detection area 23C, and a detection area 24C, and imaging in which the object exists. A frame image showing the outer shape of the area 15C is displayed.
- the imaging area 15C is an imaging area 10C that overlaps the detection area 27C of the radar device 27 that has detected the object among the plurality of imaging areas 10C (11C to 16C).
- the form of the imaging area 10C (11C to 16C) is different from the form of the detection area 20C (21C to 28C).
- the form includes an outline, a size, and a design on the screen.
- the radar device 21, the radar device 22, the radar device 23, and the radar device 24 in which an abnormality has occurred are displayed using the detection area 21C, the detection area 22C, the detection area 23C, and the detection area 24C. 50 screens.
- the normal radar device 27 that has detected the object is displayed on the screen of the display device 50 using the imaging area 15C.
- the display control unit 140 differs between the detection area 20C of the radar device 20 in which an abnormality has occurred and the detection area 20C (imaging area 10C) of the normal radar device 20 that has detected an object. Display in form.
- the display control unit 140 includes a detection area 20C of the radar apparatus 20 in which an abnormality has occurred and a detection area 20C (imaging image) of the normal radar apparatus 27 that has detected an object among the plurality of radar apparatuses 20. Area 15C) is simultaneously displayed in different forms. This makes it easy for the operator WM to distinguish between the radar apparatus 20 in which an abnormality has occurred and the radar apparatus 20 performing normal operation. Further, the operator WM can simultaneously acquire a plurality of information on one screen.
- the display control unit 140 displays the radar device 20 that has detected the object in the normal working state using the imaging area 10C, and detects the radar device 20 that is determined to be defective in the operation check mode. Display using area 20C.
- the display device 50 includes the identification information of the radar device 20 that has detected the object in the normal operation state before or after the operation check mode is started, and the identification information of the radar device 20 that is determined to be defective in the operation check mode. Are displayed in different forms, so that the operator WM can easily distinguish these differences.
- the identification information (detection areas 21C to 24C) of the radar apparatus 20 (21 to 24) in which an abnormality has occurred as shown in FIG. 29 is displayed even when the dump truck 1 is traveling at high speed in the normal working state. Also good.
- the display control unit 140 displays the overhead image 200 in the first image area 50A and the detection area 21C, as shown in FIG. An image including the detection area 22C, the detection area 23C, and the detection area 24C may be displayed on the display device 50.
- the operator WM can recognize the radar devices 21 to 24 in which an abnormality has occurred.
- the identification information (detection areas 21C to 24C) of the radar devices 21 to 24 in which an abnormality has occurred is displayed even when the dump truck 1 is traveling at a high speed in the normal working state. It may be broken.
- the identification information of the radar device 20 that is determined to be defective by the determination unit 210 in the operation confirmation mode for the inspection of the radar device 20 is displayed on the display device 50. As a result, it is possible to prevent the operator WM from continuing the work without recognizing the situation even though the radar apparatus 20 does not operate normally.
- the identification information of the radar apparatus 20 that is determined to be abnormal by the abnormality detection unit 230 is displayed on the display device 50 in the normal working state. Nevertheless, the operator WM is prevented from continuing work without recognizing the situation.
- the operator WM can execute a predetermined measure such as repair or continue the work carefully while recognizing the presence of the defective radar device 20. . Therefore, the contact between the object existing around the dump truck 1 and the dump truck 1 is suppressed. For example, when the dump truck 1 starts and travels at a low speed, a problem that the dump truck 1 traps an object is suppressed.
- the periphery monitoring system 7 can assist the operator WM to recognize the state of the radar device 20 using the display device 50.
- a plurality of radar devices 20 are arranged so that different regions around the dump truck 1 can be detected, and the controller 100 determines whether the operating state is good or not for each of the plurality of radar devices 20. be able to. As a result, the operator WM can individually recognize whether the operating states of the plurality of radar apparatuses 20 are good or bad.
- the dump truck 1 when the operating state of the radar device 20 is defective or when an abnormality occurs, the dump truck 1 is displayed on the screen of the display device 50, and the radar device having a defective operating state. 20 or a detection area 20C of the radar device 20 in which an abnormality has occurred is displayed around the dump truck 1.
- the periphery monitoring system 7 can visually appeal the detection area 20C of the defective or abnormal radar apparatus 20 to the operator WM.
- the operator WM can intuitively grasp the detection area 20C of the radar device 20 in which the operating state is defective or abnormal. Therefore, the burden and stress on the operator WM are reduced, and safe work is performed.
- the overhead image 200 around the dump truck 1 generated based on the imaging result of the imaging device 10 is displayed around the dump truck 1 on the screen of the display device 50, and the overhead image is displayed.
- the detection area 20 ⁇ / b> C of the radar device 20 whose operation state is defective or abnormal is displayed so as to overlap with 200. Thereby, when an object exists in the detection area 20 ⁇ / b> C, the operator WM can visually recognize an image (optical image) of the object based on the imaging result of the imaging device 10.
- the periphery monitoring system 7 detects all the objects around the dump truck 1 using both the radar device 20 and the imaging device 10, and sufficiently supports the recognition of the operator WM for the objects. can do.
- the radar device 20 can detect an object in a wider range (far distance) than the imaging device 10, and the display device 50 can intuitively tell the operator WM the position of the object using the index MK.
- the imaging apparatus 10 can cause the operator WM to recognize an object image (optical image).
- both the information from the radar device 20 and the information from the imaging device 10 are displayed on the display device 50. Therefore, for example, when it is recognized that an object (reflecting member 300) exists around the dump truck 1 based on the imaging result of the imaging apparatus 10, the radar apparatus 20 does not detect the object.
- the operator WM itself can determine that the operating state of the radar apparatus 20 is defective.
- the radar device 20 outputs a detection result in which an object is present even though it is recognized that no object (reflecting member 300) exists around the dump truck 1. In this case, the operator WM itself can determine that the operating state of the radar apparatus 20 is defective. In this way, the operator WM can check the accuracy of the start-up inspection by itself based on both the information from the radar device 20 displayed on the display device 50 and the information from the imaging device 10. .
- the display device 50 displays the detection area 20C of the radar device 20 determined to be defective, and does not display the detection area 20C of the detection device 20 determined to be good.
- the operator WM can instantly recognize the radar device 20 in a good operating state and the bad radar device 20.
- the display device 50 displays the detection area 20C of each of the plurality of radar devices 20, and the radar device 20 in which the operating state is determined to be good by the determination unit 210.
- the detection area 20C is erased.
- the operator WM can smoothly recognize the radar device 20 in a good operating state.
- the operation confirmation mode is started when a command signal is acquired while the dump truck 1 is in the parking state. Thereby, the inspection work including the work of moving the reflecting member 300 around the dump truck 1 can be performed safely. Further, when the parking state is released, the operation confirmation mode is ended, so that the operation confirmation mode can be smoothly shifted to the normal work state.
- the display device 50 does not perform the operation check even if the radar device 20 whose operation state is determined to be defective is repaired without changing the normal operation state.
- Warning information (in this embodiment, the icon 53M shown in FIG. 27) indicating the presence of the radar apparatus 20 determined to be defective in the mode is displayed. Thereby, even if it transfers to a normal work state, it can continue making operator WM recognize presence of the radar apparatus 20 with a bad operation state.
- the display device 50 displays the identification information of the radar device 20 that has detected the object in the normal working state and the identification information of the radar device 20 that has been determined to be defective in the operation check mode in different forms. To do.
- the detection area 20C of the radar device 20 in which an abnormality has occurred in the normal work state and the detection area 20C (imaging area 10C) of the normal radar device 20 that detected the object are displayed in different forms. .
- the operator WM can correctly recognize whether the display is an abnormal radar device 20 display or the result of detecting an object.
- the detection area 20C of the radar device 20 in which an abnormality has occurred and the detection area 20C (imaging area 10C) of the normal radar device 20 that has detected the object are simultaneously displayed in different forms.
- the operator WM can correctly recognize a plurality of pieces of information collectively.
- the execution time of the operation check mode and the detection result of the radar device 20 in the operation check mode are stored in the storage unit 160. Thereby, the performance analysis of the radar apparatus 20 etc. can be performed using the memory
- the display apparatus 50 when an abnormality occurs in the radar apparatus 20 in the normal work state, the display apparatus 50 blinks the detection area 20C on the screen. Accordingly, the periphery monitoring system 7 can visually appeal the presence of the radar device 20 in which an abnormality has occurred. Further, when the bird's-eye view image 200 is displayed on the screen of the display device 50 by blinking the detection area 20C, the display device 50 blinks even if the detection area 20C is displayed over the bird's-eye view image 200.
- the overhead image 200 can be visually recognized by the operator WM during the non-display operation period of the detection area 20C.
- the non-display operation period in which the detection area 20C is not displayed is longer than the display operation period in which the detection area 20C is displayed. Therefore, even if the detection area 20C is displayed so as to overlap the overhead image 200, the display device 50 can cause the operator WM to sufficiently view the overhead image 200 during the non-display operation period of the detection area 20C in blinking. it can.
- the display device 50 may semi-transparently display the detection area 20C on the screen. Thereby, even if the detection area 20C is displayed so as to overlap the bird's-eye view image 200, the display device 50 can sufficiently make the operator WM visually recognize both the detection area 20C and the bird's-eye view image 200.
- display is performed using the imaging area 10 ⁇ / b> C as identification information of the radar apparatus 20 that is determined to be defective in the operation state in the operation check mode. You may display using the detection area 20C.
- the imaging area 10C (or the detection area 20C) around the dump truck 1 on the screen of the display device 50 is used as the identification information of the radar device 20 that is determined to be defective in the operation confirmation mode. Is to be displayed.
- identification information of the radar apparatus 20 that is determined to have a poor operating state letters or numbers may be used, or icons may be used.
- the radar device 20 that is determined to be defective in the operation check mode among the plurality of radar devices 20 is the radar device 23, the characters “radar device 23 is defective in operation” are displayed on the screen of the display device 50. May be displayed.
- the detection device 20 is a radar device.
- the detection device only needs to detect an object around the dump truck 1 in a non-contact manner.
- the detection device may be, for example, a laser device that detects an object based on laser light applied to the object.
- the display device 50 displays both the index MK (and icon) indicating the detection result of the radar device 20 and the image (including the overhead image 200) indicating the imaging result of the imaging device 10. I decided to display it.
- the display device 50 may not display the imaging result of the imaging device 10.
- the dump truck 1 may not have the imaging device 10.
- the work vehicle 1 is a dump truck.
- the work vehicle 1 may be a hydraulic excavator having a lower traveling body, an upper swing body, and a work implement.
- an imaging device, a lator device, and the like may be installed on the upper swing body.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Remote Sensing (AREA)
- Structural Engineering (AREA)
- Radar, Positioning & Navigation (AREA)
- Mining & Mineral Resources (AREA)
- Civil Engineering (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Mechanical Engineering (AREA)
- Electromagnetism (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Theoretical Computer Science (AREA)
- Closed-Circuit Television Systems (AREA)
- Traffic Control Systems (AREA)
- Radar Systems Or Details Thereof (AREA)
Abstract
Description
図1は、本実施形態に係る作業車両1の一例を示す斜視図である。本実施形態においては、作業車両1がダンプトラック(オフロードダンプトラック)1である例について説明する。ダンプトラック1は、鉱山における作業に使用される自走式の車両である。ダンプトラック1は、リジッドフレーム式でもよいし、アーティキュレート式でもよい。
次に、本実施形態に係るキャブ3について、図2を参照して説明する。図2は、本実施形態に係るキャブ3の一例を示す図である。図2に示すように、キャブ3は、複数の支柱3a、3b、3c、3dを含むROPS(Roll-Over Protection System:転倒時保護構造)を有する。ダンプトラック1が転倒した場合、ROPSは、キャブ3のオペレータを保護する。
次に、本実施形態に係る周辺監視システム7の概要について、図3を参照して説明する。図3は、本実施形態に係る周辺監視システム7の一例を示すブロック図である。周辺監視システム7は、ダンプトラック1の周辺を監視して、ダンプトラック1の周辺の状況をオペレータに認識させる。周辺監視システム7は、例えば、コントローラ100と、コントローラ100に接続された入力装置80と、コントローラ100に接続されたシフトレバーボジションセンサ37Sと、コントローラ100に接続されたパーキングブレーキ操作スイッチ37Pと、コントローラ100に接続された表示装置50と、コントローラ100に接続され、ダンプトラック1の周辺の画像を撮像する撮像装置10(11~16)と、コントローラ100に接続され、ダンプトラック1の周辺の物体を非接触で検出可能な検出装置20(21~28)とを備えている。シフトレバーボジションセンサ37S、パーキングブレーキ操作スイッチ37P、及び操作パネル8の入力装置80は、コントローラ100に対する指令信号(入力信号、操作信号)を生成可能な入力部として機能する。
次に、本実施形態に係る撮像装置10及びレーダ装置20の配置例について説明する。図4は、本実施形態に係る撮像装置10(11~16)の配置位置の一例を示す図である。
次に、本実施形態に係る撮像装置10について、図12及び図13を参照して説明する。図12は、本実施形態に係る撮像装置10及びレーダ装置20の一例を模式的に示す平面図である。図13は、複数の撮像装置10(11~16)によって撮像される撮像エリア10C(11C~16C)及び複数の撮像装置10によって撮像された画像情報に基づいて生成された俯瞰画像200の一例を示す模式図である。
次に、本実施形態に係るレーダ装置20について、図12、図14、図15、及び図16を参照して説明する。図12は、本実施形態に係る撮像装置10及びレーダ装置20の一例を模式的に示す平面図である。図14は、レーダ装置20の一例を示す図である。図15は、レーダ装置20の一例を示す図である。図16は、複数のレーダ装置20(21~28)によって検出される検出エリア20C(21C~28C)の一例を示す模式図である。
次に、本実施形態に係るコントローラ100について、図3を参照して説明する。コントローラ100は、演算装置であるCPU(Central Processing Unit)及びVRAM(Video Random Access Memory)のようなメモリを有する。コントローラ100は、撮像装置10及びレーダ装置20を用いて、ダンプトラック1の周辺の物体の有無を表示装置50に表示する。図3に示すように、コントローラ100は、俯瞰画像200を生成する俯瞰画像合成部110と、指令信号(入力信号、操作信号)を取得する取得部120と、物体の位置情報を生成する位置情報生成部130と、表示装置50を制御する表示制御部140と、ダンプトラック1のモードを設定するモード制御部150と、レーダ装置20の作動状態の良否を判断する判定部210と、レーダ装置20の検出結果を処理する処理部220と、レーダ装置20の異常を検出する異常検出部230と、記憶部160と、タイマー170とを有する。
次に、本実施形態に係る表示装置50の画像の表示例について説明する。図17は、コントローラ100の表示制御部140が表示装置50に表示させる画像の一例を示す図である。表示装置50は、カラー表示可能である。図17において、符号UPは、表示装置50の上側を示す。符号UNは、表示装置50の下側を示す。符号Lは、表示装置50の左側を示す。符号Rは、表示装置50の右側を示す。符号Fは、ダンプトラック1の前側を示す。符号Bは、ダンプトラック1の後側を示す。ダンプトラック1は、表示装置50の上側がダンプトラック1の前側となり、表示装置50の下側がダンプトラック1の後側となるように、表示装置50に表示される。
次に、本実施形態に係る周辺監視システム7の動作の一例について説明する。本実施形態においては、ダンプトラック1の作業前(稼動前)に、レーダ装置20の点検(始業時点検、日常点検)が行われる。図20は、レーダ装置20の点検作業の一例を示すフローチャートである。図20に示すように、点検作業は、ダンプトラック1がパーキング状態において、レーダ装置20及びコントローラ100などを含むダンプトラック1の電子機器を作動する工程(ステップSP1)と、パーキング状態において、入力装置80を操作して、レーダ装置20の点検のための動作確認モード(始業点検モード)を示す指令信号を生成する工程(ステップSP2)と、ダンプトラック1の周辺において物体を移動してレーダ装置20の検出エリア20Cに配置する工程(ステップSP3)と、レーダ装置20の検出結果に基づいてレーダ装置20の作動状態の良否を判断する工程(ステップSP4)と、作動状態が不良と判断されたレーダ装置20の検出エリア20Cを表示装置50に表示する工程(ステップSP5)と、シフトレバー37を操作して、動作確認モードを終了する工程(ステップSP6)と、を含む。
本実施形態においては、動作確認モードの実施時期及び動作確認モードにおけるレーダ装置20の検出結果(作動状態の良否)が記憶部160に記憶される。コントローラ100は、タイマー170を有し、時間に対応付けて、動作確認モード(点検作業)の実施時期及び動作確認モードにおけるレーダ装置20の検出結果(作動状態の良否)を記憶部160に記憶する。これにより、その記憶部160の記憶情報を使って、レーダ装置20の性能分析等を実行することができる。タイマー170は、カレンダー時計機能を有している。カレンダー時計機能は、年、月、日、時、分及び秒を計数する機能である。
次に、レーダ装置20に異常が発生したときの表示装置50の表示例について説明する。図28は、レーダ装置20に異常が発生したときの周辺監視システム7の動作の一例を示すフローチャートである。図28に示すように、レーダ装置20の異常が検出される工程(ステップSQ1)と、異常が発生したレーダ装置20の検出エリア20Cを表示装置50に表示する工程(ステップSQ2)とが実行される。
2 車両本体
2a ロアデッキ
2b アッパデッキ
2c 可動式ラダー
2d 斜めラダー
2e 手すり
2f フレーム
2g フロントフェンダー
3 キャブ
3a 支柱
3b 支柱
3c 支柱
3d 支柱
4 ベッセル
4F 鍔部
5 走行装置
5A 前輪
5B 後輪
7 周辺監視システム
8 操作パネル
10(11~16) 撮像装置
10C(11C~16C) 撮像エリア
20(21~28) レーダ装置
20C(21C~28C) 検出エリア
31 運転席
32 ステアリングホイール
33 ダッシュカバー
34 無線装置
35A アクセルペダル
35Bf ブレーキペダル
35Bs セカンダリブレーキペダル
36 リターダ
37 シフトレバー
37S シフトレバーポジションセンサ
37P パーキングブレーキ操作スイッチ
50 表示装置
50A 第1画像エリア
50B 第2画像エリア
50C 第3画像エリア
50D 第4画像エリア
51 アイコン
52 アイコン
53 アイコン
53F アイコン
53M アイコン
54 アイコン
55 アイコン
56 アイコン
57 エラーコード
62 エアクリーナ
70 クロスメンバー
71 リアアクスル
80 入力装置
81 レーダ本体
82 ケーブル
83 保護部材
84 保護部材
100 コントローラ
110 俯瞰画像合成部
120 取得部
130 位置情報生成部
140 表示制御部
150 モード制御部
200 俯瞰画像
210 判定部
220 処理部
230 異常検出部
300 反射部材
301 支持部材
B 後側
F 前側
L 左側
MK 指標
R 右側
UN 下側
UP 上側
WM オペレータ
Claims (12)
- 作業車両に配置され、前記作業車両の周辺の物体を検出可能な検出装置と、
前記検出装置の点検のための動作確認モードを示す指令信号を取得する取得部と、
前記指令信号の取得後、前記検出装置の検出結果に基づいて前記検出装置の作動状態の良否を判断する判定部と、
前記判定部により前記作動状態が不良と判断された前記検出装置の識別情報を表示する表示装置と、
を備える周辺監視システム。 - 前記検出装置は、前記作業車両の周辺の異なる領域が検出されるように複数配置され、
前記判定部は、複数の前記検出装置ごとに作動状態の良否を判断する請求項1に記載の周辺監視システム。 - 前記識別情報は、不良と判断された前記検出装置の検出エリアを含み、
前記表示装置は、画面に前記作業車両を表示するとともに前記画面において前記作業車両の周辺に前記検出エリアを表示する請求項1に記載の周辺監視システム。 - 前記作業車両に配置され、前記作業車両の周辺を撮像する撮像装置を備え、
前記表示装置は、前記撮像装置の撮像結果に基づいて生成された前記作業車両の周辺の俯瞰画像を前記作業車両の周辺に表示し、前記俯瞰画像に重なるように前記検出エリアを表示する請求項3に記載の周辺監視システム。 - 前記検出装置は、前記作業車両の周辺の異なる領域が検出されるように複数配置され、
前記判定部は、複数の前記検出装置ごとに作動状態の良否を判断し、
前記表示装置は、不良と判断された前記検出装置の検出エリアを表示し、良好と判断された前記検出装置の検出エリアを表示しない請求項3又は請求項4に記載の周辺監視システム。 - 前記指令信号の取得後、前記表示装置は、複数の前記検出装置それぞれの検出エリアを表示し、前記判定部により前記作動状態が良好と判断された前記検出装置の検出エリアを消去する請求項5に記載の周辺監視システム。
- 前記作業車両がパーキング状態において前記指令信号が取得されたときに前記動作確認モードを開始し、前記パーキング状態が解除されたときに前記動作確認モードを終了する制御部を備える請求項1から請求項6のいずれか一項に記載の周辺監視システム。
- 前記動作確認モードの終了後、前記表示装置は、前記動作確認モードにおいて不良と判断された前記検出装置の存在を示す警告情報を表示する請求項1から請求項7のいずれか一項に記載の周辺監視システム。
- 前記表示装置は、前記動作確認モード開始前又は終了後の通常作業状態において物体を検出した前記検出装置の識別情報と、前記動作確認モードにおいて不良と判断された前記検出装置の識別情報とを異なる形態で表示する請求項1から請求項8のいずれか一項に記載の周辺監視システム。
- 前記動作確認モードの実施時期及び前記動作確認モードにおける前記検出装置の検出結果を記憶する記憶部を備える請求項1から請求項9のいずれか一項に記載の周辺監視システム。
- 請求項1から請求項10のいずれか一項に記載の周辺監視システムを備える作業車両。
- 作業車両に配置され前記作業車両の周辺の物体を検出可能な検出装置の点検のための動作確認モードの開始後、前記検出装置の検出エリアに物体を配置することと、
前記検出装置の検出結果に基づいて前記検出装置の作動状態の良否を判断することと、
前記作業車両に配置された表示装置の画面に前記作業車両を表示するとともに前記画面において前記作業車両の周辺に前記作動状態が不良と判断された前記検出装置の検出エリアを表示することと、
を含む周辺監視方法。
Priority Applications (5)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CA2863656A CA2863656C (en) | 2014-04-25 | 2014-04-25 | Surroundings monitoring system, work vehicle, and surroundings monitoring method |
US14/382,328 US10240323B2 (en) | 2014-04-25 | 2014-04-25 | Surroundings monitoring system, work vehicle, and surroundings monitoring method |
PCT/JP2014/061801 WO2015162800A1 (ja) | 2014-04-25 | 2014-04-25 | 周辺監視システム、作業車両、及び周辺監視方法 |
CN201480000810.5A CN105339061B (zh) | 2014-04-25 | 2014-04-25 | 周边监视系统、作业车辆以及周边监视方法 |
JP2014526331A JP5933004B2 (ja) | 2014-04-25 | 2014-04-25 | 周辺監視システム、作業車両、及び周辺監視方法 |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/JP2014/061801 WO2015162800A1 (ja) | 2014-04-25 | 2014-04-25 | 周辺監視システム、作業車両、及び周辺監視方法 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2015162800A1 true WO2015162800A1 (ja) | 2015-10-29 |
Family
ID=54331987
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2014/061801 WO2015162800A1 (ja) | 2014-04-25 | 2014-04-25 | 周辺監視システム、作業車両、及び周辺監視方法 |
Country Status (5)
Country | Link |
---|---|
US (1) | US10240323B2 (ja) |
JP (1) | JP5933004B2 (ja) |
CN (1) | CN105339061B (ja) |
CA (1) | CA2863656C (ja) |
WO (1) | WO2015162800A1 (ja) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2018008542A1 (ja) * | 2016-07-05 | 2018-01-11 | 住友建機株式会社 | ショベル |
JP2018109875A (ja) * | 2017-01-04 | 2018-07-12 | 株式会社デンソーテン | 画像処理装置および画像処理方法 |
Families Citing this family (35)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP5667594B2 (ja) * | 2012-03-15 | 2015-02-12 | 株式会社小松製作所 | 障害物検出機構付きダンプトラックおよびその障害物検出方法 |
JP2016151897A (ja) * | 2015-02-17 | 2016-08-22 | 株式会社安川電機 | 移動体制御装置および移動体制御方法 |
JP6224029B2 (ja) * | 2015-05-21 | 2017-11-01 | 富士通テン株式会社 | 画像処理装置および画像処理方法 |
ITUB20154924A1 (it) * | 2015-11-06 | 2017-05-06 | Same Deutz Fahr Italia S P A | Trattore con sistema di visione |
US10290194B2 (en) * | 2016-02-29 | 2019-05-14 | Analog Devices Global | Occupancy sensor |
JP6468444B2 (ja) * | 2016-04-28 | 2019-02-13 | コベルコ建機株式会社 | 建設機械 |
JP6684682B2 (ja) * | 2016-08-18 | 2020-04-22 | 株式会社神戸製鋼所 | 建設機械 |
CA3187706C (en) * | 2016-08-26 | 2023-08-29 | Crown Equipment Corporation | Materials handling vehicle obstacle scanning tools |
CN106384476A (zh) * | 2016-11-22 | 2017-02-08 | 天津尔岚科技有限公司 | 一种基于定位卡下的牲畜个体消失报警系统及检测方法 |
JP2018116612A (ja) * | 2017-01-20 | 2018-07-26 | 株式会社クボタ | センサ管理装置 |
EP3584120B1 (en) * | 2017-02-17 | 2021-04-14 | Sumitomo Heavy Industries, Ltd. | Work machine surroundings monitoring system |
JP6752168B2 (ja) * | 2017-02-27 | 2020-09-09 | 日立建機株式会社 | ダンプトラック及び後退支援装置 |
WO2018164152A1 (ja) * | 2017-03-07 | 2018-09-13 | 住友建機株式会社 | ショベル |
JP6891087B2 (ja) * | 2017-09-29 | 2021-06-18 | 株式会社小松製作所 | 作業車両、表示装置、および障害判定方法 |
JP6969983B2 (ja) * | 2017-11-10 | 2021-11-24 | 株式会社小松製作所 | ダンプトラック |
US10594991B1 (en) | 2018-01-09 | 2020-03-17 | Wm Intellectual Property Holdings, Llc | System and method for managing service and non-service related activities associated with a waste collection, disposal and/or recycling vehicle |
DE102018202387B3 (de) * | 2018-02-16 | 2019-05-02 | Audi Ag | Rückspiegelanordnung |
JP7092540B2 (ja) | 2018-04-04 | 2022-06-28 | パナソニックホールディングス株式会社 | 交通監視システムおよび交通監視方法 |
TWI714857B (zh) * | 2018-06-05 | 2021-01-01 | 為昇科科技股份有限公司 | 車用雷達偵測系統 |
US20190377064A1 (en) * | 2018-06-06 | 2019-12-12 | GM Global Technology Operations LLC | Method and apparatus for deicing of sensor systems in a vehicle |
CN108805509A (zh) * | 2018-09-05 | 2018-11-13 | 曹华华 | 一种土石方车辆管理装置及方法 |
JP7091955B2 (ja) * | 2018-09-06 | 2022-06-28 | トヨタ自動車株式会社 | 車両用周辺表示装置 |
US20220174241A1 (en) * | 2019-03-26 | 2022-06-02 | Volvo Truck Corporation | Vehicle comprising a viewing system and method for adjusting position of a monitor of the viewing system |
US11878694B2 (en) * | 2019-06-24 | 2024-01-23 | Andy Krejci | Vehicle safety system |
US11475416B1 (en) | 2019-08-23 | 2022-10-18 | Wm Intellectual Property Holdings Llc | System and method for auditing the fill status of a customer waste container by a waste services provider during performance of a waste service activity |
WO2021060533A1 (ja) * | 2019-09-26 | 2021-04-01 | 日立建機株式会社 | 作業機械 |
US11320830B2 (en) | 2019-10-28 | 2022-05-03 | Deere & Company | Probabilistic decision support for obstacle detection and classification in a working area |
CN112995583B (zh) * | 2019-12-18 | 2022-07-01 | 杭州海康威视数字技术股份有限公司 | 摄像投取装置及交通工具监控系统 |
US11421402B2 (en) * | 2020-02-05 | 2022-08-23 | Caterpillar Paving Products Inc. | Operation-based object detection for a work machine |
JP2021163260A (ja) * | 2020-03-31 | 2021-10-11 | 株式会社小松製作所 | 検出システムおよび検出方法 |
US11386362B1 (en) | 2020-12-16 | 2022-07-12 | Wm Intellectual Property Holdings, L.L.C. | System and method for optimizing waste / recycling collection and delivery routes for service vehicles |
US11373536B1 (en) | 2021-03-09 | 2022-06-28 | Wm Intellectual Property Holdings, L.L.C. | System and method for customer and/or container discovery based on GPS drive path and parcel data analysis for a waste / recycling service vehicle |
US11928693B1 (en) | 2021-03-09 | 2024-03-12 | Wm Intellectual Property Holdings, L.L.C. | System and method for customer and/or container discovery based on GPS drive path analysis for a waste / recycling service vehicle |
US11488118B1 (en) | 2021-03-16 | 2022-11-01 | Wm Intellectual Property Holdings, L.L.C. | System and method for auditing overages and contamination for a customer waste container by a waste services provider during performance of a waste service activity |
US11977381B1 (en) | 2022-04-01 | 2024-05-07 | Wm Intellectual Property Holdings, L.L.C. | System and method for autonomous waste collection by a waste services provider during performance of a waste service activity |
Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH1199894A (ja) * | 1997-09-30 | 1999-04-13 | Mazda Motor Corp | 車両用障害物検出装置 |
JPH11264871A (ja) * | 1998-03-17 | 1999-09-28 | Komatsu Ltd | 車両用障害物検出装置の監視機構 |
JP2008095307A (ja) * | 2006-10-06 | 2008-04-24 | Hitachi Constr Mach Co Ltd | 作業機械の周囲監視装置 |
JP2010210412A (ja) * | 2009-03-10 | 2010-09-24 | Toshiba Tec Corp | 障害物検知システム及びこのシステムの障害物センサ診断方法 |
JP2013159930A (ja) * | 2012-02-02 | 2013-08-19 | Sumitomo Heavy Ind Ltd | 周囲監視装置 |
JP2013242172A (ja) * | 2012-05-18 | 2013-12-05 | Sumitomo Heavy Ind Ltd | 超音波センサ |
JP2014025272A (ja) * | 2012-07-27 | 2014-02-06 | Hitachi Constr Mach Co Ltd | 作業機械の周囲監視装置 |
JP2014064192A (ja) * | 2012-09-21 | 2014-04-10 | Komatsu Ltd | 作業車両用周辺監視システム及び作業車両 |
Family Cites Families (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2000028717A (ja) | 1998-07-13 | 2000-01-28 | Mitsubishi Electric Corp | 障害物検出装置 |
WO2008007625A1 (en) * | 2006-07-11 | 2008-01-17 | Komatsu Ltd. | System for monitoring component of operating machine |
JP4847913B2 (ja) | 2007-03-30 | 2011-12-28 | 日立建機株式会社 | 作業機械周辺監視装置 |
JP2011135253A (ja) * | 2009-12-24 | 2011-07-07 | Fujitsu Ten Ltd | 画像処理装置、画像処理システム、および、画像処理方法 |
JP5071743B2 (ja) | 2010-01-19 | 2012-11-14 | アイシン精機株式会社 | 車両周辺監視装置 |
JP5597596B2 (ja) | 2011-06-07 | 2014-10-01 | 株式会社小松製作所 | 作業車両の周辺監視装置 |
US9043125B2 (en) * | 2011-08-18 | 2015-05-26 | Dufournier Technologies | Device and process for vehicle driving evaluation |
JP5230828B1 (ja) | 2012-02-09 | 2013-07-10 | 株式会社小松製作所 | 作業車両用周辺監視システム及び作業車両 |
US10963133B2 (en) * | 2014-01-07 | 2021-03-30 | Honeywell International Inc. | Enhanced awareness of obstacle proximity |
WO2015162801A1 (ja) | 2014-04-25 | 2015-10-29 | 株式会社小松製作所 | 周辺監視システム、作業車両、及び周辺監視方法 |
-
2014
- 2014-04-25 US US14/382,328 patent/US10240323B2/en active Active
- 2014-04-25 WO PCT/JP2014/061801 patent/WO2015162800A1/ja active Application Filing
- 2014-04-25 CN CN201480000810.5A patent/CN105339061B/zh active Active
- 2014-04-25 JP JP2014526331A patent/JP5933004B2/ja active Active
- 2014-04-25 CA CA2863656A patent/CA2863656C/en active Active
Patent Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH1199894A (ja) * | 1997-09-30 | 1999-04-13 | Mazda Motor Corp | 車両用障害物検出装置 |
JPH11264871A (ja) * | 1998-03-17 | 1999-09-28 | Komatsu Ltd | 車両用障害物検出装置の監視機構 |
JP2008095307A (ja) * | 2006-10-06 | 2008-04-24 | Hitachi Constr Mach Co Ltd | 作業機械の周囲監視装置 |
JP2010210412A (ja) * | 2009-03-10 | 2010-09-24 | Toshiba Tec Corp | 障害物検知システム及びこのシステムの障害物センサ診断方法 |
JP2013159930A (ja) * | 2012-02-02 | 2013-08-19 | Sumitomo Heavy Ind Ltd | 周囲監視装置 |
JP2013242172A (ja) * | 2012-05-18 | 2013-12-05 | Sumitomo Heavy Ind Ltd | 超音波センサ |
JP2014025272A (ja) * | 2012-07-27 | 2014-02-06 | Hitachi Constr Mach Co Ltd | 作業機械の周囲監視装置 |
JP2014064192A (ja) * | 2012-09-21 | 2014-04-10 | Komatsu Ltd | 作業車両用周辺監視システム及び作業車両 |
Cited By (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2018008542A1 (ja) * | 2016-07-05 | 2018-01-11 | 住友建機株式会社 | ショベル |
KR20190022468A (ko) * | 2016-07-05 | 2019-03-06 | 스미토모 겐키 가부시키가이샤 | 쇼벨 |
JPWO2018008542A1 (ja) * | 2016-07-05 | 2019-04-18 | 住友建機株式会社 | ショベル |
US10920403B2 (en) | 2016-07-05 | 2021-02-16 | Sumitomo(S.H.I.) Construction Machinery Co., Ltd. | Shovel |
KR102386846B1 (ko) * | 2016-07-05 | 2022-04-13 | 스미토모 겐키 가부시키가이샤 | 쇼벨 |
JP2018109875A (ja) * | 2017-01-04 | 2018-07-12 | 株式会社デンソーテン | 画像処理装置および画像処理方法 |
Also Published As
Publication number | Publication date |
---|---|
JP5933004B2 (ja) | 2016-06-08 |
CN105339061B (zh) | 2017-05-10 |
CA2863656A1 (en) | 2015-10-25 |
CA2863656C (en) | 2017-04-25 |
US10240323B2 (en) | 2019-03-26 |
US20150326829A1 (en) | 2015-11-12 |
JPWO2015162800A1 (ja) | 2017-04-13 |
CN105339061A (zh) | 2016-02-17 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP5933004B2 (ja) | 周辺監視システム、作業車両、及び周辺監視方法 | |
JP6228538B2 (ja) | 周辺監視システム、作業車両、及び周辺監視方法 | |
JP5529943B2 (ja) | 作業車両用周辺監視システム及び作業車両 | |
JP5643272B2 (ja) | 作業車両用周辺監視システム及び作業車両 | |
JP5629740B2 (ja) | 作業車両用周辺監視システム及び作業車両 | |
US9457715B2 (en) | Work vehicle periphery monitoring system and work vehicle | |
JP5550695B2 (ja) | 作業車両用周辺監視システム及び作業車両 | |
CA2809654C (en) | Dump truck with obstacle detection mechanism and method for detecting obstacle | |
WO2014045466A1 (ja) | 作業車両用周辺監視システム及び作業車両 | |
JP5926315B2 (ja) | 作業車両用周辺監視システム及び作業車両 | |
JP5595565B2 (ja) | 作業車両用周辺監視システム、作業車両及び作業車両用周辺監視方法 | |
JP5788048B2 (ja) | 作業車両用周辺監視システム及び作業車両 | |
JP5990237B2 (ja) | ダンプトラック用周辺監視システム及びダンプトラック | |
JP5823553B2 (ja) | 作業車両用周辺監視システム及び作業車両 | |
CA2817863C (en) | Work vehicle periphery monitoring system and work vehicle |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
WWE | Wipo information: entry into national phase |
Ref document number: 201480000810.5 Country of ref document: CN |
|
ENP | Entry into the national phase |
Ref document number: 2014526331 Country of ref document: JP Kind code of ref document: A |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2863656 Country of ref document: CA |
|
WWE | Wipo information: entry into national phase |
Ref document number: 14382328 Country of ref document: US |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 14890436 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 14890436 Country of ref document: EP Kind code of ref document: A1 |