US20160006947A1 - Surroundings monitoring device for slewing-type work machine - Google Patents

Surroundings monitoring device for slewing-type work machine Download PDF

Info

Publication number
US20160006947A1
US20160006947A1 US14/766,596 US201414766596A US2016006947A1 US 20160006947 A1 US20160006947 A1 US 20160006947A1 US 201414766596 A US201414766596 A US 201414766596A US 2016006947 A1 US2016006947 A1 US 2016006947A1
Authority
US
United States
Prior art keywords
interference
slewing
dump truck
hydraulic excavator
work machine
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US14/766,596
Other languages
English (en)
Inventor
Yoichi Kowatari
Hidefumi Ishimoto
Yoshihiro Inanobe
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hitachi Construction Machinery Co Ltd
Original Assignee
Hitachi Construction Machinery Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hitachi Construction Machinery Co Ltd filed Critical Hitachi Construction Machinery Co Ltd
Assigned to HITACHI CONSTRUCTION MACHINERY CO., LTD. reassignment HITACHI CONSTRUCTION MACHINERY CO., LTD. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: INANOBE, Yoshihiro, ISHIMOTO, HIDEFUMI, KOWATARI, YOICHI
Publication of US20160006947A1 publication Critical patent/US20160006947A1/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/265—Mixing
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/20—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/22—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle
    • B60R1/23—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view
    • B60R1/27—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view providing all-round vision, e.g. using omnidirectional cameras
    • E—FIXED CONSTRUCTIONS
    • E02—HYDRAULIC ENGINEERING; FOUNDATIONS; SOIL SHIFTING
    • E02F—DREDGING; SOIL-SHIFTING
    • E02F9/00—Component parts of dredgers or soil-shifting machines, not restricted to one of the kinds covered by groups E02F3/00 - E02F7/00
    • E02F9/26—Indicating devices
    • E02F9/261—Surveying the work-site to be treated
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/63—Control of cameras or camera modules by using electronic viewfinders
    • H04N23/633—Control of cameras or camera modules by using electronic viewfinders for displaying additional information relating to control or operation of the camera
    • H04N23/635—Region indicators; Field of view indicators
    • H04N5/23293—
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/44—Receiver circuitry for the reception of television signals according to analogue transmission standards
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/181—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/30—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing
    • B60R2300/306—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing using a re-scaling of images
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/60—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by monitoring and displaying vehicle exterior scenes from a transformed perspective
    • B60R2300/607—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by monitoring and displaying vehicle exterior scenes from a transformed perspective from a bird's eye viewpoint

Definitions

  • the present invention relates to a slewing-type work machine adapted to sustain security for surrounding of the slewing-type work machine, such as a hydraulic excavator or the like.
  • a hydraulic excavator is a kind of a slewing-type work machine.
  • the hydraulic excavator consists of a lower travelling mechanism and a upper swiveling mechanism which are connected by a slewing apparatus, the upper swiveling mechanism being adapted to rotate with respect to the lower travelling mechanism.
  • a front working member is provided on the upper swiveling mechanism, the working member being consisted of a boom, an arm and a front attachment.
  • the front attachment is mainly a bucket to be connected to the arm.
  • Soil and sand excavated by the hydraulic excavator are loaded on a vessel of a dump truck.
  • a dump truck waits at a position which is apart a predetermined distance from the hydraulic excavator, excavated soil and sand being loaded from the hydraulic excavator on the vessel of the dump truck.
  • the hydraulic excavator performs repeatedly the excavation of soil and sand, and loading them on the vessel of the dump truck.
  • the slewing apparatus is mounted to carry out the repeated performance of the hydraulic excavator.
  • the hydraulic excavator executes swiveling action so that it is necessary to ensure safety of surroundings. That is, the hydraulic excavator is necessary to pay attention not to contact with some obstacle at a time of swiveling action of the hydraulic excavator. For example, when the hydraulic excavator makes swiveling action in such a situation that the dump truck is extremely approached to the hydraulic excavator, a counterweight of the hydraulic excavator being brought into contact with the dump truck. An operator who operates the hydraulic excavator cannot find visually as to whether or not the counterweight causes interference, due to the counterweight is positioned rearward direction of an operator's cab.
  • Dead angle zone comes into existence specifically to the backward direction for an operator who is boarded in an operator's cab, and also dead angle is produced for left side and right side direction, further also is formed dead angle to the front side thereof.
  • a patent document 1 discloses a technology that plural cameras are mounted on a hydraulic excavator for displaying an overhead view image by means of signal process of the images taken from the cameras.
  • virtual image of overhead view from upper position to downwardly can be displayed by performing coordinate transformation of images taken by the cameras, the surrounding situation can be recognized by the operator in the manner of high visibility.
  • any obstacle is placed at a closed position from the hydraulic excavator, it is extremely important technology to make intuitively recognition for the operator as to the distance between the hydraulic excavator and the obstacle.
  • the operator can understand the surrounding situation of the hydraulic excavator intuitively by displaying overhead view image in accordance with the patent document 1. It is useful to specify marginal area to interfere with any obstacle at the time of rotating action of the hydraulic excavator (that is an interference scope) on the overhead view image.
  • the operator has clear visibility for visual recognition with respect to the forward field of view, the operator can judge by sight as to whether or not the front working mechanism would interfere with the obstacle. Therefore, it is toward the rearward direction, in most cases at the direction of the counterweight, for highly necessary to show the marginal area of interference at the time of swiveling action.
  • the overhead view image is created by converting the view point from upper to downwardly by means of a camera image which is turned the optical axis toward obliquely downward direction. Therefore, the position coordinate becomes different position when the ground height (the height from the ground) is different. That is to say, in a case where there exists a height difference between the hydraulic excavator and the obstacle, difference is caused in relative positioning between them on the overhead view image. This is resulted by converting three-dimensional image taken from a camera to two-dimensional plane view at the time of creating the overhead view image processed by the coordinate conversion.
  • the interfering scope shown becomes indefinite if not comply with the same ground height, such as height from the ground. In a case where the shown interfering scope with indefinite height standard, misunderstandings may arise for the operator.
  • the object of the present invention is to represent precisely an interference scope shown on an overhead view image of surrounding situation of a slewing-type work machine.
  • a view point converting section for performing coordinate conversion of image data taken from respective imaging devices to make overhead view images to look down from upper position
  • a composite overhead view image creating section to create a composite overhead view image arranged around symbolized view image of the slewing-type work machine
  • an interference scope indicating section to indicate on the overhead view image to cause interference with a surrounding obstacle placed according to the ground height at the time of rotating action of the slewing-type work machine
  • a display image producing section to display the composite overhead view image together with the interference scope on the display image
  • a monitor to display the display image.
  • the interference scope is settled on the basis of the positional relation between the rotating area of the slewing-type work machine and the position of an obstacle. More concretely, rear end of the rotating radius of the slewing-type work machine, in a case of a hydraulic excavator, rear end of a counterweight is determined as criterion of the interference scope. In connection with the hydraulic excavator, although a front working mechanism is provided on front-side thereof, the front working mechanism is not determined as criterion of the interference scope, even if it has rotating radius larger than that of the counterweight, because the operator can visually recognize the front working mechanism.
  • the interference scope marking section is settled on the basis of same ground height of the slewing-type work machine and the obstacle, same criterion of the interference scope can be applied even if there is difference in ground height between the slewing-type work machine and the obstacle, except that the slewing-type work machine is extremely inclined. However, it may be shown the obstacle into or out of the criterion depending upon the difference in height therebetween. Plural number of criterions of the interference scope can be indicated on the display device.
  • the rearmost portion of a vessel or the rear end portion of a frame of the dump truck can be determined the positional relationship of the criterion region at the time of swiveling action of the hydraulic excavator.
  • wireless communication members can be provided for respective dump truck in order to identify the kind of the dump truck, thereby the interference scope marking section may indicate the interference scope of the rearmost portion of the vessel or the rear end portion of the frame at the ground height for respective dump trucks.
  • the display image producing section can be so designed as to enter a numeral of the ground height of the interference scope.
  • the interference scope at the time of same ground height between the positioned height for the slewing-type work machine and located height of the interfered object is set as a standard interference scope, and the interference scope can be changed the interference scope in accordance with the difference in height, further the change of the interference scope may be performed manually or may be adjusted automatically depending upon the measured value of the difference in height.
  • the obstacle is the dump truck as mentioned above, the height of the vessel is changed on the basis of the loaded earth and sand. Taking into consideration of this aspect, variation may be provided for the interference scope.
  • the extent of interference to the obstacle can be recognized precisely and easily.
  • FIG. 1 is a side elevation view of a hydraulic excavator.
  • FIG. 2 is a block diagram of a display controller and a monitor.
  • FIG. 3 is an example showing to indicating plural number of interference scopes on a composite overhead view image.
  • FIG. 4 is a illustrative view showing relationship between a hydraulic excavator and the composite overhead view image.
  • FIG. 5 shows a large-sized dump truck and a composite overhead view image being indicated an interference scope therein corresponding to the large-sized dump truck.
  • FIG. 6 shows a small-sized dump truck and a composite overhead view image being indicated an interference scope therein corresponding to the small-sized dump truck.
  • FIG. 7 shows a set of a hydraulic excavator, a large-sized dump truck and a small-sized dump truck.
  • FIG. 8 shows actual large-sized dump truck, and a composite overhead view image being indicated two interference scopes of the large-sized dump truck and the small-sized dump truck.
  • FIG. 9 shows actual small-sized dump truck, and a composite overhead view image being indicated two interference scopes of the small-sized dump truck and the large-sized dump truck.
  • FIG. 10 is a second embodiment of a block diagram of a display controller and a monitor.
  • FIG. 11 shows an embodiment illustrating information as to ground height added on FIG. 5 .
  • FIG. 12 shows a super large-sized dump truck, and a composite overhead view image being indicated an interference scope therein corresponding to the super large-sized dump truck.
  • FIG. 13 shows an embodiment illustrating information as to ground height added on FIG. 11 .
  • FIG. 14 is a fifth embodiment of a block diagram of a display controller and a monitor.
  • FIG. 15 shows a composite overhead view accompanied with an interference scope in a case that hydraulic excavator and a dump truck are positioned at a differential height.
  • FIG. 16 shows an illustrative view in changing the interference scope between empty state and loaded state of the dump truck.
  • a hydraulic excavator is referred to as an example for a slewing-type work machine, but the slewing-type work machine is not limited to the hydraulic excavator.
  • other work machines such as a crane truck and the like may be applicable as the slewing-type work machine.
  • any work machine to perform predetermined work with swiveling action may be included as the slewing-type work machine.
  • FIG. 1 shows a hydraulic excavator 1 as a slewing-type work machine.
  • the hydraulic excavator 1 is consisting mainly of a lower traveling mechanism 2 , upper swiveling mechanism 3 and a slewing apparatus 4 .
  • the lower traveling mechanism 2 is a traveling means of the hydraulic excavator 1 , a crawler-type lower traveling mechanism 2 being exemplified in the present invention.
  • the lower traveling mechanism 2 and the upper swiveling mechanism 3 are connected by the slewing apparatus 4 , thus allowing to rotate upper swiveling mechanism 3 in respect to the lower traveling mechanism 2 by the operation of the slewing apparatus 4 .
  • the hydraulic excavator 1 is functioned as a slewing-type work machine.
  • the upper swiveling mechanism 3 has an operator's cab 5 , a front working member 6 , a machinery house 7 and a counterweight 8 .
  • Various operating members for operating the hydraulic excavator 1 are provided in the operator's cab 5 , an operator boarded in the operator's cab 5 operates the hydraulic excavator 1 .
  • Operating member for the slewing apparatus 4 is also provided in the operator's cab 5 .
  • the machinery house 7 is arranged at the rear position of the operator's cab 5 and the front working member 6 , further rear position of the machinery house 7 being mounted the counterweight 8 . In this connection, at the rear-most position of the counterweight 8 , highest position from the ground G (height) is called as the uppermost portion 8 H and the lowest position from the ground G is called as the lowermost portion 8 L.
  • the front working member 6 is positioned side by side of the operator's cab 5 at the front side of the upper swiveling mechanism 3 which consists of a boom 10 , an arm 11 and a bucket 12 .
  • the boom 10 is adapted to turn up and down by pivotally connected the proximal end with a connecting pin to a frame 3 a of the upper swiveling mechanism 3 .
  • the arm 11 is connected to the distal end of the boom 10 for allowing to rotate up and down direction, further the bucket 12 being rotatably connected to the distal end of the arm 11 .
  • the operation to turn up and down is caused by a boom cylinder 10 a .
  • the arm 11 is driven by an arm cylinder 11 a , the bucket 12 being driven by an bucket cylinder 12 a .
  • the bucket 12 is a replaceable front attachment, basically being connected for the sake of excavating earth and sand.
  • Cameras 13 are provided on the hydraulic excavator 1 respectively for taking images of different direction.
  • a rearward camera 13 B to take image of rearward direction
  • a left side camera 13 L for taking image of left side direction
  • a right side camera 13 R for taking image of right side direction
  • forward camera 13 F for taking image of forward direction, respectively of the hydraulic excavator 1 .
  • Respective cameras have the optical axis directed to the obliquely downwardly.
  • respective cameras have the optical axis of the lens of inclined degree ⁇ (0 degree ⁇ 90 degree) to the ground G.
  • the rearward camera 13 B is shown in FIG. 1 , but having same situation for other cameras 13 L, 13 R and 13 F.
  • the rearward camera 13 B is placed on the top of the counterweight 8 , the left side camera 13 L being placed on the top of the operator's cab 5 , the right side camera 13 R being on the top of the counterweight 8 , and the forward camera 13 F being located on the top of the operator's cab 5 .
  • these cameras may be located at optional positions.
  • the visual fields of these cameras 13 are so designed as to be overlapped at the opposite ends each other by arranging each visual field, position and the like. For example, the visual field of the rearward camera 13 B is brought to overlap with that of the left side camera 13 L, and the rearward camera 13 B being brought to overlap with that of the right side camera 13 R. Thereby, blind area does not produced between the adjacent cameras 13 .
  • FIG. 2 shows a monitor 15 and a display controller 16 for controlling the indication contents to the monitor 15 .
  • the monitor 15 consists of a display part 17 and an operation part 18 .
  • the display part 17 is a screen for showing an image of the output from the operation part 18 .
  • the operation part 18 is adapted to operate the display contents such as, for example, a button for the operation part 18 .
  • the operation part 18 is not in particular provided in a case of a touch panel structure.
  • the display controller 16 comprises an image correcting section 20 , a view point converting section 21 , a composite overhead view image creating section 22 , a ground height information storage section 23 , a rotating radius calculating section 24 , an interference scope indicating section 25 and a display image creating section 26 .
  • the image creating section 20 is connected to the rearward camera 13 B, the left side camera 13 L, the right side camera 13 R and the forward camera 13 F, respective cameras 13 being adapted to take image.
  • Various image correction processes such as distortion correcting, contrast correcting, color tone correcting are performed for the thus taken image (image data) on the basis of camera optical parameters and the like. Such corrections are processed to the four image data in the image correcting section independently due to image data being taken from respective cameras 13 .
  • the view point converting section 21 performs process to convert the view point for image data which has been corrected the image data by the image correcting section 20 .
  • Respective cameras 13 take image directed the optical axis toward obliquely downwardly as shown in FIG. 1 .
  • the view point conversion is performed so as to put the view point of the cameras 13 to upper position, resulting virtually plan view to see from upper to downward direction.
  • the cameras 13 taken image of three dimensional space is subjected coordinate transformation to convert into a plane view from upper virtual view point 13 V to downwardly (optical axis being vertical direction). This processing is view point conversion.
  • the view point conversion is performed for each image data of respective cameras 13 . Therefore, four image data is performed processing of the view point conversion independently.
  • the image data of the rearward camera 13 B which is performed the coordinate transformation is a rearward overhead view image
  • the image data of the left side camera 13 L performed the coordinate transformation for taking a left side overhead view image
  • the image data of the right side camera 13 R performed the coordinate transformation for taking a right side overhead view image
  • the image data of the forward camera 13 F performed the coordinate transformation for taking a forward overhead view image.
  • the composite overhead view image creating section 22 composes to create a composite overhead view image from the four overhead view images.
  • the composite overhead view image is composed of these four overhead view images around a plane view of a graphic image of a hydraulic excavator 1 .
  • the composite overhead view image is comprehensively created consisting of four overhead view images around the graphic image of the hydraulic excavator 1 .
  • the composite overhead view image which is created by the overhead view image creating section 22 outputs to the display image creating section 26 .
  • the ground height information storage section 23 has a function to store as to a predetermined height (height from ground height G).
  • the ground height has a meaning for determining height to indicate interference scope on the composite overhead view image.
  • the ground height may not only be settled one type, but also plural number of different types of height levels can be settled. Also, the ground height can arbitrary be settled.
  • the rotating radius calculating section 24 has a function to the interference scope as a rotating radius for indicating on the composite overhead view image.
  • the rotating radius calculating section 24 is inputted information for converting the view point, that is coordinate conversion information from the rotating radius calculating section 24 .
  • the apparent rotating radius can be calculated at a specific position of the hydraulic excavator 1 in the ground height, at the time of converting the information of three dimension to two dimensional plane view image (overhead view image).
  • the apparent rotating radius is calculated in accordance with information of height from ground.
  • the interference scope indicating section 25 is inputted the rotating radius R calculated by the rotating radius calculating section 24 .
  • the display image creating section 26 is inputted the composite overhead view image data, thus indicating a circle of calculated rotating radius R on the image of the hydraulic excavator 1 at the place about the center of the composite overhead view image. This circle is an interference scope of the counterweight 8 at arbitral height.
  • the display image creating section 26 outputs an image of the composite overhead view image indicated the interference scope as a display image to the display part 17 .
  • the display part 17 shows the display image.
  • FIG. 3 shows an example of a display image.
  • This display image is produced in accordance with the following signal process.
  • the four cameras 13 provided on the hydraulic excavator 1 take image at a predetermined cycle, but the forward camera 13 F can be omitted due to securing an excellent visibility for forward view of the operator's cab 5 .
  • images taken from four cameras 13 are inputted to the image correction section 20 .
  • the image correction section 20 performs various image correction processes such as distortion correcting, contrast correcting, color tone correcting and the like for the four image data.
  • the four image data after correction are outputted to the view point converting section 21 .
  • the view point converting section 21 executes to convert the view point for the four view image data after correction. Since the respective cameras 13 take image of three dimensional space, these four image data are subjected to convert coordinate images into a view from upper virtual view point 13 V to downwardly (optical axis being vertical direction). The processing as explained is to convert the view point.
  • the composite overhead view image P as shown in FIG. 3 is an image consisting of a rearward overhead view image 32 B, a left side overhead view image 32 L, a right side overhead view image 32 R and a forward overhead view image 32 F arranged around a symbolized view image 31 of the hydraulic excavator 1 . Therefore, the composite overhead view image P is a composite image consisting of respective overhead view images.
  • the operator boarded in the operator's cab 5 can be recognized the situation around the hydraulic excavator 1 by reviewing the composite overhead view image P, such as for example, when some obstacle is placed around there, the distance between the hydraulic excavator 1 and the obstacle intuitively and precisely.
  • a pole 33 is erected near the hydraulic excavator 1 as shown on this figure.
  • interference scopes 40 through 44 are indicated around the view image 31 .
  • the interference scope 40 shown in a solid line is a circle of the rotating radius R of the counterweight 8 at the level zero of ground height (H 0 ). While, shown with short dash lines are interference scopes 41 to 44 on appearance.
  • the view direction of cameras 13 which are directed toward obliquely downwardly are converted the view point coordinate to vertical direction having the virtual view point 13 V, the interference scopes 41 to 44 on appearance have height from ground height H 1 to H 4 (H 1 ⁇ H 2 ⁇ H 3 ⁇ H 4 ) at the position of the pole 33 as the obstacle projected on the virtual plane.
  • the rotating radius on ground G that is the ground height H 0
  • the rotating radius becomes different depending upon the view angle of the visual line.
  • the ground heights H 1 to H 4 which are determined as virtual planes, data about the ground heights H 1 to H 4 and the interference scopes 41 to 44 are stored in the ground height information storage section 23 .
  • the ground height H 4 is the highest position 8 H of the rearmost position of the counterweight 8 .
  • the ground heights H 2 and H 3 are the heights divided equal parts between the ground height H 1 and the ground height H 4 .
  • the values of the ground heights can set manually beforehand or automatically.
  • the outermost moving track at the swiveling action of the hydraulic excavator 1 is the rearmost portion of the counterweight 8 except for the front working member 6 . Since the front working member 6 is placed at the fore direction of the operator's cab 5 , the operator can confirm certainly whether or not the front working member 6 is caused interference with some obstacle. However, it is difficult to judge by sight whether or not bringing the rearmost portion of the counterweight 8 into contact with some obstacle in the course of swiveling action of the hydraulic excavator 1 .
  • the operator can roughly judge whether or not the counterweight 8 will bring into contact with some obstacle, by paying notice of the display part 17 which shows the composite overview image P.
  • the interference scope in the composite overhead view image P may change depending upon the ground height, even though at the same distance of the outermost position of the counterweight 8 from the center of the hydraulic excavator 1 , because the composite overhead view image is a two dimensional plane image which is processed coordinate conversion from a three dimensional image.
  • the rotating radius calculating section 24 which is inputted information as to the four ground heights H 1 to H 4 from the ground height information storage section 23 , calculates apparent rotating radiuses R 1 to R 4 respectively at the ground heights H 1 to H 4 on the composite overhead view image thus processed view point conversion.
  • the rotating radius calculating section 24 is inputted the calculation method for convert the coordinate from the view point converting section 21 , then calculating the apparent rotating radiuses R 1 to R 4 at four ground heights H 1 to H 4 based upon the inputted calculating method.
  • R 1 is regarded as an apparent rotating radius at the ground heights H 1
  • R 2 being regarded as an apparent rotating radius at the ground heights H 2
  • R 3 being regarded as an apparent rotating radius at the height level H 3
  • R 3 being regarded as an apparent rotating radius at the ground heights H 4
  • the relation of “R 1 ⁇ R 2 ⁇ R 3 ⁇ R 4 ” is satisfied due to the relation of“H 1 ⁇ H 2 ⁇ H 3 ⁇ H 4 ” being established.
  • the apparent rotating radius becomes smaller where it is lower the ground height, while the apparent rotating radius being larger where it is higher in the ground height, because that two dimensional overhead view image is prepared by converting coordinate transformation from three dimensional space at the view point converting section 21 .
  • the height of a subject to take image is transformed to the distance from the center of swivel action, thus accordingly the height of the subject has a meaning to express the radius from the swivel center.
  • the rotating radius calculating section 24 can confirm the apparent rotating radiuses R 1 top R 4 corresponding to the ground height from ground H 1 to H 4 at the rearmost position of the counterweight 8 of the hydraulic excavator 1 .
  • the thus calculated four apparent rotating radiuses R 1 to R 4 are outputted from the rotating radius calculating section 24 to the interference scope indicating section 25 .
  • the display image creating section 26 is inputted data of the composite overhead view image from the overhead view image creating section 22 , and the interference scope indicating section 25 indicates four interference scopes 42 to 44 (shown by dash lines) on the basis of four apparent rotating radiuses R 1 to R 4 . That is, as shown in FIG. 1 , a plotted circle having the rotating radius R 1 is indicated as the interference scope 41 , a plotted circle having the rotating radius R 2 is indicated as the interference scope 42 , a plotted circle having the rotating radius R 3 is indicated as the interference scope 43 , and a plotted circle having the rotating radius R 4 is indicated as the interference scope 44 .
  • FIG. 4( a ) shows a part of the composite overhead view image P
  • FIG. 4( b ) is shown a picture view from the backward direction of actual hydraulic excavator 1 .
  • the relation between the interference scopes 41 to 44 of FIG. 4( a ) and the actual hydraulic excavator 1 is shown.
  • the pole 33 having a column shape as erected vertically in FIG. 4( b )
  • the pole 33 appears as distorted shape in FIG. 4( a ).
  • This distortion results from the conversion in the view point converting section 21 of three dimensional image to the two dimensional overhead view image.
  • the ground heights H 1 to H 4 are at the same distance from the center of the hydraulic excavator 1 .
  • apparent rotating radiuses (R 1 to R 4 ) are shown different circles at the height level H 1 to H 4 due to the overhead view image P has been processed coordinate transformation.
  • the interference scopes 41 to 44 respectively indicate the ground heights H 1 to H 4 , that means the rotating track of the rearmost end of the counterweight 8 . Therefore, in a case where the obstacle is contacted with or placed within the interference scope 41 to 44 , the obstacle becomes in contact with the counterweight 8 .
  • the counterweight 8 comes in contact with the pole 33 at every height positions H 1 to H 4 at the time of swiveling action. While, counterweight 8 does not contact with the obstacle positioned at the out of the interference scopes 41 to 44 .
  • the operator boarded in the operator's cab 5 can recognize the surrounding situation of the hydraulic excavator 1 in detail.
  • the operator can confirm intuitively and certainly whether or not interference will occur against any obstacle by being clearly shown the interference scope at ground height, otherwise difficulty may be encountered to judge by the composite overhead view image coordinate transformation.
  • the interference scopes 41 to 44 are shown as circular shapes in the foregoing explanation, but may be shown as arcuate shapes.
  • the interference scopes 41 to 44 are indicated as circular shapes, in a case of unable to indicate the complete interference scopes due to limitation of the display size in the display part 17 , it may be partially not necessarily indicating them complete circles.
  • the interference scopes 41 to 44 are indicated as arcuate shapes.
  • interference scopes 41 to 44 corresponding to the ground heights H 1 to H 4 are indicated in the composite overhead view image P, one single interference scope may be indicated therein.
  • the interference scope 44 may only be indicated for the ground height H 4 .
  • the ground height H 4 means the highest position 8 H at the rearmost portion of the counterweight 8 . There is not existed particular substance at higher position over the highest position 8 H on the rearmost portion of the counterweight 8 , thus no obstacle being brought contact with the above the highest position 8 H at the rearmost portion of the counterweight 8 .
  • the interference scope 44 of the highest position 8 H at the rearmost portion of the counterweight 8 operators can recognize that there is no possibility to contact the counterweight 8 with an obstacle. Further, since there is not any substance in the space under the lowest position 8 L at the rearmost portion of the counterweight 8 , even if an obstacle is existed at that place, the counterweight 8 does not contact with the obstacle, as far as the height of the obstacle being lower than position H 1 . Therefore, by indicating the interference scopes 41 and 44 , one can recognize the possibility to contact with the obstacle within area of the interference scopes 41 to 44 , while the other area being no possibility to contact with the obstacle at the time of swiveling operation.
  • the interference scopes 42 and 43 can be shown at the equal intervals between the interference scopes 41 and 44 , as FIGS. 3 and 4( a ).
  • a dump truck 50 is illustrated as an example of the obstacle.
  • the hydraulic excavator 1 is a work machine to excavate earth and sand, the dump truck 50 transports the excavated earth and sand.
  • the dump truck 50 is placed stationary at a predetermined position to the hydraulic excavator 1 .
  • the hydraulic excavator 1 is operated to make rotating action to load the earth and sand on a vessel 51 as the substance excavated by the hydraulic excavator 1 .
  • the hydraulic excavator 1 is rotated again to carry out further excavation.
  • the foregoing referred dump truck 50 is a large-sized dump truck 50 (of course, may be small, middle or super large-sized dump truck).
  • the large-sized dump truck 50 comes close to the hydraulic excavator 1 from backward direction. This movement is for the purpose of loading the excavated substance on the vessel 51 .
  • the vessel 51 is protruded rearward direction, and the rearmost position of the vessel 51 (vessel rearmost end 52 ) is the rearmost position of the large-sized dump truck 50 . Therefore, the vessel rearmost end 52 comes into first contact with the hydraulic excavator 1 . That is to say, the vessel rearmost portion becomes the obstacle.
  • the large-sized dump truck 50 moves backward direction to access by driving backwardly to the hydraulic excavator 1 .
  • the rearmost portion of the large-sized dump truck 50 is the vessel rearmost end 52 . Therefore, the portion which firstly comes into contact with the counterweight 8 during is the vessel rearmost end 52 .
  • the interference scope during rotating action of the hydraulic excavator 1 should be determined on the basis of the vessel rearmost end 52 . Thus accordingly, the ground height of the vessel rearmost end 52 is necessary to be recognized on the part of the hydraulic excavator 1 .
  • plural large-sized dump tracks 50 and one hydraulic excavator 1 are used as one set and the kind of large-sized dump truck 50 are to be in advance known by the hydraulic excavator 1 . Therefore, information as to the height from ground height of vessel rearmost end 52 can be known beforehand. Information as to the height from ground height (called as H 5 ) of the vessel rearmost end 52 of the large-sized dump truck 50 can be stored in the ground height information storage section 23 as described in FIG. 2 .
  • the rotating radius calculating section 24 executes operation to the apparent rotating radius R 5 on the basis of ground height H 5 .
  • interference scope indicating section 25 indicates the interference scope 45 having the apparent rotating radius R 5 on the composite overhead view image P. Thereby, the composite overhead view image P containing the interference scope 45 is displayed on the display part 17 of the monitor 15 .
  • the interference scope 45 is a region corresponding to the ground height H 5 of the large-sized dump truck 50 , the operator of the hydraulic excavator 1 can recognize, when the counterweight 8 is performed rotating action under the circumstance that the vessel rearmost end 52 is placed into the interference scope 45 or in contact with the interference scope 45 , the counterweight 8 is caused to contact with the vessel rearmost end 52 due to the vessel rearmost end 52 is placed within the swivel locus of the counterweight 8 as shown in dash line in FIG. 5 .
  • the operator of the hydraulic excavator 1 should stay not to swivel operation, and should command to the operator of the large-sized dump truck 50 to move away from the hydraulic excavator 1 .
  • the command is to move the hydraulic excavator 1 away to outside of the interference scope 45 .
  • the counterweight 8 and the vessel rearmost portion 52 become not contact at the time of performing rotating action of the counterweight 8 .
  • the operator of the hydraulic excavator 1 can operate to rotate the hydraulic excavator 1 for loading the excavated substance on the vessel 51 .
  • the small-sized dump truck 60 of FIG. 6 is smaller than the large-sized dump truck 50 of FIG. 5 . Therefore, the ground height H 6 of the rearmost portion of a vessel 61 (vessel rearmost end 62 ) is also lower than the ground height H 5 of the vessel rearmost end 52 of the large-sized dump truck 50 . As a result, the radius R 6 of the interference scope 46 in the dump truck 60 is smaller than the radius R 5 of the interference scope 45 in the dump truck 50 . Therefore, the small-sized dump truck 60 can approach to the hydraulic excavator 1 to the proximal position to the interference scope 46 .
  • the height is different between the vessel rearmost end 52 of the large-sized dump truck 50 and the vessel rearmost end 62 of the small-sized dump truck 60 . Namely, it is certain that H 5 >H 6 . Due to there is deference in radiuses R 5 and R 6 , the interference scope 45 of the large-sized dump truck 50 is wider than the interference scope 46 of the small-sized dump truck 60 . Since sizes of the interference scopes of 45 and 46 are different by the vessel rearmost ends 52 and 62 , suitable interference scope is shown on the basis of the kind of the dump truck. The kind of the dump truck is known beforehand, thereby optimum interference scope can be indicated by being stored the known information in advance in the ground height information storage section 23 .
  • one hydraulic excavator 1 is consisting a group with the same kind dump truck in the foregoing embodiment.
  • one hydraulic excavator 1 is allotted the large-sized dump truck 50 and small-sized dump truck 60 .
  • FIGS. 8 and 9 two types of the interference scope 45 and the interference scope 56 are adapted to indicate on the composite overhead view image.
  • FIG. 8 shows the loading work of the hydraulic excavator 1 to the vessel 51 of the large-sized dump truck 50 .
  • FIG. 9 shows the loading work of the hydraulic excavator 1 to the vessel 61 of the small-sized dump truck 60 .
  • the two types of the interference scopes 45 and 46 can be indicated on the composite overhead view image P.
  • the operator who boarded in the operator's cab can recognize by sight which type of the large-sized dump truck 50 or small-sized dump truck 60 can perform the work to load the excavated substance.
  • the operator can recognize, at the time of loading the excavated substance, whether or not the counterweight 8 is liable to contact with the vessel rearmost end 52 when performing rotating action with reference to the interference scope 45 . Namely, as shown in FIG. 8 , in a case where the vessel rearmost end 52 is placed in contact with the interference scope 45 on the composite overhead view image P or placed within the interference scope 45 , the counterweight 8 is assumed to bring into contact with the vessel rearmost end 52 at the time of rotating action.
  • the operator can judge by sight of the interference scope 44 as to whether or not the counterweight 8 and the vessel rearmost portion 62 contact with each other at the time of rotating action. That is, as shown in FIG. 9 , when the vessel rearmost portion 62 is placed in contact with the interference scope 46 on the composite overhead view image P or placed within the interference scope 46 , the counterweight 8 is assumed to bring into contact with the vessel rearmost portion 62 at the time of swiveling action. As shown in FIG.
  • the vessel rearmost end 62 of the small-sized dump truck 60 is positioned within the interference scope 45 which is defined as the vessel rearmost end 52 of the large-sized dump truck 50 .
  • the interference is not occurred as far as the vessel rearmost end 62 of the small-sized dump truck 60 is positioned out of the interference scope 46 , even though within the interference scope 45 .
  • the interference scope indicating section 25 indicates two interference scopes 45 and 46 on the composite overhead view image, and the operator of the hydraulic excavator 1 judging by sight to perform loading work of the excavated substance used by the large-sized dump truck 50 or the small-sized dump truck 60 .
  • FIG. 10 shows a block diagram for the modified embodiment 2.
  • a wireless communication device 27 is provided further in addition to FIG. 2 .
  • a wireless communication device 28 is also provided for the dump truck (large-sized dump truck 50 and small-sized dump truck 60 ). Communication can be performed between the wireless communication devices 27 and 28 .
  • the wireless communication device 28 of the dump truck performs communication with the wireless communication device 27 to inform the kind of the own dump truck.
  • the wireless communication device 27 can identify the kind of the dump truck.
  • the identification is performed as to the large-sized dump truck 50 or the small-sized dump truck 60 .
  • the information as to the kind of the dump truck is outputted to the interference scope indicating section 25 .
  • the interference scope indicating section 25 indicates on the composite overhead view image P the interference scope 45 in a case of operating the large-sized dump truck 50 or otherwise the interference scope 46 in a case of operating the small-sized dump truck 60 .
  • the kind of dump truck can be recognized by the hydraulic excavator 1 , by means of the wireless communication between the hydraulic excavator 1 and the dump truck, thereby being able to indicate the interference scope 45 or 46 depending upon the thus recognition.
  • Some communication is also able to send from the hydraulic excavator 1 to the dump truck. Therefore, the display image created by the display image creating section 26 may be send to the dump truck by manner of wireless communication.
  • the monitor can shows the display image on the display part received by means of wireless communication, thereby the positional relation between the vessel rear end and the interference scope being recognized on the part of the dump truck. Therefore, the operator of the dump truck is adapted to move away the dump truck from the hydraulic excavator in a case of the vessel rearmost end being contact or entered into the interference scope. Thereby, the vessel rearmost end is removed away from the interference scope for allowing not to interfere the counterweight 8 of the hydraulic excavator 1 at the time of rotating action.
  • FIG. 11 shows the interference scope 45 for the vessel rearmost end 52 of the large-sized dump truck 50 and the interference scope 46 for the vessel rearmost end 62 of the small-sized dump truck 60 on the composite overhead view image P.
  • the interference scope 45 is indicated on the basis of the ground height H 5 of the vessel rearmost end 52 of the large-sized dump truck 50 which is stored in the ground height information storage section 23
  • the interference scope 46 is indicated on the basis of the ground height H 6 of the vessel rearmost end 62 of the small-sized dump truck 60 which is also stored in the ground height information storage section 23 .
  • Information as to the ground height for the interference scopes 45 and 46 can be added to indicate on the basis of the information concerning the ground heights H 5 and H 6 which are stored in the ground height information storage section 23 .
  • the ground height H 5 is 4000 cm and the ground height H 6 is 3000 cm.
  • the large-sized dump truck 50 is partially shown on the composite overhead view image P as shown in FIG. 11 .
  • the vessel 51 is not loaded any excavated substance before starting and the outer surface of the vessel 51 is exposed. In such a case, it may be indicated on the surface of the vessel 51 information as to the ground height of the vessel rearmost end 52 (4000 cm in FIG. 11 ).
  • the operator can recognize information as to the ground height of the vessel rearmost end 52 shown on the surface of the vessel 51 .
  • the interference scope 45 Because of the interference scope 45 being shown on the composite overhead view image P, those have same ground height on the basis of information indicated on the surface of the vessel 51 (4000 cm) and information of the interference scope (4000 cm). Therefore, it can be recognized the interference scope 45 is liable to contact to the counterweight 8 , even though being indicated two interference scopes 45 and 46 on the composite overhead view image.
  • the dump truck to be loaded the excavated substance from the hydraulic excavator 1 is an super large-sized dump truck 70 as shown in FIG. 12 .
  • the super large-sized dump truck 70 is provided a vessel 71 for loading the excavated substance from the hydraulic excavator 1 .
  • the vessel rearmost end 72 of the super large-sized hydraulic excavator 70 stands higher than the uppermost portion 8 H (ground height H 4 ) of the counterweight 8 of the hydraulic excavator 1 , thus accordingly the counterweight 8 being not contact with the vessel rearmost end 72 at the time of operating the slewing apparatus 4 .
  • the super large-sized dump truck 70 has a frame 73 as a basic framework, a vessel 71 is mounted on the frame 73 . Therefore, there is a possibility that ground height H 7 of the frame rearmost end 74 of the frame 74 is brought into contact with the counterweight 8 . In other words, the ground height H 7 of the frame rearmost end 74 has a height between the ground height H 4 of the uppermost portion H 4 and lowermost portion H 1 of the counterweight 8 . In such a case, the frame rearmost end 74 is the criterion in place of the vessel rearmost end 72 .
  • the ground height information storage section 23 stores the ground height H 7 of the frame rearmost end 74 in the super large-sized dump truck 70 , thereby allowing to calculate the rotating radius R 7 in accordance with the ground height H 7 by the rotating radius calculating section 24 .
  • the interference scope indicating section 25 performing to indicate the interference scope 47 on the basis of the rotating radius R 7 . Thereby, it can be able to judge whether or not the counterweight 8 may be brought into contact with the frame rearmost end 74 at the time of rotating action of the counterweight 8 .
  • the frame rearmost end 74 is painted with different color than the other portion of the frame.
  • the positional relation can be recognized clearly between the frame rearmost end 74 and the interference scope 47 at the time of reviewing the displayed image. Thereby, it can easily be judged whether or not the interference is occurred between the frame rearmost end 74 and the interference scope 47 , by clearly being the position of the colored frame rearmost end 74 .
  • FIG. 13 shows an embodiment to indicate plural interference scopes on the composite overhead view image.
  • the vessel rearmost end 62 is possible to contact with the counterweight 8 at the rotating action. Therefore, the interference scope indicating section 25 indicates the interference scope 46 as shown in FIG. 6 .
  • the frame rearmost end 74 is possible to interfere with the counterweight 8 at the time of rotating action. Therefore, the interference scope indicating section 25 indicates the interference scope 47 as in FIG. 11 .
  • the interference scope 47 is to be indicated for ground height H 7 corresponding to the frame rearmost end 74 , thus allowing to automatically indicate the interference scope which is likely to cause contact with the counterweight 8 at the time of swiveling action.
  • FIG. 14 is added a best loading region indicating section 81 replaced of the interference scope indicating section 25 of the display controller 16 shown in FIG. 2 .
  • the best loading region means an optimum position to stay the hydraulic excavator 1 for performing the loading work of excavated substance from the hydraulic excavator 1 to the large-sized dump truck 50 .
  • the vessel rearmost end 52 of the large-sized dump truck 50 is positioned out of the interference scope 45 , interference is not occurred between the vessel rearmost end 52 and the counterweight 8 . Therefore, the large-sized dump truck 50 is adapted to shift the position up to substantially contact with the interference scope 45 .
  • the best loading region is the region that the vessel rearmost end 52 is placed at optimum position in accordance with the ground height on performing the loading work from the hydraulic excavator 1 to the large-sized dump truck 50 .
  • the best loading region indicating section 81 indicates the optimum position of the best loading region.
  • the best loading region is expressed with a circle on the composite overhead view image P, the radius is longer than the interference region.
  • the hydraulic excavator 1 as the slewing-type work machine stands at the same height (ground G) with the dump truck 50 (or dump truck 60 , 70 ) as the obstacle, there are some cases that the hydraulic excavator 1 is positioned at a ground of different height on the ground positioned the dump truck 50 .
  • the interference scope between the hydraulic excavator 1 and dump truck 50 does not vary as far as not changed the position of a horizontal direction, but the interference scope 45 being not necessarily exact the apparent rotating radius R 5 which is indicated on the composite overhead view image P.
  • the position on the image of the vessel rearmost end 52 attained by the left side camera 13 L is indicated the position shifted at the distance ⁇ L from the position shown in FIG. 5 toward the hydraulic excavator 1 , as a result the interference scope 45 on the composite overhead view image being indicated as if the hydraulic excavator 1 is brought into contact with the dump truck 50 at the time of rotating action.
  • Such situation is caused by performing the view point transforming process depending on the change in angle of the optical axial center to the surface of object and in the ground height of the dump truck 50 from the height position of the camera 13 L.
  • the interference scope 45 at the time of the hydraulic excavator 1 and the dump truck 50 which are positioned the same horizontal plane is modified to an interference scope 145 in accordance with the difference of height ⁇ H.
  • the modification carry out based on the measurement or calculation.
  • the vessel rearmost end of the dump truck 50 there may be difference in the height of the vessel rearmost end of the dump truck 50 positioned the hydraulic excavator 1 and the dump truck 50 on the same horizontal plane.
  • the height of the vessel rearmost end 52 is changed between before and after loading earth and sand on the vessel 51 , due to the compression degree of the tires and the suspension weight of the suspension mechanism. For the reason, the position of the vessel rearmost end at the time of full loading state is closed positioned on the composite overhead view image within the interference scope 45 (or 145 ) which is set at the time of empty state.
  • the interference scope 245 may be set to have a width, the outer end being interference scope of empty state and the inner end being interference scope of full loaded state.
US14/766,596 2013-02-08 2014-02-07 Surroundings monitoring device for slewing-type work machine Abandoned US20160006947A1 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
JP2013023720 2013-02-08
JP2013-023720 2013-02-08
PCT/JP2014/052942 WO2014123228A1 (ja) 2013-02-08 2014-02-07 旋回式作業機械の周囲監視装置

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2014/052942 A-371-Of-International WO2014123228A1 (ja) 2013-02-08 2014-02-07 旋回式作業機械の周囲監視装置

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US16/057,900 Continuation US10506179B2 (en) 2013-02-08 2018-08-08 Surrounding monitoring device for slewing-type work machine

Publications (1)

Publication Number Publication Date
US20160006947A1 true US20160006947A1 (en) 2016-01-07

Family

ID=51299818

Family Applications (2)

Application Number Title Priority Date Filing Date
US14/766,596 Abandoned US20160006947A1 (en) 2013-02-08 2014-02-07 Surroundings monitoring device for slewing-type work machine
US16/057,900 Active US10506179B2 (en) 2013-02-08 2018-08-08 Surrounding monitoring device for slewing-type work machine

Family Applications After (1)

Application Number Title Priority Date Filing Date
US16/057,900 Active US10506179B2 (en) 2013-02-08 2018-08-08 Surrounding monitoring device for slewing-type work machine

Country Status (5)

Country Link
US (2) US20160006947A1 (de)
EP (1) EP2955914B1 (de)
JP (1) JP6173358B2 (de)
CN (1) CN104969544B (de)
WO (1) WO2014123228A1 (de)

Cited By (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130261885A1 (en) * 2012-03-29 2013-10-03 Harnischfeger Technologies, Inc. Overhead view system for a shovel
US20160224029A1 (en) * 2013-07-30 2016-08-04 Komatsu Ltd. Management system and management method of mining machine
US20160231807A1 (en) * 2015-02-10 2016-08-11 Yoshiyasu Ogasawara Electronic apparatus
US20170284069A1 (en) * 2015-03-31 2017-10-05 Komatsu Ltd. Surrounding monitoring device for work machine
US20170298595A1 (en) * 2015-03-31 2017-10-19 Komatsu Ltd. Surrounding monitoring device for work machine
US20180141788A1 (en) * 2016-11-22 2018-05-24 Manitowoc Crane Companies, Llc Optical detection and analysis of a counterweight assembly on a crane
US20190241124A1 (en) * 2016-11-01 2019-08-08 Sumitomo(S.H.I.) Construction Machinery Co., Ltd. Construction machine safety management system, management apparatus
US10544012B2 (en) 2016-01-29 2020-01-28 Manitowoc Crane Companies, Llc Visual outrigger monitoring system
US10590629B2 (en) * 2016-03-29 2020-03-17 Komatsu Ltd. Working vehicle
CN111065781A (zh) * 2018-01-31 2020-04-24 株式会社小松制作所 作业机械
US10687026B2 (en) 2015-08-10 2020-06-16 Sumitomo(S.H.I.) Construction Machinery Co., Ltd. Shovel
US10907324B2 (en) * 2016-07-28 2021-02-02 Kobe Steel, Ltd. Construction machine
CN112639915A (zh) * 2018-09-28 2021-04-09 株式会社小松制作所 作业车辆的周边监视系统及作业车辆的周边监视方法
US11047113B2 (en) * 2016-11-01 2021-06-29 Sumitomo(S.H.I.) Construction Machinery Co., Ltd. Surroundings monitoring system for work machine
AU2018333191B2 (en) * 2017-09-15 2021-07-29 Komatsu Ltd. Display system, display method, and display apparatus
US20210298220A1 (en) * 2020-03-26 2021-09-30 Deere & Company System and method for communicating the presence of proximate objects in a working area
US11142891B2 (en) * 2017-08-24 2021-10-12 Hitachi Construction Machinery Co., Ltd. Working machine
US20220165070A1 (en) * 2018-10-23 2022-05-26 Capital One Services, Llc Method for determining correct scanning distance using augmented reality and machine learning models
US11447928B2 (en) 2017-05-31 2022-09-20 Komatsu Ltd. Display system, display method, and remote control system

Families Citing this family (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6407663B2 (ja) * 2014-10-30 2018-10-17 日立建機株式会社 作業支援画像生成装置、及びそれを備えた作業機械の操縦システム
WO2016047806A1 (ja) * 2015-09-30 2016-03-31 株式会社小松製作所 クローラ式作業機械の周辺監視装置
JP6681747B2 (ja) * 2016-03-02 2020-04-15 株式会社神戸製鋼所 アタッチメント認識装置
JP6794193B2 (ja) * 2016-09-02 2020-12-02 株式会社小松製作所 作業機械の画像表示システム
JP6306115B2 (ja) * 2016-09-21 2018-04-04 株式会社小松製作所 クローラ式作業機械の周辺監視装置
JP7091896B2 (ja) * 2018-07-12 2022-06-28 コベルコ建機株式会社 旋回式作業機械の安全装置
CN109826255A (zh) * 2019-02-14 2019-05-31 青岛雷沃工程机械有限公司 一种装载机电气系统
JP7231444B2 (ja) * 2019-03-04 2023-03-01 日立建機株式会社 作業機械
WO2021054756A1 (ko) * 2019-09-20 2021-03-25 주식회사 와이즈오토모티브 중장비용 전방 영상 생성 장치
JP7145137B2 (ja) * 2019-09-30 2022-09-30 日立建機株式会社 作業機械の制御装置
JP7460416B2 (ja) * 2020-03-27 2024-04-02 住友重機械建機クレーン株式会社 クレーン及びクレーンの監視装置
DE102020214291B3 (de) * 2020-11-13 2022-03-17 Tadano Faun Gmbh Kran, insbesondere Mobilkran

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6169948B1 (en) * 1996-06-26 2001-01-02 Hitachi Construction Machinery Co., Ltd. Front control system, area setting method and control panel for construction machine
JP2008095307A (ja) * 2006-10-06 2008-04-24 Hitachi Constr Mach Co Ltd 作業機械の周囲監視装置
JP2010053588A (ja) * 2008-08-28 2010-03-11 Hitachi Constr Mach Co Ltd 建設機械
JP2012036645A (ja) * 2010-08-06 2012-02-23 Ohbayashi Corp 積込量管理システム及び積込量管理方法
JP2012074929A (ja) * 2010-09-29 2012-04-12 Hitachi Constr Mach Co Ltd 作業機械の周囲監視装置
EP2631374A1 (de) * 2010-10-22 2013-08-28 Hitachi Construction Machinery Co., Ltd. Periphere überwachungsvorrichtung für eine arbeitsmaschine

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH11296229A (ja) * 1998-02-13 1999-10-29 Komatsu Ltd 車両の誘導装置
JP4196826B2 (ja) * 2003-12-26 2008-12-17 日立建機株式会社 旋回式作業車両の後方視野表示装置
JP5061084B2 (ja) * 2008-11-13 2012-10-31 日立建機株式会社 現場内監視システム
JP2010148058A (ja) * 2008-12-22 2010-07-01 Denso It Laboratory Inc 運転支援装置及び運転支援方法
US8612102B2 (en) * 2010-05-17 2013-12-17 Komatsu Ltd. Hydraulic excavator and hydraulic excavator control method
JP2012174929A (ja) 2011-02-22 2012-09-10 Techno Polymer Co Ltd 太陽電池用裏面保護フィルム及び太陽電池モジュール
EP2511677B1 (de) * 2011-04-12 2020-08-19 Tamtron Oy Überwachungssystem für ein Materialtransportfahrzeug
CN102244771B (zh) * 2011-04-18 2013-08-28 北京中矿华沃科技股份有限公司 一种基于图像的露天矿挖掘机装车过程的监控方法和装置
CN202248033U (zh) * 2011-09-14 2012-05-30 鞍钢集团矿业公司 电铲回转区域监控装置
CN202627038U (zh) * 2012-04-13 2012-12-26 云南建工水利水电建设有限公司 一种具有监控功能的挖掘机

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6169948B1 (en) * 1996-06-26 2001-01-02 Hitachi Construction Machinery Co., Ltd. Front control system, area setting method and control panel for construction machine
JP2008095307A (ja) * 2006-10-06 2008-04-24 Hitachi Constr Mach Co Ltd 作業機械の周囲監視装置
JP2010053588A (ja) * 2008-08-28 2010-03-11 Hitachi Constr Mach Co Ltd 建設機械
JP2012036645A (ja) * 2010-08-06 2012-02-23 Ohbayashi Corp 積込量管理システム及び積込量管理方法
JP2012074929A (ja) * 2010-09-29 2012-04-12 Hitachi Constr Mach Co Ltd 作業機械の周囲監視装置
EP2631374A1 (de) * 2010-10-22 2013-08-28 Hitachi Construction Machinery Co., Ltd. Periphere überwachungsvorrichtung für eine arbeitsmaschine

Cited By (34)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9598836B2 (en) * 2012-03-29 2017-03-21 Harnischfeger Technologies, Inc. Overhead view system for a shovel
US20130261885A1 (en) * 2012-03-29 2013-10-03 Harnischfeger Technologies, Inc. Overhead view system for a shovel
US10671089B2 (en) * 2013-07-30 2020-06-02 Komatsu Ltd. Management system and management method of mining machine
US20160224029A1 (en) * 2013-07-30 2016-08-04 Komatsu Ltd. Management system and management method of mining machine
US20160231807A1 (en) * 2015-02-10 2016-08-11 Yoshiyasu Ogasawara Electronic apparatus
US9804667B2 (en) * 2015-02-10 2017-10-31 Nintendo Co., Ltd. Electronic apparatus
US20170284069A1 (en) * 2015-03-31 2017-10-05 Komatsu Ltd. Surrounding monitoring device for work machine
US20170298595A1 (en) * 2015-03-31 2017-10-19 Komatsu Ltd. Surrounding monitoring device for work machine
US10687026B2 (en) 2015-08-10 2020-06-16 Sumitomo(S.H.I.) Construction Machinery Co., Ltd. Shovel
US10544012B2 (en) 2016-01-29 2020-01-28 Manitowoc Crane Companies, Llc Visual outrigger monitoring system
US10590629B2 (en) * 2016-03-29 2020-03-17 Komatsu Ltd. Working vehicle
US10907324B2 (en) * 2016-07-28 2021-02-02 Kobe Steel, Ltd. Construction machine
US20190241124A1 (en) * 2016-11-01 2019-08-08 Sumitomo(S.H.I.) Construction Machinery Co., Ltd. Construction machine safety management system, management apparatus
US11047113B2 (en) * 2016-11-01 2021-06-29 Sumitomo(S.H.I.) Construction Machinery Co., Ltd. Surroundings monitoring system for work machine
US11148593B2 (en) * 2016-11-01 2021-10-19 Sumitomo(S.H.I.) Construction Machinery Co., Ltd. Construction machine safety management system, management apparatus
US11130658B2 (en) * 2016-11-22 2021-09-28 Manitowoc Crane Companies, Llc Optical detection and analysis of a counterweight assembly on a crane
US10717631B2 (en) 2016-11-22 2020-07-21 Manitowoc Crane Companies, Llc Optical detection and analysis of crane hoist and rope
US10829347B2 (en) 2016-11-22 2020-11-10 Manitowoc Crane Companies, Llc Optical detection system for lift crane
US20180141788A1 (en) * 2016-11-22 2018-05-24 Manitowoc Crane Companies, Llc Optical detection and analysis of a counterweight assembly on a crane
US11124392B2 (en) 2016-11-22 2021-09-21 Manitowoc Crane Companies, Llc Optical detection and analysis for boom angles on a crane
US11447928B2 (en) 2017-05-31 2022-09-20 Komatsu Ltd. Display system, display method, and remote control system
US11142891B2 (en) * 2017-08-24 2021-10-12 Hitachi Construction Machinery Co., Ltd. Working machine
AU2018333191B2 (en) * 2017-09-15 2021-07-29 Komatsu Ltd. Display system, display method, and display apparatus
US11230825B2 (en) 2017-09-15 2022-01-25 Komatsu Ltd. Display system, display method, and display apparatus
CN111065781A (zh) * 2018-01-31 2020-04-24 株式会社小松制作所 作业机械
US11560692B2 (en) 2018-01-31 2023-01-24 Komatsu Ltd. Work machine
CN112639915A (zh) * 2018-09-28 2021-04-09 株式会社小松制作所 作业车辆的周边监视系统及作业车辆的周边监视方法
US11562635B2 (en) 2018-09-28 2023-01-24 Komatsu Ltd. Work vehicle periphery monitoring system and work vehicle periphery monitoring method
US11657688B2 (en) 2018-09-28 2023-05-23 Komatsu Ltd. Work vehicle periphery monitoring system and work vehicle periphery monitoring method
US11663891B2 (en) 2018-09-28 2023-05-30 Komatsu Ltd. Work vehicle periphery monitoring system and work vehicle periphery monitoring method
US20220165070A1 (en) * 2018-10-23 2022-05-26 Capital One Services, Llc Method for determining correct scanning distance using augmented reality and machine learning models
US11594045B2 (en) * 2018-10-23 2023-02-28 Capital One Services, Llc Method for determining correct scanning distance using augmented reality and machine learning models
US20210298220A1 (en) * 2020-03-26 2021-09-30 Deere & Company System and method for communicating the presence of proximate objects in a working area
US11647686B2 (en) * 2020-03-26 2023-05-16 Deere & Company System and method for communicating the presence of proximate objects in a working area

Also Published As

Publication number Publication date
US10506179B2 (en) 2019-12-10
EP2955914A4 (de) 2016-09-21
EP2955914A1 (de) 2015-12-16
CN104969544B (zh) 2018-02-27
JPWO2014123228A1 (ja) 2017-02-02
EP2955914B1 (de) 2018-10-17
WO2014123228A1 (ja) 2014-08-14
US20190037148A1 (en) 2019-01-31
CN104969544A (zh) 2015-10-07
JP6173358B2 (ja) 2017-08-02

Similar Documents

Publication Publication Date Title
US10506179B2 (en) Surrounding monitoring device for slewing-type work machine
JP6987186B2 (ja) 表示システム、建設機械、及び表示方法
EP3000761B1 (de) Kran mit vorrichtung zur erkennung einer kameraausrichtung
US10927527B2 (en) Periphery monitoring device for crawler-type working machine
US20140354813A1 (en) Surroundings Monitoring Device for Work Machine
RU2625438C2 (ru) Система изображения сверху для экскаватора
US20140111648A1 (en) Device For Monitoring Area Around Working Machine
US20170072857A1 (en) Display device for self-propelled industrial machine
CN107079089B (zh) 作业机械的周边监视装置
US9845051B2 (en) Display device for self-propelled industrial machine
US20170341581A1 (en) Display device for self-propelled industrial machine
WO2016158265A1 (ja) 作業機械
CA3029812C (en) Image display system of work machine, remote operation system of work machine, work machine, and method for displaying image of work machine
WO2017038183A1 (ja) 移動式クレーンの周囲表示装置
KR20130138227A (ko) 작업 기계의 주위 감시 장치
US20140354816A1 (en) Peripheral Monitoring Device for Transportation Vehicle
WO2015029110A1 (ja) 作業機械の周囲監視装置
WO2016140016A1 (ja) 車両の周囲監視装置
US20210363732A1 (en) System and method for selectively displaying image data in a working machine
JP2021079762A (ja) 合成距離画像の作成方法、土砂採取モニター用画像の作成方法、及び、合成距離画像の作成装置
JP7145137B2 (ja) 作業機械の制御装置
US20240141621A1 (en) Display control device, display control method, and work machine

Legal Events

Date Code Title Description
AS Assignment

Owner name: HITACHI CONSTRUCTION MACHINERY CO., LTD., JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:KOWATARI, YOICHI;ISHIMOTO, HIDEFUMI;INANOBE, YOSHIHIRO;SIGNING DATES FROM 20150710 TO 20150713;REEL/FRAME:036278/0791

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION