JP2020063567A - Hydraulic backhoe - Google Patents

Abstract

To provide a hydraulic backhoe capable of reducing unnecessary notification caused by movement of the hydraulic backhoe.SOLUTION: A hydraulic backhoe 1 is provided with: cameras 201, 202, 203 attached on a revolving super structure 12 to image surroundings; a controller 40 detecting obstacles around the revolving super structure based on captured camera images; and a speaker 302 notifying of detection of the obstacles when those are detected with the controller. The controller allows: notification with the speaker when a lock lever 401 is positioned in a lock release position and when operating levers 22, 23 are held in a non-operation state from starting of the controller 40; and notification with the speaker when the lock lever is positioned in the lock release position and when the non-operation state continued for a predetermined time T1 or more after the operating levers are switched from an operation state to the non-operation state.SELECTED DRAWING: Figure 5

Description

  The present invention relates to a hydraulic excavator capable of detecting an obstacle around it based on a camera image.

  The hydraulic excavator detects obstacles around the upper revolving structure with a camera or millimeter-wave radar, and when an obstacle is detected, a monitor (display device) or alarm device informs the operator of that fact. Some have a surveillance system.

  For example, in Patent Document 1, a camera and a display device are provided, the relative position between an obstacle and a shovel detected using a camera image is calculated, and in the surroundings of the shovel based on the posture and movement of the shovel. The danger area is calculated, the contact danger level is set for obstacles existing within the danger area, the camera image is converted into an overhead image centered on the shovel, and the obstacle with the highest contact danger degree is set. There is disclosed a hydraulic excavator that creates an image of a bird's-eye view image from the viewpoint set above and that includes an image of the excavator and all of the dangerous area, and displays the created image on a display device.

International Publication No. 2012/53105

  By the way, in a hydraulic excavator provided with the above-mentioned surroundings monitoring system, an obstacle warning function by a monitor and a warning device may be stopped under a certain condition. In this way, when the alarm function once stopped is restored for the purpose of resuming work, etc., if the hydraulic excavator is operated by the operator's operation or the hydraulic excavator is moving due to inertia etc. even when it is not operated, Even if there is no obstacle at the point, unnecessary notification may occur due to the movement of the hydraulic excavator, which may make the operator feel annoyed.

  The present invention has been made in view of the above circumstances, and an object thereof is to provide a hydraulic excavator capable of reducing unnecessary notification due to movement of the hydraulic excavator.

  The present application includes a plurality of means for solving the above problems. To give an example of the means, a lower traveling body, an upper revolving body rotatably attached to an upper portion of the lower traveling body, and an upper revolving body are provided. An attached front working device, an operating device for operating an operation target including the lower traveling body, the upper swing body, and the front working device, and a lock position that disables the operation of the operation target by the operating device. And a lock lever that can be switched to one of a lock release position that permits operation of the operation target by the operation device, a camera that is attached to the upper revolving structure and captures an image around the upper revolving structure, A controller that detects an obstacle existing around the upper swing body based on the image; and a controller that detects an obstacle when the controller detects the obstacle. In a hydraulic excavator provided with a notification device for notifying that, when the lock lever is in the unlocked position and the operating device is held in a non-operating state from the time of activation of the controller, When the notification by the notification device is permitted and the lock lever is in the unlocked position and the operating device changes from the operating state to the non-operating state, the informing device is provided when the non-operating state continues for a predetermined time. Notification is permitted.

  According to the present invention, unnecessary notification due to the movement of the hydraulic excavator can be reduced, so that it is possible to reduce the operator's annoyance.

It is a side view of hydraulic excavator 1 concerning an embodiment of the present invention. It is a perspective view in the operator's cab 106 of hydraulic excavator 1 concerning an embodiment of the present invention. It is a top view of the hydraulic excavator 1 which concerns on embodiment of this invention. It is a schematic diagram of a hydraulic drive system in hydraulic excavator 1 concerning an embodiment of the present invention. It is a functional block diagram of controller 40 concerning an embodiment of the present invention. It is a control flow figure of controller 40 concerning an embodiment of this patent. It is a control flow figure of controller 40 concerning an embodiment of this patent. It is a figure which shows an example of the display screen of the monitor 301 which concerns on embodiment of this patent. It is a figure which shows an example of the timing chart of the presence or absence of operation input to an operation lever, ON / OFF of a notification flag, and the presence or absence of a moving obstacle. It is a figure which shows an example of the table which defines the relationship between the turning speed and the predetermined time T1 according to the embodiment of the present invention.

Embodiments of the present invention will be described below with reference to the drawings.
Although a hydraulic excavator including a bucket as a working tool (attachment) at the tip of the working device is exemplified below as the working machine, the present invention may be applied to a working machine including an attachment other than the bucket. Further, as long as it has a multi-joint type work device configured by connecting a plurality of link members (attachment, boom, arm, etc.), it can be applied to work machines other than hydraulic excavators.

  In addition, in the following description, when there are a plurality of the same constituent elements, an uppercase letter of the alphabet may be added to the end of the reference numeral, but the uppercase letter of the alphabet is omitted and the plurality of constituent elements are collectively described. There is. For example, when the same three pumps 190a, 190b, 190c exist, these may be collectively referred to as a pump 190.

  1 is a configuration diagram of a hydraulic excavator 1 according to an embodiment of the present invention, FIG. 2 is an internal configuration diagram of a driver's cab 106 in the hydraulic excavator 1, and FIG. 3 is a mounting position of a camera attached to the hydraulic excavator 1 and its mounting position. FIG. 4 is a bird's-eye view of the hydraulic excavator 1 showing the viewing angle, and FIG. In each figure, the same parts are designated by the same reference numerals.

  In FIG. 1, a hydraulic excavator 1 is composed of an articulated front working device 1A and a vehicle body (machine body) 1B. The vehicle body (machine body) 1B is attached to the lower traveling body 11 that is driven by the crawler tracks driven by the left and right traveling hydraulic motors 3a and 3b, and is attached to the upper portion of the lower traveling body 11 and is driven by the swing hydraulic motor 4 (see FIG. 4). And an upper revolving superstructure 12 which can be swung left and right.

  The front working device 1A is configured by connecting a plurality of front members (boom 8, arm 9, and bucket 10) that rotate in the vertical direction, respectively. The base end of the boom 8 is rotatably supported at the front part of the upper swing body 12 via a boom pin. A base end of an arm 9 is rotatably connected to a tip end of the boom 8 via an arm pin, and a base end of a bucket 10 is rotatably connected to a tip end of the arm 9 via a bucket pin. . The boom 8 is driven by the boom cylinder 5, the arm 9 is driven by the arm cylinder 6, and the bucket 10 is driven by the bucket cylinder 7.

  An IMU (IMU: Inertial Measurement Unit) 33 is attached to the upper swing body 12 as a speed sensor (turning speed measurement sensor) for detecting the velocity of the upper swing body 12.

  Further, as shown in the top view of FIG. 3, a left side camera 201, a right side camera 202, and a rear camera 203 are installed on the upper revolving structure 12 as cameras for capturing an image (video) of the surroundings of the hydraulic excavator 1. Has been done. The left side camera 201 is for taking an image of the left side area S1 of the upper swing body 12, and is installed on the left side of the upper swing body 12. The right side camera 202 is for taking an image of the right side area S2 of the upper swing body 12, and is installed on the right side of the upper swing body 12. The rear camera 203 is for taking an image of the rear area S3 of the upper swing body 12, and is installed behind the upper swing body 12. As a camera for capturing an image of the front area of the upper swing body 12, a front camera may be installed in front of the upper swing body 12, for example, directly below the boom 8.

  A controller 40 (see FIG. 4) is mounted on the upper swing body 12 as a control device that controls various controls of the hydraulic excavator 1. Although details will be described later, the controller 40 of the present embodiment detects an obstacle (moving body) existing around the hydraulic excavator 1 based on images (camera images) taken by the three cameras 201, 202, and 203. The obstacle detection process is performed. The controller 40 has, as its hardware configuration, an arithmetic processing device (for example, CPU), a storage device (for example, semiconductor memory such as ROM and RAM, a magnetic storage device such as a hard disk drive), and an interface (input / output device). A program (software) that is configured and stored in advance in the storage device is executed by the operation processing device, and the operation result is output as a signal from the interface.

  An operating device 47a (FIG. 4) for operating the traveling right hydraulic motor 3a (lower traveling body 11) has a traveling right lever 23a (FIG. 2) in the cab 106 provided in front of the upper swing body 12. ), An operating device 47b (FIG. 4) for operating the traveling left hydraulic motor 3b (lower traveling body 11) having a traveling left lever 23b (FIG. 2), and an operating right lever 22a (FIG. 2) in common. The operation devices 45a and 46a (FIG. 4) for operating the boom cylinder 5 (boom 8) and the bucket cylinder 7 (bucket 10) share the operation left lever 22b (FIG. 2), and the arm cylinder 6 (arm 9) and Operating devices 45b and 46b (FIG. 4) for operating the swing hydraulic motor 4 (the upper swing body 12) are installed. Hereinafter, the operation right lever 22a, the operation left lever 22b, the traveling right lever 23a, and the traveling left lever 23b may be collectively referred to as the operation levers 22 and 23.

  On the left side of the driver's seat in the driver's cab 106, one of a switching position (a position where the operation levers 22 and 23 cannot be operated) and a lock release position where the operation levers 22 and 23 are permitted to operate is a switching position (position). ) Is provided, and a lock lever sensor 116 for detecting whether the switching position of the lock lever 401 is the lock position or the unlock position. The lock lever sensor 116 outputs a signal indicating switching position information (position) of the lock lever 401 to the controller 40. When this signal indicates the unlocked position, it indicates that the operator can operate the operation target including the lower traveling structure 11, the upper revolving structure 12 and the front working device 1A. On the contrary, when the lock position is shown, it means that the operator cannot operate the operation target.

  On the right side of the driver's seat in the cab 106, a monitor 301 that displays the position of an obstacle detected by the controller 40 based on the camera image on the camera image, and an alarm when an alarm output command is input from the controller 40 A speaker 302 as an alarm device for outputting is provided. The monitor 301 and the speaker 302 can function as an informing device for informing that an obstacle is detected by the controller 40.

  In FIG. 4, the engine 18, which is a prime mover mounted on the upper swing body 12, drives the hydraulic pump 2 and the pilot pump 48. The hydraulic pump 2 is a variable displacement pump whose displacement is controlled by the regulator 2a, and the pilot pump 48 is a fixed displacement pump. In this embodiment, as shown in FIG. 4, a shuttle block 162 is provided in the middle of the pilot lines 144a, 144b, 145a, 145b, 146a, 146b, 147a, 147b, 148a, 148b, 149a, 149b. The hydraulic signals output from the operating devices 45, 46, 47 are also input to the regulator 2a via the shuttle block 162. Although detailed description of the configuration of the shuttle block 162 is omitted, a hydraulic signal is input to the regulator 2a via the shuttle block 162, and the discharge flow rate of the hydraulic pump 2 is controlled according to the hydraulic signal.

  The pump line 150, which is the discharge pipe of the pilot pump 48, passes through the lock valve 39 and then is branched into a plurality of parts to connect to the operating devices 45, 46, 47 and each valve in the front control hydraulic unit 160. The lock valve 39 is an electromagnetic switching valve in this example, and its electromagnetic drive unit is electrically connected to a lock lever sensor 116 which is a position detector of a lock lever 401 arranged in the operator's cab 106. The position of the lock lever 401 is detected by the lock lever sensor 116, and the lock lever sensor 116 inputs a signal corresponding to the position of the lock lever 401 to the lock valve 39. If the position of the lock lever 401 is in the lock position, the lock valve 39 is closed to shut off the pump line 150, and if it is in the unlock position, the lock valve 39 is opened and the pump line 150 is opened. That is, when the pump line 150 is shut off, the operation by the operating devices 45, 46, 47 is invalidated, and operations such as turning and excavation are prohibited.

  The operating devices 45, 46, 47 are of the hydraulic pilot type, and the operation amount (for example, lever stroke) of the operating levers 22, 23 operated by the operator based on the pressure oil discharged from the pilot pump 48, respectively. Generates pilot pressure (sometimes referred to as operating pressure) according to the operating direction. The pilot pressure thus generated is supplied to the hydraulic drive units 150a to 155b of the corresponding flow control valves 15a to 15f via the pilot lines 144a to 149b and used as control signals for driving these flow control valves 15a to 15f. To be done.

  Pressure sensors 70a to 75b are provided on the pilot lines 144a to 149b, respectively. The pressure sensors 70a to 75b detect the pilot pressures generated in the pilot lines 144a to 149b and output them to the controller 40, and function as operation amount sensors of the operation devices 45, 46, and 47. Hereinafter, the pressure sensors 70, 71, 72 for detecting the pilot pressure (operation amount) of the hydraulic cylinders 5, 6, 7 for driving the front working device 1A are generically referred to as a front operation measurement sensor 115, and the upper swing body 12 is driven. The pressure sensor 73 that detects the pilot pressure of the hydraulic motor 4 is referred to as a turning operation measurement sensor 114, and the pressure sensors 74 and 75 that detect the pilot pressure of the hydraulic motors 3a and 3b that drive the lower traveling body 11 are the traveling operation measurement sensors. It may be collectively referred to as 113.

  The pressure oil (working oil) discharged from the hydraulic pump 2 passes through the flow rate control valves 15a, 15b, 15c, 15d, 15e, 15f to the traveling right hydraulic motor 3a, the traveling left hydraulic motor 3b, the swing hydraulic motor 4, the boom. It is supplied to the cylinder 5, the arm cylinder 6, and the bucket cylinder 7. The boom cylinder 5, the arm cylinder 6, and the bucket cylinder 7 are driven to expand and contract by the supplied pressure oil, whereby the boom 8, the arm 9, and the bucket 10 rotate, respectively, and the position and posture of the bucket 10 change. Further, the turning hydraulic motor 4 is rotationally driven by the supplied pressure oil, whereby the upper turning body 12 turns with respect to the lower traveling body 11. Then, the traveling right hydraulic motor 3a and the traveling left hydraulic motor 3b are rotationally driven by the supplied pressure oil, so that the lower traveling body 11 travels. Hereinafter, the traveling hydraulic motor 3, the swing hydraulic motor 4, the boom cylinder 5, the arm cylinder 6, and the bucket cylinder 7 may be collectively referred to as a hydraulic actuator 3-7.

-Controller 40-
FIG. 5 is a system configuration diagram of the controller 40 and the input / output device related to the controller 40. Inside the controller 40 in the figure, the functions of programs installed in the controller 40 are shown in a block diagram.

  The controller 40 includes cameras 201, 202, 203, a traveling operation measurement sensor 113, a turning operation measurement sensor 114, a front operation measurement sensor 115, a lock lever sensor 116, a turning speed measurement sensor 33, and a monitor 301. , Speaker 302 is connected.

  Further, the controller 40 controls the ON / OFF state of the engine 18 that drives the hydraulic pump 2 that supplies hydraulic oil to the plurality of hydraulic actuators 3-7 that drive the lower traveling structure 11, the upper revolving structure 12, and the front working device 1A. It is possible to obtain information (ON / OFF information) indicating the value from a sensor (not shown). The ON state / OFF state of the engine 18 may be determined from the position (OFF position, ON position, START position) of a key switch (not shown) used to ignite and stop the engine 18. When the key switch is switched from the OFF position to the ON position, the controller 40 is activated, and then the position of the key switch is output to the controller 40 as a signal.

  The controller 40 includes a vehicle body operation state determination unit 5002, a bird's-eye view image creation unit 5005, a moving obstacle detection unit 5007, a time measurement unit 5009, a predetermined time determination unit 5003, an output video creation unit 5008, and an alarm output determination. It functions as the unit 5004.

  The vehicle body operating state determination unit 5002 receives detection signals (voltage values) from the measurement sensors 113, 114, 115 and the lock lever sensor 116, and the operating devices 45, 46, 47 (operating levers 22, 23) are in the operating state and non-operating state. In addition to determining which state the switch lever is in, it determines whether the switching position of the lock lever 401 is the lock position or the lock release position. The vehicle body operation state determination unit 5002 outputs the determination result to the time measurement unit 5009 and the alarm output determination unit 5004.

  The bird's-eye view image creation unit 5005 uses a bird's-eye view image 701 centering on the hydraulic excavator 1 based on the images (time-series data of still images) of the regions S1, S2, S3 captured by the cameras 201, 202, 203 (see FIG. 7). ) Is created and the overhead video is output to the output video creation unit 5008. FIG. 7 shows an example of the screen of the monitor 301. As shown in this figure, the bird's-eye view image 701 is, for example, when a reference point is set at the turning center of the hydraulic excavator 1 and the work site is viewed from a position directly above the reference point (that is, immediately above the hydraulic excavator). In the present embodiment, the images corresponding to the plan view obtained in (1) are created by converting and combining the images of the three cameras 201, 202, 203. An icon 702 schematically showing a top view of the hydraulic excavator 1 is arranged at the center of the overhead view image 701 in FIG. 7.

  The moving obstacle detection unit 5007 detects a moving obstacle from the luminance change of each pixel in each frame based on the images (time-series data of still images) of the regions S1, S2, S3 captured by the cameras 201, 202, 203. Is stored, and the coordinates of the detected moving obstacle on the bird's-eye view image are stored and output to the alarm output determination unit 5004.

  The moving obstacle detection unit 5007 can detect the moving obstacle, for example, as follows. That is, first, the time-series data of the input images from the cameras 201, 202, and 203 immediately before or n frames before, an image obtained by separately capturing an image without an obstacle, and the like are input as background images. Then, a difference image for each pixel is created by using the time-series data of the input image and the background image, and in the created difference image, the part where the brightness is less than a predetermined threshold value is set to 0, and the part above it is set to 1 or more. Binarization processing is performed to extract a changing area of the obstacle. Next, it is determined whether or not the extracted change region has a portion whose area is equal to or larger than a predetermined threshold value. If there is a portion whose area is equal to or larger than the threshold in the change area, it is determined that there is an obstacle area, and if there is only a portion that is less than the threshold, it is determined that there is no obstacle.

  The time measuring unit 5009, based on the determination result of the vehicle body operating state determining unit 5002, the time period during which the operating devices 45, 46, 47 (operating levers 22, 23) remain in the non-operating state (non-operating duration time) T2. Is a part that executes the process of measuring and outputs the result to the alarm output determination unit 5004. The initial value of the non-operation duration T2 when the controller 40 is activated (that is, when the key switch is switched from the OFF position to the ON position) is larger than a predetermined time (non-operation continuation required time) T1 described later (for example, ∞). ) Is set, and when the operating devices 22 and 23 are in the non-operating state at the time of starting the engine, the determination of YES is always made in S615 of FIG. 6B described later (that is, the process proceeds to S616). When the operating devices 45, 46, 47 change from the non-operating state to the operating state, the time measuring unit 5009 resets the measurement of the non-operating duration T2.

  The predetermined time determination unit 5003 inputs the turning speed (angular speed) of the upper-part turning body 12 from the turning speed measurement sensor (IMU) 33, and calculates a predetermined time (necessary duration of non-operation) T1 based on the turning speed. Is executed and the result is output to the alarm output determination unit 5004. The predetermined time (necessary duration of non-operation) T1 allows the notification by the speaker 302 when the lock lever 401 is in the unlocked position and when the operating devices 45, 46, 47 change from the operating state to the non-operating state. This is the duration of the non-operation state required for the purpose.

  The predetermined time determination unit 5003 of this embodiment calculates a predetermined time (non-operation continuation required time) T1 from the turning speed based on the table shown in FIG. As shown in this figure, the relationship between the turning speed and the predetermined time T1 is set so that the predetermined time T1 monotonically increases as the turning speed increases. In the example of FIG. 9, the turning speed and the predetermined time T1 have a direct proportional relationship, but if the predetermined time T1 monotonically increases as the turning speed increases, other relationships such as curves and stair graphs may be used. You may specify.

  Further, in the example of FIG. 9, the value of the predetermined time T1 is 0 when the turning speed is 0, but a value larger than 0 is set, and the predetermined time T1 is set to monotonically increase as the turning speed increases. May be. The policy for setting the size of the predetermined time T1 when the turning speed is 0 is that when the operation levers 22 and 23 input an operation other than the turning operation, the operation of the front working device 1A and the operation of the lower traveling structure 11 are performed. The upper swing body 12 may shake, but when the operating levers 22 and 23 are changed from the operated state to the non-operated state (neutral position), the predetermined time T1 is greater than the maximum time required for the shaking to stop. Is preferably set.

  The output image creation unit 5008 outputs to the monitor 23 based on the coordinates of the moving obstacle detected on the bird's-eye view image 701 by the moving obstacle detection unit 5007 and the bird's-eye view image 701 created by the bird's-eye view image creation unit 5005. This is the part that performs the process of creating video. The output image creation unit 5008 indicates the position of the moving obstacle on the bird's-eye view image 701. A person 705 as a moving obstacle is photographed on the bird's-eye view image 701 of the monitor 301 in FIG. When the person 705 is detected as a moving obstacle by the moving obstacle detecting unit 5007, the output image creating unit 5008 determines that the moving obstacle is located at the position of the person 705 based on the coordinates calculated by the moving obstacle detecting unit 5007. A graphic (circle in the example of FIG. 7) 704 indicating that it exists is displayed. The display and non-display of the graphic 704 can be changed by setting.

  The alarm output determination unit 5004 determines the non-operation duration time T2 and the predetermined time T1, the detection signal of the lock lever sensor 116 (the switching position of the lock lever 401), and the detection result of the moving obstacle by the moving obstacle detection unit 5007. Based on this, it is a part that determines whether or not to output an alarm from the speaker 302, and controls the audio output from the speaker 302 based on the determination result. If the alarm output determination unit 5004 determines to output an alarm, the notification flag in the flowchart (see FIGS. 6A and 6B) described below is set to ON, and if it is determined that the alarm is not output, the notification flag is OFF. Is set to.

-Flowchart of processing by controller 40-
6A and 6B are flowcharts of the internal processing of the controller 40 according to the embodiment of the present invention. The steps denoted by reference numerals A and B in FIG. 6A are connected to the steps denoted by the same reference numerals A and B in FIG. 6B.

  When the key switch is switched from the OFF position to the ON position and the controller 40 is activated, the cameras 201, 202 and 203 start image acquisition and the processing is executed in the order of this flowchart.

  In S601, the controller 40 (moving obstacle detection unit 5007 and bird's-eye view image creation unit 5005) acquires images from all the cameras 201, 202, and 203.

  In S602, the controller 40 (moving obstacle detection unit 5007) detects the presence or absence of a moving obstacle based on the image acquired in S601, stores the detection result, and when the moving obstacle is detected, The coordinates of the moving obstacle on the overhead view image 701 are stored.

  In S603, the controller 40 (overhead view image creating unit 5005) creates an overhead view image 701 based on the image acquired in S601.

  In S604, the controller 40 (vehicle body operation state determination unit 5002) determines whether or not the position of the lock lever 401 is at the lock position based on the signal of the lock lever sensor 116. If it is determined that the lock lever 401 is in the lock position, the lock state flag is set to ON (S620), and the process proceeds to S611. On the other hand, when it is determined that the lock lever 401 is in the unlocked position, the lock state flag is set to OFF (S605), and the process proceeds to S607.

  In S607, the controller 40 (vehicle body operation state determination unit 5002) acquires the traveling operation pressure TrPi, the turning operation pressure SwPi, and the front operation pressure FrPi from the traveling operation measurement sensor 113, the turning operation measurement sensor 114, and the front operation measurement sensor 115. To do. For each of the operation pressures TrPi, SwPi, FrPi acquired in S607, the controller 40 (vehicle body operation state determination unit 5002) determines in S608, S609, S610 whether the operation determination thresholds Pi1, Pi2, Pi3 or less. To judge. If any of the operating pressures TrPi, SwPi, FrPi exceeds the comparison thresholds Pi1, Pi2, Pi3, the process proceeds to S626 (see FIG. 6B), and any operating pressure TrPi, SwPi, FrPi has a threshold Pi1. , Pi2, Pi3 or less, the process proceeds to S611.

  In S626 (see FIG. 6B), the controller 40 (time measuring unit 5009) resets the non-operation duration time T2 to zero and proceeds to S623.

  In S611 (refer to FIG. 6A), the controller 40 (predetermined time determination unit 5003) calculates the turning speed from the signal of the turning speed measurement sensor 33, and proceeds to S612 (refer to FIG. 6B).

  In S612, the controller 40 (predetermined time determination unit 5003) calculates the predetermined time T1 using the turning speed acquired in S611 and the table of FIG. 9, and proceeds to S613.

  In S613, the controller 40 (time measuring unit 5009) counts the non-operation duration time T2 and proceeds to S614. When the non-operation duration time T2 reaches zero in step S613, the controller 40 (time measuring unit 5009) starts counting the non-operation duration time T2, but the non-operation duration time T2 is not zero in step S613. When it reaches, the counting of the non-operation duration time T2 is continued. When the non-operation duration time T2 is other than zero, that is, when the non-operation state of the operating devices 45, 46, 47 continues, the output video creation unit 5008 indicates that fact on the screen of the monitor 23. The icon 703 (see FIG. 7) may be displayed.

  In S614, the controller 40 (alarm output determination unit 5004) moves from the images (time-series data of camera images) taken by the cameras 201, 202, and 203 in the obstacle detection processing of the mobile obstacle detection unit 5007 in S602. It is determined whether or not an obstacle has been detected. If even one moving obstacle is detected, the process proceeds to S615, and if no moving obstacle is detected, the process proceeds to S623.

  In S615, the controller 40 (alarm output determination unit 5004) determines whether or not the non-operation duration time T2 counted in S613 exceeds the predetermined time T1 determined in S612. If the non-operation duration T2 is longer than the predetermined time T1, the process proceeds to S616, and if the non-operation duration T2 is less than or equal to the predetermined time T1, the process proceeds to S623.

  In S616, the controller 40 (warning output determination unit 5004) determines whether the lock state flag set in S603 and 604 is set to OFF. Here, if the lock state flag is OFF, the process proceeds to S617, and if it is ON, the process proceeds to S621.

  In S617, the controller 40 (alarm output determination unit 5004) sets the notification flag to ON and permits the speaker 302 to output an alarm sound. As a result, an alarm sound is output from the speaker 302, the operator (operator) of the hydraulic excavator 1 is notified of the presence of the moving obstacle (S618), and the process proceeds to S619.

  In S621, the controller 40 (alarm output determination unit 5004) sets the notification flag to OFF and prohibits the alarm sound output from the speaker 302. As a result, the output of the alarm sound from the speaker 302 is stopped or the output stop state is continued (S622), and the process proceeds to S619.

  In S623, the controller 40 (alarm output determination unit 5004) sets the notification flag to OFF and prohibits the speaker 302 from outputting an alarm sound. As a result, the output of the alarm sound from the speaker 302 is stopped or the output stop state is continued (S624), and the process proceeds to S625.

  In S619, the controller 40 (output image creation unit 5008) combines the detection result (figure 704) of the moving obstacle into the bird's-eye view image 701, outputs the result to the monitor 23, and returns to the first process S601.

  In S625, the controller 40 (output image creation unit 5008) outputs only the overhead view image 701 to the monitor 23 without synthesizing the detection result (figure 704) of the moving obstacle in the overhead view image 701, and then proceeds to the first process S601. Return.

-Operation / effect-
The operation / effect of the hydraulic excavator 1 configured as described above will be described based on the situation shown in FIG. The diagram shown in (a) of the upper stage of FIG. 8 is a timing chart showing the presence / absence of an input (operating state / non-operating state) to the operating levers 22 and 23, and the diagram shown in (b) of the middle stage is an alarm. 9 is a timing chart showing the ON / OFF change of the notification flag by the output determination unit 5004, and the diagram shown in (c) at the bottom shows the presence or absence of a moving obstacle within the shooting range of the cameras 201, 202, 203. It is a timing chart. As shown on the right side of FIG. 8, the key switch is switched from the OFF position to the ON position at time 0, the operation of the operation levers 22 and 23 is started at time t1, and the operation of the operation levers 22 and 23 is ended at time t2. It is assumed that the key switch is switched from the ON position to the OFF position after time t4. At this time, as shown in (c), the moving obstacle appears within the shooting range of the cameras 201, 202, and 203 from time 0 to time t1, and then at time t4, the shooting of the cameras 201, 202, and 203 is performed. Out of range.

(1) Time 0
At time 0, when the operator switches the key switch of the hydraulic excavator 1 from the OFF position to the ON position, the controller 40 is activated. Subsequently, when the key switch is switched from the ON position to the START position and the engine 18 is started, the key switch is quickly held in the ON position. Immediately after that, the operator switches the lock lever 401 from the lock position to the lock release position. At this time, since the moving obstacle does not exist within the shooting range of the cameras 201, 202, and 203, the processing by the controller 40 proceeds from S614 to S623 in the flowcharts of FIGS. 6A and 6B, the notification flag is set to OFF, and the speaker 302 is used. No notification is given.

(2) From time 0 to time t1 The operating levers 22 and 23 are still in the non-operated state after that, but the moving obstacle is within the range of the cameras 201, 202 and 203 from time 0 to time t1. When it appears, the non-operation duration T2 is counted from the initial value (for example, ∞) and is longer than the predetermined time T1, so the processing of the controller 40 advances from S615 to S616. At this time, the lock lever 401 is switched to the unlocked position. That is, since the lock state flag is set to OFF, the process further proceeds to S617 and the notification flag is set to ON. As a result, the speaker 302 notifies the user (S618), and the graphic 704 indicating the position of the moving obstacle is displayed on the bird's-eye view image of the monitor 301 (S619). As a result, the operator can easily recognize the presence of the moving obstacle by the alarm of the speaker 302 and the image of the monitor 301 at the timing when the surroundings of the vehicle body need to be checked before starting the work.

(3) Time t1
After that, when the operation levers 22 and 23 change to the operation state at time t1, the process of the controller 40 proceeds to S626 (see FIG. 6B), the non-operation duration T2 is reset to zero, and the notification flag is set to OFF. (S623). As a result, although the moving obstacle exists within the shooting range of the cameras 201, 202, and 203, the notification by the speaker 302 is stopped (S624), and the graphic 704 indicating the position of the moving obstacle is removed from the bird's-eye view image of the monitor 301. (S625). In this case, since the operator has already recognized the presence of the moving obstacle by the alarm of the speaker 302 and the image of the monitor 301 before the time t1, it is possible to prevent unnecessary notification from being issued and make the operator feel annoyed. Nothing. Further, during the operation of the operation levers 22 and 23, there is a high possibility that the operation causes the upper swing body 12 to which the cameras 201, 202 and 203 are attached to swing or vibrate. Therefore, when the method of detecting a moving obstacle from the brightness change of the pixel of each frame of the bird's-eye view image is used when detecting the moving obstacle as in the present embodiment, the detection of unnecessary moving obstacles may increase. This can make the operator feel annoyed. However, if the notification flag is set to OFF during the operation of the operation levers 22 and 23 as in this embodiment, it is possible to avoid unnecessary notification of such a moving obstacle.

(4) Time t2
When the operating levers 22 and 23 change from the operating state to the non-operating state at time t2, the processing of the controller 40 proceeds to S611 and 612, and the predetermined time T1 is calculated based on the turning speed of the upper swing body 12. For example, when the turning operation is input via the operation lever 22b from time t1 to immediately before time t2, and the turning speed of the upper turning body 12 at time t2 is ωa (see FIG. 9), the predetermined time T1 is set to T1a. (See FIG. 9) is calculated. The processing of the controller 40 at this time proceeds to S615, but the non-operation duration time T2 is substantially zero immediately after the counting is started and is shorter than the predetermined time T1a. Therefore, the notification flag is still held OFF (S623), and the status immediately before time t2 is maintained for the notification by the speaker 302 and the monitor 301. After that, since the turning speed of the upper-part turning body 12 approaches ωa to zero over time, the predetermined time T1 similarly approaches zero.

(5) Time t3
At time t3, the non-operation duration time T2 becomes longer than the predetermined time T1 (that is, the upper swing body 12 has stopped), so the processing of the controller 40 proceeds from S615 to S617 via 616, and the notification flag is set to ON again. To be done. That is, since the state immediately before the time t1 at which the operation of the operation levers 22 and 23 is started is restored, the notification by the speaker 302 is permitted (S618) and the figure showing the position of the moving obstacle on the bird's-eye view image of the monitor 301. The display of 704 is also permitted (S619). At this time, since the upper revolving structure 12 is stationary, unnecessary moving obstacles are not detected and the operator is not bothered. Further, when the moving obstacle exists within the photographing range of the cameras 201, 202, and 203 at time t3 as in the example of FIG. 8, the operator uses the alarm of the speaker 302 and the image of the monitor 301 to detect the moving obstacle. Can easily recognize the existence of.

(6) Others Although not mentioned above, if the moving obstacle is detected when the lock lever 401 is in the lock position and the non-operation duration time T2 exceeds the predetermined time T1, the controller 40 The process proceeds to S621 via S616, and the notification flag is set to OFF. In this case, in the present embodiment, the alarm by the speaker 302 is stopped (S622), but the position of the moving obstacle is displayed on the monitor 301 (S619). As a specific scene in which the lock lever 401 is switched to the lock position while the operator is in the cab 106, the operator can take a break or work in the cab 106 except when the controller 40 is activated (when the key is ON). It is assumed that there will be confirmations. If an alarm is output from the speaker 302 in such a situation, there is a high possibility that it will disturb the operator's break or confirmation work, and the operator is likely to give unnecessary notification. However, with the configuration according to the present embodiment, it is possible to prevent unnecessary notification.

-Summary As described above, in the hydraulic excavator 1 of the present embodiment, the controller 40 operates the operating devices 45, 46, 47 (the operating levers 22, 23 when the lock lever 401 is in the unlocked position and when the controller 40 is activated). ) Is held in the non-operation state, the notification by the speaker (notification device) 302 is permitted, and when the lock lever 401 is in the unlocked position and the operation devices 45, 46, 47 (operation levers 22, 23). When is changed from the operating state to the non-operating state, the notification by the speaker (informing device) 302 is permitted when the non-operating state continues for a predetermined time T1. As a result, the operator can easily recognize the presence of the moving obstacle by the notification from the speaker 302 at a timing after the activation of the controller 40 and before the start of work before the work is started. Further, when the operating devices 45, 46, 47 (the operating levers 22, 23) are returned from the operated state to the non-operated state, the speaker 302 gives a notification after the upper swing body 12 has stopped. It is possible to prevent unnecessary notification to the operator and prevent the operator from feeling uncomfortable.

<Other>
It should be noted that the present invention is not limited to the above-described embodiment, but includes various modifications within the scope of the invention. For example, the present invention is not limited to those having all the configurations described in the above-described embodiments, and includes those in which a part of the configuration is deleted. Further, part of the configuration according to one embodiment can be added or replaced with the configuration according to another embodiment.

  In the above, the predetermined time T1 is calculated based on the turning speed at that time, but the predetermined time T1 may use a preset value regardless of the magnitude of the turning speed. In this case, for example, the time required from when the turning operation by the operation lever 22b is stopped to when the upper turning body 12 is stationary at the time when the turning speed is maximum can be measured, and the time can be set as the predetermined time T1. . Further, a configuration may be adopted in which the predetermined time T1 is determined from the turning speed at a certain timing (for example, when the operation levers 22 and 23 change from the operated state to the non-operated state).

  Further, in the above, the predetermined time T1 is determined from the turning speed, but the IMU detects the pitching (longitudinal vibration) and rolling (horizontal vibration) of the upper revolving superstructure 12 due to the operation of the operation levers 22 and 23. The predetermined time T1 may be determined based on the time required for the upper revolving superstructure 12 to decay and stop.

  Further, in the above, ON / OFF of the output of the alarm sound by the speaker 302 is controlled based on ON / OFF of the notification flag, but instead of this, ON / OFF of the position display of the moving obstacle on the monitor 301 is controlled. May be. That is, instead of the speaker 302, the monitor 301 may be used as a notification device.

  Further, each configuration of the controller 40, functions of each configuration, execution processing, and the like are partially or entirely realized by hardware (for example, a logic for executing each function is designed by an integrated circuit). May be. Further, the configuration related to the controller 40 may be a program (software) that realizes each function related to the configuration of the controller 40 by being read and executed by an arithmetic processing unit (for example, a CPU). Information related to the program can be stored in, for example, a semiconductor memory (flash memory, SSD, etc.), a magnetic storage device (hard disk drive, etc.), a recording medium (magnetic disk, optical disk, etc.), and the like.

  Further, in the above description of each embodiment, the control line and the information line are shown to be necessary for the description of the embodiment, but not all the control lines and information lines related to the product. Does not necessarily indicate. In reality, it can be considered that almost all the configurations are connected to each other.

  DESCRIPTION OF SYMBOLS 1 ... Hydraulic excavator, 1A ... Front working device, 1B ... Vehicle body (machine body), 2 ... Hydraulic pump, 3-7 ... Hydraulic actuator, 11 ... Lower traveling body, 12 ... Upper swing body, 18 ... Engine, 22 ... Operation Lever, 23 ... Operating lever, 23 ... Monitor, 33 ... Turning speed measuring sensor (IMU), 40 ... Controller, 45-47 ... Operating device, 70-75 ... Pressure sensor, 106 ... Cab, 113 ... Traveling operation measuring sensor , 114 ... Turning operation measurement sensor, 115 ... Front operation measurement sensor, 116 ... Lock lever sensor, 201-203 ... Camera, 301 ... Monitor (notification device), 302 ... Speaker (notification device), 401 ... Lock lever, 701 ... Overhead view

Claims (6)

An undercarriage,
An upper revolving structure which is rotatably attached to the upper part of the lower traveling structure,
A front working device attached to the upper swing body,
An operation device for operating an operation target including the lower traveling body, the upper swing body, and the front working device,
A lock lever that can be switched to one of a lock position that disables the operation of the operation target by the operation device and a lock release position that allows the operation of the operation target by the operation device,
A camera attached to the upper swing body for capturing an image of the surroundings of the upper swing body;
A controller that detects an obstacle existing around the upper swing body based on the image;
In a hydraulic excavator equipped with an informing device that informs when an obstacle is detected by the controller,
The controller permits the notification by the notification device when the lock lever is in the unlocked position and when the operating device has been held in the non-operation state since the controller was started, and the lock lever is locked. A hydraulic excavator, wherein when the operating device changes from an operating state to a non-operating state when in the release position and the non-operating state continues for a predetermined time, the notification by the notification device is permitted. In the hydraulic excavator according to claim 1,
The hydraulic excavator, wherein the predetermined time is determined based on a time required from when the operating device changes from an operating state to a non-operating state until the upper swing body comes to rest. In the hydraulic excavator according to claim 1,
The notification device is at least one of a monitor that displays the position of an obstacle detected by the controller on the image, and an alarm device that outputs an alarm when the obstacle is detected by the controller. And hydraulic excavator. In the hydraulic excavator according to claim 1,
Further comprising a speed sensor for detecting a turning speed of the upper swing body,
The hydraulic excavator, wherein the controller determines the predetermined time based on a turning speed of the upper-part turning body detected by the speed sensor. In the hydraulic excavator according to claim 1,
The hydraulic excavator, wherein the controller prohibits the notification by the notification device when the lock lever is in the unlocked position and when the operating device is in the operating state. In the hydraulic excavator according to claim 1,
The controller determines whether the state of the operating device is an operating state or a non-operating state based on a detection signal of an operation amount sensor that detects the operation amount of the operating device, and the switching position of the lock lever is determined. A hydraulic excavator, characterized in that it is judged whether it is a locked position or an unlocked position based on a detection signal of a lock lever sensor for detecting a switching position of the lock lever.

Images