WO2024111594A1 - Construction equipment - Google Patents

Construction equipment Download PDF

Info

Publication number
WO2024111594A1
WO2024111594A1 PCT/JP2023/041862 JP2023041862W WO2024111594A1 WO 2024111594 A1 WO2024111594 A1 WO 2024111594A1 JP 2023041862 W JP2023041862 W JP 2023041862W WO 2024111594 A1 WO2024111594 A1 WO 2024111594A1
Authority
WO
WIPO (PCT)
Prior art keywords
display
operation mode
unmanned
manned
vehicle body
Prior art date
Application number
PCT/JP2023/041862
Other languages
French (fr)
Japanese (ja)
Inventor
拓馬 菅原
圭一郎 穴原
直樹 萩原
Original Assignee
日立建機株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 日立建機株式会社 filed Critical 日立建機株式会社
Publication of WO2024111594A1 publication Critical patent/WO2024111594A1/en

Links

Images

Classifications

    • EFIXED CONSTRUCTIONS
    • E02HYDRAULIC ENGINEERING; FOUNDATIONS; SOIL SHIFTING
    • E02FDREDGING; SOIL-SHIFTING
    • E02F9/00Component parts of dredgers or soil-shifting machines, not restricted to one of the kinds covered by groups E02F3/00 - E02F7/00
    • E02F9/20Drives; Control devices
    • EFIXED CONSTRUCTIONS
    • E02HYDRAULIC ENGINEERING; FOUNDATIONS; SOIL SHIFTING
    • E02FDREDGING; SOIL-SHIFTING
    • E02F9/00Component parts of dredgers or soil-shifting machines, not restricted to one of the kinds covered by groups E02F3/00 - E02F7/00
    • E02F9/24Safety devices, e.g. for preventing overload
    • EFIXED CONSTRUCTIONS
    • E02HYDRAULIC ENGINEERING; FOUNDATIONS; SOIL SHIFTING
    • E02FDREDGING; SOIL-SHIFTING
    • E02F9/00Component parts of dredgers or soil-shifting machines, not restricted to one of the kinds covered by groups E02F3/00 - E02F7/00
    • E02F9/26Indicating devices

Definitions

  • the present invention relates to construction machinery such as hydraulic excavators that can be selectively switched between manned operation, in which the operator directly operates the machinery by riding on the machinery, and unmanned operation, in which the operator operates the machinery from a remote location.
  • the object of the present invention is to provide a construction machine that can inform occupants of the machine that it is in a state where it can be operated unmanned.
  • the present invention provides a vehicle body having a driver's cab, a display device provided inside the driver's cab, an on-board operation device provided inside the driver's cab and operated by an operator in the driver's cab to output a manned operation signal which is an operation signal commanding the operation of the vehicle body, a communication device that receives an unmanned operation signal which is output from an unmanned operation unit for operating the vehicle body from outside the vehicle body and is an operation signal commanding the operation of the vehicle body, and a driving mode that can select one of a manned operation mode in which the manned operation signal is enabled and the unmanned operation signal is disabled, and an unmanned operation mode in which the unmanned operation signal is enabled and the manned operation signal is disabled.
  • a construction machine equipped with a driver's mode switch and a controller that controls the vehicle body based on the manned operation signal or the unmanned operation signal according to the operation mode set by the operation mode switch, the controller controls the vehicle body based on the unmanned operation signal when the unmanned operation mode is selected by the operation mode switch, and outputs a warning display on the display device to alert the user that the unmanned operation mode has been selected, and provides a construction machine that controls the vehicle body based on the manned operation signal and does not display the warning display on the display device when the manned operation mode is selected by the operation mode switch.
  • the present invention makes it possible to inform occupants of construction machinery that is capable of unmanned operation that the machinery is capable of unmanned operation.
  • FIG. 1 is a plan view of a hydraulic excavator, which is an example of a construction machine according to an embodiment of the present invention.
  • FIG. 1 is a diagram illustrating an example of the configuration of a remote control system including a construction machine according to an embodiment of the present invention.
  • FIG. 2 is a diagram illustrating an example of a display screen displayed on a display device in the cab of the hydraulic excavator shown in FIG. 1 in a manned operation mode.
  • FIG. 2 is a diagram illustrating an example of a display screen displayed on a display device in a cab of the hydraulic excavator shown in FIG. 1 in an unmanned operation mode.
  • FIG. 1 is a plan view of a hydraulic excavator, which is an example of a construction machine according to an embodiment of the present invention.
  • FIG. 1 is a diagram illustrating an example of the configuration of a remote control system including a construction machine according to an embodiment of the present invention.
  • FIG. 2 is a diagram illustrating an example of
  • FIG. 2 is a diagram showing another example of a display screen displayed on the display device in the cab of the hydraulic excavator shown in FIG. 1 in the unmanned operation mode;
  • FIG. 2 is a diagram showing yet another example of a display screen displayed on the display device in the cab of the hydraulic excavator shown in FIG. 1 in an unmanned operation mode;
  • 2 is a flowchart showing a main part of a procedure for controlling the display of a display device in a cab by a controller provided in the hydraulic excavator shown in FIG.
  • FIG. 1 Schematic configuration of a construction machine Fig. 1 is a plan view of a hydraulic excavator, which is an example of a construction machine according to an embodiment of the present invention.
  • the hydraulic excavator 1 is a representative example of a construction machine to which the present invention is applied, but the present invention is not limited to hydraulic excavators and can also be applied to other construction machines such as dump trucks, bulldozers, and wheel loaders.
  • the direction in which an operator sitting in the driver's seat faces (the left side in Fig. 1) is assumed to be the front side of the hydraulic excavator 1 (strictly speaking, the rotating body 4).
  • the hydraulic excavator 1 shown in Fig. 1 includes a working device (front working machine) 5 on its vehicle body 2.
  • the vehicle body 2 includes a running body 3 and a rotating body 4.
  • the running body 3 is a foundation structure that allows the hydraulic excavator 1 to travel under its own power, and may be a wheel-type running body, but this embodiment illustrates a configuration in which a crawler-type running body is used.
  • the present invention is not limited to construction machines in which the vehicle body 2 includes the running body 3 and the rotating body 4, but can also be applied to construction machines of a type in which the vehicle body does not have a rotating structure.
  • the running body 3 includes a track frame, tracks 3c, and a running motor.
  • the track frame is formed in an H-shape in plan view by a center frame and left and right side frames connected to the center frame.
  • An idler is supported at one end of the front and rear of the left and right side frames of the track frame, and a sprocket is supported at the other end for free rotation.
  • the output shaft of the running motor is connected to the rotating shaft of the sprocket.
  • the running motor is a hydraulic motor.
  • a circular track 3c is looped around the idler and sprocket on each of the left and right side frames, and the running body 3 runs by driving the track 3c with the sprocket.
  • the rotating body 4 is mounted on the upper part of the running body 3 via a slewing ring (not shown) so as to be able to rotate left and right, and includes a slewing frame, a driver's cab (cabin) 4b, a counterweight 4c, an engine room (machine room) 4d, etc.
  • the slewing frame is the base frame of the rotating body 4, and is supported on the truck frame via the slewing ring.
  • a slewing motor (not shown) is mounted on the slewing frame near the slewing ring, and the output shaft of the slewing motor meshes with a gear provided on the slewing ring, causing the rotating body 4 to rotate left and right relative to the running body 3.
  • a hydraulic motor or an electric motor can be used as the slewing motor.
  • a cab 4b is provided at the front of the rotating frame so as to be located on one side of the working device 5 in the left-right direction (the left side in this example).
  • An engine room 4d is provided behind the cab 4b on the rotating frame.
  • the engine room 4d houses a hydraulic system including a prime mover, a hydraulic pump driven by the prime mover, a control valve that controls the pressure oil from the hydraulic pump to the hydraulic actuator (boom cylinder 5e, etc.), heat exchangers, etc.
  • An electric motor may be used as the prime mover, but in this embodiment, an engine (internal combustion engine) is used.
  • a counterweight 4c is attached to the rear end of the rotating frame.
  • the counterweight 4c is a heavy object for balancing the weight with the working device 5, and is formed in an arc shape along the rear end rotating trajectory of the rotating frame.
  • the working device 5 is attached to the revolving body 4 and is a multi-joint working device including a working arm 5a, a bucket 5d as an attachment, a boom cylinder 5e as an actuator, an arm cylinder 5f, and a bucket cylinder.
  • the working arm 5a is configured to include a boom 5b and an arm 5c.
  • the boom 5b is connected to the front part of the revolving body 4 so as to be rotatable in the vertical direction.
  • the arm 5c is connected to the tip of the boom 5b so as to be rotatable in the front-rear direction.
  • the bucket 5d is rotatably attached to the tip of the arm 5c.
  • Both ends of the boom cylinder 5e are connected to the revolving body 4 and the boom 5b. Both ends of the arm cylinder 5f are connected to the boom 5b and the arm 5c.
  • the base end of the bucket cylinder is rotatably connected to the arm 5c.
  • the tip of the bucket cylinder is connected to the arm 5c and the bucket 5d via a bucket link.
  • the boom cylinder 5e, the arm cylinder 5f, and the bucket cylinder drive the boom 5b, the arm 5c, and the bucket 5d, respectively.
  • the boom cylinder 5e, the arm cylinder 5f, and the bucket cylinder are all hydraulic cylinders.
  • FIG. 2 is a diagram showing an example of the configuration of a remote control system including a construction machine according to one embodiment of the present invention.
  • the remote control system shown in Fig. 2 has a hydraulic excavator 1 that can be wirelessly controlled, and a remote operation unit 50 that wirelessly controls the hydraulic excavator 1.
  • the hydraulic excavator 1 is disposed at a work site.
  • the remote operation unit 50 is disposed in a building constructed away from the work site.
  • the remote unit 50 is an unmanned operation unit installed in a remote location or the like for operating the vehicle body 2 of the hydraulic excavator 1 from outside the vehicle body 2.
  • This remote operation unit 50 is configured to simulate the on-board operation devices (described later) such as the operating lever device 14 of the hydraulic excavator 1 to be operated, and the driver's cab 4b, and has a communication device 51, an operation device 52, a display device 53, and a controller 60.
  • the communication device 51 is a device for sending and receiving signals related to the remote operation of the hydraulic excavator 1, and plays a role in sending and receiving data related to remote operation (unmanned operation signals, work video signals, surveillance video signals, etc.) between the hydraulic excavator 1 via the network NW.
  • the unmanned operation signals are operation signals that command the operation of the running body 3, rotating body 4, work equipment 5, etc. of the hydraulic excavator 1, and are signals transmitted from the remote operation unit 50 and received by the hydraulic excavator 1.
  • the work video is live video captured by the camera 11 (part of multiple cameras) mounted on the hydraulic excavator 1 of the field of view including the work equipment 5 from the driver's cab 4b side.
  • the surveillance video is live video captured by the camera 11 (part of multiple cameras) of the hydraulic excavator 1 of the surroundings (rear and sides) of the vehicle body 2 of the hydraulic excavator 1.
  • the operating device 52 is a device that commands the operation of the hydraulic excavator 1, and includes a lever-type operating device that imitates the operating lever device 14.
  • the display device 53 includes a large monitor that displays in real time the work images captured by the camera 11 of the hydraulic excavator 1, as well as a display device that displays various settings, surveillance images, etc., equivalent to the display device 12 (described below) provided in the operator's cab 4b of the hydraulic excavator 1.
  • the controller 60 is a computer and has an operation signal processing function 61 and a display control function 62.
  • the display control function 62 is a function that controls the display of the display device 53 based on video signals and other signals from the hydraulic excavator 1 input via the communication device 51.
  • the operator who remotely operates the hydraulic excavator using the remote operation unit 50 operates the operation device 52 while viewing the work images and the like on the display device 53.
  • the operation signal processing function 61 is a function that generates an unmanned operation signal in response to the operation of the operation device 52 and transmits it to the hydraulic excavator 1 via the communication device 51.
  • the hydraulic excavator 1 is equipped with a camera 11, a display device 12, a communication device 13, an operating lever device 14, an operation mode switch 15, a speaker 16, a warning light 17, and a controller 20.
  • the cameras 11 include a perimeter monitoring camera that captures surveillance footage of the area around the vehicle body 2, and a remote driving camera that captures work footage as seen from the driver's cab 4b.
  • the perimeter monitoring camera is generally a rear monitoring camera mounted on the rear of the rotating body 4 to capture footage of the area behind the rotating body 4, and in many cases a side monitoring camera is also provided on the side of the rotating body 4.
  • the remote driving camera is mounted, for example, in the driver's cab 4b, and captures footage from the perspective of the passenger operating the vehicle in the driver's cab 4b.
  • the footage captured by these cameras 11 is converted into a digital signal via an encoder, output, and input to the controller 20.
  • the display device 12 is provided inside the driver's cab 4b and displays various settings such as the driving mode, operation information, vehicle information, camera images, warnings, messages, etc. Several examples of the display screen of the display device 12 will be explained later using Figures 3 to 6.
  • the communication device 13 transmits and receives data related to remote operation to and from the remote operation unit 50 via the network NW.
  • the communication device 13 communicates with the remote operation unit 50 and sequentially receives unmanned operation signals.
  • the hydraulic excavator 1 is configured to be able to receive unmanned operation signals from outside the vehicle body 2 via the communication device 13.
  • the communication device 13 sequentially transmits work video signals from the camera 11 output from the controller 20 to the remote operation unit 50 during the unmanned operation mode described below.
  • the operating lever device 14 is an electric lever device provided inside the cab 4b, and is used to operate the actuator 18 that drives the working device 5 and the rotating body 4.
  • the actuator 18 is a collective term for the boom cylinder 5e, the arm cylinder 5f, the bucket cylinder, and the rotating motor.
  • the cab 4b is also provided with an operating device (not shown) for operating the travel motor of the traveling body 3, but is omitted from FIG. 2.
  • the operating lever device 14 is a boarding operating device operated by a passenger sitting in the driver's seat of the cab 4b, and generates an operating signal (hereinafter referred to as a "manned operating signal" to distinguish it from an unmanned operating signal) that commands the operation of the working device 5 and the rotating body 4 according to the operation of the passenger, and outputs it to the controller 20.
  • the boarding operating device includes an operating device (not shown) that operates the travel motor of the traveling body 3, as well as handles and various pedals of a wheel loader or a dump truck, if it is a different type of construction machine. The same applies to the operating device 52 of the remote control unit 50 that simulates the boarding operating device.
  • remote operation of the hydraulic excavator 1 by the remote operation unit 50 is described as a typical example of "unmanned operation", but unmanned operation means operation other than manned operation in which an operator in the driver's cab 4b operates the hydraulic excavator 1 using the operating lever device 14 or the like.
  • unmanned operation means operation other than manned operation in which an operator in the driver's cab 4b operates the hydraulic excavator 1 using the operating lever device 14 or the like.
  • automatic operation of construction machinery is also an example of unmanned operation. Therefore, the "unmanned operation signal” is not limited to operation signals received from the remote operation unit 50, but can also include operation signals that command the operation of the vehicle body 2 other than manned operation signals.
  • the control signal from a control device serving as an unmanned operation unit corresponds to the above-mentioned "unmanned operation signal".
  • the driving mode switch 15 is a switch that can selectively switch the driving mode setting between a manned driving mode and an unmanned driving mode.
  • the driving mode switch 15 may be a switch on the screen of the display device 12, or may be a physical switch provided separately from the screen.
  • the manned driving mode is a driving mode in which the manned operation signal is enabled and the unmanned operation signal is disabled.
  • the unmanned driving mode is a driving mode in which the unmanned operation signal is enabled and the manned operation signal is disabled.
  • the remote operation unit 50 In the manned operation mode, even if communication between the remote operation unit 50 and the hydraulic excavator 1 is established, the remote operation unit 50 is not given the right to operate. In the manned operation mode, the hydraulic excavator 1 operates in response to the operation of the operating lever device 14 inside the operator's cab 4b, and the remote operation unit 50 cannot perform any interrupt operations. The remote operation unit 50 cannot switch the operation mode from the manned operation mode to the unmanned operation mode.
  • the remote operation unit 50 is given the operating authority, the hydraulic excavator 1 operates in response to the operation of the remote operation unit 50, and the hydraulic excavator 1 does not respond even if the operating lever device 14 inside the driver's cab 4b is operated.
  • the operation of the operation mode switch 15 is valid not only in the manned operation mode but also in the unmanned operation mode. Therefore, by operating the operation mode switch 15 to switch the operation mode from the unmanned operation mode to the manned operation mode, boarding operations using the operating lever device 14 and the like are enabled.
  • the operation of the key switch 19 is also valid regardless of the operation mode.
  • the key switch 19 is a switch that starts and stops the prime mover of the hydraulic excavator 1. Even in the unmanned operation mode, the key switch 19 can be turned off in the driver's cab 4b to stop the prime mover of the hydraulic excavator 1 and forcibly stop the hydraulic excavator 1.
  • the speaker 16 is provided inside the cab 4b and notifies the occupant of the vehicle of warnings or messages by sound.
  • the warning light 17 is an indicator light such as a lamp attached to the outer wall of the hydraulic excavator 1 (e.g., the top of the rotating body 4) in a position visible from around the hydraulic excavator 1.
  • the controller 20 is an on-board computer (a computer mounted on the hydraulic excavator 1) that controls the operation of the hydraulic excavator 1.
  • the controller 20 has a machine control function that controls the vehicle body 2 including the working device 5, the traveling body 3, and the rotating body 4 based on a manned operation signal or an unmanned operation signal according to the operation mode set by the operation mode switch 15.
  • the controller 20 drives a solenoid valve (e.g., a boom-raising solenoid valve) of a hydraulic system mounted on the hydraulic excavator 1 according to an operation signal input according to an operation (e.g., a boom-raising operation).
  • a solenoid valve e.g., a boom-raising solenoid valve
  • a directional control valve (a boom directional control valve) is driven by a pilot pressure output from the solenoid valve, an actuator is driven (e.g., the boom cylinder 5e is extended), and the hydraulic excavator 1 operates (the boom 5b rotates upward).
  • the operation signal that is the basis of such control is either the manned operation signal or the unmanned operation signal described above, and differs depending on the operation mode.
  • the controller 20 also has an operation mode determination function 21 and a display control function 22.
  • the operation mode determination function 21 is a function that determines whether the current operation mode set by the operation mode switch 15 is a manned operation mode or an unmanned operation mode based on the operation signal of the operation mode switch 15.
  • the display control function 22 is a function that controls the display of the display device 12 according to the current operation mode.
  • the operation mode determination function 21 can also be configured to determine the current operation mode based on operation mode setting data (e.g., a flag indicating unmanned operation mode/manned operation mode) recorded in the memory of the controller 20 when the mode is switched by the operation mode switch 15.
  • a single controller 20 has a machine control function for controlling the work device 5, the running body 3, the rotating body 4, etc., as well as an operation mode determination function 21 and a display control function 22, but the controller 20 may be composed of multiple computers.
  • the machine control function, the operation mode determination function 21, and the display control function 22 may be executed by separate computers.
  • the operation mode determination function 21 and the display control function 22 may be executed by separate computers.
  • the controller 20 disables the unmanned operation signal and simultaneously enables the manned operation signal, hides the warning display (described later) on the display device 12, and outputs various setting displays required for boarding operations and surveillance images from the camera 11 to the display device 12 (for example, FIG. 3 described later).
  • the controller 20 then controls the actuator 18 based on the manned operation signal input from the operating lever device 14, thereby controlling the vehicle body 2.
  • the controller 20 disables the manned operation signal and enables the unmanned operation signal, and transmits the work video and monitoring video from the camera 11 to the remote driving unit 50 via the network NW. Then, based on the unmanned operation signal received from the remote driving unit 50 via the network NW, the controller 20 controls the actuator 18 and controls the vehicle body 2. In this embodiment, the controller 20 displays the screen of the display device 12 inside the driver's cab 4b not only when the driving mode is the manned driving mode but also when the driving mode is the unmanned driving mode, regardless of whether there is a passenger in the driver's cab 4b, and controls the display according to the driving mode.
  • the controller 20 controls the vehicle body 2 based on the unmanned operation signal and outputs a warning display to the display device 12 to alert the driver that the unmanned driving mode has been selected.
  • the warning display on the display device 12 is not displayed.
  • Fig. 3 is a diagram showing an example of a display screen displayed on a display device in the cab in the manned operation mode.
  • the controller 20 determines that the current operation mode is the manned operation mode, it outputs various data required for the occupant in the cab 4b to operate the vehicle to the display device 12 installed in the cab 4b, as shown in Fig. 3.
  • the display screen 200A shown in Fig. 3 has display areas for a setting display 201, a vehicle body information display 202, a camera image 203, and a driving mode display 204.
  • the setting display 201 displays various current settings set by the occupant in the driver's cab 4b.
  • FIG. 3 shows, as examples, a mark indicating that the driving mode is set to low speed mode (setting display 201 at the top of the screen) and setting displays for air conditioning and radio (setting display 201 at the bottom of the screen).
  • the driving mode is shown as an example of the setting display 201 at the top of the screen, but in reality other setting displays such as the idle speed setting may also be displayed.
  • the vehicle body information display 202 displays data related to the current state of the vehicle body from various sensors mounted on the vehicle, such as the coolant temperature, hydraulic oil temperature, and remaining fuel.
  • the coolant temperature is shown as an example of the vehicle body information display 202.
  • Camera image 203 is a live image of the surroundings of the vehicle captured by camera 11.
  • FIG. 3 shows an example in which images from multiple cameras 11 are combined with a planar image of the hydraulic excavator 1 to display an image of the hydraulic excavator 1 and its surroundings viewed from above. While viewing this display, the occupant (operator) drives the hydraulic excavator 1 while checking that there are no obstacles or the like in the surrounding area.
  • the operation mode display 204 is a display of the current operation mode determined by the controller 20 using the operation mode determination function 21. In FIG. 3, it is displayed that the current operation mode setting is the manned operation mode.
  • FIG. 4 is a diagram showing an example of a display screen displayed on the display device in the cab in the unmanned operation mode.
  • the controller 20 determines that the current operation mode is the unmanned operation mode, as shown in FIG. 4, it outputs a warning display to the display device 12 to call attention that the operation mode is set to the unmanned operation mode.
  • the warning display is constantly displayed on the display device 12 in the form of a light or a flash while the operation mode is set to the unmanned operation mode.
  • the unmanned operation will start before the occupant who got into the cab 4b to start the hydraulic excavator 1 gets off, or that the occupant will mistakenly switch the operation mode to the unmanned operation mode.
  • a worker who does not know that the hydraulic excavator 1 is in the unmanned operation mode will get into the hydraulic excavator 1.
  • the construction machine may perform an unexpected operation for the occupant.
  • the operation mode display 204 is switched to the unmanned operation mode, and a warning message 205 and a warning icon 206 are displayed.
  • whether the current operation mode is the unmanned operation mode or the manned operation mode is displayed in a single area on the display screen (the display area of the operation mode display 204). Only one of the warning message 205 and the warning icon 206 may be used to warn that the operation mode is the unmanned operation mode. Furthermore, the display form of these warning and attention displays (the warning message 205, the warning icon 206, and the unmanned operation mode display of the operation mode display 204) can be emphasized by a blinking display (repeated display/non-display, repeated inversion of the character color/background color, etc.) in addition to a lit display.
  • a blinking display peerated display/non-display, repeated inversion of the character color/background color, etc.
  • the warning message 205 includes a message indicating that the current driving mode is the unmanned driving mode and a message prompting the driver to change the driving mode setting to the manned driving mode.
  • the warning message 205 may be displayed in a display area dedicated to warning messages, or in a display area that is exclusively used for on-board driving.
  • at least a portion of the dedicated display for the manned driving mode on the display device 12 can be hidden, and the warning message 205 can be displayed in place of the hidden dedicated display for the manned driving mode.
  • the dedicated display for the manned driving mode is a display that does not need to be displayed if there is no driver in the driver's cab 4b, but needs to be displayed when the driver is on-board driving.
  • the setting display 201 at the top of the screen, the vehicle information display 202, and the camera image 203 also correspond to the dedicated display for the manned driving mode.
  • a warning message 205 is displayed in the display area of the setting display 201 ( Figure 3) at the bottom of the screen, and the air conditioning and radio settings are hidden.
  • This setting is just one example, and in unmanned driving mode, at least one of the setting display 201, vehicle body information display 202, and camera image 203 can be configured to be hidden.
  • the setting display 201 (driving mode) at the top of the screen is displayed in the same way as in attended driving mode.
  • the indicator for the cooling water temperature itself is displayed, but the data display is hidden.
  • the display device 12 displays a message informing the occupant of the details of the abnormality.
  • the message is displayed, for example, in the display area of the setting display 201 (FIG. 3) at the bottom of the screen.
  • the controller 20 can also be configured to alternately and repeatedly display a warning message 205 and a message informing the occupant of the details of the abnormality at a specified time interval in the display area of the setting display 201.
  • the warning icon 206 is an icon that notifies the passenger of an abnormality.
  • the warning icon 206 is highlighted when an abnormality occurs in the vehicle body condition, for example, when the coolant temperature or hydraulic oil temperature exceeds a set value, but in this embodiment, this warning icon 206 is also displayed in unmanned driving mode.
  • the output from the display device 12 in the cab 4b indicating that the vehicle is in the unmanned operation mode can be combined with at least one of a sound output from the speaker 16 in the cab 4b and a notification output from the warning light 17 to the outside of the vehicle.
  • the warnings from the speaker 16 and warning light 17 are also constantly output while the operation mode of the hydraulic excavator 1 is in the unmanned operation mode, similar to the caution display from the display device 12. Both the speaker 16 and the warning light 17 are driven by a command signal from the controller 20.
  • the sound output from the speaker 16 can be a warning sound, a voice message, or a combination of both.
  • the notification output from the warning light 17 can also be used to notify of matters other than the unmanned operation mode by lighting, flashing, the flashing interval, and the lighting color. For example, by changing the display color of the warning light 17 such that blue indicates that the hydraulic excavator 1 is in the unmanned operation mode, orange indicates that the prime mover is running, green indicates that the hydraulic excavator 1 is locked, and red indicates that a malfunction has occurred, the warning light 17 can notify of multiple matters.
  • warning output on the display device 12 in the driver's cab 4b indicating that the vehicle is in the unmanned operation mode as described in FIG. 4 is just one example, and the warning can be modified in various ways without departing from the basic concept. Some modified examples are briefly described below.
  • Modification 1 5 is a diagram showing an example of a display screen displayed on a display device in a cab during unmanned operation mode.
  • elements that are the same as or correspond to those in the previously mentioned drawings are given the same reference numerals as those in the previously mentioned drawings, and description thereof will be omitted.
  • FIG. 4 has been described in which at least a portion of the dedicated display for the attended operation mode on the display device 12 can be hidden and a warning message 205 can be displayed in place of the hidden dedicated display for the attended operation mode.
  • FIG. 4 has been described in which a warning message 205 is displayed in the display area of the setting display 201 (FIG. 3) at the bottom of the screen
  • FIG. 5 illustrates a case in which a warning message 205 is displayed in place of the vehicle body information display 202 in the display area of the vehicle body information display 202.
  • the display area of the setting display 201 at the bottom of the screen displays air conditioning settings and the like as they are displayed in attended operation mode (FIG. 3).
  • the display of the warning icon 206 has been omitted.
  • the display example of FIG. 5 is similar to the display example of FIG. 4.
  • the warning message 205 may be displayed in place of the camera image 203 in the display area of the camera image 203.
  • the display example in Figure 5 can also be combined with at least one of the warning display using the speaker 16 and the warning light 17.
  • Modification 2 6 is a diagram showing another example of a display screen displayed on the display device in the cab during unmanned operation mode.
  • elements that are the same as or correspond to those in the previously mentioned drawings are given the same reference numerals as those in the previously mentioned drawings, and the description thereof will be omitted.
  • Figure 4 shows an example of hiding the data on the vehicle information display 202 in unmanned driving mode, but when hiding some of the displays necessary in manned driving mode (except when a warning message is displayed instead), it is also possible to change which displays are hidden as appropriate.
  • Figure 6 shows an example of simply hiding the camera image 203 (when the camera image 203 is erased without displaying the warning message 205). In the example of Figure 6, the display of the warning icon 206 has also been omitted. In other respects, the display example of Figure 6 is the same as the display example of Figure 4.
  • the display example in Figure 6 can also be combined with at least one of the warning displays using the speaker 16 and the warning light 17.
  • Display Control Fig. 7 is a flow chart showing the main steps of the display control procedure of the display device in the cab by the controller.
  • the controller 20 starts the flow shown in FIG. 7 (START).
  • the controller 20 first determines whether the current operation mode set by the operation mode switch 15 is the unmanned operation mode using the operation mode determination unit function 21 (step S1). If the controller 20 determines that the current operation mode is the unmanned operation mode, it proceeds to step S2, and if the controller 20 determines that the current operation mode is the attended operation mode, it proceeds to step S3.
  • the controller 20 uses the display control function 22 to display a warning on the display device 12 of the driver's cab 4b (step S2).
  • the warning display is an appropriate display indicating that the operation mode is unmanned (unmanned operation mode display on the operation mode display 204, warning message 205, warning icon 206, etc.), as shown in each of Figs. 4 to 6.
  • the controller 20 uses the display control function 22 to display various information necessary for driving on the display device 12 of the driver's cab 4b (step S3).
  • various information necessary for driving is described in FIG. 3, for example, the setting display 201 at the top and bottom of the screen, the vehicle information display 202, the camera image 203, etc.
  • step S4 After outputting to the display device 12 according to the driving mode (after executing the processing of step S2 or S3), the controller 20 judges whether the key switch 19 is off (step S4). If it is judged that the key switch 19 is off, the controller 20 ends the display control of the display device 12 as a delay process, and ends the flow of FIG. 7. If it is judged that the key switch 19 is still on, the controller 20 returns to the procedure of step S1 and repeats the procedure of steps S1-S4.
  • the controller 20 repeatedly executes the control of steps S1-S4 at a predetermined cycle time (for example, about 0.1 s) while energized.
  • a predetermined cycle time for example, about 0.1 s
  • the controller 20 repeatedly executes the control of steps S1-S4 at a predetermined cycle time (for example, about 0.1 s) while energized.
  • the controller 20 if there is an occupant in the driver's seat 4b during the unmanned operation mode and the occupant switches the operation mode to the manned operation mode in response to the warning message 205, the warning by the display device 12, speaker 16, and warning light 17 related to the unmanned operation mode will stop.
  • the display on the display device 12 will switch to a display for on-board operation as exemplified in FIG. 3.
  • step S2 If there is no occupant in the driver's cab 4b during the unmanned operation mode and remote operation of the hydraulic excavator 1 continues without switching the operation mode, the display control of step S2 will be repeatedly executed during that time. Therefore, even if the driver's cab 4b is unmanned, as long as the operation mode is the unmanned operation mode, warnings by the display device 12 and the like will be continuously executed within the driver's cab 4b.
  • the screen of the display device 12 switches, for example, from the screen shown in FIG. 3 to any of the screens shown in FIG. 4 to FIG. 6. If a warning is set to be issued by the speaker 16 or the warning light 17, the warning will start from the speaker 16 or the warning light 17 together with a warning display by the display device 12.
  • the cab 4b of the hydraulic excavator 1 is assumed to be unmanned, but in this embodiment, a warning is displayed on the display device 12 inside the cab 4b regardless of whether or not there is an occupant in the cab 4b. As a result, if there is an occupant in the unmanned operation mode, the occupant can be notified that the unmanned operation mode is in effect. If the cab 4b is unmanned as expected, the warning display on the display device 12 continues unseen. In this way, according to this embodiment, it is possible to notify an occupant in the hydraulic excavator 1 that is capable of unmanned operation that the unmanned operation mode is in effect.
  • displaying a warning on the display device 12 regardless of whether there is an occupant is present is a reasonable form of notifying an occupant who may be in the driver's cab 4b for some reason of the unmanned operation mode.
  • Another major advantage of this embodiment is that it does not require a system for detecting occupants and is inexpensive.
  • a warning message 205 is output to the display device 12 as a caution display, urging the user to switch the operation mode to the manned operation mode.
  • Figures 4 to 6 show an example in which the setting display 201, vehicle body information display 202, and camera image 203, which are displayed for the occupant driving in the manned driving mode, are each hidden in the unmanned driving mode.
  • the driving mode is not a manned driving mode, i.e., that the driving mode is unmanned.
  • a warning message 205 is displayed in the display area of the setting display 201 and the vehicle body information display 202 in place of the hidden setting display 201 and the vehicle body information display 202.
  • the warning light 17 indicates that the operation mode is unmanned, thereby making it possible to inform those around that the hydraulic excavator 1 is being remotely operated.

Landscapes

  • Engineering & Computer Science (AREA)
  • Mining & Mineral Resources (AREA)
  • Civil Engineering (AREA)
  • General Engineering & Computer Science (AREA)
  • Structural Engineering (AREA)
  • Component Parts Of Construction Machinery (AREA)

Abstract

Provided is construction equipment that comprises a display device that is provided in an operator cab, an on-board operation device that is operated by an operator that has boarded the operator cab and outputs a manned operation signal, a communication device that receives an unmanned operation signal from outside a vehicle body, an operating mode switch that selects either a manned operating mode in which the manned operation signal is valid or an unmanned operating mode in which the unmanned operation signal is valid, and a controller that controls the vehicle body on the basis of the manned operation signal or the unmanned operation signal according to the operating mode. When the unmanned operating mode has been selected, the controller controls the vehicle body on the basis of the unmanned operation signal and outputs a caution display that urges caution that the unmanned operating mode has been selected to the display device. When the manned operating mode has been selected, the controller controls the vehicle body on the basis of the manned operation signal and does not display the caution display. The present invention can thereby notify a rider of construction equipment that is in a state in which unmanned operation is enabled that the construction equipment is in a state in which unmanned operation is enabled.

Description

建設機械Construction Machinery
 本発明は、建設機械に搭乗して建設機械を直接的に操作する有人操作と、建設機械を遠隔地から操作する無人操作とを択一的に切り換え可能な油圧ショベル等の建設機械に関する。 The present invention relates to construction machinery such as hydraulic excavators that can be selectively switched between manned operation, in which the operator directly operates the machinery by riding on the machinery, and unmanned operation, in which the operator operates the machinery from a remote location.
 災害現場等では、特許文献1に記載されているような建設機械を遠隔地から操作(以下、「遠隔操作」という)することができる油圧ショベル等の建設機械に対する要望がある。一方で、建設機械を遠隔操作によって作業するよりもオペレータが搭乗して直接的に建設機械を操作する操作(以下、「搭乗操作」という)の方が、車体の状況や周囲の状況を把握しやすく、効率的に作業できる場合もあるため、遠隔操作可能な建設機械であっても搭乗操作に切り換えて使用できることが望ましい。 At disaster sites and the like, there is a demand for hydraulic excavators and other construction machines that can be operated from a remote location (hereinafter referred to as "remote operation") as described in Patent Document 1. However, there are cases where an operator can more easily grasp the condition of the vehicle and the surroundings and work more efficiently by riding on the machine and directly operating it (hereinafter referred to as "on-board operation") than by remote operation, so it is desirable to be able to switch to on-board operation even for remotely operable construction machines.
特開2011-9823号公報JP 2011-9823 A
 しかし、遠隔操作と搭乗操作を切り替えて操作可能な建設機械の場合、遠隔操作可能な状態の建設機械内に搭乗者がいないか配慮すべきである。例えば建設機械の始動のために建設機械内に乗り込んだ搭乗者が降車しないうちに遠隔運転が始まったり、搭乗者が運転モードを過って遠隔運転モードに切り替えてしまったりする可能性もある。このような場合、建設機械が搭乗者にとって不測の動作をし得ることになる。 However, in the case of construction machinery that can be operated by switching between remote operation and on-board operation, consideration should be given to whether there is any passenger inside the machinery that can be operated remotely. For example, there is a possibility that a passenger who has boarded the machinery to start it up may start remote operation before getting off, or that a passenger may mistakenly switch the operation mode to remote operation mode. In such cases, the construction machinery may make unexpected movements to the passenger.
 本発明の目的は、無人運転可能な状態の建設機械内の搭乗者に対して無人運転可能な状態であることを知らせることができる建設機械を提供することにある。 The object of the present invention is to provide a construction machine that can inform occupants of the machine that it is in a state where it can be operated unmanned.
 上記目的を達成するために、本発明は、運転室を有する車体と、前記運転室の内部に設けられた表示装置と、前記運転室の内部に設けられ、前記運転室に搭乗したオペレータが操作し、前記車体の動作を指令する操作信号である有人操作信号を出力する搭乗操作装置と、前記車体の外部から前記車体を操作するための無人運転ユニットから出力され、前記車体の動作を指令する操作信号である無人操作信号を受信する通信装置と、前記有人操作信号が有効、かつ前記無人操作信号が無効となる有人運転モード、及び前記無人操作信号が有効、かつ前記有人操作信号が無効となる無人運転モードのいずれかの運転モードを選択可能な運転モードスイッチと、前記運転モードスイッチにより設定された前記運転モードに応じて、前記有人操作信号又は前記無人操作信号に基づき前記車体を制御するコントローラとを備えた建設機械において、前記コントローラは、前記運転モードスイッチにより前記無人運転モードが選択された場合、前記無人操作信号に基づいて前記車体を制御するとともに、前記表示装置に前記無人運転モードが選択されたことの注意を促す注意表示を出力し、前記運転モードスイッチにより前記有人運転モードが選択された場合、前記有人操作信号に基づいて前記車体を制御するとともに、前記表示装置の前記注意表示を非表示にする建設機械を提供する。 In order to achieve the above object, the present invention provides a vehicle body having a driver's cab, a display device provided inside the driver's cab, an on-board operation device provided inside the driver's cab and operated by an operator in the driver's cab to output a manned operation signal which is an operation signal commanding the operation of the vehicle body, a communication device that receives an unmanned operation signal which is output from an unmanned operation unit for operating the vehicle body from outside the vehicle body and is an operation signal commanding the operation of the vehicle body, and a driving mode that can select one of a manned operation mode in which the manned operation signal is enabled and the unmanned operation signal is disabled, and an unmanned operation mode in which the unmanned operation signal is enabled and the manned operation signal is disabled. A construction machine equipped with a driver's mode switch and a controller that controls the vehicle body based on the manned operation signal or the unmanned operation signal according to the operation mode set by the operation mode switch, the controller controls the vehicle body based on the unmanned operation signal when the unmanned operation mode is selected by the operation mode switch, and outputs a warning display on the display device to alert the user that the unmanned operation mode has been selected, and provides a construction machine that controls the vehicle body based on the manned operation signal and does not display the warning display on the display device when the manned operation mode is selected by the operation mode switch.
 本発明によれば、無人運転可能な状態の建設機械内の搭乗者に対して無人運転可能な状態であることを知らせることができる。 The present invention makes it possible to inform occupants of construction machinery that is capable of unmanned operation that the machinery is capable of unmanned operation.
本発明の一実施形態に係る建設機械の一例である油圧ショベルの平面図FIG. 1 is a plan view of a hydraulic excavator, which is an example of a construction machine according to an embodiment of the present invention. 本発明の一実施形態に係る建設機械を含む遠隔操作システムの構成例を表す図FIG. 1 is a diagram illustrating an example of the configuration of a remote control system including a construction machine according to an embodiment of the present invention. 図1に示した油圧ショベルの運転室内の表示装置に有人運転モード時に表示される表示画面の例を表す図FIG. 2 is a diagram illustrating an example of a display screen displayed on a display device in the cab of the hydraulic excavator shown in FIG. 1 in a manned operation mode. 図1に示した油圧ショベルの運転室内の表示装置に無人運転モード時に表示される表示画面の一例を表す図FIG. 2 is a diagram illustrating an example of a display screen displayed on a display device in a cab of the hydraulic excavator shown in FIG. 1 in an unmanned operation mode. 図1に示した油圧ショベルの運転室内の表示装置に無人運転モード時に表示される表示画面の他の例を表す図FIG. 2 is a diagram showing another example of a display screen displayed on the display device in the cab of the hydraulic excavator shown in FIG. 1 in the unmanned operation mode; 図1に示した油圧ショベルの運転室内の表示装置に無人運転モード時に表示される表示画面の更に他の例を表す図FIG. 2 is a diagram showing yet another example of a display screen displayed on the display device in the cab of the hydraulic excavator shown in FIG. 1 in an unmanned operation mode; 図1に示した油圧ショベルに備わったコントローラによる運転室内の表示装置の表示制御の手順の要部を表すフローチャート2 is a flowchart showing a main part of a procedure for controlling the display of a display device in a cab by a controller provided in the hydraulic excavator shown in FIG.
 以下に図面を用いて本発明の実施の形態を説明する。 The following describes an embodiment of the present invention using the drawings.
 1.建設機械の概略構成
 図1は本発明の一実施形態に係る建設機械の一例である油圧ショベルの平面図である。油圧ショベル1は、本発明の適用対象である建設機械の代表的であるが、油圧ショベルに限らず、ダンプトラック、ブルドーザ、ホイールローダ等の他の建設機械にも本発明は適用可能である。以降、運転席に着いたオペレータが向く方向(図1中の左側)が油圧ショベル1(厳密には旋回体4)の前側であるとする。図1に示した油圧ショベル1は、その車体2に作業装置(フロント作業機)5を含んでいる。
1. Schematic configuration of a construction machine Fig. 1 is a plan view of a hydraulic excavator, which is an example of a construction machine according to an embodiment of the present invention. The hydraulic excavator 1 is a representative example of a construction machine to which the present invention is applied, but the present invention is not limited to hydraulic excavators and can also be applied to other construction machines such as dump trucks, bulldozers, and wheel loaders. Hereinafter, the direction in which an operator sitting in the driver's seat faces (the left side in Fig. 1) is assumed to be the front side of the hydraulic excavator 1 (strictly speaking, the rotating body 4). The hydraulic excavator 1 shown in Fig. 1 includes a working device (front working machine) 5 on its vehicle body 2.
 2.車体
 車体2は、走行体3と旋回体4とを含む。走行体3は、油圧ショベル1が自力走行するための基礎構造体であり、ホイール式の走行体でも良いが、本実施形態ではクローラ式の走行体を採用した構成を例示する。また、車体2が走行体3と旋回体4とを備えた構造の建設機械に限らず、車体が旋回構造を持たないタイプの建設機械にも本発明は適用可能である。
2. Vehicle Body The vehicle body 2 includes a running body 3 and a rotating body 4. The running body 3 is a foundation structure that allows the hydraulic excavator 1 to travel under its own power, and may be a wheel-type running body, but this embodiment illustrates a configuration in which a crawler-type running body is used. Furthermore, the present invention is not limited to construction machines in which the vehicle body 2 includes the running body 3 and the rotating body 4, but can also be applied to construction machines of a type in which the vehicle body does not have a rotating structure.
 走行体3は、トラックフレーム、履帯3c、走行モータを含む。特に図示していないが、トラックフレームは、センタフレーム及びセンタフレームに連結した左右のサイドフレームにより平面視でH型に形成されている。トラックフレームの左右のサイドフレームの前後の一端側にはアイドラが、他端側にはスプロケットがそれぞれ回転自在に支持されている。走行モータの出力軸は、スプロケットの回転軸に連結されている。走行モータは油圧モータである。左右のサイドフレームのそれぞれにおいて、アイドラとスプロケットとに環状の履帯3cが掛け回されていて、履帯3cをスプロケットで駆動することによって走行体3が走行する。 The running body 3 includes a track frame, tracks 3c, and a running motor. Although not specifically shown, the track frame is formed in an H-shape in plan view by a center frame and left and right side frames connected to the center frame. An idler is supported at one end of the front and rear of the left and right side frames of the track frame, and a sprocket is supported at the other end for free rotation. The output shaft of the running motor is connected to the rotating shaft of the sprocket. The running motor is a hydraulic motor. A circular track 3c is looped around the idler and sprocket on each of the left and right side frames, and the running body 3 runs by driving the track 3c with the sprocket.
 旋回体4は、旋回輪(不図示)を介して走行体3の上部に左右に旋回可能に設けられており、旋回フレーム、運転室(キャビン)4b、カウンタウェイト4c、エンジンルーム(機械室)4d等を備えている。旋回フレームは、旋回体4のベースフレームであり、旋回輪を介してトラックフレームに支持されている。旋回フレームには、旋回輪の付近に旋回モータ(不図示)が搭載されており、旋回モータの出力軸が旋回輪に設けた歯車と噛み合うことで、走行体3に対して旋回体4が左右に旋回する。旋回モータには、油圧モータ又は電動モータを用いることができる。 The rotating body 4 is mounted on the upper part of the running body 3 via a slewing ring (not shown) so as to be able to rotate left and right, and includes a slewing frame, a driver's cab (cabin) 4b, a counterweight 4c, an engine room (machine room) 4d, etc. The slewing frame is the base frame of the rotating body 4, and is supported on the truck frame via the slewing ring. A slewing motor (not shown) is mounted on the slewing frame near the slewing ring, and the output shaft of the slewing motor meshes with a gear provided on the slewing ring, causing the rotating body 4 to rotate left and right relative to the running body 3. A hydraulic motor or an electric motor can be used as the slewing motor.
 旋回フレームの前部には、作業装置5の左右方向の一方側(本例では左側)に位置するように運転室4bが設置されている。旋回フレームにおける運転室4bの後側には、エンジンルーム4dが設置されている。エンジンルーム4dには、原動機、原動機で駆動される油圧ポンプ、油圧ポンプから油圧アクチュエータ(ブームシリンダ5e等)への圧油を制御するコントロールバルブ等を含む油圧システム、熱交換器類等が収容されている。原動機には、電動機を用いることもあるが、本実施形態ではエンジン(内燃機関)が用いてある。旋回フレームの後端には、カウンタウェイト4cが取り付けられている。カウンタウェイト4cは、作業装置5との重量バランスをとるための重量物であり、旋回フレームの後端旋回軌道に沿って円弧状に形成されている。 A cab 4b is provided at the front of the rotating frame so as to be located on one side of the working device 5 in the left-right direction (the left side in this example). An engine room 4d is provided behind the cab 4b on the rotating frame. The engine room 4d houses a hydraulic system including a prime mover, a hydraulic pump driven by the prime mover, a control valve that controls the pressure oil from the hydraulic pump to the hydraulic actuator (boom cylinder 5e, etc.), heat exchangers, etc. An electric motor may be used as the prime mover, but in this embodiment, an engine (internal combustion engine) is used. A counterweight 4c is attached to the rear end of the rotating frame. The counterweight 4c is a heavy object for balancing the weight with the working device 5, and is formed in an arc shape along the rear end rotating trajectory of the rotating frame.
 3.作業装置
 作業装置5は、旋回体4に取り付けられており、作業腕5a、アタッチメントであるバケット5d、アクチュエータであるブームシリンダ5e、アームシリンダ5f及びバケットシリンダを含む多関節型の作業装置である。作業腕5aは、ブーム5b及びアーム5cを含んで構成されている。ブーム5bは、旋回体4の前部に上下方向に回動可能に連結されている。アーム5cは、ブーム5bの先端に前後方向に回動可能に連結されている。バケット5dは、アーム5cの先端に回動可能に装着されている。ブームシリンダ5eは、旋回体4及びブーム5bに両端が連結されている。アームシリンダ5fは、ブーム5b及びアーム5cに両端が連結されている。バケットシリンダの基端は、アーム5cに回動可能に連結されている。バケットシリンダの先端は、バケットリンクを介してアーム5c及びバケット5dに連結されている。ブームシリンダ5e、アームシリンダ5f、バケットシリンダは、それぞれブーム5b、アーム5c、バケット5dを駆動する。ブームシリンダ5e、アームシリンダ5f、及びバケットシリンダは、いずれも油圧シリンダである。
3. Working device The working device 5 is attached to the revolving body 4 and is a multi-joint working device including a working arm 5a, a bucket 5d as an attachment, a boom cylinder 5e as an actuator, an arm cylinder 5f, and a bucket cylinder. The working arm 5a is configured to include a boom 5b and an arm 5c. The boom 5b is connected to the front part of the revolving body 4 so as to be rotatable in the vertical direction. The arm 5c is connected to the tip of the boom 5b so as to be rotatable in the front-rear direction. The bucket 5d is rotatably attached to the tip of the arm 5c. Both ends of the boom cylinder 5e are connected to the revolving body 4 and the boom 5b. Both ends of the arm cylinder 5f are connected to the boom 5b and the arm 5c. The base end of the bucket cylinder is rotatably connected to the arm 5c. The tip of the bucket cylinder is connected to the arm 5c and the bucket 5d via a bucket link. The boom cylinder 5e, the arm cylinder 5f, and the bucket cylinder drive the boom 5b, the arm 5c, and the bucket 5d, respectively. The boom cylinder 5e, the arm cylinder 5f, and the bucket cylinder are all hydraulic cylinders.
 4.遠隔操作システム
 図2は本発明の一実施形態に係る建設機械を含む遠隔操作システムの構成例を表す図である。図2に例示した遠隔操作システムは、無線操作可能な油圧ショベル1と、油圧ショベル1を無線操作する遠隔運転ユニット50とを有する。油圧ショベル1は、作業現場に配置される。遠隔運転ユニット50は、作業現場から離れた場所に建つ建物内に配置される。
4. Remote Control System Fig. 2 is a diagram showing an example of the configuration of a remote control system including a construction machine according to one embodiment of the present invention. The remote control system shown in Fig. 2 has a hydraulic excavator 1 that can be wirelessly controlled, and a remote operation unit 50 that wirelessly controls the hydraulic excavator 1. The hydraulic excavator 1 is disposed at a work site. The remote operation unit 50 is disposed in a building constructed away from the work site.
 4-1.遠隔運転ユニット-
 遠隔ユニット50は、遠隔地等に設置された、油圧ショベル1の車体2の外部から車体2を操作するための無人運転ユニットである。この遠隔操作ユニット50は、操作対象である油圧ショベル1の操作レバー装置14等の搭乗操作装置(後述)や運転室4bを模擬して構成されており、通信装置51と、操作装置52と、表示装置53と、コントローラ60とを有している。
4-1. Remote operation unit
The remote unit 50 is an unmanned operation unit installed in a remote location or the like for operating the vehicle body 2 of the hydraulic excavator 1 from outside the vehicle body 2. This remote operation unit 50 is configured to simulate the on-board operation devices (described later) such as the operating lever device 14 of the hydraulic excavator 1 to be operated, and the driver's cab 4b, and has a communication device 51, an operation device 52, a display device 53, and a controller 60.
 通信装置51は、油圧ショベル1の遠隔運転に関する信号を授受するための装置であり、ネットワークNWを介して油圧ショベル1との間で、遠隔操作に関するデータ(無人操作信号、作業用映像信号、監視映像信号等)を送受信する役割を果たす。無人操作信号とは、本実施形態においては、油圧ショベル1の走行体3、旋回体4、作業装置5等の動作を指令する操作信号であって、遠隔運転ユニット50から送信されて油圧ショベル1が受信する信号である。作業用映像とは、油圧ショベル1に搭載されたカメラ11(複数のカメラの一部)により運転室4b側からの作業装置5を含む視野を捉えたライブ映像である。監視映像とは、カメラ11(複数のカメラの一部)による油圧ショベル1の車体2の周囲(後方や側方)を捉えたライブ映像である。 The communication device 51 is a device for sending and receiving signals related to the remote operation of the hydraulic excavator 1, and plays a role in sending and receiving data related to remote operation (unmanned operation signals, work video signals, surveillance video signals, etc.) between the hydraulic excavator 1 via the network NW. In this embodiment, the unmanned operation signals are operation signals that command the operation of the running body 3, rotating body 4, work equipment 5, etc. of the hydraulic excavator 1, and are signals transmitted from the remote operation unit 50 and received by the hydraulic excavator 1. The work video is live video captured by the camera 11 (part of multiple cameras) mounted on the hydraulic excavator 1 of the field of view including the work equipment 5 from the driver's cab 4b side. The surveillance video is live video captured by the camera 11 (part of multiple cameras) of the hydraulic excavator 1 of the surroundings (rear and sides) of the vehicle body 2 of the hydraulic excavator 1.
 操作装置52は、油圧ショベル1の動作を指示する装置であり、操作レバー装置14を模したレバー型の操作装置等を含む。 The operating device 52 is a device that commands the operation of the hydraulic excavator 1, and includes a lever-type operating device that imitates the operating lever device 14.
 表示装置53は、油圧ショベル1のカメラ11で撮影される作業用映像をリアルタイムに映し出す大型モニタの他、油圧ショベル1の運転室4bに備えられた表示装置12(後述)に相当する各種設定や監視映像等を表示する表示装置を含む。 The display device 53 includes a large monitor that displays in real time the work images captured by the camera 11 of the hydraulic excavator 1, as well as a display device that displays various settings, surveillance images, etc., equivalent to the display device 12 (described below) provided in the operator's cab 4b of the hydraulic excavator 1.
 コントローラ60は、コンピュータであり、運転信号処理機能61及び表示制御機能62を有する。表示制御機能62は、通信装置51を介して入力される油圧ショベル1からの映像信号その他の信号を基に表示装置53の表示を制御する機能である。遠隔運転ユニット50で油圧ショベルを遠隔運転する操作者は、表示装置53の作業用映像等を見ながら操作装置52を操作する。運転信号処理機能61は、操作装置52の操作に応じて無人操作信号を生成し、通信装置51を介して油圧ショベル1に送信する機能である。 The controller 60 is a computer and has an operation signal processing function 61 and a display control function 62. The display control function 62 is a function that controls the display of the display device 53 based on video signals and other signals from the hydraulic excavator 1 input via the communication device 51. The operator who remotely operates the hydraulic excavator using the remote operation unit 50 operates the operation device 52 while viewing the work images and the like on the display device 53. The operation signal processing function 61 is a function that generates an unmanned operation signal in response to the operation of the operation device 52 and transmits it to the hydraulic excavator 1 via the communication device 51.
 4-2.建設機械の機能ブロック
 油圧ショベル1は、カメラ11、表示装置12、通信装置13、操作レバー装置14、運転モードスイッチ15、スピーカ16、警告灯17、及びコントローラ20を搭載している。
4-2. Functional Blocks of the Construction Machine The hydraulic excavator 1 is equipped with a camera 11, a display device 12, a communication device 13, an operating lever device 14, an operation mode switch 15, a speaker 16, a warning light 17, and a controller 20.
 カメラ11には、車体2の周囲の監視映像を撮影する周辺監視用のカメラと、運転室4bから見た作業用映像を撮影する遠隔運転用のカメラとが含まれる。周辺監視用のカメラとしては、旋回体4の後部に搭載されて旋回体4の後方を撮影する後方監視カメラが一般に設けられ、旋回体4の側部に側方監視カメラが更に設けられる場合も多い。遠隔運転用のカメラは、例えば運転室4bに設けられ、運転室4bで搭乗操作する搭乗者目線の映像を撮影する。これらのカメラ11で撮影された映像は、エンコーダを介してデジタル信号化されて出力され、コントローラ20に入力される。 The cameras 11 include a perimeter monitoring camera that captures surveillance footage of the area around the vehicle body 2, and a remote driving camera that captures work footage as seen from the driver's cab 4b. The perimeter monitoring camera is generally a rear monitoring camera mounted on the rear of the rotating body 4 to capture footage of the area behind the rotating body 4, and in many cases a side monitoring camera is also provided on the side of the rotating body 4. The remote driving camera is mounted, for example, in the driver's cab 4b, and captures footage from the perspective of the passenger operating the vehicle in the driver's cab 4b. The footage captured by these cameras 11 is converted into a digital signal via an encoder, output, and input to the controller 20.
 表示装置12は、運転室4bの内部に設けられており、運転モード等の各種設定や操作情報、車体情報、カメラ映像、注意表示、メッセージ等を表示する装置である。表示装置12の表示画面については、後で図3-図6を用いて幾つかの例を説明する。 The display device 12 is provided inside the driver's cab 4b and displays various settings such as the driving mode, operation information, vehicle information, camera images, warnings, messages, etc. Several examples of the display screen of the display device 12 will be explained later using Figures 3 to 6.
 通信装置13は、ネットワークNWを介して遠隔運転ユニット50との間で遠隔操作に関するデータを送受信する。通信装置13は、遠隔運転ユニット50と通信し、無人操作信号を逐次受信する。つまり、油圧ショベル1は、通信装置13を介して車体2の外部から無人操作信号を受信できるように構成されている。また、通信装置13は、後述する無人運転モード時にコントローラ20から出力されるカメラ11の作業用映像信号を遠隔運転ユニット50に逐次送信する。 The communication device 13 transmits and receives data related to remote operation to and from the remote operation unit 50 via the network NW. The communication device 13 communicates with the remote operation unit 50 and sequentially receives unmanned operation signals. In other words, the hydraulic excavator 1 is configured to be able to receive unmanned operation signals from outside the vehicle body 2 via the communication device 13. In addition, the communication device 13 sequentially transmits work video signals from the camera 11 output from the controller 20 to the remote operation unit 50 during the unmanned operation mode described below.
 操作レバー装置14は、運転室4bの内部に設けられた電気レバー装置であり、作業装置5や旋回体4を駆動するアクチュエータ18の操作に用いられる。アクチュエータ18は、ブームシリンダ5e、アームシリンダ5f、バケットシリンダ、旋回モータの総称である。運転室4bの室内には、走行体3の走行モータを操作する操作装置(不図示)も運転室4bに備わっているが、図2では図示省略してある。操作レバー装置14は、運転室4bの運転席に座った搭乗者により操作される搭乗操作装置であり、搭乗者の操作に応じて作業装置5や旋回体4の動作を指令する操作信号(無人操作信号との区別のため、以下「有人操作信号」と記載する)を生成しコントローラ20に出力する。搭乗操作装置には、走行体3の走行モータを操作する操作装置(不図示)の他、種類の異なる建設機械であれば、例えばホイールローダやダンプトラックのハンドルや各種ペダル等も含まれる。搭乗操作装置を模擬した遠隔操作ユニット50の操作装置52も同様である。 The operating lever device 14 is an electric lever device provided inside the cab 4b, and is used to operate the actuator 18 that drives the working device 5 and the rotating body 4. The actuator 18 is a collective term for the boom cylinder 5e, the arm cylinder 5f, the bucket cylinder, and the rotating motor. The cab 4b is also provided with an operating device (not shown) for operating the travel motor of the traveling body 3, but is omitted from FIG. 2. The operating lever device 14 is a boarding operating device operated by a passenger sitting in the driver's seat of the cab 4b, and generates an operating signal (hereinafter referred to as a "manned operating signal" to distinguish it from an unmanned operating signal) that commands the operation of the working device 5 and the rotating body 4 according to the operation of the passenger, and outputs it to the controller 20. The boarding operating device includes an operating device (not shown) that operates the travel motor of the traveling body 3, as well as handles and various pedals of a wheel loader or a dump truck, if it is a different type of construction machine. The same applies to the operating device 52 of the remote control unit 50 that simulates the boarding operating device.
 なお、本実施形態において、「無人運転」の典型例として遠隔運転ユニット50による油圧ショベル1の遠隔運転を説明するが、無人運転は、運転室4bに搭乗したオペレータが操作レバー装置14等を用いて油圧ショベル1を操作する有人操作以外の操作を意味する。例えば建設機械の自動運転も無人運転の一例である。従って、「無人操作信号」には、遠隔運転ユニット50から受信する操作信号に限らず、有人操作信号以外の車体2の動作を指令する操作信号が含まれ得る。例えば鉱山現場で稼働する建設機械の自動運転の場合、無人運転ユニットとしての管制装置からの管制信号が、前述した「無人操作信号」に該当する。 In this embodiment, remote operation of the hydraulic excavator 1 by the remote operation unit 50 is described as a typical example of "unmanned operation", but unmanned operation means operation other than manned operation in which an operator in the driver's cab 4b operates the hydraulic excavator 1 using the operating lever device 14 or the like. For example, automatic operation of construction machinery is also an example of unmanned operation. Therefore, the "unmanned operation signal" is not limited to operation signals received from the remote operation unit 50, but can also include operation signals that command the operation of the vehicle body 2 other than manned operation signals. For example, in the case of automatic operation of construction machinery operating at a mining site, the control signal from a control device serving as an unmanned operation unit corresponds to the above-mentioned "unmanned operation signal".
 運転モードスイッチ15は、有人運転モード及び無人運転モードのいずれかに運転モードの設定を択一的に切り替えることが可能なスイッチである。運転モードスイッチ15は、表示装置12の画面上のスイッチであっても良いし、画面とは別に設けた物理的なスイッチであっても良い。有人運転モードとは、有人操作信号が有効で、かつ無人操作信号が無効となる運転モードである。無人運転モードとは、無人操作信号が有効で、かつ有人操作信号が無効となる運転モードである。 The driving mode switch 15 is a switch that can selectively switch the driving mode setting between a manned driving mode and an unmanned driving mode. The driving mode switch 15 may be a switch on the screen of the display device 12, or may be a physical switch provided separately from the screen. The manned driving mode is a driving mode in which the manned operation signal is enabled and the unmanned operation signal is disabled. The unmanned driving mode is a driving mode in which the unmanned operation signal is enabled and the manned operation signal is disabled.
 有人運転モード時には、遠隔運転ユニット50と油圧ショベル1との通信が確立した状態であっても、遠隔運転ユニット50に操作権は与えられない。有人運転モード時には、運転室4bの室内の操作レバー装置14の操作に応じて油圧ショベル1が動作し、遠隔運転ユニット50による一切の割り込み操作は不能である。遠隔運転ユニット50により、有人運転モードから無人運転モードに運転モードを切り替えることもできない。 In the manned operation mode, even if communication between the remote operation unit 50 and the hydraulic excavator 1 is established, the remote operation unit 50 is not given the right to operate. In the manned operation mode, the hydraulic excavator 1 operates in response to the operation of the operating lever device 14 inside the operator's cab 4b, and the remote operation unit 50 cannot perform any interrupt operations. The remote operation unit 50 cannot switch the operation mode from the manned operation mode to the unmanned operation mode.
 反対に、無人運転モード時には、遠隔運転ユニット50に操作権が与えられ、遠隔運転ユニット50の操作に応じて油圧ショベル1が動作し、運転室4bの室内の操作レバー装置14を操作しても油圧ショベル1は応答しない。但し、有人運転モード時はもちろん、無人運転モード時であっても運転モードスイッチ15の操作は有効である。従って、運転モードスイッチ15を操作して無人運転モードから有人運転モードに運転モードを切り替えることで、操作レバー装置14等を用いた搭乗操作が有効化される。その他、キースイッチ19の操作も運転モードによらず有効である。キースイッチ19は、油圧ショベル1の原動機を始動及び停止させるスイッチである。無人運転モード時であっても、運転室4bでキースイッチ19をオフにして油圧ショベル1の原動機を停止させ、油圧ショベル1を強制停止させることができる。 In contrast, in the unmanned operation mode, the remote operation unit 50 is given the operating authority, the hydraulic excavator 1 operates in response to the operation of the remote operation unit 50, and the hydraulic excavator 1 does not respond even if the operating lever device 14 inside the driver's cab 4b is operated. However, the operation of the operation mode switch 15 is valid not only in the manned operation mode but also in the unmanned operation mode. Therefore, by operating the operation mode switch 15 to switch the operation mode from the unmanned operation mode to the manned operation mode, boarding operations using the operating lever device 14 and the like are enabled. In addition, the operation of the key switch 19 is also valid regardless of the operation mode. The key switch 19 is a switch that starts and stops the prime mover of the hydraulic excavator 1. Even in the unmanned operation mode, the key switch 19 can be turned off in the driver's cab 4b to stop the prime mover of the hydraulic excavator 1 and forcibly stop the hydraulic excavator 1.
 スピーカ16は、運転室4bの内部に設けられ、搭乗者に対して警告又はメッセージを音で通知する。警告灯17は、油圧ショベル1の外壁(例えば旋回体4の上部)に対して油圧ショベル1の周囲から視認可能な位置に取り付けられたランプ等の表示灯である。 The speaker 16 is provided inside the cab 4b and notifies the occupant of the vehicle of warnings or messages by sound. The warning light 17 is an indicator light such as a lamp attached to the outer wall of the hydraulic excavator 1 (e.g., the top of the rotating body 4) in a position visible from around the hydraulic excavator 1.
 4-3.コントローラ
 コントローラ20は、油圧ショベル1の動作を制御する車載コンピュータ(油圧ショベル1に搭載されたコンピュータ)である。コントローラ20には、運転モードスイッチ15により設定された運転モードに応じて、有人操作信号又は無人操作信号に基づき作業装置5、走行体3、旋回体4を含む車体2を制御する機体制御機能が備えられている。具体的には、コントローラ20は、運転操作(例えばブーム上げ操作)に応じて入力される操作信号に応じ、油圧ショベル1に搭載された油圧システムの電磁弁(例えばブーム上げ用電磁弁)を駆動する。これにより電磁弁から出力されるパイロット圧で方向制御弁(ブーム用方向制御弁)が駆動され、アクチュエータが駆動し(例えばブームシリンダ5eが伸長し)、油圧ショベル1が動作する(ブーム5bが上方に回動する)。このような制御の基礎となる操作信号は、前述した有人操作信号及び無人操作信号のいずれかであり、運転モードにより異なる。
4-3. Controller The controller 20 is an on-board computer (a computer mounted on the hydraulic excavator 1) that controls the operation of the hydraulic excavator 1. The controller 20 has a machine control function that controls the vehicle body 2 including the working device 5, the traveling body 3, and the rotating body 4 based on a manned operation signal or an unmanned operation signal according to the operation mode set by the operation mode switch 15. Specifically, the controller 20 drives a solenoid valve (e.g., a boom-raising solenoid valve) of a hydraulic system mounted on the hydraulic excavator 1 according to an operation signal input according to an operation (e.g., a boom-raising operation). As a result, a directional control valve (a boom directional control valve) is driven by a pilot pressure output from the solenoid valve, an actuator is driven (e.g., the boom cylinder 5e is extended), and the hydraulic excavator 1 operates (the boom 5b rotates upward). The operation signal that is the basis of such control is either the manned operation signal or the unmanned operation signal described above, and differs depending on the operation mode.
 また、コントローラ20は、運転モード判定機能21、表示制御機能22を有する。運転モード判定機能21は、運転モードスイッチ15の操作信号を基に、運転モードスイッチ15で設定されている現在の運転モードが有人運転モードであるか無人運転モードであるかを判定する機能である。表示制御機能22は、現在の運転モードに応じて表示装置12の表示を制御する機能である。運転モード判定機能21は、運転モードスイッチ15によるモード切替操作時にコントローラ20のメモリに記録される運転モードの設定データ(例えば無人運転モード/有人運転モードを表すフラグ)を基に、現在の運転モードを判定する形態とすることもできる。 The controller 20 also has an operation mode determination function 21 and a display control function 22. The operation mode determination function 21 is a function that determines whether the current operation mode set by the operation mode switch 15 is a manned operation mode or an unmanned operation mode based on the operation signal of the operation mode switch 15. The display control function 22 is a function that controls the display of the display device 12 according to the current operation mode. The operation mode determination function 21 can also be configured to determine the current operation mode based on operation mode setting data (e.g., a flag indicating unmanned operation mode/manned operation mode) recorded in the memory of the controller 20 when the mode is switched by the operation mode switch 15.
 なお、本実施形態においては、単一のコントローラ20に、作業装置5、走行体3、旋回体4等を制御する機体制御機能の他、運転モード判定機能21及び表示制御機能22を持たせた場合を例に挙げて説明しているが、コントローラ20は複数のコンピュータで構成される場合もある。この場合、例えば機体制御機能と、運転モード判定機能21及び表示制御機能22とが、別個のコンピュータで実行されるようにしても良い。更に、運転モード判定機能21と表示制御機能22とが、別個のコンピュータで実行されるようにしても良い。 In this embodiment, an example is given in which a single controller 20 has a machine control function for controlling the work device 5, the running body 3, the rotating body 4, etc., as well as an operation mode determination function 21 and a display control function 22, but the controller 20 may be composed of multiple computers. In this case, for example, the machine control function, the operation mode determination function 21, and the display control function 22 may be executed by separate computers. Furthermore, the operation mode determination function 21 and the display control function 22 may be executed by separate computers.
 例えば運転モードスイッチ15により有人運転モードが選択された場合、コントローラ20は、無人操作信号を無効とすると同時に有人操作信号を有効とし、表示装置12の注意表示(後述)を非表示にして、搭乗操作に必要な各種設定表示やカメラ11による監視映像を表示装置12に出力する(例えば後述する図3)。そして、コントローラ20は、操作レバー装置14から入力される有人操作信号に基づいてアクチュエータ18を制御し、車体2を制御する。 For example, when the manned operation mode is selected by the operation mode switch 15, the controller 20 disables the unmanned operation signal and simultaneously enables the manned operation signal, hides the warning display (described later) on the display device 12, and outputs various setting displays required for boarding operations and surveillance images from the camera 11 to the display device 12 (for example, FIG. 3 described later). The controller 20 then controls the actuator 18 based on the manned operation signal input from the operating lever device 14, thereby controlling the vehicle body 2.
 反対に運転モードスイッチ15により無人運転モードが選択された場合、コントローラ20は、有人操作信号を無効とすると同時に無人操作信号を有効とし、ネットワークNWを介してカメラ11による作業用映像や監視映像を遠隔運転ユニット50に送信する。そして、ネットワークNWを介して受信する遠隔運転ユニット50からの無人操作信号に基づいてアクチュエータ18を制御し、車体2を制御する。本実施形態において、コントローラ20は、運転室4bに搭乗者がいるかどうかに関わらず、運転モードが有人運転モードのときのみならず無人運転モードのときも、運転室4bの室内の表示装置12の画面を表示させ、その表示を運転モードに応じて制御する。無人運転モードが選択された場合、コントローラ20は、無人操作信号に基づいて車体2を制御するとともに、無人運転モードが選択されたことの注意を促す注意表示を表示装置12に出力する。有人運転モード時には、この表示装置12の注意表示が非表示となる。 On the other hand, when the unmanned driving mode is selected by the driving mode switch 15, the controller 20 disables the manned operation signal and enables the unmanned operation signal, and transmits the work video and monitoring video from the camera 11 to the remote driving unit 50 via the network NW. Then, based on the unmanned operation signal received from the remote driving unit 50 via the network NW, the controller 20 controls the actuator 18 and controls the vehicle body 2. In this embodiment, the controller 20 displays the screen of the display device 12 inside the driver's cab 4b not only when the driving mode is the manned driving mode but also when the driving mode is the unmanned driving mode, regardless of whether there is a passenger in the driver's cab 4b, and controls the display according to the driving mode. When the unmanned driving mode is selected, the controller 20 controls the vehicle body 2 based on the unmanned operation signal and outputs a warning display to the display device 12 to alert the driver that the unmanned driving mode has been selected. In the manned driving mode, the warning display on the display device 12 is not displayed.
 5.運転室内の表示画面
 運転室内の表示装置の表示画面の例を図3-図6を用いて説明する。
5. Display Screen in the Cab An example of the display screen of the display device in the cab will be described with reference to Figs. 3 to 6.
 5-1.有人運転モード時
 図3は有人運転モード時に運転室内の表示装置に表示される表示画面の例を表す図である。コントローラ20は、現在の運転モードが有人運転モードであると判定すると、図3に示したように、運転室4b内の搭乗者が搭乗運転に必要な各種データを運転室4bに設置された表示装置12に出力する。図3に例示した表示画面200Aには、設定表示201、車体情報表示202、カメラ映像203、運転モード表示204の表示領域がある。
5-1. In manned operation mode Fig. 3 is a diagram showing an example of a display screen displayed on a display device in the cab in the manned operation mode. When the controller 20 determines that the current operation mode is the manned operation mode, it outputs various data required for the occupant in the cab 4b to operate the vehicle to the display device 12 installed in the cab 4b, as shown in Fig. 3. The display screen 200A shown in Fig. 3 has display areas for a setting display 201, a vehicle body information display 202, a camera image 203, and a driving mode display 204.
 設定表示201は、運転室4bで搭乗者が設定した現在の各種設定の表示である。図3では走行モードが低速モードに設定されていることを示すマーク(画面上部の設定表示201)や、空調及びラジオの設定表示(画面下部の設定表示201)を例示している。同図では、図の簡略化のために、画面上部の設定表示201として走行モードのみを例示しているが、アイドル回転数の設定等、その他の設定表示も実際には表示され得る。 The setting display 201 displays various current settings set by the occupant in the driver's cab 4b. FIG. 3 shows, as examples, a mark indicating that the driving mode is set to low speed mode (setting display 201 at the top of the screen) and setting displays for air conditioning and radio (setting display 201 at the bottom of the screen). In the figure, for the sake of simplicity, only the driving mode is shown as an example of the setting display 201 at the top of the screen, but in reality other setting displays such as the idle speed setting may also be displayed.
 車体情報表示202は、車載された各種センサによる現在の車体の状態に関するデータ表示であり、例えば冷却水温度、作動油温度、燃料残量といったデータが表示される。図3では、図の簡略化のために、車体情報表示202として冷却水温度を例示している。 The vehicle body information display 202 displays data related to the current state of the vehicle body from various sensors mounted on the vehicle, such as the coolant temperature, hydraulic oil temperature, and remaining fuel. In FIG. 3, to simplify the illustration, the coolant temperature is shown as an example of the vehicle body information display 202.
 カメラ映像203は、カメラ11による車体周囲のライブ映像である。図3では、複数のカメラ11の映像と油圧ショベル1の平面画像とを合成し、油圧ショベル1及びその周囲を上方から俯瞰した映像を表示した場合を例示している。このような表示を見ながら、搭乗者(オペレータ)は、周囲に障害物等がないことを確認しながら油圧ショベル1を運転する。 Camera image 203 is a live image of the surroundings of the vehicle captured by camera 11. FIG. 3 shows an example in which images from multiple cameras 11 are combined with a planar image of the hydraulic excavator 1 to display an image of the hydraulic excavator 1 and its surroundings viewed from above. While viewing this display, the occupant (operator) drives the hydraulic excavator 1 while checking that there are no obstacles or the like in the surrounding area.
 運転モード表示204は、コントローラ20が運転モード判定機能21により判定した現在の運転モードの表示である。図3では、現在の運転モードの設定が有人運転モードであることが表示されている。 The operation mode display 204 is a display of the current operation mode determined by the controller 20 using the operation mode determination function 21. In FIG. 3, it is displayed that the current operation mode setting is the manned operation mode.
 5-2.無人運転モード時
 図4は無人運転モード時に運転室内の表示装置に表示される表示画面の一例を表す図である。コントローラ20は、現在の運転モードが無人運転モードであると判定すると、図4に示したように、運転モードが無人運転モードに設定されていることの注意を促す注意表示を表示装置12に出力する。無人運転モード時は運転室4bに搭乗者はいない想定であるが、注意表示は、運転モードの設定が無人運転モードである間、点灯又は点滅の形式で表示装置12に常時表示される。例えば油圧ショベル1の始動のために運転室4b内に乗り込んだ搭乗者が降車しないうちに無人運転が始まったり、搭乗者が運転モードを過って無人運転モードに切り替えてしまったりする可能性もある。また、無人運転モードであることを知らない作業者が油圧ショベル1に乗り込む可能性もある。このような場合、建設機械が搭乗者にとって不測の動作をし得ることになる。図4の例では、注意表示として、運転モード表示204を無人運転モードに切り替えると共に、警告メッセージ205及び警告アイコン206を表示している。本実施形態では、無人運転モード及び有人運転モードのいずれが現在の運転モードであるのかが、表示画面上の同一領域(運転モード表示204の表示領域)に切替表示される。警告メッセージ205及び警告アイコン206は、運転モードが無人運転モードであることを警告する表示としては、いずれか一方のみでも良い。また、これら警告表示注意表示(警告メッセージ205、警告アンコン206、運転モード表示204の無人運転モード表示)の表示形態は、点灯表示の他、点滅表示(表示/非表示の繰り返し、文字色/背景色の反転の繰り返し等)により、強調的にすることもできる。
5-2. In unmanned operation mode FIG. 4 is a diagram showing an example of a display screen displayed on the display device in the cab in the unmanned operation mode. When the controller 20 determines that the current operation mode is the unmanned operation mode, as shown in FIG. 4, it outputs a warning display to the display device 12 to call attention that the operation mode is set to the unmanned operation mode. In the unmanned operation mode, it is assumed that there is no occupant in the cab 4b, but the warning display is constantly displayed on the display device 12 in the form of a light or a flash while the operation mode is set to the unmanned operation mode. For example, there is a possibility that the unmanned operation will start before the occupant who got into the cab 4b to start the hydraulic excavator 1 gets off, or that the occupant will mistakenly switch the operation mode to the unmanned operation mode. In addition, there is a possibility that a worker who does not know that the hydraulic excavator 1 is in the unmanned operation mode will get into the hydraulic excavator 1. In such a case, the construction machine may perform an unexpected operation for the occupant. In the example of FIG. 4, as a warning display, the operation mode display 204 is switched to the unmanned operation mode, and a warning message 205 and a warning icon 206 are displayed. In this embodiment, whether the current operation mode is the unmanned operation mode or the manned operation mode is displayed in a single area on the display screen (the display area of the operation mode display 204). Only one of the warning message 205 and the warning icon 206 may be used to warn that the operation mode is the unmanned operation mode. Furthermore, the display form of these warning and attention displays (the warning message 205, the warning icon 206, and the unmanned operation mode display of the operation mode display 204) can be emphasized by a blinking display (repeated display/non-display, repeated inversion of the character color/background color, etc.) in addition to a lit display.
 警告メッセージ205は、現在の運転モードが無人運転モードであることを表示するメッセージと、運転モードの設定を有人運転モードに切り替えるように促すメッセージとを含んでいる。警告メッセージ205は、警告メッセージ専用の表示領域に表示されるようにしても良いが、搭乗運転のために専ら表示される表示の表示領域に表示されるようにしても良い。つまり、表示装置12における有人運転モードの専用表示の少なくとも一部を非表示にして、非表示にした有人運転モードの専用表示に代えて警告メッセージ205が表示されるようにすることができる。有人運転モードの専用表示は、運転室4bに搭乗者がいなければ表示する必要がなく、かつ搭乗運転時には表示する必要がある表示である。図3の表示例であれば、画面下側の設定表示201の他、画面上側の設定表示201や車体情報表示202、カメラ映像203も、有人運転モードの専用表示に該当する。 The warning message 205 includes a message indicating that the current driving mode is the unmanned driving mode and a message prompting the driver to change the driving mode setting to the manned driving mode. The warning message 205 may be displayed in a display area dedicated to warning messages, or in a display area that is exclusively used for on-board driving. In other words, at least a portion of the dedicated display for the manned driving mode on the display device 12 can be hidden, and the warning message 205 can be displayed in place of the hidden dedicated display for the manned driving mode. The dedicated display for the manned driving mode is a display that does not need to be displayed if there is no driver in the driver's cab 4b, but needs to be displayed when the driver is on-board driving. In the display example of FIG. 3, in addition to the setting display 201 at the bottom of the screen, the setting display 201 at the top of the screen, the vehicle information display 202, and the camera image 203 also correspond to the dedicated display for the manned driving mode.
 図4の例では、画面下側の設定表示201(図3)の表示領域に警告メッセージ205が表示され、空調やラジオの設定が非表示になる例を表している。このような設定は一例であり、無人運転モード時には、設定表示201、車体情報表示202、カメラ映像203の少なくとも1つを非表示にする構成とすることができる。なお、図4の例では、画面上側の設定表示201(走行モード)は有人運転モード時と同様に表示している。車体情報表示202については、冷却水温度のインジケータ自体は表示されるが、データ表示が消える例を表している。 In the example of Figure 4, a warning message 205 is displayed in the display area of the setting display 201 (Figure 3) at the bottom of the screen, and the air conditioning and radio settings are hidden. This setting is just one example, and in unmanned driving mode, at least one of the setting display 201, vehicle body information display 202, and camera image 203 can be configured to be hidden. Note that in the example of Figure 4, the setting display 201 (driving mode) at the top of the screen is displayed in the same way as in attended driving mode. As for the vehicle body information display 202, the indicator for the cooling water temperature itself is displayed, but the data display is hidden.
 また、表示装置12には、例えば冷却水温度や作動油温度が設定温度を超える場合等、予め定めた異常状態が検知された場合に、その異常の内容を搭乗者に知らせるメッセージが表示される。特に図示していないが、本実施形態では、例えば画面下側の設定表示201(図3)の表示領域に表示される。仮に無人運転モード時に冷却水温等の異常状態が検知された場合、コントローラ20は、設定表示201の表示領域に、警告メッセージ205と異常内容を知らせるメッセージとを所定の時間間隔で交互に繰り返し表示するようにすることもできる。 In addition, if a predetermined abnormal state is detected, such as when the cooling water temperature or hydraulic oil temperature exceeds a set temperature, the display device 12 displays a message informing the occupant of the details of the abnormality. Although not specifically shown, in this embodiment, the message is displayed, for example, in the display area of the setting display 201 (FIG. 3) at the bottom of the screen. If an abnormal state such as the cooling water temperature is detected during unmanned operation mode, the controller 20 can also be configured to alternately and repeatedly display a warning message 205 and a message informing the occupant of the details of the abnormality at a specified time interval in the display area of the setting display 201.
 警告アイコン206は、搭乗者に異常を通知するアイコンである。警告アイコン206は、例えば冷却水温度や作動油温度が設定値を超えた場合等、車体の状態に異常が発生した場合に強調的に表示されるが、本実施形態では、無人運転モード時にもこの警告アイコン206が表示される。 The warning icon 206 is an icon that notifies the passenger of an abnormality. The warning icon 206 is highlighted when an abnormality occurs in the vehicle body condition, for example, when the coolant temperature or hydraulic oil temperature exceeds a set value, but in this embodiment, this warning icon 206 is also displayed in unmanned driving mode.
 加えて、表示装置12による無人運転モードであることの運転室4b内における出力には、スピーカ16による運転室4b内における音出力、及び警告灯17による車外への報知出力の少なくとも一方を組み合わせることができる。スピーカ16及び警告灯17による警告も、表示装置12による注意表示と同様、油圧ショベル1の運転モードが無人運転モードである間に常時出力される。スピーカ16及び警告灯17は、いずれもコントローラ20からの指令信号により駆動される。 In addition, the output from the display device 12 in the cab 4b indicating that the vehicle is in the unmanned operation mode can be combined with at least one of a sound output from the speaker 16 in the cab 4b and a notification output from the warning light 17 to the outside of the vehicle. The warnings from the speaker 16 and warning light 17 are also constantly output while the operation mode of the hydraulic excavator 1 is in the unmanned operation mode, similar to the caution display from the display device 12. Both the speaker 16 and the warning light 17 are driven by a command signal from the controller 20.
 スピーカ16による音出力は、警告音、メッセージの音声出力、及びその組み合わせのいずれも採用可能である。警告灯17による報知出力は、点灯、点滅、点滅間隔、点灯色により、無人運転モードであること以外の事項の報知にも用いることができる。例えば、油圧ショベル1が無人運転モードであることは青、原動機稼働中であることは橙、油圧ショベル1の動作ロック中であることは緑、故障発生中であることは赤、といった要領で警告灯17の表示色を変えることで、警告灯17で複数の事項を報知できる。 The sound output from the speaker 16 can be a warning sound, a voice message, or a combination of both. The notification output from the warning light 17 can also be used to notify of matters other than the unmanned operation mode by lighting, flashing, the flashing interval, and the lighting color. For example, by changing the display color of the warning light 17 such that blue indicates that the hydraulic excavator 1 is in the unmanned operation mode, orange indicates that the prime mover is running, green indicates that the hydraulic excavator 1 is locked, and red indicates that a malfunction has occurred, the warning light 17 can notify of multiple matters.
 なお、図4で説明した無人運転モードであることを運転室4bの表示装置12に出力する警告の態様は一例であり、警告の態様は基本思想を逸脱しない範囲で種々変更可能である。以下、幾つかの変形例を簡単に説明する。 Note that the warning output on the display device 12 in the driver's cab 4b indicating that the vehicle is in the unmanned operation mode as described in FIG. 4 is just one example, and the warning can be modified in various ways without departing from the basic concept. Some modified examples are briefly described below.
 5-3.変形例1
 図5は無人運転モード時に運転室内の表示装置に表示される表示画面の一例を表す図である。図5において、既出図面と同一の又は対応する要素には既出図面と同符号を付して説明を省略する。
5-3. Modification 1
5 is a diagram showing an example of a display screen displayed on a display device in a cab during unmanned operation mode. In FIG. 5, elements that are the same as or correspond to those in the previously mentioned drawings are given the same reference numerals as those in the previously mentioned drawings, and description thereof will be omitted.
 表示装置12における有人運転モードの専用表示の少なくとも一部を非表示にして、非表示にした有人運転モードの専用表示に代えて警告メッセージ205が表示されるようにすることができる旨を図4の例で説明した。一例として図4では画面下側の設定表示201(図3)の表示領域に警告メッセージ205が表示される場合を説明したが、図5では車体情報表示202の表示領域に車体情報表示202に代えて警告メッセージ205が表示される場合を例示している。図4の例と異なり、画面下側の設定表示201の表示領域には、有人運転モード時の表示(図3)のまま空調設定等が表示されている。また、図5の例では、警告アイコン206の表示を省略してある。その他の点について、図5の表示例は図4の表示例と同様である。 The example of FIG. 4 has been described in which at least a portion of the dedicated display for the attended operation mode on the display device 12 can be hidden and a warning message 205 can be displayed in place of the hidden dedicated display for the attended operation mode. As an example, FIG. 4 has been described in which a warning message 205 is displayed in the display area of the setting display 201 (FIG. 3) at the bottom of the screen, but FIG. 5 illustrates a case in which a warning message 205 is displayed in place of the vehicle body information display 202 in the display area of the vehicle body information display 202. Unlike the example of FIG. 4, the display area of the setting display 201 at the bottom of the screen displays air conditioning settings and the like as they are displayed in attended operation mode (FIG. 3). Also, in the example of FIG. 5, the display of the warning icon 206 has been omitted. In other respects, the display example of FIG. 5 is similar to the display example of FIG. 4.
 このように、有人運転モード時の専用表示のどの表示領域に警告メッセージ205を表示させるかは適宜変更可能である。例えばカメラ映像203の表示領域に、カメラ映像203に代えて警告メッセージ205を表示するようにしても良い。 In this way, it is possible to change as appropriate which display area of the dedicated display in the attended operation mode the warning message 205 is displayed in. For example, the warning message 205 may be displayed in place of the camera image 203 in the display area of the camera image 203.
 もちろん、図4の表示例と同様、図5の表示例も、スピーカ16や警告灯17による注意表示の少なくとも一方と組み合わせることができる。 Of course, like the display example in Figure 4, the display example in Figure 5 can also be combined with at least one of the warning display using the speaker 16 and the warning light 17.
 5-4.変形例2
 図6は無人運転モード時に運転室内の表示装置に表示される表示画面の他の例を表す図である。図6において、既出図面と同一の又は対応する要素には既出図面と同符号を付して説明を省略する。
5-4. Modification 2
6 is a diagram showing another example of a display screen displayed on the display device in the cab during unmanned operation mode. In FIG. 6, elements that are the same as or correspond to those in the previously mentioned drawings are given the same reference numerals as those in the previously mentioned drawings, and the description thereof will be omitted.
 図4では無人運転モード時に車体情報表示202のデータを非表示にする場合を例示したが、有人運転モード時に必要な表示を一部非表示にする場合(警告メッセージを代わりに表示する場合を除く)、どの表示を非表示にするかも適宜変更可能である。図6は、カメラ映像203を単に非表示にする場合(警告メッセージ205を表示することなくカメラ映像203を消す場合)を例示している。図6の例でも、警告アイコン206の表示は省略してある。その他の点について、図6の表示例は図4の表示例と同様である。 Figure 4 shows an example of hiding the data on the vehicle information display 202 in unmanned driving mode, but when hiding some of the displays necessary in manned driving mode (except when a warning message is displayed instead), it is also possible to change which displays are hidden as appropriate. Figure 6 shows an example of simply hiding the camera image 203 (when the camera image 203 is erased without displaying the warning message 205). In the example of Figure 6, the display of the warning icon 206 has also been omitted. In other respects, the display example of Figure 6 is the same as the display example of Figure 4.
 もちろん、図4の表示例と同様、図6の表示例も、スピーカ16や警告灯17による注意表示の少なくとも一方と組み合わせることができる。 Of course, like the display example in Figure 4, the display example in Figure 6 can also be combined with at least one of the warning displays using the speaker 16 and the warning light 17.
 6.表示制御
 図7はコントローラによる運転室内の表示装置の表示制御の手順の要部を表すフローチャートである。
6. Display Control Fig. 7 is a flow chart showing the main steps of the display control procedure of the display device in the cab by the controller.
 コントローラ20は、キースイッチ19がオンになって通電されると、図7に示したフローを開始する(START)。図7のフローを開始すると、コントローラ20は、まず運転モードスイッチ15で設定された現在の運転モードが無人運転モードであるか否かを運転モード判定部機能21により判定する(ステップS1)。コントローラ20は、現在の運転モードが無人運転モードであると判定される場合はステップS2に手順を移し、現在の運転モードが有人運転モードであると判定される場合はステップS3に手順を移す。 When the key switch 19 is turned on and power is applied, the controller 20 starts the flow shown in FIG. 7 (START). When the flow in FIG. 7 starts, the controller 20 first determines whether the current operation mode set by the operation mode switch 15 is the unmanned operation mode using the operation mode determination unit function 21 (step S1). If the controller 20 determines that the current operation mode is the unmanned operation mode, it proceeds to step S2, and if the controller 20 determines that the current operation mode is the attended operation mode, it proceeds to step S3.
 現在の運転モードが無人運転モードと判定される場合、コントローラ20は、表示制御機能22によって運転室4bの表示装置12に注意表示をする(ステップS2)。注意表示は、図4-図6でそれぞれ一例を説明したように、無人運転モードである旨の適宜の表示(運転モード表示204の無人運転モード表示、警告メッセージ205、警告アイコン206等)である。その際、図4-図6の各図に例示したように、有人運転モードへの切替操作を促すメッセージ(警告メッセージ205)が表示されることが望ましい。その他、前述した通り、有人運転モード時の専用表示の一部非表示、スピーカ16による音警告、警告灯17による周囲への報知の少なくとも1つが、併せて実行されるようにすることも望ましい。 If it is determined that the current operation mode is the unmanned operation mode, the controller 20 uses the display control function 22 to display a warning on the display device 12 of the driver's cab 4b (step S2). The warning display is an appropriate display indicating that the operation mode is unmanned (unmanned operation mode display on the operation mode display 204, warning message 205, warning icon 206, etc.), as shown in each of Figs. 4 to 6. At that time, it is desirable to display a message (warning message 205) encouraging the user to switch to the manned operation mode, as shown in each of Figs. 4 to 6. In addition, as described above, it is also desirable to simultaneously perform at least one of the following: hiding part of the dedicated display for the manned operation mode, sound warning by the speaker 16, and alerting the surroundings by the warning light 17.
 反対に、現在の運転モードが無人運転モードではない、つまり有人運転モードであると判定される場合、コントローラ20は、表示制御機能22により運転室4bの表示装置12に搭乗運転に必要な各種情報を表示する(ステップS3)。搭乗運転に必要な各種情報の表示は、図3で一例を説明したように、例えば、画面上下の設定表示201、車体情報表示202、カメラ映像203等である。 On the other hand, if it is determined that the current driving mode is not the unmanned driving mode, i.e., the manned driving mode, the controller 20 uses the display control function 22 to display various information necessary for driving on the display device 12 of the driver's cab 4b (step S3). As an example of the display of various information necessary for driving is described in FIG. 3, for example, the setting display 201 at the top and bottom of the screen, the vehicle information display 202, the camera image 203, etc.
 運転モードに応じて表示装置12に出力したら(ステップS2又はS3の処理を実行したら)、コントローラ20は、キースイッチ19がオフであるかを判定する(ステップS4)。キースイッチ19がオフであると判定される場合、コントローラ20は、遅延処理として表示装置12の表示制御を終了し、図7のフローを終了する。キースイッチ19が引き続きオンであると判定される場合、コントローラ20は、ステップS1に手順を戻し、ステップS1-S4の手順を繰り返す。 After outputting to the display device 12 according to the driving mode (after executing the processing of step S2 or S3), the controller 20 judges whether the key switch 19 is off (step S4). If it is judged that the key switch 19 is off, the controller 20 ends the display control of the display device 12 as a delay process, and ends the flow of FIG. 7. If it is judged that the key switch 19 is still on, the controller 20 returns to the procedure of step S1 and repeats the procedure of steps S1-S4.
 このようにして、コントローラ20は、通電中にステップS1-S4の制御を所定のサイクルタイム(例えば0.1s程度)で繰り返し実行する。その過程で、仮に無人運転モード時に運転席4bに搭乗者がいて、警告メッセージ205に従った搭乗者が運転モードを有人運転モードに切り替えた場合、無人運転モードに係る表示装置12、スピーカ16、警告灯17による警告が停止する。同時に、表示装置12の表示が図3に例示したような搭乗運転用の表示に切り替わる。無人運転モード時に運転室4bに搭乗者がおらず、運転モードが切り替えられることなく油圧ショベル1の遠隔運転が継続する場合、その間はステップS2の表示制御が繰り返し実行される。従って、運転室4bが無人であっても、運転モードが無人運転モードである限り、運転室4b内では表示装置12等による警告が継続的に実行される。また、運転モードが有人運転モードに設定された状態で、運転室4bで搭乗者が運転モードを無人運転モードに切り替えた場合、表示装置12の画面は、例えば図3に例示した画面から図4-図6のいずれかに例示した画面に切り替わる。スピーカ16や警告灯17の警告が実行されるようにしてある場合には、表示装置12による注意表示と共に、スピーカ16や警告灯17の警告がスタートする。 In this way, the controller 20 repeatedly executes the control of steps S1-S4 at a predetermined cycle time (for example, about 0.1 s) while energized. During this process, if there is an occupant in the driver's seat 4b during the unmanned operation mode and the occupant switches the operation mode to the manned operation mode in response to the warning message 205, the warning by the display device 12, speaker 16, and warning light 17 related to the unmanned operation mode will stop. At the same time, the display on the display device 12 will switch to a display for on-board operation as exemplified in FIG. 3. If there is no occupant in the driver's cab 4b during the unmanned operation mode and remote operation of the hydraulic excavator 1 continues without switching the operation mode, the display control of step S2 will be repeatedly executed during that time. Therefore, even if the driver's cab 4b is unmanned, as long as the operation mode is the unmanned operation mode, warnings by the display device 12 and the like will be continuously executed within the driver's cab 4b. In addition, when the driving mode is set to the manned driving mode and an occupant in the driver's cab 4b switches the driving mode to the unmanned driving mode, the screen of the display device 12 switches, for example, from the screen shown in FIG. 3 to any of the screens shown in FIG. 4 to FIG. 6. If a warning is set to be issued by the speaker 16 or the warning light 17, the warning will start from the speaker 16 or the warning light 17 together with a warning display by the display device 12.
 7.効果
 (1)無人運転モード時には油圧ショベル1の運転室4bは無人の想定であるが、本実施形態においては運転室4bに搭乗者がいるかどうかに関わらず運転室4bの室内の表示装置12に警告が表示される。これにより、仮に無人運転モード時に搭乗者がいる場合、その搭乗者に無人運転モードである旨を知らせることができる。想定通り運転室4bが無人である場合には、表示装置12に注意表示される状態が人目に触れることなく継続する。このように、本実施形態によれば、無人運転可能な状態の油圧ショベル1内の搭乗者に対して無人運転可能な状態であることを知らせることができる。
7. Effects (1) In the unmanned operation mode, the cab 4b of the hydraulic excavator 1 is assumed to be unmanned, but in this embodiment, a warning is displayed on the display device 12 inside the cab 4b regardless of whether or not there is an occupant in the cab 4b. As a result, if there is an occupant in the unmanned operation mode, the occupant can be notified that the unmanned operation mode is in effect. If the cab 4b is unmanned as expected, the warning display on the display device 12 continues unseen. In this way, according to this embodiment, it is possible to notify an occupant in the hydraulic excavator 1 that is capable of unmanned operation that the unmanned operation mode is in effect.
 なお、運転席の座面や操作レバー装置14のグリップに圧力センサを設置する等して運転室4bにいる搭乗者を検知する構成とし、搭乗者が検知された場合にのみ表示装置12に注意表示をする構成とすることも考えられる。しかし、この場合には、搭乗者を検知するシステムを油圧ショベル1に実装する必要があり、コストがかかる。また運転室4bにいる搭乗者は、運転室4bに乗り込んだ搭乗者の目的が油圧ショベル1の運転でなければ、搭乗者が運転席に座ったりグリップを握ったりするとは限らない。従って、搭乗者の有無に関わらず表示装置12に注意表示をすることが、何らかの理由で運転室4bにいる可能性のある搭乗者に無人運転モードを知らせる形態として合理的である。また、搭乗者を検知するシステムも不要であり低廉であることも、本実施形態の大きなメリットである。 It is also possible to install a pressure sensor on the seat surface of the driver's seat or on the grip of the operating lever device 14 to detect an occupant in the driver's cab 4b, and to display a warning on the display device 12 only when an occupant is detected. In this case, however, it is necessary to implement a system for detecting occupants in the hydraulic excavator 1, which is costly. Furthermore, if the occupant in the driver's cab 4b does not intend to operate the hydraulic excavator 1, the occupant will not necessarily sit in the driver's seat or hold the grip. Therefore, displaying a warning on the display device 12 regardless of whether there is an occupant is present is a reasonable form of notifying an occupant who may be in the driver's cab 4b for some reason of the unmanned operation mode. Another major advantage of this embodiment is that it does not require a system for detecting occupants and is inexpensive.
 (2)また、運転モードの設定が無人運転モードである間、運転モードの設定を有人運転モードに切り替えるように促す警告メッセージ205が注意表示として表示装置12に出力される。これにより、仮に無人運転モード時に運転室4bに搭乗者がいる場合、その搭乗者に対処法を具体的かつ簡潔に知らせることができ、搭乗者に望ましい行動を促すことができる。 (2) In addition, while the operation mode is set to the unmanned operation mode, a warning message 205 is output to the display device 12 as a caution display, urging the user to switch the operation mode to the manned operation mode. As a result, if there is an occupant in the driver's cab 4b during the unmanned operation mode, the occupant can be notified of specific and concise measures to be taken, and the occupant can be encouraged to take the desired action.
 (3)また、例えば図4-図6では、無人運転モード時に、有人運転モード時に運転中の搭乗者のために表示される設定表示201や車体情報表示202、カメラ映像203をそれぞれ非表示にする場合を例示した。このように、無人運転モード時、搭乗操作に必要な有人運転モードの専用表示を一部非表示にすることでも、有人運転モードではないこと、つまり無人運転モードであることを、運転室4bにいる可能性のある搭乗者に間接的に伝えることができる。 (3) For example, Figures 4 to 6 show an example in which the setting display 201, vehicle body information display 202, and camera image 203, which are displayed for the occupant driving in the manned driving mode, are each hidden in the unmanned driving mode. In this way, by hiding some of the dedicated displays for the manned driving mode that are necessary for boarding operations in the unmanned driving mode, it is possible to indirectly inform occupants who may be in the driver's cab 4b that the driving mode is not a manned driving mode, i.e., that the driving mode is unmanned.
 加えて、図4や図5の例では、設定表示201や車体情報表示202の表示領域に、非表示にした設定表示201や車体情報表示202に代えて警告メッセージ205を表示した。このように遠隔運転中の運転室4bの室内では不要となる情報の表示領域に注意表示をすることで、表示画面の表示の繁雑化が抑制され、情報伝達効率が向上すると共に、表示装置12の表示領域の利用効率の観点でも好ましい。 In addition, in the examples of Figs. 4 and 5, a warning message 205 is displayed in the display area of the setting display 201 and the vehicle body information display 202 in place of the hidden setting display 201 and the vehicle body information display 202. By displaying a warning in the display area of information that is not required inside the driver's cab 4b during remote operation in this way, cluttering of the display screen is suppressed, the efficiency of information transmission is improved, and it is also preferable from the viewpoint of efficient utilization of the display area of the display device 12.
 (4)また、運転モードの設定が無人運転モードである間、警告灯17により無人運転モードであることを表示することで、油圧ショベル1が遠隔運転中であることを周囲にも知らせることができる。 (4) In addition, while the operation mode is set to the unmanned operation mode, the warning light 17 indicates that the operation mode is unmanned, thereby making it possible to inform those around that the hydraulic excavator 1 is being remotely operated.
1…油圧ショベル(建設機械)、2…車体、4b…運転室、5…作業装置、12…表示装置、13…通信装置、14…操作レバー装置(搭乗操作装置)、15…運転モードスイッチ、17…警告灯、20…コントローラ、50…遠隔運転ユニット、201…設定表示(専用表示)、202…車体情報表示専用表示)、203…カメラ映像(専用表示)、204…運転モード表示(注意表示)、205…警告メッセージ(注意表示、メッセージ) 1...hydraulic excavator (construction machine), 2...vehicle body, 4b...operator cab, 5...working device, 12...display device, 13...communication device, 14...operating lever device (boarding operation device), 15...operating mode switch, 17...warning light, 20...controller, 50...remote operation unit, 201...setting display (dedicated display), 202...vehicle information display (dedicated display), 203...camera image (dedicated display), 204...operating mode display (warning display), 205...warning message (warning display, message)

Claims (7)

  1.  運転室を有する車体と、
     前記運転室の内部に設けられた表示装置と、
     前記運転室の内部に設けられ、前記運転室に搭乗したオペレータが操作し、前記車体の動作を指令する操作信号である有人操作信号を出力する搭乗操作装置と、
     前記車体の外部から前記車体を操作するための無人運転ユニットから出力され、前記車体の動作を指令する操作信号である無人操作信号を受信する通信装置と、
     前記有人操作信号が有効、かつ前記無人操作信号が無効となる有人運転モード、及び前記無人操作信号が有効、かつ前記有人操作信号が無効となる無人運転モードのいずれかの運転モードを選択可能な運転モードスイッチと、
     前記運転モードスイッチにより設定された前記運転モードに応じて、前記有人操作信号又は前記無人操作信号に基づき前記車体を制御するコントローラと
    を備えた建設機械において、
     前記コントローラは、前記運転モードスイッチにより前記無人運転モードが選択された場合、前記無人操作信号に基づいて前記車体を制御するとともに、前記表示装置に前記無人運転モードが選択されたことの注意を促す注意表示を出力し、
     前記運転モードスイッチにより前記有人運転モードが選択された場合、前記有人操作信号に基づいて前記車体を制御するとともに、前記表示装置の前記注意表示を非表示にする
    ことを特徴とする建設機械。
    A vehicle body having a driver's cab;
    A display device provided inside the cab;
    An on-board operation device that is provided inside the cab and is operated by an operator who is on board the cab and outputs a manned operation signal that is an operation signal that commands the operation of the vehicle body;
    A communication device that receives an unmanned operation signal that is an operation signal that commands the operation of the vehicle body and is output from an unmanned operation unit for operating the vehicle body from outside the vehicle body;
    an operation mode switch capable of selecting one of an operation mode of a manned operation mode in which the manned operation signal is enabled and the unmanned operation signal is disabled, and an unmanned operation mode in which the unmanned operation signal is enabled and the manned operation signal is disabled;
    a controller for controlling the vehicle body based on the manned operation signal or the unmanned operation signal in accordance with the operation mode set by the operation mode switch,
    When the unmanned driving mode is selected by the driving mode switch, the controller controls the vehicle body based on the unmanned operation signal and outputs a warning display on the display device to alert the user that the unmanned driving mode has been selected;
    A construction machine characterized in that, when the manned operation mode is selected by the operation mode switch, the vehicle body is controlled based on the manned operation signal, and the warning display on the display device is made non-display.
  2.  請求項1に記載の建設機械において、
     前記コントローラは、前記運転モードスイッチにより前記無人運転モードが選択された場合、前記注意表示として、前記無人運転モードから前記有人運転モードに切り替えるように促すメッセージを前記表示装置に出力することを特徴とする建設機械。
    2. The construction machine according to claim 1,
    The construction machine is characterized in that, when the unmanned operation mode is selected by the operation mode switch, the controller outputs, as the warning display, a message to prompt the user to switch from the unmanned operation mode to the manned operation mode on the display device.
  3.  請求項1に記載の建設機械において、
     前記コントローラは、
    前記運転モードスイッチにより前記有人運転モードが選択された場合、前記表示装置に前記有人運転モードの専用表示を出力し、
    前記運転モードスイッチにより前記無人運転モードが選択された場合、前記表示装置の前記有人運転モードの前記専用表示の少なくとも一部を非表示にすることを特徴とする建設機械。
    2. The construction machine according to claim 1,
    The controller:
    When the manned operation mode is selected by the operation mode switch, a dedicated display for the manned operation mode is output to the display device,
    A construction machine characterized in that, when the unmanned operation mode is selected by the operation mode switch, at least a part of the dedicated display for the manned operation mode on the display device is not displayed.
  4.  請求項3に記載の建設機械において、
     前記専用表示は、空調設定表示、ラジオ設定表示、カメラ映像、車体情報表示の少なくとも1つであることを特徴とする建設機械。
    The construction machine according to claim 3,
    The construction machine is characterized in that the dedicated display is at least one of an air conditioning setting display, a radio setting display, a camera image, and a vehicle information display.
  5.  請求項1に記載の建設機械において、
     前記車体の周囲から視認可能な位置に取り付けられた警告灯を備え、
     前記コントローラは、前記運転モードスイッチにより前記無人運転モードが選択された場合、前記警告灯を点灯又は点滅させることを特徴とする建設機械。
    2. The construction machine according to claim 1,
    A warning light is provided at a position visible from around the vehicle body,
    A construction machine characterized in that the controller turns on or flashes the warning light when the unmanned operation mode is selected by the operation mode switch.
  6.  請求項1に記載の建設機械において、
     前記搭乗操作装置は、前記車体に含まれる作業装置の動作を指令する搭乗操作信号を出力可能な操作レバー装置であることを特徴とする建設機械。
    2. The construction machine according to claim 1,
    A construction machine characterized in that the boarding operation device is an operation lever device capable of outputting a boarding operation signal that commands the operation of a work device included in the vehicle body.
  7.  請求項1に記載の建設機械において、
     前記無人運転ユニットは、前記車体の外部に設置され、前記搭乗操作装置を模擬して構成された遠隔運転ユニットであることを特徴とする建設機械。
    2. The construction machine according to claim 1,
    A construction machine characterized in that the unmanned operation unit is a remote operation unit installed outside the vehicle body and configured to simulate the on-board operation device.
PCT/JP2023/041862 2022-11-25 2023-11-21 Construction equipment WO2024111594A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2022188580 2022-11-25
JP2022-188580 2022-11-25

Publications (1)

Publication Number Publication Date
WO2024111594A1 true WO2024111594A1 (en) 2024-05-30

Family

ID=91196147

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2023/041862 WO2024111594A1 (en) 2022-11-25 2023-11-21 Construction equipment

Country Status (1)

Country Link
WO (1) WO2024111594A1 (en)

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016143174A1 (en) * 2015-03-11 2016-09-15 株式会社クボタ Work vehicle and travel control device for automatic travel of work vehicle
KR20180026243A (en) * 2016-09-02 2018-03-12 엘지전자 주식회사 Autonomous vehicle and control method thereof
JP2018047977A (en) * 2016-09-20 2018-03-29 三菱ロジスネクスト株式会社 Cargo work vehicle calling device, cargo work vehicle system, control method and control program
KR20180042556A (en) * 2016-10-18 2018-04-26 현대자동차주식회사 Control system and method for traveling mode switching of autonomous vehicle
JP2020132350A (en) * 2019-02-19 2020-08-31 三菱ロジスネクスト株式会社 Cargo handling system and control method
JP2020143481A (en) * 2019-03-05 2020-09-10 日立建機株式会社 Automatic driving work machine
WO2021085608A1 (en) * 2019-10-31 2021-05-06 住友建機株式会社 Shovel management system, portable terminal for shovel, and program used in portable terminal for shovel
WO2022201855A1 (en) * 2021-03-22 2022-09-29 日立建機株式会社 Autonomously operating construction machinery
WO2022209046A1 (en) * 2021-03-31 2022-10-06 日立建機株式会社 Construction machine

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016143174A1 (en) * 2015-03-11 2016-09-15 株式会社クボタ Work vehicle and travel control device for automatic travel of work vehicle
KR20180026243A (en) * 2016-09-02 2018-03-12 엘지전자 주식회사 Autonomous vehicle and control method thereof
JP2018047977A (en) * 2016-09-20 2018-03-29 三菱ロジスネクスト株式会社 Cargo work vehicle calling device, cargo work vehicle system, control method and control program
KR20180042556A (en) * 2016-10-18 2018-04-26 현대자동차주식회사 Control system and method for traveling mode switching of autonomous vehicle
JP2020132350A (en) * 2019-02-19 2020-08-31 三菱ロジスネクスト株式会社 Cargo handling system and control method
JP2020143481A (en) * 2019-03-05 2020-09-10 日立建機株式会社 Automatic driving work machine
WO2021085608A1 (en) * 2019-10-31 2021-05-06 住友建機株式会社 Shovel management system, portable terminal for shovel, and program used in portable terminal for shovel
WO2022201855A1 (en) * 2021-03-22 2022-09-29 日立建機株式会社 Autonomously operating construction machinery
WO2022209046A1 (en) * 2021-03-31 2022-10-06 日立建機株式会社 Construction machine

Similar Documents

Publication Publication Date Title
JP5337220B2 (en) Work machine display device and work machine equipped with the display device
JP5572770B1 (en) Work vehicle display device and display method thereof
US20180143625A1 (en) Command for under ground
US9702121B2 (en) State information display for work machine, caution-sign displaying method for work machine, and caution-sign displaying program for work machine
KR102027395B1 (en) Display system of work machine, and display method of work machine
WO2019189399A1 (en) Shovel
JP6775602B2 (en) Work vehicle and work vehicle control system
JP4569739B2 (en) Construction machine display device
WO2024111594A1 (en) Construction equipment
US10026242B2 (en) Status information display device for wheeled work vehicle, maintenance-screen display method for wheeled work vehicle, and maintenance-screen display program for wheeled work vehicle
US20240125091A1 (en) Construction Machine
JP4237538B2 (en) Construction equipment rearward monitoring device
US11821171B2 (en) Work machine
JP2022151102A (en) Remote control system for work vehicle, remote operation device and remote control method
JP7399836B2 (en) work vehicle
JP2022156496A (en) Rolling compaction machine
JP2022156497A (en) Rolling compaction machine
JP2022156495A (en) Rolling compaction machine
JP2022157015A (en) Construction machine
CN117248587A (en) Work machine control method, work machine control program, work machine control system, and work machine
CN117248592A (en) Work machine control method, work machine control program, work machine control system, and work machine
JP2020170395A (en) Operation mechanism for work machine, and work machine with the same
JPH0657737U (en) Drum drive for concrete mixer truck
JPH07158066A (en) Work display monitor for pile driver