WO2022172716A1 - 作業機械用表示制御システム、作業機械用表示システム、作業機械、作業機械用表示制御方法及び作業機械用表示制御プログラム - Google Patents
作業機械用表示制御システム、作業機械用表示システム、作業機械、作業機械用表示制御方法及び作業機械用表示制御プログラム Download PDFInfo
- Publication number
- WO2022172716A1 WO2022172716A1 PCT/JP2022/001922 JP2022001922W WO2022172716A1 WO 2022172716 A1 WO2022172716 A1 WO 2022172716A1 JP 2022001922 W JP2022001922 W JP 2022001922W WO 2022172716 A1 WO2022172716 A1 WO 2022172716A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- display
- information
- work machine
- area
- remaining amount
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims description 33
- 238000012545 processing Methods 0.000 claims abstract description 61
- 230000002093 peripheral effect Effects 0.000 claims abstract description 32
- 239000000498 cooling water Substances 0.000 description 44
- 239000010720 hydraulic oil Substances 0.000 description 33
- 238000004891 communication Methods 0.000 description 19
- 239000000446 fuel Substances 0.000 description 15
- 230000002159 abnormal effect Effects 0.000 description 12
- 230000008569 process Effects 0.000 description 12
- 238000010586 diagram Methods 0.000 description 8
- 230000006870 function Effects 0.000 description 8
- 230000004048 modification Effects 0.000 description 8
- 238000012986 modification Methods 0.000 description 8
- 230000015654 memory Effects 0.000 description 7
- 238000001514 detection method Methods 0.000 description 6
- 239000003921 oil Substances 0.000 description 6
- 230000007704 transition Effects 0.000 description 6
- WTHDKMILWLGDKL-UHFFFAOYSA-N urea;hydrate Chemical compound O.NC(N)=O WTHDKMILWLGDKL-UHFFFAOYSA-N 0.000 description 6
- 239000012530 fluid Substances 0.000 description 5
- 238000005259 measurement Methods 0.000 description 4
- 238000010276 construction Methods 0.000 description 3
- 239000002828 fuel tank Substances 0.000 description 3
- 230000006872 improvement Effects 0.000 description 3
- 239000004973 liquid crystal related substance Substances 0.000 description 3
- XSQUKJJJFZCRTK-UHFFFAOYSA-N Urea Chemical compound NC(N)=O XSQUKJJJFZCRTK-UHFFFAOYSA-N 0.000 description 2
- 238000009412 basement excavation Methods 0.000 description 2
- 230000008901 benefit Effects 0.000 description 2
- 239000004202 carbamide Substances 0.000 description 2
- 240000007594 Oryza sativa Species 0.000 description 1
- 235000007164 Oryza sativa Nutrition 0.000 description 1
- 239000000969 carrier Substances 0.000 description 1
- 238000010531 catalytic reduction reaction Methods 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 239000002826 coolant Substances 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 239000003502 gasoline Substances 0.000 description 1
- 230000010365 information processing Effects 0.000 description 1
- 239000007788 liquid Substances 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 235000009566 rice Nutrition 0.000 description 1
- 239000007858 starting material Substances 0.000 description 1
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 1
Images
Classifications
-
- E—FIXED CONSTRUCTIONS
- E02—HYDRAULIC ENGINEERING; FOUNDATIONS; SOIL SHIFTING
- E02F—DREDGING; SOIL-SHIFTING
- E02F9/00—Component parts of dredgers or soil-shifting machines, not restricted to one of the kinds covered by groups E02F3/00 - E02F7/00
- E02F9/26—Indicating devices
-
- E—FIXED CONSTRUCTIONS
- E02—HYDRAULIC ENGINEERING; FOUNDATIONS; SOIL SHIFTING
- E02F—DREDGING; SOIL-SHIFTING
- E02F9/00—Component parts of dredgers or soil-shifting machines, not restricted to one of the kinds covered by groups E02F3/00 - E02F7/00
- E02F9/26—Indicating devices
- E02F9/261—Surveying the work-site to be treated
-
- E—FIXED CONSTRUCTIONS
- E02—HYDRAULIC ENGINEERING; FOUNDATIONS; SOIL SHIFTING
- E02F—DREDGING; SOIL-SHIFTING
- E02F9/00—Component parts of dredgers or soil-shifting machines, not restricted to one of the kinds covered by groups E02F3/00 - E02F7/00
- E02F9/26—Indicating devices
- E02F9/264—Sensors and their calibration for indicating the position of the work tool
-
- E—FIXED CONSTRUCTIONS
- E02—HYDRAULIC ENGINEERING; FOUNDATIONS; SOIL SHIFTING
- E02F—DREDGING; SOIL-SHIFTING
- E02F9/00—Component parts of dredgers or soil-shifting machines, not restricted to one of the kinds covered by groups E02F3/00 - E02F7/00
- E02F9/26—Indicating devices
- E02F9/267—Diagnosing or detecting failure of vehicles
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/04847—Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/147—Digital output to display device ; Cooperation and interconnection of the display device with other functional units using display panels
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
- G09G5/36—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory
- G09G5/38—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory with means for controlling the display position
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N7/183—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a single remote source
Definitions
- the present invention relates to a work machine display control system, a work machine display system, a work machine, a work machine display control method, and a work machine display control program used for displaying information related to the work machine.
- an image display device that simultaneously displays two or more types of images on a display device (monitor) provided in a work machine (construction machine) is known (see Patent Document 1, for example).
- a device according to the related art displays, on a display device, a measurement data image of predetermined instruments and a camera image obtained from a camera installed to supplementally obtain an external field of view.
- the information displayed as the measurement data image includes an engine cooling water temperature gauge, a fuel gauge, a working oil temperature gauge, and the like.
- the measurement data image is superimposed on the camera image, and the camera image is displayed in a see-through state from the measurement data image.
- An object of the present invention is to provide a display control system for a working machine, a display system for a working machine, a working machine, a display control method for the working machine, and a display for the working machine that facilitate improvement in visibility of each of various information related to the working machine. It is to provide a control program.
- a work machine display control system includes a display processing unit that causes a display device to display a display screen.
- the display screen includes a remaining amount display area and a switching display area.
- the remaining amount display area is an area for displaying remaining amount information regarding the remaining amount of the monitored object that is consumed with the operation of the work machine.
- the switching display area is an area for displaying information to be displayed switchably selected from a plurality of information including at least first information and second information related to the work machine.
- the switching display area is arranged in a central area including the center of the display screen.
- the remaining amount display area is arranged in a peripheral area located around the central area of the display screen.
- a work machine display system includes the work machine display control system and the display device that displays the display screen.
- a work machine includes the work machine display system and a body on which the display device is mounted.
- a work machine display control method includes causing a display device to display a display screen including a remaining amount display area and a switching display area.
- the remaining amount display area is arranged in a peripheral area located around a central area including the center of the display screen, and displays remaining amount information regarding the remaining amount of the monitored object consumed by the operation of the work machine. area.
- the switching display area is arranged in the central area of the display screen, and displays information to be displayed switchably selected from a plurality of information including at least first information and second information related to the working machine. This is the area where
- a work machine display control program is a program for causing one or more processors to cause a display device to display a display screen including a remaining amount display area and a switching display area.
- the remaining amount display area is arranged in a peripheral area located around a central area including the center of the display screen, and displays remaining amount information regarding the remaining amount of the monitored object consumed by the operation of the work machine. area.
- the switching display area is arranged in the central area of the display screen, and displays information to be displayed switchably selected from a plurality of information including at least first information and second information related to the working machine. This is the area where
- a working machine display control system a working machine display system, a working machine, a working machine display control method, and a working machine display that facilitates improving the visibility of each of various information related to the working machine.
- a control program can be provided.
- FIG. 1 is a block diagram showing a working machine according to Embodiment 1.
- FIG. FIG. 2 is a schematic external view of the display system according to Embodiment 1.
- FIG. 3 is a diagram illustrating an example of a home screen displayed by the display control system according to the first embodiment;
- FIG. 4 is a conceptual diagram showing transition states of display screens displayed by the display control system according to the first embodiment.
- 5 is a diagram illustrating an example of a home screen displayed by the display control system according to the first embodiment;
- FIG. 6 is a diagram illustrating an example of a camera screen displayed by the display control system according to the first embodiment;
- FIG. 7 is a diagram illustrating an example of a full display screen displayed by the display control system according to the first embodiment;
- FIG. 1 is a block diagram showing a working machine according to Embodiment 1.
- FIG. FIG. 2 is a schematic external view of the display system according to Embodiment 1.
- FIG. 3 is a diagram illustrating an example of a home
- FIG. 8 is a flowchart illustrating an example of processing related to a display control method by the display control system according to the first embodiment
- FIG. 9 is a diagram illustrating an example of a home screen displayed by the display control system according to the first modification of the first embodiment
- FIG. 10 is a block diagram showing the display system and working machine according to the second embodiment.
- a work machine display control system 1 (hereinafter simply referred to as "display control system 1") according to the present embodiment is related to a work machine 3 such as a backhoe, as shown in FIGS. used to display information about
- the display control system 1 causes the display device 2 to display a display screen D1 (see FIG. 2) by controlling the display device 2 .
- the display device 2 is mounted on the body 30 of the work machine 3 and presents various information to the user (operator) who operates the work machine 3 on the display screen D1. That is, the user who operates the work machine 3 can visually obtain various information related to the work machine 3 by looking at the display screen D1 displayed on the display device 2 .
- the display control system 1 configures a work machine display system 10 (hereinafter simply referred to as "display system 10") together with the display device 2, as shown in FIG.
- the display system 10 includes the display control system 1 and the display device 2 that displays the display screen D1.
- the display system 10 constitutes the working machine 3 together with the machine body 30 .
- the work machine 3 according to this embodiment includes the display system 10 and the machine body 30 on which the display device 2 is mounted.
- the display system 10 and the aircraft 30 can communicate with each other.
- Communication possible means direct or indirect communication via a communication network (network) or repeater, etc., using an appropriate communication method such as wired communication or wireless communication (communication using radio waves or light as a medium). In short, it means that information (data) can be sent and received.
- the display system 10 and the body 30 can communicate with each other by a communication method such as CAN (Controller Area Network).
- the communication means between the display system 10 and the machine body 30 is not limited to the above example, and can be realized by any suitable communication means. Further, it is not an essential configuration of the display control system 1 that the display system 10 and the body 30 can communicate with each other.
- the engine 37 drives a hydraulic pump, and from the hydraulic pump, hydraulic actuators (including hydraulic cylinders, hydraulic motors, etc.) of various parts of the machine body 30 are driven.
- the airframe 30 is driven by the hydraulic oil being supplied to the .
- Such a work machine 3 is controlled by, for example, a user (operator) in the driver's cab of the machine body 30 operating a control lever or the like.
- a display device 2 is mounted in the cab of the machine body 30, and the user operates the work machine 3 while viewing various information related to the work machine 3 displayed on the display device 2.
- the display screen D ⁇ b>1 of the display device 2 displays information about the operating state of the work machine 3 , such as the temperature of the cooling water and the temperature of the hydraulic oil, so that the user can see the operation of the work machine 3 necessary for operating the work machine 3 . Information about the operating state can be confirmed on the display device 2 .
- the body 30 of the work machine 3 is provided with the camera 36
- the surrounding image of the work machine 3 captured by the camera 36 can also be displayed on the display screen D ⁇ b>1 of the display device 2 .
- the user can check the situation behind the work machine 3, which is likely to be a blind spot from the driver's seat, on the peripheral image displayed on the display device 2, for example. .
- the display control system 1 realizes a configuration that facilitates improving the visibility of each of the various information related to the work machine 3 .
- the user who operates the work machine 3 is less burdened to grasp various information related to the work machine 3, which leads to an improvement in the operability of the work machine 3, which in turn leads to the improvement of the work machine 3. It is also expected to improve the efficiency of work using 3.
- Work machine in the present disclosure means various machines for work, and examples thereof include work vehicles such as backhoes (including hydraulic excavators, mini excavators, etc.), wheel loaders, and carriers.
- the work machine 3 is not limited to a "vehicle”, and may be, for example, a work vessel, a work projectile such as a drone or a multicopter.
- the working machine 3 is not limited to a construction machine (construction machine), and may be, for example, an agricultural machine (agricultural machine) such as a rice transplanter, a tractor, or a combine harvester.
- the working machine 3 is a riding type backhoe, and the case where excavation work, ground leveling work, ditch excavation work, loading work, or the like can be performed as work is taken as an example. explain.
- a "screen” such as the display screen D1 in the present disclosure means a video (image) displayed on the display device 2, and includes icons, figures, photographs, text, moving images, and the like. That is, the display control system 1 can cause the display device 2 to display the display screen D1 including an image or the like representing information about the operating state of the work machine 3 such as the cooling water temperature and the hydraulic oil temperature.
- the display screen D1 includes a moving image or the like, the display screen D1 includes not a constant image but an image that changes moment by moment.
- the working machine 3 includes a working section 31 , a turning section 32 and a traveling section 33 on the body 30 .
- the airframe 30 further includes a coolant temperature sensor 34, a hydraulic oil temperature sensor 35, a camera 36, an engine 37, and the like.
- the working part 31 is supported by the swivel part 32 and performs work.
- the turning portion 32 is positioned above the traveling portion 33 and is configured to be able to turn relative to the traveling portion 33 about a rotation axis extending in the vertical direction.
- the running unit 33 is configured to be able to run (including turning) on the ground.
- the work machine 3 is a riding-type backhoe. perform the work of A driver's cab (for example, a cabin) in which a user (operator) boards is provided in the revolving section 32 .
- the working unit 31 has a boom, an arm, a bucket, hydraulic actuators (including hydraulic cylinders, hydraulic motors, etc.) and the like.
- the working unit 31 operates by receiving power from an engine 37 as a power source.
- the hydraulic pump is driven by the engine 37 , and hydraulic fluid is supplied from the hydraulic pump to the hydraulic actuator of the working section 31 , thereby operating the working section 31 .
- the revolving part 32 has a revolving hydraulic motor (hydraulic actuator) and the like.
- the revolving portion 32 is equipped with an engine 37 and the like in addition to a driver's cab.
- the traveling unit 33 has, for example, a pair of left and right crawlers, a hydraulic motor (hydraulic actuator) for traveling, and the like.
- Each of the revolving portion 32 and the traveling portion 33 also operates by receiving power from an engine 37 as a power source, similarly to the working portion 31 . That is, the revolving part 32 and the traveling part 33 are operated by supplying hydraulic fluid from the hydraulic pump to the hydraulic actuators (hydraulic motors) of the revolving part 32 and the traveling part 33 .
- the engine 37 functions as a power source that supplies power to each part as described above.
- the engine 37 is a diesel engine.
- the engine 37 is driven by being supplied with fuel (light oil in this case) from a fuel tank.
- the fuel tank is provided with a remaining amount sensor for detecting the remaining amount of fuel, and the remaining amount sensor outputs an electric signal (sensor signal) corresponding to the detected remaining amount of fuel.
- the cooling water temperature sensor 34 is a sensor that detects the temperature of radiator cooling water (cooling water temperature).
- the hydraulic fluid temperature sensor 35 is a sensor that detects the temperature of hydraulic fluid (hydraulic fluid temperature) supplied from the hydraulic pump to the hydraulic actuators of each part of the fuselage 30 . Both the cooling water temperature sensor 34 and the hydraulic oil temperature sensor 35 are provided in the airframe 30 and output an electric signal (sensor signal) corresponding to the detected temperature (cooling water temperature, hydraulic oil temperature).
- the camera 36 has a function of capturing an image of the surroundings of the work machine 3.
- the camera 36 is provided, for example, in the revolving section 32, and is configured to be able to capture an image of the surroundings of the work machine 3 (at least one of the front, rear, left, right, up, and down directions).
- An image captured by the camera 36 may be a black-and-white image, an infrared image, or a full-color image, or may be either a still image or a moving image.
- the camera 36 captures an image behind the work machine 3 (surrounding image) as a full-color moving image, and outputs image data of the surrounding image in real time.
- the airframe 30 further includes an electronic control unit (ECU: Electronic Control Unit), a communication terminal, a fuel tank, a battery, and the like. Furthermore, the state of the tachometer that measures the number of revolutions of the engine 37, the hour meter that measures the operating time, the state of the cutoff lever, the gate lock lever, the starter key switch, etc., or the state of the attachment attached to the working unit 31
- the fuselage 30 is also provided with a sensor for detecting the type and the like.
- FIG. The display system 10 includes the display control system 1 and the display device 2 as described above.
- the display control system 1 and the display device 2 are accommodated in one housing, and the display system 10 has all the functions integrated in one housing as shown in FIG. It is assumed that there is
- the display system 10 in which the display control system 1 and the display device 2 are integrated in this manner is mounted in the cab of the airframe 30 . Thereby, the user (operator) can visually recognize the display screen D1 displayed on the display device 2, and can operate the display device 2 as necessary.
- the display device 2 includes a display section 21 and an operation section 22, as shown in FIGS.
- the display device 2 is configured to be communicable with the display control system 1 and can exchange data with the display control system 1 .
- the display device 2 is a dedicated device used in the work machine 3 .
- the display unit 21 is a user interface for presenting information to the user (operator), such as a liquid crystal display or an organic EL display that displays various information.
- the display unit 21 presents various types of information to the user by display.
- the display unit 21 is a full-color liquid crystal display with a backlight, and has a "horizontally long" display area that is long in the horizontal direction, as shown in FIG.
- the operation unit 22 is a user interface for receiving an operation input by a user (operator) on the display screen D1 displayed on the display unit 21 .
- the operation unit 22 accepts various operations by the user, for example, by outputting an electrical signal according to the user's operation.
- the operation unit 22 includes a plurality of (here, six) mechanical push button switches 221 to 226, as shown in FIG.
- the plurality of push button switches 221 to 226 are arranged near (in the example of FIG. 2, below) the display area of the display unit 21 along the periphery of the display area. These push button switches 221 to 226 are associated with items displayed on a display screen D1, which will be described later. item is operated (selected).
- the operation unit 22 may include a touch panel, an operation dial, and the like. Also in this case, any item on the display screen D1 is operated (selected) by operating the operation unit 22 .
- the display control system 1 includes a data acquisition unit 11, an image acquisition unit 12, and a display processing unit 13, as shown in FIG.
- the display control system 1 is configured to be able to communicate with the fuselage 30, for example, the outputs (sensor signals) of the cooling water temperature sensor 34 and the hydraulic oil temperature sensor 35, the output of the camera 36 (image data of the peripheral image), and Outputs of other sensors, etc. can be received from the body 30 .
- the display control system 1 may acquire these information (data) directly from the cooling water temperature sensor 34, the hydraulic oil temperature sensor 35, the camera 36, etc., or through the electronic control unit of the airframe 30. may be obtained by
- the data acquisition unit 11 periodically or irregularly acquires various data including the output (sensor signal) of the cooling water temperature sensor 34 and the output (sensor signal) of the hydraulic oil temperature sensor 35 from the airframe 30 . That is, the data acquisition unit 11 acquires detection results (detection values) of various sensors, including data indicating the temperature of the cooling water of the engine 37 (cooling water temperature) and the temperature of the working oil (working oil temperature). In this embodiment, the data acquisition unit 11 also acquires the output of the remaining amount sensor (sensor signal), that is, the data indicating the remaining amount of fuel from the aircraft 30 .
- the data acquired by the data acquisition unit 11 is stored in a memory or the like, for example.
- the image acquisition unit 12 periodically or irregularly acquires the output of the camera 36 (image data of the peripheral image) from the aircraft 30 . That is, the image acquisition unit 12 acquires a peripheral image of the work machine 3 (in this embodiment, an image behind the work machine 3).
- the data acquired by the image acquisition unit 12 is stored in a memory or the like, for example.
- the display processing unit 13 is mainly composed of a computer system having one or more processors such as a CPU (Central Processing Unit) and one or more memories such as ROM (Read Only Memory) and RAM (Random Access Memory). process (information processing).
- the display processing unit 13 has a function of displaying at least the display screen D1 on the display device 2 . Specifically, the display processing unit 13 generates the display screen D1 based on the data acquired by the data acquisition unit 11 and the image acquisition unit 12, and controls the display device 2 to display the display screen D1 on the display device. 2 is displayed on the display unit 21. Furthermore, the display processing unit 13 operates according to an operation received by the operation unit 22 of the display device 2 .
- Display control method An example of a work machine display control method (hereinafter simply referred to as “display control method”) mainly executed by the display control system 1 will be described below with reference to FIGS. 3 to 8.
- the display control method according to the present embodiment is executed by the display control system 1 mainly composed of a computer system. be embodied. That is, the display control program according to the present embodiment is a computer program for causing one or more processors to execute each process related to the display control method.
- the display control program according to the present embodiment is a program for causing one or more processors to display (process) the display screen D1 on the display device 2, which will be described below.
- Such a display control program may be executed cooperatively by the display control system 1 and the display device 2, for example.
- the display control system 1 executes the following various processes related to the display control method when a preset specific start operation for executing the display control program is performed.
- the start operation is, for example, an operation to start the engine 37 of the work machine 3 or the like.
- the display control system 1 ends the following various processes related to the display control method when a specific end operation set in advance is performed.
- the termination operation is, for example, an operation to stop the engine 37 of the work machine 3 or the like.
- FIG. 3 shows a “point” indicating the center C1 of the display screen D1
- this “point” is also a virtual point that is not actually displayed on the display device 2 .
- the display screen D1 shown in FIG. 3 is the home screen D11 that is displayed first by the display control method.
- the home screen D11 is a basic display screen D1 that is first displayed on the display device 2 while the work machine 3 is in operation.
- the display screen D1 includes a camera screen D12 (see FIG. 4), a full display screen D13 (see FIG. 4), a menu screen, a crane screen, a mode screen, a PTO screen, etc., from the home screen D11 according to the operation on the operation unit 22. Transition to various display screens D1 is possible.
- the home screen D11 as the display screen D1 includes, as shown in FIG. 3, a remaining amount display area R1 (first area) and a switching display area R2 (second area).
- the home screen D11 further includes a third area R3, a fourth area R4, a fifth area R5, a sixth area R6, a seventh area R7, an eighth area R8, a ninth area R9 and a tenth area R10.
- the home screen D11 is divided into four areas in the vertical direction (vertical direction). Each of the three regions from the top is further divided into three regions in the horizontal direction (horizontal direction). As a result, the home screen D11 is divided into a total of 10 areas.
- the second area from the top is the remaining amount display area R1, the switching display area R2, and the third area R3 in order from the left.
- the lowest region is the fourth region R4.
- the regions on the third row from the top are the fifth region R5, the sixth region R6, and the seventh region R7 in order from the left, and the regions in the top row are the eighth region R8 and the ninth region R9, in order from the left. , the tenth region R10.
- the second region from the top (residual amount display region R1, switching display region R2, and third region R3) is the largest.
- the middle area is the largest among the three areas divided in the horizontal direction.
- each of these areas are only examples, and can be changed as appropriate. Also, it is not essential that each area is clearly divided by a boundary line.
- the switching display region R2 and the third region R3 are clearly divided by a boundary line, whereas the remaining amount display region R1 and the switching display region R2 are separated by a boundary line. does not exist.
- the remaining amount display area R1 and the switching display area R2 may be clearly divided by a boundary line.
- the remaining amount display area R1 is a vertically elongated rectangular area. Remaining amount information G1 relating to the remaining amount of the object to be monitored is displayed in the remaining amount display area R1.
- the object to be monitored is an object (including liquid and gas) that is consumed as the work machine 3 operates.
- the object to be monitored includes the fuel of the engine 37 (for example, light oil).
- remaining amount information G1 regarding the remaining amount of fuel, which is an object to be monitored is displayed in the remaining amount display region R1.
- the display processing unit 13 generates remaining amount information G1 in the display screen D1 (home screen D11) based on the output of the remaining amount sensor (sensor signal) acquired by the data acquisition unit 11 .
- the remaining amount information G1 is a bar graph.
- the remaining amount information G1 is information representing the remaining amount of the object to be monitored (here, fuel) as an index and represented by the length (height) of the bar graph. Displaying the remaining amount information G1 in the form of a graph (bar graph) is advantageous for the user in that the visibility is good and the remaining amount of the object to be monitored can be intuitively understood.
- the remaining amount information G1 may be any information related to the remaining amount of the object to be monitored, and not only information representing the remaining amount itself by a numerical value, but also, for example, a picture (icon) pattern representing the remaining amount in stages. Information, or information that indirectly indicates the remaining amount by indicating the consumption amount of the monitored object may be used.
- the switching display area R2 is a rectangular area elongated in the horizontal direction.
- Display target information is displayed in the switching display area R2.
- the display target information is information that is switchably selected from a plurality of information including at least first information and second information related to the work machine 3 .
- cooling water temperature information G3 and hydraulic oil temperature information G2 are displayed in the switching display area R2.
- the cooling water temperature information G3 and the hydraulic oil temperature information G2 are first information related to the working machine 3 . That is, the home screen D11 shown in FIG. 3 is the display screen D1 in a state in which the first information (the cooling water temperature information G3 and the hydraulic oil temperature information G2) is displayed as the display target information in the switching display area R2.
- Both the cooling water temperature information G3 and the hydraulic oil temperature information G2 are information related to the work machine 3, and particularly information related to the operating state of the work machine 3.
- the display processing unit 13 generates cooling water temperature information G3 in the display screen D1 (home screen D11) based on the output (sensor signal) of the cooling water temperature sensor 34 acquired by the data acquisition unit 11 .
- the display processing unit 13 generates hydraulic oil temperature information G2 in the display screen D1 (home screen D11) based on the output (sensor signal) of the hydraulic oil temperature sensor 35 acquired by the data acquisition unit 11 .
- both the cooling water temperature information G3 and the hydraulic oil temperature information G2 are graphs imitating analog meters.
- needles G21 and G31 rotate, and values are presented according to the positions of needles G21 and G31. That is, the cooling water temperature information G3 is information that indexes the cooling water temperature included in the operating state of the work machine 3 and represents it by the position of the needle G31 in the graph.
- the hydraulic oil temperature information G2 is information in which the hydraulic oil temperature included in the operating state of the work machine 3 is indexed and represented by the position of the needle G21 in the graph.
- the cooling water temperature information G3 and the hydraulic oil temperature information G2 are not only information representing the cooling water temperature and the hydraulic oil temperature numerically, but also information representing the cooling water temperature and the hydraulic oil temperature step by step by, for example, an icon pattern. etc.
- the first information is information regarding the operating state of the work machine 3 .
- the user can grasp the operating state of the work machine 3 from the first information displayed in the switching display area R2 of the display screen D1.
- the first information is information that expresses the operating state as an index. Therefore, the user can grasp the operating state of the work machine 3 in detail.
- the information to be displayed displayed in the switchable display area R2 is information that is switchably selected from a plurality of information including the first information and the second information, and is the above-described first information (cooling water temperature information). It is not limited to G3 and hydraulic oil temperature information G2). That is, in the switching display area R2, the second information, which is different from the first information and is related to the work machine 3, can be displayed in place of the first information.
- the second information there is a surrounding image G4 (see FIG. 6) captured by the camera 36, and the like. That is, the second information is information including the peripheral image of the work machine 3 .
- the user can, for example, display information as required according to the situation at that time.
- the information to be displayed can be preferentially displayed on the display screen D1.
- the third region R3 is a vertically elongated rectangular region.
- An image (icon) Im1 corresponding to the operating state of each part of the work machine 3 is displayed in the third region R3.
- a plurality of icons Im1 can be displayed in the third region R3, and the design (pattern) of each icon Im1 represents, for example, any state of the battery, seat belt, cooling water temperature, hydraulic oil temperature, etc. show water.
- each icon Im1 indicates an operating state by a display mode such as display color or size, for example.
- the display processing unit 13 determines the state of each part of the work machine 3 using the outputs of various sensors (including the cooling water temperature sensor 34 and the hydraulic oil temperature sensor 35) that detect the operating state of each part of the work machine 3. . Then, when an abnormal value is detected in any part, the display processing unit 13 performs warning display by changing the display mode such as the display color of the icon image Im1 of that part.
- the fourth area R4 is a strip-shaped area extending over the entire width of the display screen D1.
- Each item for operation on the display screen D1 is displayed in the fourth area R4.
- six items of "menu”, “crane”, “mode”, “camera”, “PTO”, and “switch” are arranged in this order from the left. ing.
- These six items are associated with the six push button switches 221 to 226 of the operation unit 22 positioned directly below them.
- the item “menu” is associated with the push button switch 221
- the item “crane” is associated with the push button switch 222, respectively. Therefore, for example, when the push button switch 224 corresponding to the item "camera” is operated by the user U1 (see FIG. 2), the item “camera” is operated (selected).
- one of the items is highlighted in the fourth area R4 so as to correspond to the operation of the operation dial (or cursor key) of the operation unit 22, or the like.
- the item "Menu” is highlighted, and the highlighted item is switched by operating the operation dial (or cursor key) or the like.
- the user U1 can select a desired item by operating the decision button while the desired item is highlighted. Therefore, for example, when the enter button is operated with the item "camera” highlighted, the item "camera” is operated (selected). Further, when the operation unit 22 includes a touch panel, the user U1 can select a desired item by touching the desired item on the display screen D1.
- Presentation information Im2 (see FIG. 5), which will be described later, is displayed in the fifth region R5.
- the sixth area R6 for example, information regarding the working unit 31 in operation in the work machine 3 is displayed.
- the seventh area R7 for example, information regarding the operating state of the work machine 3, such as the number of revolutions of the engine 37 (see FIG. 5), is displayed.
- the current time is displayed in the eighth region R8.
- the ninth area R9 for example, information indicating the item to which the currently displayed display screen D1 belongs is displayed.
- the tenth area R10 for example, information regarding the operating time (hour meter) of the work machine 3 is displayed.
- the switching display area R2 is arranged in the central area including the center C1 of the display screen D1. That is, as shown in FIG. 3, if a central area (the same range as the switching display region R1) including the center C1 of the display screen D1 is defined in the display screen D1, a plurality of information including the first information and the second information are defined. Display target information switchably selected from the information is displayed in the central area.
- the remaining amount display area R1 is arranged in a peripheral area around the central area of the display screen D1. That is, as shown in FIG. 3, when a central area including the center C1 of the display screen D1 is defined in the display screen D1, the remaining amount information G1 is displayed in a peripheral area near the edge of the display screen D1.
- the display control system 1 includes the display processing unit 13 that causes the display device 2 to display the display screen D1.
- the display screen D1 includes a remaining amount display area R1 and a switching display area R2.
- the remaining amount display area R ⁇ b>1 is an area for displaying remaining amount information G ⁇ b>1 regarding the remaining amount of the monitored object that is consumed as the work machine 3 operates.
- the switchable display area R2 is an area for displaying information to be displayed switchably selected from a plurality of information including at least first information and second information related to the work machine 3 .
- the switching display region R2 is arranged in a central area including the center C1 of the display screen D1.
- the remaining amount display area R1 is arranged in a peripheral area around the central area of the display screen D1.
- the remaining amount information G1 which is preferably always displayed on the display screen D1 can be easily displayed at the edge (surrounding area) of the display screen D1 without overlapping other information.
- the first information such as the cooling water temperature information G3 and the hydraulic oil temperature information G2 is displayed in the center (central area) of the display screen D1, so that the information prioritized when the work machine 3 is in operation is It becomes easy to display in a particularly conspicuous position with good visibility.
- the information displayed in the switching display area R2 can be switched, it is possible to switch the information displayed in the highly visible position (central area) from time to time. Therefore, according to the display control system 1 according to the present embodiment, there is an advantage that the visibility of each of various information related to the work machine 3 can be easily improved.
- the display processing unit 13 changes the display screen D1 displayed on the display device 2 from the home screen D11 to other screens (camera screen D12, full display screen D13) according to the user's operation. etc.).
- the home screen D11 is first displayed on the display unit 21 of the display device 2 by the start operation.
- the home screen D11 changes to the camera screen D12. transition to
- the camera screen D12 transitions to the full display screen D13.
- the full display screen D13 transitions to the home screen D11.
- the operation for transitioning the display screen D1, the order of transition, and the like are not limited to the above example, and can be changed as appropriate.
- the display screen D1 displayed on the display device 2 can be switched, for example, from the home screen D11 as shown in FIG. 5 to the camera screen D12 as shown in FIG. Further, the display screen D1 displayed on the display device 2 can be switched to a full display screen D13 as shown in FIG. 7, for example.
- the camera screen D12 shown in FIG. 6 is a screen in which only the display content of the switching display area R2 is changed from the home screen D11 shown in FIG. That is, the display other than the switching display region R2 is the same between the camera screen D12 and the home screen D11.
- the second information is displayed as the information to be displayed instead of the first information (the cooling water temperature information G3 and the hydraulic oil temperature information G2).
- the second information is information including the peripheral image G4 of the work machine 3 .
- the display processing unit 13 generates a peripheral image G4 in the display screen D1 (camera screen D12) based on the output (image data) of the camera 36 acquired by the image acquiring unit 12.
- FIG. Therefore, according to the camera image D12, it is possible to easily check the periphery (here, the rear) of the work machine 3, which tends to be a blind spot for the user, in the peripheral image G4 displayed in the center (central area) of the display screen D1.
- the peripheral image G4 is displayed when the engine 37 is in operation and the cut-off lever that prohibits the operation of the work machine 3 is released, that is, the prohibition of the operation is released. .
- the full display screen D13 shown in FIG. 7 is a screen obtained by enlarging the switching display area R2 in which the peripheral image G4 is displayed, compared to the camera screen D12 shown in FIG.
- the entire display screen D13 includes only two regions, the switching display region R2 and the third region R3. 3 region R3. That is, on the full display screen D13, the remaining amount display area R1 is not displayed, and the switching display area R2 is enlarged and displayed from the central area to the peripheral area where the remaining amount display area R1 is displayed on the camera screen D12 or the like.
- the display processing unit 13 has a plurality of display modes including the first mode and the second mode.
- the display processing unit 13 arranges the switching display area R2 in the central area and the remaining amount display area R1 in the peripheral area.
- the display processing unit 13 hides the remaining amount display area R1 and arranges the switching display area R2 across the central area and the peripheral area. Therefore, the display processing unit 13 displays the home screen D11 and the camera screen D12 in the first mode, and displays the entire display screen D13 in the second mode.
- the display processing unit 13 can enlarge and display the switching display area R2 while operating in the second mode, that is, by displaying the entire display screen D13. Therefore, for the user, the visibility of the information displayed in the switching display area R2 is improved.
- the peripheral image G4 as the second information is basically displayed in the switching display area R2 in the full display screen D13, but the configuration is not limited to this. That is, in the full display screen D13, the first information such as the cooling water temperature information G3 and the hydraulic oil temperature information G2 may be displayed in the switching display area R2.
- the home screen D11 in FIG. 5 shows a state in which the presentation information Im2 is displayed in the fifth area R5.
- the display processing unit 13 uses various sensors (the cooling water temperature sensor 34 and the hydraulic oil temperature sensor 35) to monitor the operating state of each part of the working machine 3 corresponding to various icons Im1 displayed in the third region R3. ) are used to determine the state of each part of the work machine 3 .
- the display processing unit 13 displays the cooling water temperature Detect outliers for Then, when such an abnormal value is detected, the display processing unit 13 changes the display mode such as the display color of the icon image Im1 corresponding to the abnormal value in the third region R3, and presents it in the fifth region R5. Display the information Im2. Furthermore, in the example of FIG. 5, presentation information Im3 indicating that an abnormal value has been detected is also displayed in the ninth region R9, such as "error occurring".
- the presentation information Im2 and Im3 are information related to the first information (cooling water temperature information G3 and hydraulic oil temperature information G2). Specifically, the presentation information Im2 and Im3 are warning displays indicating that an abnormal value has been detected for the first information. Furthermore, the presentation information Im2 and Im3 includes an image (icon) representing the first information (cooling water temperature). In other words, the presentation information Im2 and Im3 include icons related to the first information. Particularly in this embodiment, the presentation information Im2 expresses the content of the abnormal value by the display mode (display color, size, etc.) of the icon.
- the presentation information Im2 becomes a blue icon
- the presentation information Im2 becomes a red icon
- the presentation information Im2 and Im3 includes an icon, which makes it easier for the user to understand the content represented by the presentation information Im2 and Im3.
- the item on the right end of the fourth area R4 has changed from "switching" (see FIG. 3) to warning Im5. That is, when an abnormal value is detected, the display processing unit 13 displays the item of warning Im5 in the fourth region R4 while displaying the presentation information Im2 and Im3. In this state, for example, when the push button switch 226 corresponding to the warning Im5 is operated by the user U1 (see FIG. 2), the item of the warning Im5 is operated (selected). When the item of warning Im5 is operated, details of the error (abnormal value) occurring at that time are displayed on the display screen D1.
- the presentation information Im2 and Im3 are also displayed on the camera screen D12 in which the second information (peripheral image G4) is displayed in the switching display area R2. That is, the display processing unit 13 displays the presentation information Im2 and Im3 related to the first information on the display screen D1 at least in a state where the first information is not displayed in the switching display region R2.
- the presentation information Im2 and Im3 are displayed not only when the first information is not displayed (camera screen D12), but also when the first information is displayed (home screen D11).
- FIG. 7 only the presentation information Im3 of the presentation information Im2 and Im3 is displayed on the full display screen D13.
- the presentation information Im2 is displayed in the fifth region R5, that is, in a region other than the switching display region R2.
- the fifth area R5 is located below the remaining amount display area R1.
- the display processing unit 13 displays the presentation information Im2 at a position other than the switching display region R2 on the display screen D1. Accordingly, the presentation information Im2 does not overlap the first information, the second information, or the like displayed in the switching display region R2, and the visibility of each information is improved. Furthermore, the display processing unit 13 displays the presentation information Im2 below the remaining amount display area R1 on the display screen D1. As a result, the presentation information Im2 does not overlap the remaining amount information G1 displayed in the remaining amount display area R1, thereby improving the visibility of each information.
- FIG. 8 is a flowchart showing an example of processing related to the display control method.
- the display processing unit 13 of the display control system 1 first displays the home screen D11 on the display device 2. As shown in FIG. That is, the display processing unit 13 displays the first information (for example, cooling water temperature information G3 and hydraulic oil temperature information G2) regarding the operating state of the work machine 3 in the switching display area R2 of the display screen D1 (home screen D11) ( S1). Furthermore, the display processing unit 13 displays remaining amount information G1 in the remaining amount display area R1 of the display screen D1 (home screen D11) (S2). At this time, the display control system 1 uses the data acquired by the data acquisition section 11 when the display processing section 13 displays the operating state and remaining amount information G1.
- the first information for example, cooling water temperature information G3 and hydraulic oil temperature information G2 regarding the operating state of the work machine 3 in the switching display area R2 of the display screen D1 (home screen D11)
- the display processing unit 13 displays remaining amount information G1 in the remaining amount display area R1 of the display screen D1 (home screen D11) (S2).
- the display control system 1 uses the data
- the display processing unit 13 monitors whether or not an image display operation, that is, an operation (selection) of the item "camera” is performed (S3). If the image display operation is not performed (S3: No), the display processing unit 13 continues to display the home screen D11 (S1, S2).
- the display processing unit 13 displays the camera screen D12 on the display device 2. That is, the display processing unit 13 displays the peripheral image G4 of the work machine 3 in the switching display area R2 of the display screen D1 (camera screen D12) (S4).
- the image data acquisition process by the image acquisition unit 12 may be performed for the first time when the peripheral image G4 is displayed, that is, at the time of the process S4. In this state, the display processing unit 13 monitors whether or not a mode switching operation, that is, an operation (selection) of the item "camera" is performed (S5).
- the display processing unit 13 displays the full display screen D13 on the display device 2. That is, the display processing unit 13 hides the remaining amount display area R1 and displays the switching display area R2 of the display screen D1 (full display screen D13) on the full screen (enlarged) (S6). On the other hand, if the mode switching operation is not performed (S5: No), the display processing unit 13 skips the processing S6 and continues displaying the camera screen D12.
- the display processing unit 13 monitors whether or not an operation to end the image display, that is, an operation (selection) of the item "camera” is performed while the camera screen D12 or the full display screen D13 is being displayed (S7). . If the image display end operation is not performed (S7: No), the display processing unit 13 continues to display the camera screen D12 or the full display screen D13 (S4 to S6). When the image display end operation is performed (S7: Yes), the display processing unit 13 returns to the process S1 and displays the home screen D11 on the display device 2.
- the data acquisition processing by the data acquisition unit 11 and the abnormal value detection (judgment) processing by the display processing unit 13 are always (or periodically) executed as background processing of each processing in the above flowchart. ing. Therefore, the display processing unit 13 displays the presentation information Im2 and Im3 when an abnormal value is detected in the abnormal value detection process even if any of the processes in the above flowchart are being executed.
- FIG. 9 shows a display screen D1 (home screen D11) displayed by the display control system 1 according to the first modified example.
- a work machine 3 is assumed in which an engine 37 is provided with a urea SCR (Selective Catalytic Reduction) system.
- the urea SCR system removes NOx contained in the exhaust gas by injecting urea water into the exhaust gas.
- the remaining amount information G1 displayed in the remaining amount display area R1 includes urea water remaining amount information G12 regarding the remaining amount of urea water in addition to fuel remaining amount information G11 regarding the remaining amount of fuel. .
- Both the remaining fuel information G11 and the remaining urea water information G12 are bar graphs.
- the fuel consumption rate is displayed in the seventh region R7.
- the remaining amount information G1 displayed in the remaining amount display area R1 can include not only the remaining amount of fuel but also information related to the remaining amount of various objects to be monitored.
- the remaining amount information G1 may simultaneously display information regarding the remaining amounts of a plurality of monitored objects, or may display them individually. Further, for example, what is included in the monitored object may be determined automatically by the display processing unit 13 through communication with the body 30 of the work machine 3, or may be set manually.
- the display control system 1 in the present disclosure includes a computer system.
- a computer system is mainly composed of one or more processors and one or more memories as hardware.
- the functions of the display control system 1 in the present disclosure are realized by the processor executing a program recorded in the memory of the computer system.
- the program may be recorded in advance in the memory of the computer system, may be provided through an electric communication line, or may be recorded in a non-temporary recording medium such as a computer system-readable memory card, optical disk, or hard disk drive. may be provided.
- some or all of the functional units included in the display control system 1 may be configured by electronic circuits.
- the display control system 1 it is not an essential configuration of the display control system 1 that at least part of the functions of the display system 10 are integrated in one housing, and the components of the display system 10 are distributed over a plurality of housings. may be provided. Conversely, in Embodiment 1, functions such as the display system 10 distributed among multiple devices may be integrated into one housing. Furthermore, at least part of the functions of the display control system 1 may be realized by a cloud (cloud computing) or the like.
- the power source of the work machine 3 is not limited to the diesel engine, and may be, for example, an engine other than the diesel engine, a motor (electric motor), or a hybrid power source including an engine and a motor (electric motor).
- the power source includes an electric motor such as a motor
- the power source is driven by consuming electrical energy stored in the battery in addition to or instead of fuel (light oil, gasoline, etc.).
- the SOC State Of Charge
- the remaining capacity of the battery may be displayed on the display screen D1 as the remaining capacity information G1.
- the peripheral image captured by the camera 36 is not limited to the image behind the work machine 3 .
- the image behind the work machine 3 in addition to or instead of the image behind the work machine 3 , above and below.
- a plurality of cameras 36 are provided, by switching between these cameras 36, for example, an image behind the work machine 3 and an image in front thereof may be switched and displayed on the display screen D1.
- the display device 2 is not limited to a dedicated device, and may be, for example, a general-purpose terminal such as a laptop computer, a tablet terminal, or a smartphone.
- the display unit 21 is not limited to a mode in which the display screen D1 is displayed directly, such as a liquid crystal display or an organic EL display. good too.
- the display area of the display unit 21 is not limited to be horizontally long, and may be vertically long.
- a mode other than the push button switches 221 to 226, the touch panel, and the operation dial may be adopted.
- the operation unit 22 may employ a mode such as a keyboard, a pointing device such as a mouse, voice input, gesture input, or input of an operation signal from another terminal.
- the first information displayed in the switching display area R2 is not limited to the cooling water temperature information G3 and the hydraulic oil temperature information G2.
- the first information may be only one of the cooling water temperature information G3 and the hydraulic oil temperature information G2, or may be information about the working unit 31 in operation, such as is displayed in the sixth area R6. may contain.
- the above arrangement and size of the remaining amount display area R1 and the switching display area R2 are merely examples, and can be changed as appropriate.
- the switching display area R2 may be arranged in the peripheral area, and the remaining amount display area R1 may be arranged in the central area.
- at least one of the remaining amount display area R1 and the switching display area R2 may be omitted as appropriate.
- a display system 10A according to the present embodiment differs from the display system 10 according to the first embodiment in that, as shown in FIG. 10, the display system 10A is provided separately from the body 30 of the work machine 3A.
- configurations similar to those of the first embodiment are denoted by common reference numerals, and descriptions thereof are omitted as appropriate.
- the work machine 3A operates (autonomously travels) by automatic operation.
- work machine 3A has a position detection unit that detects the position (latitude and longitude) of aircraft 30 using a satellite positioning system such as GNSS (Global Navigation Satellite System), and measures the attitude of work machine 3A. It includes a posture detection unit and the like for detecting.
- GNSS Global Navigation Satellite System
- a display system 10A including the display control system 1A and the display device 2A is realized by a tablet terminal or the like arranged outside the working machine 3A.
- the display control system 1A includes a communication section 14.
- the body 30 of the working machine 3A has a body side communication section 38 .
- the communication unit 14 and the body-side communication unit 38 are configured to be able to communicate with each other via a communication network N1 such as the Internet.
- the display screen D1 similar to that of the first embodiment is displayed on the display device 2A through communication with the machine body 30. be able to.
- the work machine 3A is not limited to being configured to operate by automatic operation, and may be operated by remote control by a user (operator). In this case, for example, the user remotely operates the work machine 3A while viewing the display screen D1 displayed on the display device 2A.
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Mining & Mineral Resources (AREA)
- Structural Engineering (AREA)
- Civil Engineering (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Hardware Design (AREA)
- Component Parts Of Construction Machinery (AREA)
- Closed-Circuit Television Systems (AREA)
- Controls And Circuits For Display Device (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
Description
[1]全体構成
本実施形態に係る作業機械用表示制御システム1(以下、単に「表示制御システム1」という)は、図1及び図2に示すように、例えばバックホー等の作業機械3に関連する情報の表示に用いられる。表示制御システム1は、表示装置2を制御することにより、表示装置2に表示画面D1(図2参照)を表示させる。本実施形態では一例として、表示装置2は、作業機械3の機体30に搭載されており、作業機械3を操作するユーザ(オペレータ)に向けて表示画面D1にて種々の情報を提示する。つまり、作業機械3を操作するユーザは、表示装置2に表示される表示画面D1を見ることで、作業機械3に関連する種々の情報を視覚的に得ることが可能である。
本開示でいう「作業機械」は、各種の作業用の機械を意味し、一例として、バックホー(油圧ショベル、ミニショベル等を含む)、ホイルローダー及びキャリア等の作業車両である。作業機械3は、「車両」に限らず、例えば、作業用船舶、ドローン又はマルチコプター等の作業飛翔体等であってもよい。さらに、作業機械3は建設機械(建機)に限らず、例えば、田植機、トラクタ又はコンバイン等の農業機械(農機)であってもよい。本実施形態では、特に断りが無い限り、作業機械3が乗用タイプのバックホーであって、掘削作業、整地作業、溝掘削作業又は積込作業等を作業として実行可能である場合を例に挙げて説明する。
次に、作業機械3の機体30の構成について、図1を参照して説明する。作業機械3は、作業部31と、旋回部32と、走行部33と、を機体30に備えている。本実施形態では、機体30は、冷却水温センサ34、作動油温センサ35、カメラ36及びエンジン37等を更に備えている。
次に、表示システム10の構成について、図1及び図2を参照して詳細に説明する。表示システム10は、上述したように表示制御システム1と、表示装置2と、を備えている。本実施形態では一例として、表示制御システム1及び表示装置2は1つの筐体に収容されており、表示システム10は、図2に示すように、1つの筐体内に全ての機能が集約されていることとする。
以下、図3~図8を参照しつつ、主として表示制御システム1によって実行される作業機械用表示制御方法(以下、単に「表示制御方法」という)の一例について説明する。つまり、本実施形態に係る表示制御方法は、以下に説明する表示画面D1を、表示装置2に表示させること(処理)を有する。
ここではまず、表示制御方法によって表示装置2の表示部21に表示される表示画面D1の構成について説明する。図3等の表示装置2の表示部21に表示される表示画面D1を示す図面において、領域を表す一点鎖線、引出線及び参照符号は、いずれも説明のために付しているに過ぎず、実際に表示装置2に表示される訳ではない。さらに、図3においては、表示画面D1の中心C1を示す「点」を表記しているが、この「点」も実際には表示装置2に表示されない仮想点である。
これにより、ユーザにとっては、表示画面D1の切替表示領域R2に表示される第1情報から、作業機械3の稼働状態を把握することができる。さらに、本実施形態では、第1情報は、稼働状態を指数化して表す情報である。そのため、ユーザにとっては、作業機械3の稼働状態を詳細に把握することができる。
次に、表示制御方法に係る処理の全体の流れについて、図8を参照して説明する。図8は、表示制御方法に係る処理の一例を示すフローチャートである。
以下、実施形態1の変形例を列挙する。以下に説明する変形例は、適宜組み合わせて適用可能である。
本実施形態に係る表示システム10Aは、図10に示すように、作業機械3Aの機体30と別に設けられている点で、実施形態1に係る表示システム10と相違する。以下、実施形態1と同様の構成については、共通の符号を付して適宜説明を省略する。
Claims (13)
- 作業機械の稼働に伴って消費される監視対象物の残量に関する残量情報を表示する残量表示領域と、
少なくとも前記作業機械に関連する第1情報及び第2情報を含む複数の情報の中から切替可能に選択される表示対象情報を表示する切替表示領域と、を含む表示画面を、
表示装置に表示させる表示処理部を備え、
前記切替表示領域は、前記表示画面の中心を含む中央エリアに配置され、
前記残量表示領域は、前記表示画面の前記中央エリアの周囲に位置する周辺エリアに配置される、
作業機械用表示制御システム。 - 前記表示処理部は、少なくとも前記第1情報が前記切替表示領域に表示されていない状態において、前記第1情報に関連する提示情報を前記表示画面に表示する、
請求項1に記載の作業機械用表示制御システム。 - 前記表示処理部は、前記提示情報を、前記表示画面における前記切替表示領域以外の位置に表示する、
請求項2に記載の作業機械用表示制御システム。 - 前記表示処理部は、前記提示情報を、前記表示画面における前記残量表示領域の下方に表示する、
請求項3に記載の作業機械用表示制御システム。 - 前記提示情報は、前記第1情報に関連する図像を含む、
請求項2~4のいずれか1項に記載の作業機械用表示制御システム。 - 前記第1情報は、前記作業機械の稼働状態に関する情報である、
請求項1~5のいずれか1項に記載の作業機械用表示制御システム。 - 前記第1情報は、前記稼働状態を指数化して表す情報である、
請求項6項に記載の作業機械用表示制御システム。 - 前記第2情報は、前記作業機械の周辺画像を含む情報である、
請求項1~7のいずれか1項に記載の作業機械用表示制御システム。 - 前記表示処理部は、
第1モード及び第2モードを含む複数の表示モードを有し、
前記第1モードでは、前記中央エリアに前記切替表示領域、前記周辺エリアに前記残量表示領域をそれぞれ配置し、
前記第2モードでは、前記残量表示領域を非表示とし、前記中央エリア及び前記周辺エリアに跨って前記切替表示領域を配置する、
請求項1~8のいずれか1項に記載の作業機械用表示制御システム。 - 請求項1~9のいずれか1項に記載の作業機械用表示制御システムと、
前記表示画面を表示する前記表示装置と、を備える、
作業機械用表示システム。 - 請求項10に記載の作業機械用表示システムと、
前記表示装置が搭載される機体と、を備える、
作業機械。 - 表示画面の中心を含む中央エリアの周囲に位置する周辺エリアに配置され、作業機械の稼働に伴って消費される監視対象物の残量に関する残量情報を表示する残量表示領域と、
前記表示画面の前記中央エリアに配置され、少なくとも前記作業機械に関連する第1情報及び第2情報を含む複数の情報の中から切替可能に選択される表示対象情報を表示する切替表示領域と、
を含む前記表示画面を、表示装置に表示させることを有する、
作業機械用表示制御方法。 - 表示画面の中心を含む中央エリアの周囲に位置する周辺エリアに配置され、作業機械の稼働に伴って消費される監視対象物の残量に関する残量情報を表示する残量表示領域と、
前記表示画面の前記中央エリアに配置され、少なくとも前記作業機械に関連する第1情報及び第2情報を含む複数の情報の中から切替可能に選択される表示対象情報を表示する切替表示領域と、
を含む前記表示画面を、表示装置に表示させること、
を1以上のプロセッサに実行させるための作業機械用表示制御プログラム。
Priority Applications (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020237026929A KR20230144022A (ko) | 2021-02-12 | 2022-01-20 | 작업 기계용 표시 제어 시스템, 작업 기계용 표시 시스템,작업 기계, 작업 기계용 표시 제어 방법 및 작업 기계용 표시 제어 프로그램 |
CN202280014378.XA CN116829791A (zh) | 2021-02-12 | 2022-01-20 | 作业机械用显示控制系统、作业机械用显示系统、作业机械、作业机械用显示控制方法以及作业机械用显示控制程序 |
US18/276,437 US20240301663A1 (en) | 2021-02-12 | 2022-01-20 | Work Machine Display Control System, Work Machine Display System, Work Machine, Work Machine Display Control Method, And Work Machine Display Control Program |
EP22752547.4A EP4293163A1 (en) | 2021-02-12 | 2022-01-20 | Work machine display control system, work machine display system, work machine, work machine display control method, and work machine display control program |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2021020877A JP7438999B2 (ja) | 2021-02-12 | 2021-02-12 | 作業機械用表示制御システム、作業機械用表示システム、作業機械、作業機械用表示制御方法及び作業機械用表示制御プログラム |
JP2021-020877 | 2021-02-12 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2022172716A1 true WO2022172716A1 (ja) | 2022-08-18 |
Family
ID=82838729
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2022/001922 WO2022172716A1 (ja) | 2021-02-12 | 2022-01-20 | 作業機械用表示制御システム、作業機械用表示システム、作業機械、作業機械用表示制御方法及び作業機械用表示制御プログラム |
Country Status (6)
Country | Link |
---|---|
US (1) | US20240301663A1 (ja) |
EP (1) | EP4293163A1 (ja) |
JP (2) | JP7438999B2 (ja) |
KR (1) | KR20230144022A (ja) |
CN (1) | CN116829791A (ja) |
WO (1) | WO2022172716A1 (ja) |
Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2005163370A (ja) | 2003-12-02 | 2005-06-23 | Hitachi Constr Mach Co Ltd | 建設機械の画像表示装置 |
JP2007046241A (ja) * | 2005-08-05 | 2007-02-22 | Komatsu Ltd | 作業用車両に搭載される表示装置、及び同表示装置の表示方法 |
JP2011241631A (ja) * | 2010-05-19 | 2011-12-01 | Hitachi Constr Mach Co Ltd | 建設機械の表示装置 |
WO2015163381A1 (ja) * | 2014-04-25 | 2015-10-29 | 住友建機株式会社 | 建設機械 |
WO2015163382A1 (ja) * | 2014-04-25 | 2015-10-29 | 住友建機株式会社 | 建設機械及び建設機械の制御方法 |
JP2015209691A (ja) * | 2014-04-25 | 2015-11-24 | 住友建機株式会社 | 建設機械 |
JP2020105883A (ja) * | 2018-12-28 | 2020-07-09 | 株式会社クボタ | 表示制御装置、作業機、プログラム、及びその記録媒体 |
Family Cites Families (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN108026715B (zh) * | 2015-09-15 | 2021-06-18 | 住友建机株式会社 | 挖土机 |
-
2021
- 2021-02-12 JP JP2021020877A patent/JP7438999B2/ja active Active
-
2022
- 2022-01-20 EP EP22752547.4A patent/EP4293163A1/en active Pending
- 2022-01-20 WO PCT/JP2022/001922 patent/WO2022172716A1/ja active Application Filing
- 2022-01-20 CN CN202280014378.XA patent/CN116829791A/zh active Pending
- 2022-01-20 US US18/276,437 patent/US20240301663A1/en active Pending
- 2022-01-20 KR KR1020237026929A patent/KR20230144022A/ko unknown
-
2024
- 2024-02-14 JP JP2024019945A patent/JP2024059701A/ja active Pending
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2005163370A (ja) | 2003-12-02 | 2005-06-23 | Hitachi Constr Mach Co Ltd | 建設機械の画像表示装置 |
JP2007046241A (ja) * | 2005-08-05 | 2007-02-22 | Komatsu Ltd | 作業用車両に搭載される表示装置、及び同表示装置の表示方法 |
JP2011241631A (ja) * | 2010-05-19 | 2011-12-01 | Hitachi Constr Mach Co Ltd | 建設機械の表示装置 |
WO2015163381A1 (ja) * | 2014-04-25 | 2015-10-29 | 住友建機株式会社 | 建設機械 |
WO2015163382A1 (ja) * | 2014-04-25 | 2015-10-29 | 住友建機株式会社 | 建設機械及び建設機械の制御方法 |
JP2015209691A (ja) * | 2014-04-25 | 2015-11-24 | 住友建機株式会社 | 建設機械 |
JP2020105883A (ja) * | 2018-12-28 | 2020-07-09 | 株式会社クボタ | 表示制御装置、作業機、プログラム、及びその記録媒体 |
Also Published As
Publication number | Publication date |
---|---|
US20240301663A1 (en) | 2024-09-12 |
CN116829791A (zh) | 2023-09-29 |
EP4293163A1 (en) | 2023-12-20 |
JP2024059701A (ja) | 2024-05-01 |
JP2022123518A (ja) | 2022-08-24 |
KR20230144022A (ko) | 2023-10-13 |
JP7438999B2 (ja) | 2024-02-27 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20140189585A1 (en) | Information Display System for a Machine | |
JPWO2017191853A1 (ja) | 作業機械の表示装置及び表示システム | |
WO2020138462A1 (ja) | 表示制御装置、作業機、プログラム、及びその記録媒体 | |
JP2024045756A (ja) | 作業機械用表示制御システム、作業機械用表示システム、作業機械、作業機械用表示制御方法及び作業機械用表示制御プログラム | |
US11941313B2 (en) | Working machine control device, working machine, and working machine control method for performing screen control based on identified position | |
EP4365377A1 (en) | Work machine control method, work machine control program, work machine control system, and work machine | |
JP2020105883A (ja) | 表示制御装置、作業機、プログラム、及びその記録媒体 | |
WO2022172716A1 (ja) | 作業機械用表示制御システム、作業機械用表示システム、作業機械、作業機械用表示制御方法及び作業機械用表示制御プログラム | |
EP4293165A1 (en) | Work machine control method, work machine control program, work machine control system, and work machine | |
EP4293164A1 (en) | Work machine control method, work machine control program, work machine control system, and work machine | |
JP7480263B2 (ja) | 表示制御装置及びこれを備えた作業機 | |
KR20230167299A (ko) | 작업 기계의 제어 방법, 작업 기계용 제어 프로그램, 작업 기계용 제어 시스템 및 작업 기계 | |
EP4134493A1 (en) | Method for controlling work machine, work machine control program, and work machine control system | |
JP2020104812A (ja) | 表示制御装置、作業機、プログラム、及びその記録媒体 | |
JP2020104810A (ja) | 表示制御装置、作業機、プログラム、及びその記録媒体 | |
JP2023074223A (ja) | 作業機械の制御方法、作業機械用制御プログラム、作業機械用制御システム及び作業機械 | |
JP2023074222A (ja) | 作業機械の制御方法、作業機械用制御プログラム、作業機械用制御システム及び作業機械 | |
JP2023074224A (ja) | 作業機械の制御方法、作業機械用制御プログラム、作業機械用制御システム及び作業機械 | |
JP4758319B2 (ja) | 建設機械 | |
KR20240125437A (ko) | 작업 기계의 제어 방법, 작업 기계용 제어 프로그램, 작업 기계용 제어 시스템 및 작업 기계 | |
JP2020104813A (ja) | 表示制御装置、作業機、プログラム、及びその記録媒体 | |
JP2022163352A (ja) | 作業機械の制御方法、作業機械用制御プログラム、作業機械用制御システム及び作業機械 | |
JP2024069887A (ja) | 作業機械の制御方法、作業機械用制御プログラム、作業機械用制御システム及び作業機械 | |
JP2021110134A (ja) | 作業機械 | |
JP2020017958A (ja) | 作業機械の制御装置及び作業機械の制御方法 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 22752547 Country of ref document: EP Kind code of ref document: A1 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 18276437 Country of ref document: US |
|
WWE | Wipo information: entry into national phase |
Ref document number: 202280014378.X Country of ref document: CN |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2022752547 Country of ref document: EP |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
ENP | Entry into the national phase |
Ref document number: 2022752547 Country of ref document: EP Effective date: 20230912 |