EP3995633A1 - System and method for work state estimation and control of self-propelled work vehicles - Google Patents

System and method for work state estimation and control of self-propelled work vehicles Download PDF

Info

Publication number
EP3995633A1
EP3995633A1 EP21202273.5A EP21202273A EP3995633A1 EP 3995633 A1 EP3995633 A1 EP 3995633A1 EP 21202273 A EP21202273 A EP 21202273A EP 3995633 A1 EP3995633 A1 EP 3995633A1
Authority
EP
European Patent Office
Prior art keywords
self
work
work vehicle
propelled
parameter
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
EP21202273.5A
Other languages
German (de)
French (fr)
Inventor
Dipankar D. Dongare
Dnyaneshwar JAGTAP
Rushikesh JADHAV
Lance R Sherlock
Mahesh Sorate
Sanket Pawar
Vaibhav Bhutad
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Deere and Co
Original Assignee
Deere and Co
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US17/143,219 external-priority patent/US12024173B2/en
Application filed by Deere and Co filed Critical Deere and Co
Publication of EP3995633A1 publication Critical patent/EP3995633A1/en
Pending legal-status Critical Current

Links

Images

Classifications

    • EFIXED CONSTRUCTIONS
    • E02HYDRAULIC ENGINEERING; FOUNDATIONS; SOIL SHIFTING
    • E02FDREDGING; SOIL-SHIFTING
    • E02F9/00Component parts of dredgers or soil-shifting machines, not restricted to one of the kinds covered by groups E02F3/00 - E02F7/00
    • E02F9/26Indicating devices
    • E02F9/264Sensors and their calibration for indicating the position of the work tool
    • E02F9/265Sensors and their calibration for indicating the position of the work tool with follow-up actions (e.g. control signals sent to actuate the work tool)
    • EFIXED CONSTRUCTIONS
    • E02HYDRAULIC ENGINEERING; FOUNDATIONS; SOIL SHIFTING
    • E02FDREDGING; SOIL-SHIFTING
    • E02F9/00Component parts of dredgers or soil-shifting machines, not restricted to one of the kinds covered by groups E02F3/00 - E02F7/00
    • E02F9/20Drives; Control devices
    • E02F9/22Hydraulic or pneumatic drives
    • E02F9/2246Control of prime movers, e.g. depending on the hydraulic load of work tools

Definitions

  • the present disclosure relates generally to self-propelled work vehicles such as construction and forestry machines, and more particularly to systems and methods for work state estimation and control of certain operations of such self-propelled work vehicles.
  • Self-propelled work vehicles of this type may for example include excavator machines, forestry machines, front shovel machines, and others. These machines may typically have tracked ground engaging units supporting the undercarriage from the ground surface.
  • engine speed dials or equivalent interface tools 116 to set engine speeds, based for example on the type of operation being performed by the work vehicle, and frequently further based on operator preference.
  • operators may typically set these engine speeds dials on their high idle (i.e., maximum) set point settings, irrespective of the work being done and the load on self-propelled work vehicle, rather than continuously adjusting the engine speed manually. This understandably produces substantial waste of fuel and reduced productivity.
  • the current disclosure provides an enhancement to conventional systems, at least in part by introducing a novel system and method for estimating at least the work state of a self-propelled work vehicle at a given time, and accordingly implementing automation of certain vehicle operations and associated functions.
  • a computer-implemented method as disclosed herein for controlling one or more aspects of a self-propelled work vehicle comprising a plurality of ground engaging units and at least one work implement configured for controllably working terrain.
  • One or more operator commands are received regarding at least a first parameter or operation of the self-propelled work vehicle.
  • a work state of the self-propelled work vehicle is automatically determined, based at least in part on respective input signals from one or more onboard sensors, and a control signal is generated for controlling at least a second parameter or operation of the self-propelled work vehicle, responsive to the one or more operator commands and the determined work state.
  • the determining of a work state of the self-propelled work vehicle comprises classifying sequences of data from one or more onboard sensors into different predetermined work states, receiving input signals from at least one of the one or more onboard sensors, and predicting the work state based a comparison of the received input signals to the classified sequences of data.
  • the method further comprises, for a particular predicted work state, determining a current parameter or operation based on input signals from at least one of the one or more onboard sensors, predicting a next parameter or operation corresponding to the predicted work state and the determined current parameter or operation, and generating the control signal for controlling at least the second parameter or operation of the self-propelled work vehicle based on the predicted next parameter or operation.
  • the determining of a work state of the self-propelled work vehicle comprises classifying sequences of operator commands and data from one or more onboard sensors into different predetermined work states, receiving a sequence comprising at least one operator command and at least one input signal from an onboard sensors, and predicting the work state based a comparison of the received sequence to the classified sequences of operator commands and data.
  • the generated control signal is configured to control movements of at least one work implement, based on a detected position of the at least one work implement and further responsive to the one or more operator commands and the determined work state.
  • the one or more operator commands relate to at least swing operation commands regarding the at least one work implement, and control signals are generated for controlling movements of at least a boom and an arm associated with the swing operation, further responsive to the determined work state
  • the generated control signal is configured to control movements of the self-propelled work vehicle via the one or more ground engaging units, based on a detected position and/or orientation of at least one portion of the self-propelled work vehicle and further responsive to the one or more operator commands and the determined work state.
  • At least one of the one or more onboard sensors is configured to generate signals representing a work load, and the generated control signal is configured to control an engine speed of the self-propelled work vehicle, responsive to the one or more operator commands, the determined work state, and a determined work load.
  • the input signals from at least one of the one or more onboard sensors are representative of one or more of: a movement sequence for at least one of the one or more work implements; a location of the self-propelled work vehicle; and a plane of a ground surface upon which the self-propelled work vehicle is supported.
  • the operator commands are received via at least one of the one or more onboard sensors.
  • the operator commands are received via a user interface associated with an onboard computing device.
  • one or more further operator commands via the user interface selectively enable or disable the generated control signal for controlling at least the second parameter or operation of the self-propelled work vehicle.
  • a self-propelled work vehicle is provided with a plurality of ground engaging units, at least one work implement configured for controllably working terrain, one or more onboard sensors, and a controller functionally linked to at least the one or more onboard sensors and the user interface.
  • the controller is further configured to perform a method according to the above-referenced embodiment and optionally any of the associated aspects.
  • Fig. 1 in a particular embodiment as disclosed herein shows a representative self-propelled work vehicle in the form of, for example, a tracked excavator machine 20.
  • the working machine 20 includes an undercarriage 22 including first and second ground engaging units 24 including first and second travel motors (not shown) for driving the first and second ground engaging units 24, respectively.
  • a main frame 32 is supported from the undercarriage 22 by a swing bearing 34 such that the main frame 32 is pivotable about a pivot axis 36 relative to the undercarriage 22.
  • the pivot axis 36 is substantially vertical when a ground surface 38 engaged by the ground engaging units 24 is substantially horizontal.
  • a swing motor (not shown) is configured to pivot the main frame 32 on the swing bearing 34 about the pivot axis 36 relative to the undercarriage 22.
  • a work implement 42 in the context of the referenced work vehicle 20 includes a boom assembly 42 with a boom 44, an arm 46 pivotally connected to the boom 44, and a working tool 48.
  • the boom 44 is pivotally attached to the main frame 32 to pivot about a generally horizontal axis relative to the main frame 32.
  • the working tool in this embodiment is an excavator shovel 48 which is pivotally connected to the arm 46.
  • the boom assembly 42 extends from the main frame 32 along a working direction of the boom assembly 42.
  • the working direction can also be described as a working direction of the boom 44.
  • control of the work implement 42 may relate to control of any one or more of the associated components (e.g., boom 44, arm 46, tool 48).
  • the first and second ground engaging units 24 are tracked ground engaging units.
  • Each of the tracked ground engaging units 24 includes a front idler 52, a drive sprocket 54, and a track chain 56 extending around the front idler 52 and the drive sprocket 54.
  • the travel motor of each tracked ground engaging unit 24 drives its respective drive sprocket 54.
  • Each tracked ground engaging unit 24 has a forward traveling direction 58 defined from the drive sprocket 54 toward the front idler 52.
  • the forward traveling direction 58 of the tracked ground engaging units 24 also defines a forward traveling direction 58 of the undercarriage 22 and thus of the working machine 20.
  • An operator's cab 60 may be located on the main frame 32.
  • the operator's cab 60 and the boom assembly 42 may both be mounted on the main frame 32 so that the operator's cab 60 faces in the working direction 58 of the boom assembly.
  • a control station 62 may be located in the operator's cab 60.
  • the engine 64 may be a diesel internal combustion engine.
  • the engine 64 may drive a hydraulic pump to provide hydraulic power to the various operating systems of the working machine 20.
  • the self-propelled work vehicle 20 includes a control system including a controller 112.
  • the controller may be part of the machine control system of the working machine, or it may be a separate control module.
  • the controller 112 may include a user interface 114 and optionally be mounted in the operator's cab 60 at the control station 62.
  • the controller 112 is configured to receive input signals from some or all of various sensors collectively defining a sensor system 104, individual examples of which may be described below.
  • Various sensors on the sensor system 104 may typically be discrete in nature, but signals representative of more than one input parameter may be provided from the same sensor, and the sensor system 104 may further refer to signals provided from the machine control system.
  • the controller 112 may be configured to produce outputs, as further described below, to the user interface 114 for display to the human operator.
  • the controller 112 may further or in the alternative be configured to generate control signals for controlling the operation of respective actuators, or signals for indirect control via intermediate control units, associated with a machine steering control system 126, a machine implement control system 128, and an engine speed control system 130.
  • the controller 112 may for example generate control signals for controlling the operation of various actuators, such as hydraulic motors or hydraulic piston-cylinder units 124, and electronic control signals from the controller 112 may actually be received by electro-hydraulic control valves associated with the actuators such that the electro-hydraulic control valves will control the flow of hydraulic fluid to and from the respective hydraulic actuators to control the actuation thereof in response to the control signal from the controller 112.
  • actuators such as hydraulic motors or hydraulic piston-cylinder units 124
  • electro-hydraulic control valves associated with the actuators such that the electro-hydraulic control valves will control the flow of hydraulic fluid to and from the respective hydraulic actuators to control the actuation thereof in response to the control signal from the controller 112.
  • the controller 112 includes or may be associated with a processor 150, a computer readable medium 152, a communication unit 154, data storage 156 such as for example a database network, and the aforementioned user interface 114 or control panel 114 having a display 118.
  • An input/output device 116 such as a keyboard, joystick or other user interface tool 116, is provided so that the human operator may input instructions to the controller. It is understood that the controller 112 described herein may be a single controller having all of the described functionality, or it may include multiple controllers wherein the described functionality is distributed among the multiple controllers.
  • Various operations, steps or algorithms as described in connection with the controller 112 can be embodied directly in hardware, in a computer program product such as a software module executed by the processor 150, or in a combination of the two.
  • the computer program product can reside in RAM memory, flash memory, ROM memory, EPROM memory, EEPROM memory, registers, hard disk, a removable disk, or any other form of computer-readable medium 152 known in the art.
  • An exemplary computer-readable medium 152 can be coupled to the processor 150 such that the processor 150 can read information from, and write information to, the memory/ storage medium 152.
  • the medium 152 can be integral to the processor 150.
  • the processor 150 and the medium 152 can reside in an application specific integrated circuit (ASIC).
  • the ASIC can reside in a user terminal.
  • the processor 150 and the medium 152 can reside as discrete components in a user terminal.
  • processor 150 may refer to at least general-purpose or specific-purpose processing devices and/or logic as may be understood by one of skill in the art, including but not limited to a microprocessor, a microcontroller, a state machine, and the like.
  • a processor 150 can also be implemented as a combination of computing devices, e.g., a combination of a DSP and a microprocessor, a plurality of microprocessors, one or more microprocessors in conjunction with a DSP core, or any other such configuration.
  • the communication unit 154 may support or provide communications between the controller 112 and external systems or devices, and/or support or provide communication interface with respect to internal components of the self-propelled work vehicle 20, 120.
  • the communications unit may include wireless communication system components (e.g., via cellular modem, WiFi, Bluetooth or the like) and/or may include one or more wired communications terminals such as universal serial bus ports.
  • the data storage 156 may, unless otherwise stated, generally encompass hardware such as volatile or non-volatile storage devices, drives, memory, or other storage media, as well as one or more databases residing thereon.
  • a tracked forestry machine 120 such as a feller buncher for the harvesting of trees. Similar to the excavator type of work vehicle 20 previously described, the tracked forestry machine 120 has an undercarriage 22, first and second tracked ground engaging units 24, main frame 32, swing bearing 34, and boom assembly 42.
  • the forestry machine 120 may include the same control system as described with regard to Fig. 3 to control the orientation of its undercarriage 22 relative to the ground surface 38, and to control the orientation of its main frame 32 and boom assembly 42 relative to its undercarriage 22.
  • the forestry machine 120 may often be operated on very uneven ground such as when harvesting trees in a mountainous area. Accordingly the forestry machine 120 may include a leveling mechanism 122 including a plurality of linear actuators which may be in the form of hydraulic piston-cylinder units 124 to adjust a pitch and roll of the swing bearing 34 and thus the main frame 32 relative to the undercarriage 22.
  • a leveling mechanism 122 including a plurality of linear actuators which may be in the form of hydraulic piston-cylinder units 124 to adjust a pitch and roll of the swing bearing 34 and thus the main frame 32 relative to the undercarriage 22.
  • the pivotal axis 36 is defined by the swing bearing 34 and a pivot angle sensor (not shown) may be mounted between upper and lower rings (not shown) of the swing bearing 34.
  • FIG. 4 an exemplary and high-level method 400 may now be described, followed by more particular examples of methods as disclosed herein and with further reference to Figures 5- 9 .
  • the method 400 includes receiving operator commands, via for example the user interface 114, regarding at least a first parameter or operation, or a first sequence of parameters or operations (step 410).
  • One or more sensor inputs are received (step 412) from respective sources in the sensor system 104 are further processed along with the operator commands to ascertain a work state and/or work load (step 414) for the self-propelled work vehicle 20, 120.
  • the ascertained work state and/or work load, along with the received operator commands, are further processed to generate control signals (step 416) regarding at least a second parameter or operation (or sequence of parameters or operations) for automation in conjunction with the first parameter or operation (or sequence of parameters or operations).
  • the control signals may be provided to any one or more of the steering control system 126, the implement control system 128, and the engine speed control system 130 depending on the relevant application.
  • Figure 5 relates to an embodiment of the method 400 wherein a desired engine speed is calculated in step 416 and implemented for automated engine speed control (via e.g. the engine speed control system 130) based on work state and work load determinations in step 414.
  • the work load measurement 413 may be provided via work load inputs 412 from a payload weighing system 104j of the sensor system 104.
  • the work load may refer to log weight, and work load measurement 413 may for example be provided via work load inputs 412 from a head pressure sensor 104a.
  • the work state identification 414 in a forestry work vehicle 120 may be performed in some embodiments through direct implementation of vehicle sensors 104 including, e.g., the head pressure sensor 104a to detect attachment load, a ground plane position sensor 104b such as an inertial measurement unit (IMU) for estimating desired power while on the move, operator commands 104c received via a joystick button 116 or equivalent input/output device 116 for receiving operator commands 410 via the user interface 114, a saw position sensor 104d in the work tool 48 such as the harvester head, etc.
  • vehicle sensors 104 including, e.g., the head pressure sensor 104a to detect attachment load, a ground plane position sensor 104b such as an inertial measurement unit (IMU) for estimating desired power while on the move, operator commands 104c received via a joystick button 116 or equivalent input/output device 116 for receiving operator commands 410 via the user interface 114, a saw position sensor 104d in the work tool 48 such as the harvester head, etc.
  • the work state identification 414 may be provided using onboard machine learning algorithms.
  • training inputs may be provided to the machine learning model corresponding to time series data values for one or more of: left/ right drive pressure 104e; boom raise/ lower pressure 104f; arm in/out pressure 104g; swing left/ right pressure 104h; engine speed and load 104i; and operator commands 104c, wherein the model is further verified over time using test data inputs which may relate to the same or analogous sources.
  • work state estimation as disclosed herein may encompass the classifying of sequences of data recorded by sensors into defined machine states.
  • an exemplary sequence of work states may include Dig, Swing, Dump, Adjust to Dump, and Travel.
  • Work state estimation may be treated a classical sequence classification problem, addressed in an embodiment as disclosed herein by building supervised Machine Learning (ML)/ Deep Learning (DL) classification algorithms like Logistic Regression and Long Short-Term Memory (LSTM) recurrent neural network models for sequence classification.
  • ML Machine Learning
  • DL Deep Learning
  • LSTM Logistic Regression and Long Short-Term Memory
  • the LSTM models are capable of learning from internal representations of the time series data, effectively remembering over long sequences of input data and previous operation of the self-propelled work vehicle 20, 120.
  • the LSTM models may accordingly be trained on time series data (exemplary inputs as noted above) and observe loss and accuracy values over N training iterations, wherein losses are decreased and accuracy increased over time.
  • the model may be described as classifying these time series data into defined work states
  • the time series data may for example be streamed from the respective sensors/ data sources 104, 410, 412 on a work vehicle 20, 120 (or a plurality of analogous work vehicles) via a communications network onto a cloud server network, wherein the model is developed (i.e., trained and validated) at the cloud server level.
  • the model Once the model has been sufficiently validated, it may be transmitted, for example via the communications network, and deployed by the controller 112 onboard a work vehicle 20, 120 for subsequent work state estimation and work load estimation.
  • the cloud server network may however continue to receive input time series data from the work vehicle 20, 120 (or plurality of analogous work vehicles) for the purpose of further refining the model, wherein updated versions of the model may be transmitted to the work vehicle 20, 120 periodically or on demand.
  • the controller 112 implementing a work state estimation model as disclosed herein may be configured to distinguish various causes of detected loading based on operations of the work vehicle and components thereof, each operation having, e.g., a corresponding maximum power (pressure/ flow) requirement based on past data and/or work tool specifications, and accordingly calculating a target engine speed correlating to a reference engine speed for the defined work state and further based on a sensed load, predetermined weight factors, minimum and/or maximum engine speed settings, and the like.
  • a forestry work vehicle 120 may be associated with causes of loading including (but not limited to) a boom operation, a head operation, and a transmission operation. These causes of loading may be respectively correlated with sensor inputs corresponding to operations including but not limited to: (a) Grab/ Hold Stem; (b) Lift; (c) Grab and Left Stem; (d) Dump Stem; (e) Lift and Move; (f) Travel without Load (potentially distinguishing between flat and sloped terrain); (g) Travel with Load; (h) Travel While Handling Stem; (i) Stem Cut; and (j) Stem Cut with Grapple Pressure (for example improve the hold on the stem).
  • a first cause of loading may be correlated with the aforementioned operations: (b), (c), (e), (f), and/or (h).
  • a second cause of loading (head operation) may be correlated with the aforementioned operations: (a), (c), (d), (g), (h), (i), and/or (j).
  • a third cause of loading (transmission operation) may be correlated with the aforementioned operations: (e), (g), and/or (h).
  • work state estimation and work load estimation may also (or in the alternative) be implemented for implement and/or steering control functions via the implement control system 128 and/or steering control system 126, respectively.
  • an exemplary operation cycle may be divided into four segments: excavation of the material at an excavation point; travel from the excavation point to a dumping point; dumping of the material at the dumping point; and traveling from the dumping point back to the excavation point.
  • the excavator 20 is merely discussed herein as illustrative, and numerous other self-propelled work vehicles may perform similar operations such as knuckleboom loaders, tracked feller bunchers, swing machine log loaders, forwarders, and the like.
  • the actual excavation of material and the dumping of material may be considered as optimally performed by the operator, but the traveling functions may comprise repetitive movements of implement components (e.g., a bucket, tilted bucket, grapple, etc.), which may be optimally automated during the excavation process.
  • implement components e.g., a bucket, tilted bucket, grapple, etc.
  • work implement positioning is automated by the controller 112 based upon estimated work state and detected work implement positions, wherein a first movement or sequence of movements (e.g., corresponding to the swing of the boom) are controlled directly by the operator and used as a trigger for automatic control of a second movement of sequence of movements (e.g., the work implement positioning).
  • a first movement or sequence of movements e.g., corresponding to the swing of the boom
  • a second movement of sequence of movements e.g., the work implement positioning
  • the user interface 114 may be configured for enabling the automated control functions via a button or equivalent on/off actuator.
  • the user interface 114 may further be configured for enabling the operator to override the automated control functions, or alternatively such an override may be implemented by the operator simply carrying out the functions manually according to the conventional techniques, such as for example manual boom 44 or arm 46 commands using the relevant joysticks.
  • rules-based work state estimation 414 for the excavator work vehicle 20 may be provided, with exemplary inputs in this context provided from a payload weighing system 104j, a ground plane position sensor (e.g., IMU) 104k, an angle sensor 104L for one or more of the boom 44, the arm 46, and the work tool 48 (e.g., bucket), and inputs from the user interface 114 corresponding to operator commands 104c.
  • a payload weighing system 104j e.g., IMU
  • IMU ground plane position sensor
  • angle sensor 104L for one or more of the boom 44, the arm 46, and the work tool 48 (e.g., bucket)
  • a first cycle of the method may include recording of an excavation location and a dump location based on work state identification. Even after the initial recording/ recognition cycle, as previously noted, the actual process of dumping material may optimally be left to the operator, such that the system merely processes input data and operator commands and accordingly identifies a Digging work state (step 902), after which a received operator command corresponding to a Swing to Dump work state (step 904) triggers the system for automated control of the boom 44 and of the arm 46 to the recorded dumping location (step 906).
  • the Digging work state may for example be ascertained based on inputs from a payload weighing system 104j corresponding with a load, from a pressure sensor associated with the arm 46, boom 44, and/or working tool 48, and further based on implement component positions (via IMU 104k and/or angle sensors 104L).
  • the Swing to Dump work state may for example be ascertained based on an operator swing command with a detected load, and inputs from a swing motor pressure sensor and further based on the implement component positions (via IMU 104k and/or angle sensors 104L).
  • the actual step of dumping may also optimally be left to the operator, such that the system merely processes input data and operator commands and accordingly identifies a Dumping work state (step 908), after which a received operator Swing to Dig command (step 910) triggers the system for automated control of the boom 44 and of the arm 46 to the recorded excavation location (step 912).
  • the Dumping work state may for example be ascertained based on inputs from a payload weighing system 104j corresponding with no load, from a pressure sensor associated with the arm 46, boom 44, and/or working too 48, and further based on implement component positions (via IMU 104k and/or angle sensors 104L).
  • the Swing to Dig work state may for example be ascertained based on an operator swing command without a detected load, and inputs from a swing motor pressure sensor and further based on the implement component positions (via IMU 104k and/or angle sensors 104L).
  • the phrase "one or more of,” when used with a list of items, means that different combinations of one or more of the items may be used and only one of each item in the list may be needed.
  • “one or more of' item A, item B, and item C may include, for example, without limitation, item A or item A and item B. This example also may include item A, item B, and item C, or item Band item C.

Landscapes

  • Engineering & Computer Science (AREA)
  • Mining & Mineral Resources (AREA)
  • Civil Engineering (AREA)
  • General Engineering & Computer Science (AREA)
  • Structural Engineering (AREA)
  • Operation Control Of Excavators (AREA)

Abstract

A self-propelled work vehicle is provided with work state estimation and associated control techniques. The work vehicle comprises ground engaging units, a work implement configured for controllably working terrain, and various onboard sensors. A controller is functionally linked to at least the one or more onboard sensors and configured to ascertain a first parameter or operation of the work vehicle, determine a work state of the work vehicle, based at least in part on respective input signals from one or more onboard sensors, and generate a control signal for controlling at least a second parameter or operation of the work vehicle, responsive to the ascertained first parameter or operation and the determined work state. The control signals may be provided for proactive adjustments to engine speed, movements of the work implement, movements of the work vehicle itself, etc.

Description

    FIELD OF THE DISCLOSURE
  • The present disclosure relates generally to self-propelled work vehicles such as construction and forestry machines, and more particularly to systems and methods for work state estimation and control of certain operations of such self-propelled work vehicles.
  • BACKGROUND
  • Self-propelled work vehicles of this type may for example include excavator machines, forestry machines, front shovel machines, and others. These machines may typically have tracked ground engaging units supporting the undercarriage from the ground surface.
  • Various situations arise with such machines where the human operator needs to perform repetitive operations (e.g., dig and dump, log pick and unload). These operations often require coordinated positioning of one or more work tools at the same location. Referring to an exemplary operation of an excavator, after a digging step the operator may provide a command to curl the tool (bucket), after which simultaneous commands are provided to move the boom upwards, move the arm inwards, and laterally swing the assembly.
  • Another common situation for such tracked work vehicles includes the use of engine speed dials or equivalent interface tools 116 to set engine speeds, based for example on the type of operation being performed by the work vehicle, and frequently further based on operator preference. During field operations, operators may typically set these engine speeds dials on their high idle (i.e., maximum) set point settings, irrespective of the work being done and the load on self-propelled work vehicle, rather than continuously adjusting the engine speed manually. This understandably produces substantial waste of fuel and reduced productivity.
  • It would be desirable to automate certain of the aforementioned coordinated operations based on the type of work being performed and/or detected work conditions or parameters, such as work demand (load), thereby increasing productivity and ease of operating the work vehicle, and further reducing operator fatigue from the repetitive operations.
  • BRIEF SUMMARY
  • The current disclosure provides an enhancement to conventional systems, at least in part by introducing a novel system and method for estimating at least the work state of a self-propelled work vehicle at a given time, and accordingly implementing automation of certain vehicle operations and associated functions.
  • In one embodiment, a computer-implemented method as disclosed herein is provided for controlling one or more aspects of a self-propelled work vehicle comprising a plurality of ground engaging units and at least one work implement configured for controllably working terrain. One or more operator commands are received regarding at least a first parameter or operation of the self-propelled work vehicle. A work state of the self-propelled work vehicle is automatically determined, based at least in part on respective input signals from one or more onboard sensors, and a control signal is generated for controlling at least a second parameter or operation of the self-propelled work vehicle, responsive to the one or more operator commands and the determined work state.
  • In an exemplary aspect of the above-referenced embodiment, the determining of a work state of the self-propelled work vehicle comprises classifying sequences of data from one or more onboard sensors into different predetermined work states, receiving input signals from at least one of the one or more onboard sensors, and predicting the work state based a comparison of the received input signals to the classified sequences of data.
  • In another exemplary aspect of the above-referenced embodiment, the method further comprises, for a particular predicted work state, determining a current parameter or operation based on input signals from at least one of the one or more onboard sensors, predicting a next parameter or operation corresponding to the predicted work state and the determined current parameter or operation, and generating the control signal for controlling at least the second parameter or operation of the self-propelled work vehicle based on the predicted next parameter or operation.
  • In another exemplary aspect of the above-referenced embodiment, the determining of a work state of the self-propelled work vehicle comprises classifying sequences of operator commands and data from one or more onboard sensors into different predetermined work states, receiving a sequence comprising at least one operator command and at least one input signal from an onboard sensors, and predicting the work state based a comparison of the received sequence to the classified sequences of operator commands and data.
  • In another exemplary aspect of the above-referenced embodiment, the generated control signal is configured to control movements of at least one work implement, based on a detected position of the at least one work implement and further responsive to the one or more operator commands and the determined work state.
  • In another exemplary aspect of the above-referenced embodiment, the one or more operator commands relate to at least swing operation commands regarding the at least one work implement, and control signals are generated for controlling movements of at least a boom and an arm associated with the swing operation, further responsive to the determined work state
  • In another exemplary aspect of the above-referenced embodiment, the generated control signal is configured to control movements of the self-propelled work vehicle via the one or more ground engaging units, based on a detected position and/or orientation of at least one portion of the self-propelled work vehicle and further responsive to the one or more operator commands and the determined work state.
  • In another exemplary aspect of the above-referenced embodiment, at least one of the one or more onboard sensors is configured to generate signals representing a work load, and the generated control signal is configured to control an engine speed of the self-propelled work vehicle, responsive to the one or more operator commands, the determined work state, and a determined work load.
  • In another exemplary aspect of the above-referenced embodiment, the input signals from at least one of the one or more onboard sensors are representative of one or more of: a movement sequence for at least one of the one or more work implements; a location of the self-propelled work vehicle; and a plane of a ground surface upon which the self-propelled work vehicle is supported.
  • In another exemplary aspect of the above-referenced embodiment, the operator commands are received via at least one of the one or more onboard sensors.
  • In another exemplary aspect of the above-referenced embodiment, the operator commands are received via a user interface associated with an onboard computing device.
  • In another exemplary aspect of the above-referenced embodiment, one or more further operator commands via the user interface selectively enable or disable the generated control signal for controlling at least the second parameter or operation of the self-propelled work vehicle.
  • In another embodiment as disclosed herein, a self-propelled work vehicle is provided with a plurality of ground engaging units, at least one work implement configured for controllably working terrain, one or more onboard sensors, and a controller functionally linked to at least the one or more onboard sensors and the user interface. The controller is further configured to perform a method according to the above-referenced embodiment and optionally any of the associated aspects.
  • Numerous objects, features and advantages of the embodiments set forth herein will be readily apparent to those skilled in the art upon reading of the following disclosure when taken in conjunction with the accompanying drawings.
  • BRIEF DESCRIPTION OF THE DRAWINGS
    • Fig. 1 is a side view representing an excavator as an exemplary self-propelled work vehicle according to the present disclosure.
    • Fig. 2 is a side view representing a forestry machine as an exemplary self-propelled work vehicle according to the present disclosure.
    • Fig. 3 is a block diagram representing an exemplary control system according to an embodiment of the present disclosure.
    • Fig. 4 is a flowchart representing an exemplary method according to an embodiment of the present disclosure.
    • Fig. 5 is a flowchart representing an exemplary method according to another embodiment of the present disclosure.
    • Fig. 6 is a flowchart representing an exemplary method according to another embodiment of the present disclosure.
    • Fig. 7 is a flowchart representing an exemplary method according to another embodiment of the present disclosure.
    • Fig. 8 is a flowchart representing an exemplary method according to another embodiment of the present disclosure.
    • Fig. 9 is a flowchart representing an exemplary method according to another embodiment of the present disclosure.
    DETAILED DESCRIPTION
  • Referring now to Figures 1- 9, various embodiments may now be described of a system and method for automated work state estimation and associated control techniques.
  • Fig. 1 in a particular embodiment as disclosed herein shows a representative self-propelled work vehicle in the form of, for example, a tracked excavator machine 20. The working machine 20 includes an undercarriage 22 including first and second ground engaging units 24 including first and second travel motors (not shown) for driving the first and second ground engaging units 24, respectively.
  • A main frame 32 is supported from the undercarriage 22 by a swing bearing 34 such that the main frame 32 is pivotable about a pivot axis 36 relative to the undercarriage 22. The pivot axis 36 is substantially vertical when a ground surface 38 engaged by the ground engaging units 24 is substantially horizontal. A swing motor (not shown) is configured to pivot the main frame 32 on the swing bearing 34 about the pivot axis 36 relative to the undercarriage 22.
  • A work implement 42 in the context of the referenced work vehicle 20 includes a boom assembly 42 with a boom 44, an arm 46 pivotally connected to the boom 44, and a working tool 48. The boom 44 is pivotally attached to the main frame 32 to pivot about a generally horizontal axis relative to the main frame 32. The working tool in this embodiment is an excavator shovel 48 which is pivotally connected to the arm 46. The boom assembly 42 extends from the main frame 32 along a working direction of the boom assembly 42. The working direction can also be described as a working direction of the boom 44. As described herein, control of the work implement 42 may relate to control of any one or more of the associated components (e.g., boom 44, arm 46, tool 48).
  • In the embodiment of Fig. 1, the first and second ground engaging units 24 are tracked ground engaging units. Each of the tracked ground engaging units 24 includes a front idler 52, a drive sprocket 54, and a track chain 56 extending around the front idler 52 and the drive sprocket 54. The travel motor of each tracked ground engaging unit 24 drives its respective drive sprocket 54. Each tracked ground engaging unit 24 has a forward traveling direction 58 defined from the drive sprocket 54 toward the front idler 52. The forward traveling direction 58 of the tracked ground engaging units 24 also defines a forward traveling direction 58 of the undercarriage 22 and thus of the working machine 20.
  • An operator's cab 60 may be located on the main frame 32. The operator's cab 60 and the boom assembly 42 may both be mounted on the main frame 32 so that the operator's cab 60 faces in the working direction 58 of the boom assembly. A control station 62 may be located in the operator's cab 60.
  • Also mounted on the main frame 32 is an engine 64 for powering the working machine 20. The engine 64 may be a diesel internal combustion engine. The engine 64 may drive a hydraulic pump to provide hydraulic power to the various operating systems of the working machine 20.
  • As schematically illustrated in Fig. 3, the self-propelled work vehicle 20 includes a control system including a controller 112. The controller may be part of the machine control system of the working machine, or it may be a separate control module. The controller 112 may include a user interface 114 and optionally be mounted in the operator's cab 60 at the control station 62.
  • The controller 112 is configured to receive input signals from some or all of various sensors collectively defining a sensor system 104, individual examples of which may be described below. Various sensors on the sensor system 104 may typically be discrete in nature, but signals representative of more than one input parameter may be provided from the same sensor, and the sensor system 104 may further refer to signals provided from the machine control system.
  • The controller 112 may be configured to produce outputs, as further described below, to the user interface 114 for display to the human operator. The controller 112 may further or in the alternative be configured to generate control signals for controlling the operation of respective actuators, or signals for indirect control via intermediate control units, associated with a machine steering control system 126, a machine implement control system 128, and an engine speed control system 130. The controller 112 may for example generate control signals for controlling the operation of various actuators, such as hydraulic motors or hydraulic piston-cylinder units 124, and electronic control signals from the controller 112 may actually be received by electro-hydraulic control valves associated with the actuators such that the electro-hydraulic control valves will control the flow of hydraulic fluid to and from the respective hydraulic actuators to control the actuation thereof in response to the control signal from the controller 112.
  • The controller 112 includes or may be associated with a processor 150, a computer readable medium 152, a communication unit 154, data storage 156 such as for example a database network, and the aforementioned user interface 114 or control panel 114 having a display 118. An input/output device 116, such as a keyboard, joystick or other user interface tool 116, is provided so that the human operator may input instructions to the controller. It is understood that the controller 112 described herein may be a single controller having all of the described functionality, or it may include multiple controllers wherein the described functionality is distributed among the multiple controllers.
  • Various operations, steps or algorithms as described in connection with the controller 112 can be embodied directly in hardware, in a computer program product such as a software module executed by the processor 150, or in a combination of the two. The computer program product can reside in RAM memory, flash memory, ROM memory, EPROM memory, EEPROM memory, registers, hard disk, a removable disk, or any other form of computer-readable medium 152 known in the art. An exemplary computer-readable medium 152 can be coupled to the processor 150 such that the processor 150 can read information from, and write information to, the memory/ storage medium 152. In the alternative, the medium 152 can be integral to the processor 150. The processor 150 and the medium 152 can reside in an application specific integrated circuit (ASIC). The ASIC can reside in a user terminal. In the alternative, the processor 150 and the medium 152 can reside as discrete components in a user terminal.
  • The term "processor" 150 as used herein may refer to at least general-purpose or specific-purpose processing devices and/or logic as may be understood by one of skill in the art, including but not limited to a microprocessor, a microcontroller, a state machine, and the like. A processor 150 can also be implemented as a combination of computing devices, e.g., a combination of a DSP and a microprocessor, a plurality of microprocessors, one or more microprocessors in conjunction with a DSP core, or any other such configuration.
  • The communication unit 154 may support or provide communications between the controller 112 and external systems or devices, and/or support or provide communication interface with respect to internal components of the self-propelled work vehicle 20, 120. The communications unit may include wireless communication system components (e.g., via cellular modem, WiFi, Bluetooth or the like) and/or may include one or more wired communications terminals such as universal serial bus ports.
  • The data storage 156 as further described below may, unless otherwise stated, generally encompass hardware such as volatile or non-volatile storage devices, drives, memory, or other storage media, as well as one or more databases residing thereon.
  • Referring to Figure 2, another embodiment of such a self-propelled work vehicle is embodied as a tracked forestry machine 120 such as a feller buncher for the harvesting of trees. Similar to the excavator type of work vehicle 20 previously described, the tracked forestry machine 120 has an undercarriage 22, first and second tracked ground engaging units 24, main frame 32, swing bearing 34, and boom assembly 42. The forestry machine 120 may include the same control system as described with regard to Fig. 3 to control the orientation of its undercarriage 22 relative to the ground surface 38, and to control the orientation of its main frame 32 and boom assembly 42 relative to its undercarriage 22.
  • The forestry machine 120 may often be operated on very uneven ground such as when harvesting trees in a mountainous area. Accordingly the forestry machine 120 may include a leveling mechanism 122 including a plurality of linear actuators which may be in the form of hydraulic piston-cylinder units 124 to adjust a pitch and roll of the swing bearing 34 and thus the main frame 32 relative to the undercarriage 22. In the case of the forestry machine 120 the pivotal axis 36 is defined by the swing bearing 34 and a pivot angle sensor (not shown) may be mounted between upper and lower rings (not shown) of the swing bearing 34.
  • Referring next to Fig. 4, an exemplary and high-level method 400 may now be described, followed by more particular examples of methods as disclosed herein and with further reference to Figures 5- 9.
  • The method 400 includes receiving operator commands, via for example the user interface 114, regarding at least a first parameter or operation, or a first sequence of parameters or operations (step 410). One or more sensor inputs are received (step 412) from respective sources in the sensor system 104 are further processed along with the operator commands to ascertain a work state and/or work load (step 414) for the self-propelled work vehicle 20, 120. The ascertained work state and/or work load, along with the received operator commands, are further processed to generate control signals (step 416) regarding at least a second parameter or operation (or sequence of parameters or operations) for automation in conjunction with the first parameter or operation (or sequence of parameters or operations). The control signals may be provided to any one or more of the steering control system 126, the implement control system 128, and the engine speed control system 130 depending on the relevant application.
  • Figure 5 relates to an embodiment of the method 400 wherein a desired engine speed is calculated in step 416 and implemented for automated engine speed control (via e.g. the engine speed control system 130) based on work state and work load determinations in step 414. In self-propelled construction work vehicles 20, such as excavators, the work load measurement 413 may be provided via work load inputs 412 from a payload weighing system 104j of the sensor system 104. In self-propelled forestry vehicles 120, such as feller bunchers, the work load may refer to log weight, and work load measurement 413 may for example be provided via work load inputs 412 from a head pressure sensor 104a.
  • As represented in Figure 6, the work state identification 414 in a forestry work vehicle 120 may be performed in some embodiments through direct implementation of vehicle sensors 104 including, e.g., the head pressure sensor 104a to detect attachment load, a ground plane position sensor 104b such as an inertial measurement unit (IMU) for estimating desired power while on the move, operator commands 104c received via a joystick button 116 or equivalent input/output device 116 for receiving operator commands 410 via the user interface 114, a saw position sensor 104d in the work tool 48 such as the harvester head, etc.
  • As represented in Figure 7, where for example some of the aforementioned sensors are unavailable or otherwise preferably not implemented for a given application, the work state identification 414 may be provided using onboard machine learning algorithms. Using the excavator work vehicle 20 as an example, training inputs may be provided to the machine learning model corresponding to time series data values for one or more of: left/ right drive pressure 104e; boom raise/ lower pressure 104f; arm in/out pressure 104g; swing left/ right pressure 104h; engine speed and load 104i; and operator commands 104c, wherein the model is further verified over time using test data inputs which may relate to the same or analogous sources.
  • Generally stated, work state estimation as disclosed herein may encompass the classifying of sequences of data recorded by sensors into defined machine states. For the excavator work vehicle 20, an exemplary sequence of work states may include Dig, Swing, Dump, Adjust to Dump, and Travel. Work state estimation may be treated a classical sequence classification problem, addressed in an embodiment as disclosed herein by building supervised Machine Learning (ML)/ Deep Learning (DL) classification algorithms like Logistic Regression and Long Short-Term Memory (LSTM) recurrent neural network models for sequence classification. The LSTM models are capable of learning from internal representations of the time series data, effectively remembering over long sequences of input data and previous operation of the self-propelled work vehicle 20, 120. The LSTM models may accordingly be trained on time series data (exemplary inputs as noted above) and observe loss and accuracy values over N training iterations, wherein losses are decreased and accuracy increased over time. The model may be described as classifying these time series data into defined work states.
  • For generation of the model, the time series data may for example be streamed from the respective sensors/ data sources 104, 410, 412 on a work vehicle 20, 120 (or a plurality of analogous work vehicles) via a communications network onto a cloud server network, wherein the model is developed (i.e., trained and validated) at the cloud server level. Once the model has been sufficiently validated, it may be transmitted, for example via the communications network, and deployed by the controller 112 onboard a work vehicle 20, 120 for subsequent work state estimation and work load estimation. The cloud server network may however continue to receive input time series data from the work vehicle 20, 120 (or plurality of analogous work vehicles) for the purpose of further refining the model, wherein updated versions of the model may be transmitted to the work vehicle 20, 120 periodically or on demand.
  • In an embodiment, the controller 112 implementing a work state estimation model as disclosed herein may be configured to distinguish various causes of detected loading based on operations of the work vehicle and components thereof, each operation having, e.g., a corresponding maximum power (pressure/ flow) requirement based on past data and/or work tool specifications, and accordingly calculating a target engine speed correlating to a reference engine speed for the defined work state and further based on a sensed load, predetermined weight factors, minimum and/or maximum engine speed settings, and the like.
  • For example, a forestry work vehicle 120 may be associated with causes of loading including (but not limited to) a boom operation, a head operation, and a transmission operation. These causes of loading may be respectively correlated with sensor inputs corresponding to operations including but not limited to: (a) Grab/ Hold Stem; (b) Lift; (c) Grab and Left Stem; (d) Dump Stem; (e) Lift and Move; (f) Travel without Load (potentially distinguishing between flat and sloped terrain); (g) Travel with Load; (h) Travel While Handling Stem; (i) Stem Cut; and (j) Stem Cut with Grapple Pressure (for example improve the hold on the stem). For example, a first cause of loading (boom operation) may be correlated with the aforementioned operations: (b), (c), (e), (f), and/or (h). As another example, a second cause of loading (head operation) may be correlated with the aforementioned operations: (a), (c), (d), (g), (h), (i), and/or (j). As yet another example, a third cause of loading (transmission operation) may be correlated with the aforementioned operations: (e), (g), and/or (h).
  • The embodiments as previously described have been in the context of engine speed control 130 based on work state estimation and work load estimation. In other embodiments, work state estimation and work load estimation may also (or in the alternative) be implemented for implement and/or steering control functions via the implement control system 128 and/or steering control system 126, respectively.
  • In the context of an excavator work vehicle 20, an exemplary operation cycle may be divided into four segments: excavation of the material at an excavation point; travel from the excavation point to a dumping point; dumping of the material at the dumping point; and traveling from the dumping point back to the excavation point. It may be noted that the excavator 20 is merely discussed herein as illustrative, and numerous other self-propelled work vehicles may perform similar operations such as knuckleboom loaders, tracked feller bunchers, swing machine log loaders, forwarders, and the like. Of the aforementioned segments, the actual excavation of material and the dumping of material may be considered as optimally performed by the operator, but the traveling functions may comprise repetitive movements of implement components (e.g., a bucket, tilted bucket, grapple, etc.), which may be optimally automated during the excavation process.
  • Accordingly, in an embodiment as disclosed herein, work implement positioning is automated by the controller 112 based upon estimated work state and detected work implement positions, wherein a first movement or sequence of movements (e.g., corresponding to the swing of the boom) are controlled directly by the operator and used as a trigger for automatic control of a second movement of sequence of movements (e.g., the work implement positioning).
  • The user interface 114 may be configured for enabling the automated control functions via a button or equivalent on/off actuator. The user interface 114 may further be configured for enabling the operator to override the automated control functions, or alternatively such an override may be implemented by the operator simply carrying out the functions manually according to the conventional techniques, such as for example manual boom 44 or arm 46 commands using the relevant joysticks.
  • Referring to Fig. 8, rules-based work state estimation 414 for the excavator work vehicle 20 may be provided, with exemplary inputs in this context provided from a payload weighing system 104j, a ground plane position sensor (e.g., IMU) 104k, an angle sensor 104L for one or more of the boom 44, the arm 46, and the work tool 48 (e.g., bucket), and inputs from the user interface 114 corresponding to operator commands 104c.
  • Referring next to Fig. 9, an exemplary process 900 for excavation automation using work state estimation may be described. Initially, the automated process may optionally be enabled as described above using an operator command. In an embodiment, a first cycle of the method may include recording of an excavation location and a dump location based on work state identification. Even after the initial recording/ recognition cycle, as previously noted, the actual process of dumping material may optimally be left to the operator, such that the system merely processes input data and operator commands and accordingly identifies a Digging work state (step 902), after which a received operator command corresponding to a Swing to Dump work state (step 904) triggers the system for automated control of the boom 44 and of the arm 46 to the recorded dumping location (step 906). The Digging work state may for example be ascertained based on inputs from a payload weighing system 104j corresponding with a load, from a pressure sensor associated with the arm 46, boom 44, and/or working tool 48, and further based on implement component positions (via IMU 104k and/or angle sensors 104L). The Swing to Dump work state may for example be ascertained based on an operator swing command with a detected load, and inputs from a swing motor pressure sensor and further based on the implement component positions (via IMU 104k and/or angle sensors 104L).
  • Again as previously noted, the actual step of dumping may also optimally be left to the operator, such that the system merely processes input data and operator commands and accordingly identifies a Dumping work state (step 908), after which a received operator Swing to Dig command (step 910) triggers the system for automated control of the boom 44 and of the arm 46 to the recorded excavation location (step 912). The Dumping work state may for example be ascertained based on inputs from a payload weighing system 104j corresponding with no load, from a pressure sensor associated with the arm 46, boom 44, and/or working too 48, and further based on implement component positions (via IMU 104k and/or angle sensors 104L). The Swing to Dig work state may for example be ascertained based on an operator swing command without a detected load, and inputs from a swing motor pressure sensor and further based on the implement component positions (via IMU 104k and/or angle sensors 104L).
  • In various alternative embodiments as may be appreciated by one of skill in the art, the above-referenced work state estimation and control principles may be applied for other self-propelled work vehicle applications, including for example those requiring control over repetitive movements of the self-propelled work vehicle itself, wherein steering control systems 126 may be implemented in addition to, or instead of, the implement movement control 128 and/or engine speed control 130 embodiments as otherwise described in more detail herein.
  • As used herein, the phrase "one or more of," when used with a list of items, means that different combinations of one or more of the items may be used and only one of each item in the list may be needed. For example, "one or more of' item A, item B, and item C may include, for example, without limitation, item A or item A and item B. This example also may include item A, item B, and item C, or item Band item C.
  • Thus, it is seen that the apparatus and methods of the present disclosure readily achieve the ends and advantages mentioned as well as those inherent therein. While certain preferred embodiments of the disclosure have been illustrated and described for present purposes, numerous changes in the arrangement and construction of parts and steps may be made by those skilled in the art, which changes are encompassed within the scope and spirit of the present disclosure as defined by the appended claims. Each disclosed feature or embodiment may be combined with any of the other disclosed features or embodiments.

Claims (16)

  1. A method of controlling one or more aspects of a self-propelled work vehicle comprising a plurality of ground engaging units and at least one work implement configured for controllably working terrain, the method comprising:
    receiving one or more operator commands regarding at least a first parameter or operation of the self-propelled work vehicle;
    determining a work state of the self-propelled work vehicle, based at least in part on respective input signals from one or more onboard sensors; and
    generating a control signal for controlling at least a second parameter or operation of the self-propelled work vehicle, responsive to the one or more operator commands and the determined work state.
  2. The method of claim 1, wherein the determining of a work state of the self-propelled work vehicle comprises:
    classifying sequences of data from one or more onboard sensors into different predetermined work states;
    receiving input signals from at least one of the one or more onboard sensors; and
    predicting the work state based a comparison of the received input signals to the classified sequences of data.
  3. The method of claim 2, for a particular predicted work state comprising:
    determining a current parameter or operation based on input signals from at least one of the one or more onboard sensors;
    predicting a next parameter or operation corresponding to the predicted work state and the determined current parameter or operation; and
    generating the control signal for controlling at least the second parameter or operation of the self-propelled work vehicle based on the predicted next parameter or operation.
  4. The method of claim 1, wherein the determining of a work state of the self-propelled work vehicle comprises:
    classifying sequences of operator commands and data from one or more onboard sensors into different predetermined work states;
    receiving a sequence comprising at least one operator command and at least one input signal from an onboard sensors; and
    predicting the work state based a comparison of the received sequence to the classified sequences of operator commands and data.
  5. The method of any one of the preceding claims, wherein the generated control signal is configured to control movements of at least one work implement, based on a detected position of the at least one work implement and further responsive to the one or more operator commands and the determined work state.
  6. The method of claim 5, wherein the one or more operator commands relate to at least swing operation commands regarding the at least one work implement, and control signals are generated for controlling movements of at least a boom and an arm associated with the swing operation, further responsive to the determined work state
  7. The method of any one of the preceding claims, wherein the generated control signal is configured to control movements of the self-propelled work vehicle via the one or more ground engaging units, based on a detected position and/or orientation of at least one portion of the self-propelled work vehicle and further responsive to the one or more operator commands and the determined work state.
  8. The method of any one of the preceding claims, wherein the operator commands are received via at least one of the one or more onboard sensors or via a user interface associated with an onboard computing device.
  9. The method of claim 8, wherein one or more further operator commands via the user interface selectively enable or disable the generated control signal for controlling at least the second parameter or operation of the self-propelled work vehicle.
  10. A self-propelled work vehicle comprising:
    a plurality of ground engaging units;
    at least one work implement configured for controllably working terrain;
    one or more onboard sensors; and
    a controller functionally linked to at least the one or more onboard sensors and configured to
    ascertain a first parameter or operation of the self-propelled work vehicle,
    determine a work state of the self-propelled work vehicle, based at least in part on respective input signals from one or more onboard sensors, and
    generate a control signal for controlling at least a second parameter or operation of the self-propelled work vehicle, responsive to the ascertained first parameter or operation and the determined work state.
  11. The self-propelled work vehicle of claim 10, further comprising a user interface configured to enable user entry of operator commands regarding the first parameter or operation of the self-propelled work vehicle, wherein the controller is configured to ascertain the first parameter or operation of the self-propelled work vehicle from the operator commands.
  12. The self-propelled work vehicle of claim 10 or claim 11, wherein the work state of the self-propelled work vehicle is determined according to any one of method claims 2 to 4.
  13. The self-propelled work vehicle of claim 12, wherein the controller is configured for a particular predicted work state to:
    determine a current parameter or operation based on input signals from at least one of the one or more onboard sensors;
    predict a next parameter or operation corresponding to the predicted work state and the determined current parameter or operation; and
    generate the control signal for controlling at least the second parameter or operation of the self-propelled work vehicle based on the predicted next parameter or operation.
  14. The self-propelled work vehicle of any one of claims 10 to 13, wherein the generated control signal is configured to control one or more of:
    movements of at least one work implement, based on a detected position of the at least one work implement and further responsive to the one or more operator commands and the determined work state; and
    movements of the self-propelled work vehicle via the one or more ground engaging units, based on a detected position and/or orientation of at least one portion of the self-propelled work vehicle and further responsive to the one or more operator commands and the determined work state.
  15. The method of any one of claims 1 to 9 or the self-propelled work vehicle of any one of claims 10 to 14, wherein:
    at least one of the one or more onboard sensors is configured to generate signals representing a work load, and
    the generated control signal is configured to control an engine speed of the self-propelled work vehicle, responsive to the one or more operator commands, the determined work state, and a determined work load.
  16. The method of any one of claims 1 to 9 or the self-propelled work vehicle of any one of claims 12 to 15, wherein the input signals from at least one of the one or more onboard sensors are representative of one or more of:
    a movement sequence for at least one of the one or more work implements;
    a location of the self-propelled work vehicle; and
    a plane of a ground surface upon which the self-propelled work vehicle is supported.
EP21202273.5A 2020-11-04 2021-10-12 System and method for work state estimation and control of self-propelled work vehicles Pending EP3995633A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
IN202021048194 2020-11-04
US17/143,219 US12024173B2 (en) 2020-11-04 2021-01-07 System and method for work state estimation and control of self-propelled work vehicles

Publications (1)

Publication Number Publication Date
EP3995633A1 true EP3995633A1 (en) 2022-05-11

Family

ID=78134875

Family Applications (1)

Application Number Title Priority Date Filing Date
EP21202273.5A Pending EP3995633A1 (en) 2020-11-04 2021-10-12 System and method for work state estimation and control of self-propelled work vehicles

Country Status (1)

Country Link
EP (1) EP3995633A1 (en)

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160003171A1 (en) * 2014-07-07 2016-01-07 Caterpillar Inc. Adaptive control system for cyclic excavation machine
US20160258128A1 (en) * 2015-03-05 2016-09-08 Hitachi, Ltd. Trace Generation Device and Working Machine

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160003171A1 (en) * 2014-07-07 2016-01-07 Caterpillar Inc. Adaptive control system for cyclic excavation machine
US20160258128A1 (en) * 2015-03-05 2016-09-08 Hitachi, Ltd. Trace Generation Device and Working Machine

Similar Documents

Publication Publication Date Title
US12024173B2 (en) System and method for work state estimation and control of self-propelled work vehicles
US8430621B2 (en) Control of a boom construction and a tool articulated thereto
US8024095B2 (en) Adaptive work cycle control system
US7917265B2 (en) System for automated excavation control based on productivity
US11320830B2 (en) Probabilistic decision support for obstacle detection and classification in a working area
US11697917B2 (en) Anticipatory modification of machine settings based on predicted operational state transition
JP2013515885A (en) System and method for controlling instruments to maximize machine productivity and maintain final slope
US10267018B2 (en) Work vehicle load control system and method
CN113646487B (en) System including work machine, method executed by computer, method for manufacturing learned posture estimation model, and data for learning
US20200114992A1 (en) Tension adjustment system
CN115279973B (en) Operation guide device
CN112943751A (en) Auxiliary work control method, auxiliary work control device, electronic equipment and storage medium
US20160349733A1 (en) Machine Performance Evaluation and Feedback System
US11078648B2 (en) Grade control for machines with buckets
US20150240451A1 (en) Method For Controlling A Machine
CN115053038B (en) Work system, computer-implemented method, and learning data
EP3995633A1 (en) System and method for work state estimation and control of self-propelled work vehicles
EP4026954B1 (en) Method for detecting a work or agricultural vehicle mission through a neural network and control unit implementing the method
Fodor et al. Practical trajectory designs for semi-automation of forestry cranes
US11001989B1 (en) Electrical control of a hydraulic system
CN112064700A (en) Optimal shovel loading track matching method for loader
US12005912B2 (en) System and method for selective derating of self-propelled work vehicle parameters based on operating modes
CN113795636A (en) Method for calculating an excavation volume
US10669693B2 (en) System and method for controlling a machine through an interrupted operation
US20240273954A1 (en) Selective capture of work machine productivity factors based on work state estimation

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION HAS BEEN PUBLISHED

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20221102

RBV Designated contracting states (corrected)

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR