EP3102744A1 - Dispositif de commande de véhicule à chargement autonome - Google Patents
Dispositif de commande de véhicule à chargement autonomeInfo
- Publication number
- EP3102744A1 EP3102744A1 EP15740514.3A EP15740514A EP3102744A1 EP 3102744 A1 EP3102744 A1 EP 3102744A1 EP 15740514 A EP15740514 A EP 15740514A EP 3102744 A1 EP3102744 A1 EP 3102744A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- controller
- dig
- bucket
- sensor signal
- alv
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 239000011435 rock Substances 0.000 claims abstract description 89
- 238000000034 method Methods 0.000 claims abstract description 27
- 230000003993 interaction Effects 0.000 claims abstract description 25
- 230000033001 locomotion Effects 0.000 claims description 16
- 230000004044 response Effects 0.000 claims description 14
- 230000003044 adaptive effect Effects 0.000 claims description 9
- 238000004590 computer program Methods 0.000 claims description 6
- 238000005259 measurement Methods 0.000 claims description 6
- 238000013507 mapping Methods 0.000 claims description 4
- 230000003094 perturbing effect Effects 0.000 claims description 2
- 238000005065 mining Methods 0.000 abstract description 7
- 238000010276 construction Methods 0.000 abstract description 6
- 238000010586 diagram Methods 0.000 description 16
- 229920006395 saturated elastomer Polymers 0.000 description 15
- 238000009412 basement excavation Methods 0.000 description 14
- 238000006243 chemical reaction Methods 0.000 description 13
- 238000012937 correction Methods 0.000 description 12
- 230000008859 change Effects 0.000 description 9
- 239000000463 material Substances 0.000 description 8
- 238000005303 weighing Methods 0.000 description 8
- 238000000418 atomic force spectrum Methods 0.000 description 6
- 210000004964 innate lymphoid cell Anatomy 0.000 description 6
- 238000012360 testing method Methods 0.000 description 6
- 230000006870 function Effects 0.000 description 5
- 230000007423 decrease Effects 0.000 description 4
- 241000713826 Avian leukosis virus Species 0.000 description 3
- 230000006399 behavior Effects 0.000 description 3
- 230000008901 benefit Effects 0.000 description 3
- 239000002689 soil Substances 0.000 description 3
- 230000003247 decreasing effect Effects 0.000 description 2
- 238000006073 displacement reaction Methods 0.000 description 2
- 238000012423 maintenance Methods 0.000 description 2
- 238000012549 training Methods 0.000 description 2
- 101100443249 Caenorhabditis elegans dig-1 gene Proteins 0.000 description 1
- 230000005355 Hall effect Effects 0.000 description 1
- 235000019738 Limestone Nutrition 0.000 description 1
- 239000010426 asphalt Substances 0.000 description 1
- 230000033228 biological regulation Effects 0.000 description 1
- 210000004027 cell Anatomy 0.000 description 1
- 239000013065 commercial product Substances 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000013480 data collection Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 239000012530 fluid Substances 0.000 description 1
- 239000000446 fuel Substances 0.000 description 1
- 231100001261 hazardous Toxicity 0.000 description 1
- 239000006028 limestone Substances 0.000 description 1
- 230000000670 limiting effect Effects 0.000 description 1
- 230000007935 neutral effect Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000036961 partial effect Effects 0.000 description 1
- 239000002245 particle Substances 0.000 description 1
- 230000035515 penetration Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 230000002829 reductive effect Effects 0.000 description 1
- 150000003839 salts Chemical class 0.000 description 1
- 239000000523 sample Substances 0.000 description 1
- 239000004576 sand Substances 0.000 description 1
- 239000002893 slag Substances 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 239000000758 substrate Substances 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Classifications
-
- E—FIXED CONSTRUCTIONS
- E02—HYDRAULIC ENGINEERING; FOUNDATIONS; SOIL SHIFTING
- E02F—DREDGING; SOIL-SHIFTING
- E02F9/00—Component parts of dredgers or soil-shifting machines, not restricted to one of the kinds covered by groups E02F3/00 - E02F7/00
- E02F9/26—Indicating devices
- E02F9/264—Sensors and their calibration for indicating the position of the work tool
- E02F9/265—Sensors and their calibration for indicating the position of the work tool with follow-up actions (e.g. control signals sent to actuate the work tool)
-
- E—FIXED CONSTRUCTIONS
- E02—HYDRAULIC ENGINEERING; FOUNDATIONS; SOIL SHIFTING
- E02F—DREDGING; SOIL-SHIFTING
- E02F3/00—Dredgers; Soil-shifting machines
- E02F3/04—Dredgers; Soil-shifting machines mechanically-driven
- E02F3/28—Dredgers; Soil-shifting machines mechanically-driven with digging tools mounted on a dipper- or bucket-arm, i.e. there is either one arm or a pair of arms, e.g. dippers, buckets
- E02F3/36—Component parts
- E02F3/42—Drives for dippers, buckets, dipper-arms or bucket-arms
- E02F3/43—Control of dipper or bucket position; Control of sequence of drive operations
- E02F3/431—Control of dipper or bucket position; Control of sequence of drive operations for bucket-arms, front-end loaders, dumpers or the like
- E02F3/434—Control of dipper or bucket position; Control of sequence of drive operations for bucket-arms, front-end loaders, dumpers or the like providing automatic sequences of movements, e.g. automatic dumping or loading, automatic return-to-dig
-
- E—FIXED CONSTRUCTIONS
- E02—HYDRAULIC ENGINEERING; FOUNDATIONS; SOIL SHIFTING
- E02F—DREDGING; SOIL-SHIFTING
- E02F9/00—Component parts of dredgers or soil-shifting machines, not restricted to one of the kinds covered by groups E02F3/00 - E02F7/00
- E02F9/20—Drives; Control devices
-
- E—FIXED CONSTRUCTIONS
- E02—HYDRAULIC ENGINEERING; FOUNDATIONS; SOIL SHIFTING
- E02F—DREDGING; SOIL-SHIFTING
- E02F9/00—Component parts of dredgers or soil-shifting machines, not restricted to one of the kinds covered by groups E02F3/00 - E02F7/00
- E02F9/20—Drives; Control devices
- E02F9/2025—Particular purposes of control systems not otherwise provided for
- E02F9/2029—Controlling the position of implements in function of its load, e.g. modifying the attitude of implements in accordance to vehicle speed
-
- E—FIXED CONSTRUCTIONS
- E02—HYDRAULIC ENGINEERING; FOUNDATIONS; SOIL SHIFTING
- E02F—DREDGING; SOIL-SHIFTING
- E02F9/00—Component parts of dredgers or soil-shifting machines, not restricted to one of the kinds covered by groups E02F3/00 - E02F7/00
- E02F9/20—Drives; Control devices
- E02F9/2025—Particular purposes of control systems not otherwise provided for
- E02F9/205—Remotely operated machines, e.g. unmanned vehicles
Definitions
- This invention relates to control of excavation/loading vehicles.
- this invention relates to autonomous or semi-autonomous control of excavation/loading vehicles.
- Autonomous (or robotic) excavation/loading vehicles are of interest in the mining and construction industries, where the aim is to remove operators from hazardous environments, improve machine utilization and productivity, and reduce maintenance costs.
- Autonomous excavation is also of interest in lunar or planetary exploration, where excavation cannot easily be carried out by remote control.
- a dig controller for an autonomous or semi-autonomous loading vehicle comprising: at least one controller that controls a bucket and/or the ALV in accordance with at least one sensor signal, wherein the at least one sensor signal is representative of interaction between the bucket and the rock pile during a dig; wherein the at least one sensor signal is obtained from at least one sensor associated with one or more actuators other than a bucket actuator, or one or more actuated elements.
- the dig controller further comprises at least one iterative learning controller (ILC) that uses feedback from at least one previous dig to modify the at least one sensor signal provided to the at least one controller.
- ILC iterative learning controller
- a dig controller for an ALV comprising: at least one controller that controls a bucket and/or the ALV in accordance with at least one sensor signal, wherein the at least one sensor signal is representative of interaction between the bucket and the rock pile during a dig; and at least one ILC that uses feedback from at least one previous dig to modify the at least one sensor signal provided to the at least one controller.
- the at least one controller comprises at least one admittance controller.
- the at least one sensor signal is obtained by measuring a force received by a boom actuator. In another embodiment, the at least one sensor signal is obtained by measuring a force received by an actuated element.
- an admittance controller may control velocity of the bucket.
- At least one admittance controller may comprise an adaptive admittance controller.
- An adaptive admittance controller may dynamically adjust at least one parameter in response to a difference between a sensor signal and a desired signal.
- the at least one controller maps one or more sensor signals to a range of possible bucket velocities or ALV velocities by using at least one of proportional, integral, and derivative control.
- the at least one controller may map a total force error to a range of possible sensed forces using at least one of proportional, integral, and derivative control.
- the at least one ILC may map a signal from a previous dig to changes in dig controller response using at least one of proportional, integral, and derivative control.
- the dig controller may modify the at least one sensor signal provided to the controller such that bucket velocity or ALV velocity are changed.
- the dig controller may comprise at least one position controller that controls at least one of movement of the bucket of the ALV to at least one selected pose, and movement of the ALV relative to the rock pile.
- the dig controller may comprise a first velocity ILC that perturbs an ALV velocity based on a sensor signal representative of interaction between the bucket and the rock pile during at least one previous dig, and a second ILC that modifies a sensor signal derived from boom and bucket force error measurement of at least one previous dig.
- the dig controller may comprise a first ILC that modifies a sensor signal being provided to a boom admittance controller, and a second ILC that modifies a sensor signal being provided to a bucket admittance controller, wherein modifying is based on feedback from at least one previous dig.
- programmed media for use with an ALV dig controller comprising a computer
- the programmed media comprising: a computer program stored on non-transitory storage media compatible with the computer, the computer program containing instructions to direct the computer to perform one or more of: receive at least one sensor signal from at least one sensor associated with one or more actuators other than a bucket actuator, or one or more actuated elements; wherein the at least one sensor signal is representative of interaction between the bucket and the rock pile during a dig; and control the bucket and/or the ALV in accordance with the at least one sensor signal.
- ALV dig controller comprising a computer
- the programmed media comprising: a computer program stored on non-transitory storage media compatible with the computer, the computer program containing instructions to direct the computer to perform one or more of: control a bucket and/or the ALV in accordance with at least one sensor signal, wherein the at least one sensor signal is representative of interaction between the bucket and the rock pile during a dig; and direct an ILC to use feedback from at least one previous dig to modify the at least one sensor signal; wherein modifying the at least one sensor signal changes the control of the bucket and/or the ALV.
- Also described herein is a method of controlling an ALV, comprising: obtaining at least one sensor signal from at least one sensor associated with one or more actuators other than a bucket actuator, or one or more actuated elements; wherein the at least one sensor signal is representative of interaction between the bucket and the rock pile during a dig; and controlling the bucket and/or the ALV in accordance with the at least one sensor signal.
- Also described herein is a method of controlling an ALV, comprising: controlling a bucket and/or the ALV in accordance with at least one sensor signal, wherein the at least one sensor signal is representative of interaction between the bucket and the rock pile during a dig; and modifying the at least one sensor signal using at least one ILC that incorporates feedback from at least one previous dig; wherein modifying the at least one sensor signal changes the control of the bucket and/or the ALV.
- the method may include modifying the at least one sensor signal provided to the controller such that bucket velocity or ALV velocity are changed.
- Controlling may further comprise dynamically adjusting at least one parameter in response to a difference between a sensor signal and a desired signal.
- the method may further comprise controlling at least one of movement of the bucket of the ALV to at least one selected pose, and movement of the ALV relative to the rock pile.
- the method may further comprise perturbing an ALV velocity based on a sensor signal representative of interaction between the bucket and the rock pile during at least one previous dig, and modifying a sensor signal derived from boom and bucket force error measurement of at least one previous dig.
- the method may further comprise modifying a sensor signal being provided to a boom admittance controller, and modifying a sensor signal being provided to a bucket admittance controller, wherein modifying is based on feedback from at least one previous dig.
- controlling may include mapping a total force error to a range of possible sensed forces using at least one of proportional, integral, and derivative control.
- the method may further comprise mapping a signal from a previous dig to changes in dig controller response using at least one of proportional, integral, and derivative control.
- the pay load may be controlled based on a parameter of a breakout condition, or by modifying such a parameter.
- Fig. 1 A is a schematic diagram of an ALV
- Figs. IB-ID are schematic diagrams of an ALV during three dig phases
- Figs. 2A and 2B are block diagrams of generalized dig controller embodiments
- Fig. 3 A is a block diagram of an admittance dig controller according to an embodiment
- Fig. 3B is a block diagram of an example of dig logic used in dig controller embodiments
- Fig. 3C is a block diagram of a dig controller according to one embodiment that includes an admittance controller
- Fig. 3D is a block diagram of a dig controller according to one embodiment that includes an iterative learning controller (ILC);
- ILC iterative learning controller
- Fig. 3E is a block diagram of a dig controller according to another embodiment that includes an iterative learning controller
- FIGS. 4A and 4B are block diagrams showing generation of boom and bucket correction forces according to embodiments
- Figs. 4C and 4D are block diagrams showing generation of entry throttle correction according to embodiments.
- Fig. 5 is a plot showing dig efficiency points for 57 dig attempts using the experimental setup of Example 1 ;
- Figs. 6A and 6B are plots showing boom and bucket desired force profiles, respectively, and the target forces (in boxes) used by boom and bucket admittance controllers in an embodiment described in Example 2;
- Fig. 7 is a plot showing desired and actual boom entry force rate of change, according to an embodiment described in Example 2.
- Fig. 8 is a plot showing boom and bucket desired forces used to calculate total error for each dig attempt (dark shading for negative error; light shading for positive error), for the embodiment described in Example 2. Detailed Description of Embodiments
- autonomous loading vehicle As used herein, the term “autonomous loading vehicle” (ALV) is intended to refer generally to an autonomous, semi-autonomous, or robotic excavator machine or load-haul dump (LHD) vehicle used in accordance with the embodiments described herein.
- LHD load-haul dump
- actuator is intended to refer to a component of the ALV that causes a change in vehicle configuration and/or motion.
- An actuator may carry out a function based on a command from a controller.
- vehicle configuration may include position and/or orientation of a boom or dig tool, and/or position and/or orientation of the ALV.
- actuated element is intended to refer to a component of the ALV that is acted upon by an actuator, such as, for example, a boom or a dig tool, or actuator not currently receiving a command but being acted on by another actuator.
- bucket is intended to refer generally to a dig tool of an ALV, which may comprise a bucket, blade, chisel, fork, probe, bit, or other, as known in the art.
- rock pile is intended to refer generally to the material being loaded by the ALV. It is to be understood that the material may be of any type or composition as may be associated with excavation, construction, mining, and exploration, such as, but not limited to, soil, sand, gravel, ore, slag, salt, fragmented rock, regolith, or any combination thereof.
- dig is intended to refer generally to the actions performed by an ALV to carry out a desired function using its bucket.
- a desired function may be to fill the bucket with material from the rock pile, wherein “dig” may be considered equivalent to "excavate”.
- other actions e.g., "load”
- the dig actions of the ALV are controlled by dig controller embodiments described herein.
- modify means to change, adjust, or alter a magnitude or value, such as to increase or decrease a magnitude or value.
- the magnitude or value may pertain to a sensor signal. Modifying may be performed according to a mathematical operation or function, and/or may be performed in respect of a constant.
- the dig controller embodiments for ALVs described herein provide efficient autonomous excavation in a wide range of materials in applications such as mining, construction, and exploration.
- the embodiments are particularly effective in rock piles including randomly sized fractured rock, which may be encountered in applications such as, for example, mining and construction.
- FIG. 1A A generic ALV is shown in Fig. 1A.
- the ALV includes a bucket 1 attached to a boom 2.
- the bucket is moved by actuating a bucket linear actuator 3 (curl), while the boom is moved by actuating a boom linear actuator 4 (hoist).
- These actuators which may be electric, hydraulic, pneumatic, or a combination thereof, may be equipped with linear sensors or angular encoders to determine the configuration and/or motion of the bucket.
- Each actuator has a cylinder side and a rod side, shown as 7 and 8, respectively, for the bucket actuator 3.
- the boom and bucket actuators 4, 3, respectively, are connected to a vehicle 5 that can drive the boom and actuators to a desired location within the workspace.
- the vehicle drives the boom and bucket forward into the rock pile 6 (e.g., Fig. IB).
- the interaction between the bucket and the rock pile e.g., Fig. 1C
- causes changes in pressure on both the cylinder side 7 and rod side 8 of both linear actuators e.g., Fig. ID, until the bucket is extracted from the rock pile.
- an ALV 10 interacts with a rock pile 6.
- Sensors produce sensor signals 14 representative of interaction between the bucket and the rock pile (e.g., reaction forces 40) and signals representative of motion of one or more bucket actuators 50.
- the sensors signals may be generated using one or more sensor or a combination of sensors selected from, but not limited to, accelerometer, force sensor, pressure sensor, torque sensor, load cell, and strain gauge.
- Bucket velocity may be sensed using one or more sensor or a combination of sensors, transducers, and the like selected from, but not limited to, accelerometer, linear variable differential transformer, wave reflection measurement (e.g., sonar, laser, infrared, video, optical encoder), and potentiometer (e.g., string, linear, or angular).
- the sensor signals are used by the dig controller 20, together with parameters 16 such as target forces 12, to generate control signals 18 that control the ALV.
- Dig controller embodiments may include or utilize a sensing system 30 and controllers to control digging behavior of the ALV. Further detail is shown in the generalized embodiment block diagram of Fig. 2B.
- the sensing system 30 includes at least one sensor 32 and optionally a signal conditioner 34 that provides a sensor signal as input to the dig controller 20, which may include a logic device 22 and memory 24. Manual controls 26 and an operator interface 28 may also be provided.
- One or more sensors may be associated with an actuated element 64 of the ALV.
- the controllers may include an actuator control device 60 to move the boom and bucket actuators 62 to an entry pose, to drive the ALV into the rock pile, and control forward motion of the ALV throughout the dig.
- the sensing system may detect that a force threshold is reached (e.g., 40 in Fig. 2A), upon which the dig controller 20 may use admittance controllers in an actuator control device 60 to regulate the velocity of the boom and/or bucket actuators 62 in response to the sensed forces.
- the sensing system may detect that the bucket actuator is fully extended (e.g., 50 in Fig. 2A), whereupon the forward motion of the ALV may be halted, and a position controller may be used to raise the boom to a weighing pose.
- the sensing system 30 may include at least one linear or angular sensor for each actuator (e.g., boom and bucket), and at least one force sensor for each actuator.
- the force sensors include one or more pressure sensors on each actuator (e.g., one on the cylinder side, and one on the rod side of hydraulic actuators).
- the sensing system may optionally include a sensor for measuring the forward motion of the ALV.
- the sensor may include one or more of an angular wheel encoder, an inertial sensor for detecting initial contact with the rock pile, and a vision system for detecting and/or assessing and/or characterizing the surface state of the rock pile.
- the vision system may include a ranging system capable of generating a 3-D representation of the rock pile surface. The 3-D representation may be used to select a point of contact between the bucket and rock pile such that digging time and effort are minimized.
- a controller may include a proportional, integral, or derivative controller, or any combination thereof.
- Dig controller embodiments are shown in Figs. 3A-3E.
- the dig controller may include one or more admittance controllers 20A (Fig. 3A).
- Admittance controllers respond to changes in force with changes in velocity.
- an admittance controller seeks to maintain a mechanical admittance relationship between the environment (e.g., the rock pile) and a dig tool such that dig tool velocity is altered to achieve a desired environment reaction force.
- an admittance controller may map a force signal to a change in bucket motion (e.g., a desired velocity, as shown in Fig. 3C).
- Sensor signal input to the dig controller may be one or more parameter selected from, or may include all of: entry height, angle, boom force target, throttle, digging boom and bucket force targets, boom and bucket admittance controller gains, breakout condition, and weighing height and angle.
- entry height, angle, boom force target, throttle, digging boom and bucket force targets, boom and bucket admittance controller gains, breakout condition, and weighing height and angle For example, in one embodiment, when bucket forces increase, the velocity of the bucket is adjusted to bring the sensed forces within desired values.
- admittance controllers provides embodiments that are relatively invariant to bucket-rock pile interactions because they regulate force, not position, of the bucket. This dynamic force regulation is particularly desirable for digging through a rock pile with random rock sizes, because pre-determined
- Admittance controller parameters may include proportional, integral, or derivative control terms, and a controller may implement a linear or nonlinear control scheme, e.g., according to a mathematical operation or function, and/or according to a constant.
- An admittance controller may be operated using dig logic 22 such as that shown in the embodiment of Fig. 3B.
- Aggressiveness of an admittance controller may be governed by one or more parameters.
- these parameters are the ALV entry throttle and the target force values 12 for the admittance controllers 20A for the boom and bucket.
- excavation efficiency is governed by the controller parameters and unknown rock pile parameters (more generally, the environmental parameters).
- the unknown rock pile parameters may include, for example, the rock size distribution, the pile shape, rock parameters (shape, Young's modulus, Poisson's ratio, etc.), moisture content, cohesion, and angle of repose, among others. It would be impractical to measure each of these parameters because of their number, and because the rock pile changes so frequently.
- admittance controller overcomes this problem by treating the rock pile as an un- modelled body that provides changing reaction forces as the bucket passes through the pile.
- the admittance controller uses these forces to modify the motion of the bucket without explicitly knowing the characteristics of the rock pile.
- admittance controllers work well when the controller parameters have been tuned for a current state of the rock pile, they may need to be re-tuned when the rock pile changes significantly. For example, an admittance controller tuned for a wet rock pile may be too aggressive when the pile dries out, resulting in wasted effort and decreased efficiency.
- the boom actuator may be used to sense the digging force and provide a sensor signal that is used by the controller (e.g., an admittance controller, an adaptive admittance controller) to change the velocity of the bucket.
- the controller e.g., an admittance controller, an adaptive admittance controller
- no commands are issued to the boom actuator, and forces sensed in the boom actuator are in response to the interaction between the dig tool and the rock pile.
- reaction forces received by the boom actuator provide an indication of the interaction between the dig tool and the rock pile.
- the bucket actuator receives commands from the controller, and the boom actuator becomes an actuated element because no commands are sent to it by the controller.
- a sensor signal may be obtained by measuring strain in an actuated element, such as a boom.
- one or more other elements of the ALV could be used together with, or instead of the boom actuator, to provide sensor signal(s) to the controller, and used for controlling the ALV, provided that such one or more other elements are associated with appropriate sensor(s) to generate sensor signal(s) related to a dig parameter such as interaction between the dig tool and the rock pile.
- Such an embodiment may, for example, reduce strain on ALV components, thereby reducing down-time for maintenance and associated costs. This may be achieved by controlling the payload based on a parameter of a breakout condition, or by modifying such a parameter.
- rock pile parameters can vary significantly from one dig to the next even if the material being extracted remains of the same type.
- Admittance control as described herein has proved resilient to such changes; however, significant changes to digging conditions might give rise to a need to re-tune the admittance controller. Constantly tuning the admittance controller would not be practical or desirable.
- Some embodiments as described herein avoid the tuning problem by including at least one iterative learning controller (ILC) 70, 72, as shown in Figs. 3D and 3E.
- ILC iterative learning controller
- An ILC modifies the inputs to an admittance controller so that the controller parameters can remain constant while the controller response is altered. For example, as shown in Figs.
- an ILC may modify an input sensor signal, such as force, to an admittance controller, so that a desired dig behaviour is achieved while the entry throttle and force targets remain the same.
- an input sensor signal such as force
- an ILC allows the algorithm to respond to changing rock pile conditions without having to re-tune (e.g., select constants that optimize performance) the admittance controller. This feature saves time, and eliminates the need for a specialist who would otherwise be needed for the re-tuning process.
- an adaptive admittance controller may be used. Parameters (e.g., proportional, integral, or derivative control terms) may be tuned or adapted dynamically (e.g., in real time or substantially in real time) to compensate for rapid changes in rock pile characteristics, such as stiffness, during a dig, thereby avoiding the need for modelling the rock pile. For example, an adaptive admittance controller may use the force tracking error to dynamically adjust admittance parameters throughout the dig in real time. In a further embodiment, an adaptive admittance controller may be used together with at least one ILC.
- a dig controller shown in the block diagram of Fig. 3D, includes two admittance controllers 20A and two ILCs 70, 72.
- a further embodiment may also include scripted entry and exit controllers.
- a further embodiment may include a detector for detecting if/when the ALV is stuck.
- the entry controller moves the boom and bucket actuators to an entry pose (e.g., bucket level with and just above the ground) using, for example, a proportional position controller.
- the ALV is then commanded to move towards the rock pile at a rate determined by the entry throttle set point, and the bucket engages the rock pile.
- the admittance controllers begin moving the boom and bucket actuators.
- an exit controller takes over.
- the exit controller moves the boom and bucket to a weighing pose (e.g., bucket fully curled and raised above the rock pile) using, e.g., a proportional position controller.
- a weighing pose e.g., bucket fully curled and raised above the rock pile
- the actuators is used to assess the success of the dig attempt.
- An optimum dig maximizes bucket payload while minimizing dig time and work expended.
- the admittance and position controllers operate at high frequency to perform the digging operations, while the ILCs only operate once per dig cycle.
- An admittance controller may implement any mathematical relationship that maps the range of force errors to a range of possible actuator velocities.
- An admittance controller may modify a parameter, for example, in response to the magnitude of a sensed signal less a desired signal value.
- Fig. 3E is a block diagram of an admittance controller 20A according to one embodiment. Perturbed forces are used by the admittance controller to publish changes in the boom and bucket actuator velocities. These velocities are integrated to provide a set of desired positions for the boom and bucket actuator position controllers 60. The desired positions are tracked by the position controllers to provide the desired change in actuator length. The change in length causes the bucket to move in the rock pile, which causes the reaction forces to change.
- This change in force is sensed by pressure sensors 90 and used to calculate the new boom and bucket actuator forces 80.
- these updated forces are again perturbed by the admittance ILC before being fed back to the admittance controller.
- the total force error 85 is used to update the force perturbation for the next dig attempt, while the entry throttle ILC adds the new entry slope error to the previous entry slope errors so that the next entry throttle perturbation can be calculated.
- an ILC applies a correction 87 to the default entry throttle based on the entry force slope from several previous dig attempts.
- Other parameters used are the digging force targets.
- the ILCs apply a correction 92 to the sensed forces 94 based on the total force error 96 from several previous dig attempts.
- the entry throttle is initially tuned to a set value, the entry throttle is perturbed by the ILC to improve digging efficiency consistency.
- the entry throttle is perturbed by the ILC to improve digging efficiency consistency.
- the initial force rise for each dig attempt may be represented by the slope of a line passing through the lowest force reading, and the highest force reading, during the entry period (between bucket entry and admittance control). These slopes are compared against an ideal entry force slope to calculate the slope error for each dig attempt. These errors are stored in memory and a specified number n of them are summed. The sum 98 is used by the entry ILC to calculate how the entry throttle should be perturbed for the next dig attempt.
- an ILC may modify incoming forces so that the admittance controllers respond more aggressively.
- Figs. 4C and 4D show that the ILCs increase the target entry throttle, and artificially increase the incoming forces. The increased values cause the ALV to enter the rock pile at a higher velocity, and curl and hoist the bucket faster.
- increasing the entry, boom, and bucket velocities increases overall dig controller aggressiveness, and decreases digging variability compared to using parameters obtained from a training rock pile.
- Dig controller embodiments may be implemented in analog and/or digital
- a dig controller may be implemented in whole or in part using discrete components, using digital technology (e.g., in a digital signal processor (DSP), field programmable gate array (FPGA), or application specific integrated circuit (ASIC) device), or using a combination thereof.
- DSP digital signal processor
- FPGA field programmable gate array
- ASIC application specific integrated circuit
- One or more components of the dig controller may be implemented in an algorithm using a suitable hardware language such as, for example, very high speed integrated circuit (VHSIC), hardware descriptive language (VHDL), register transfer language (RTL), or Verilog.
- VHSIC very high speed integrated circuit
- VHDL hardware descriptive language
- RTL register transfer language
- Verilog Verilog
- This example illustrates the design and field testing of an embodiment of a loading algorithm based on admittance control using forces sensed from the bucket-rock interactions to modify the velocity of the bucket during digging.
- the loading algorithm (shown below) has three parts corresponding to three dig phases. The three dig phases, entry, digging, and breakout, are shown schematically in Figs. IB, 1C, and ID, respectively.
- the entry phase is shown in Fig. I B.
- the entry phase ends when the bucket is in the entry position, and the forward motion of the ALV causes the bucket rock reaction forces to rise above a preset value.
- the admittance controller causes the bucket to curl upwards or downwards to maintain a desired reaction force while the boom is used only to measure the digging reaction forces.
- the breakout phase starts when the bucket has fully curled, and ends when the bucket is in the weighing position
- the admittance controller is the part of the algorithm that governs the motion of the bucket through the rock pile.
- the admittance controller uses the error between the sensed dig reaction forces and a digging force target to alter the velocity of the bucket actuator.
- a generalized block diagram for the admittance controller is shown in Fig. 3C. Whereas any controller C can be used to map the force error to the actuator velocities, the admittance controller in this example is one-sided and proportional, such that
- the drive train commands were set such that the loader was driven straight into the rock pile at a constant velocity.
- the entry position was selected such that the bucket scraped the asphalt substrate to ensure the bucket penetrated the rock pile at entry.
- the combination of drive train commands and entry pose resulted in substantially consistent penetration depth.
- the throttle was set to full to maximize the bucket actuator speed and power while the forward thrust was limited by applying partial brake.
- the brake level was set such that the forward thrust tended to increase the forces experienced in the actuators, which caused the admittance controllers to attempt to reduce the forces by curling backwards.
- the forward thrust tends to bias the controller towards the breakout condition ensuring that the dig completes before the bucket forces rise sufficiently to overcome the capacity of the actuators.
- An automated 1 -tonne surface loader and a blasted limestone rock pile were used to test and tune the loading algorithm.
- the loader was a Kubota R520s that was outfitted for automation by adding sensors, actuators, and on-board computer systems. Only boom and bucket extension and pressure sensors were used for this example. The boom and bucket actuator extensions were measured at 10 Hz by a custom hall effect sensor. Each extension sensor contained two Honeywell SPSL225 contactless IP69 linear encoders mounted in a custom housing, Two Measurement Specialties MSP-400 pressure sensors were installed on the rod and cylinder ports of each actuator so that the net force acting on the actuators could be calculated. The pressure sensor data was captured at 107 Hz by a single chicken Uno board.
- the chicken Uno pressure and actuator extension messages were passed to the main computer over a Robot Operating System (ROS) Electric network.
- the main computer was a Mini-ITX Intel Core i5 64-bit PC running Ubuntu 1 1.10, and ROS Electric.
- the main computer used a ROS network to publish and subscribe to topics over a wireless network.
- the autonomous loading algorithm was run on a separate Intel Core i5 64-bit laptop (running Ubuntu 1 1.10, and ROS Electric) connected to the wireless network. This laptop was also used for data collection.
- valves on the loader When considering the actuator positions, valve commands (based on valve positions), and actuator forces for the nominal digs (SI 1 and P7), the valves on the loader have a deadband between ⁇ 0.5. No fluid can flow to the actuators for any commanded valve positions within the deadband, hence any command within the deadband can be treated as zero valve displacement (a closed valve).
- the saturated dig curls the bucket at maximum velocity and the forces oscillate severely.
- the admittance controller alters the curl velocity in response to the changing forces resulting in less severe force changes.
- SI 8 For the slow digs (S I 8 and PI 1), the lack of actuator response to the full valve commands, and the high forces (well above both the entry and digging targets) in SI 8 indicated a network communication issue between the loader computer and the laptop running the loading algorithm.
- the force profile does show the level of force imparted to the pile by the drive train when the bucket stops moving, and the final payload mass indicates that the bucket was filled by the end of the dig.
- PI 1 is more interesting because the forces are very close to the 80 kN force target throughout the dig. When the forces rise above the target the admittance controller curls the bucket, which causes the forces to drop and allows the vehicle to penetrate deeper into the pile. When the loader stalls against the pile the forces rise, and another curl command is sent.
- the average dig efficiency values are given for both the saturated and P controlled digs in Table 1.
- the dig time rose dramatically when the bucket was controlled by the P admittance controller compared to when the bucket was moved at its maximum rate.
- Desired force profiles such as shown in Figs. 6A and 6B, may be used as basis for dividing a loading ILC into two parts: the entry ILC that governs the entry throttle; and the admittance controller ILC that modifies the sensed forces going into the admittance controllers.
- the entry ILC compared the slope of the boom entry force profile to the slope of the desired entry force profile as shown in Fig. 7.
- a force rise below 100 kN/s indicates that the rock pile provided less resistance than a training rock pile, while a force rise above this target indicates a more resistive pile. Compensation for a less resistive pile may be achieved by adjusting the entry throttle according to the relationship shown in Equation 5.
- ⁇ entry is any desired controller that maps the entry slope error e en try slope to a throttle increment, referred to as the entry throttle correction CEntry throttle.
- the simplest controller is a proportional controller entry that linearly maps slope error to a throttle correction increment. is the number of dig cycles to consider, n is an optional weight applied to each entry slope error. This weight term can be used to bias the correction towards a desired set of entry slope error readings. For instance, the most recent entry slope errors are likely to best represent the current state of the rock pile. For example, a weight that exponentially decreases with respect to may be used to apply the largest weights to the most recent tests.
- Equation 6 shows a specific instance of the entry ILC where slope errors from five dig attempts are multiplied by an exponentially decreasing weight, and summed before being multiplied by a proportional gain entry.
- the admittance ILC compares the calculated forces to the desired forces, and uses the result to modify the forces used by the admittance controllers.
- An example force profile is shown in Fig. 8.
- the total error between the sensed forces and the desired forces eFNet is calculated using Equation 7.
- y admittance is the admittance ILC gain. Any general controller Y admittance could be used instead of the proportional controller ) 'admittance.
- ILCs An advantage of the ILCs is that once the admittance controller parameters are tuned for a given vehicle and rock pile they need never be tuned again,
- the ILCs discussed in this section have only two parameters each: the number of previous dig attempts /, and the ILC gains y.
- Another way to view the ILC gains is in terms of the aggressiveness of the entire digging algorithm (admittance and ILC controllers).
- the admittance controllers will respond more aggressively to changes in the rock pile, and if the ILC gains are low the controllers will respond less aggressively. This level of control is perfect for operators since it is a single value that can be tuned based on the overall loading goals. If an LHD payload is below the desired mass flow rate of the mill the operator can increase the aggressiveness of the controller by increasing the ILC gains. If the mass flow rate exceeds what the mill can handle, the ILC gains can be reduced, e.g., to save on tire wear and fuel consumption.
Landscapes
- Engineering & Computer Science (AREA)
- Mining & Mineral Resources (AREA)
- Civil Engineering (AREA)
- General Engineering & Computer Science (AREA)
- Structural Engineering (AREA)
- Mechanical Engineering (AREA)
- Operation Control Of Excavators (AREA)
- Control Of Position, Course, Altitude, Or Attitude Of Moving Bodies (AREA)
Abstract
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201461931243P | 2014-01-24 | 2014-01-24 | |
US201462033904P | 2014-08-06 | 2014-08-06 | |
PCT/CA2015/000044 WO2015109392A1 (fr) | 2014-01-24 | 2015-01-23 | Dispositif de commande de véhicule à chargement autonome |
Publications (4)
Publication Number | Publication Date |
---|---|
EP3102744A1 true EP3102744A1 (fr) | 2016-12-14 |
EP3102744A4 EP3102744A4 (fr) | 2018-03-07 |
EP3102744B1 EP3102744B1 (fr) | 2023-07-05 |
EP3102744C0 EP3102744C0 (fr) | 2023-07-05 |
Family
ID=53680534
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP15740514.3A Active EP3102744B1 (fr) | 2014-01-24 | 2015-01-23 | Dispositif de commande de véhicule à chargement autonome |
Country Status (7)
Country | Link |
---|---|
EP (1) | EP3102744B1 (fr) |
AU (1) | AU2015208631B2 (fr) |
CA (1) | CA2935576C (fr) |
CL (1) | CL2016001684A1 (fr) |
MX (1) | MX2016008819A (fr) |
RU (1) | RU2703086C2 (fr) |
WO (1) | WO2015109392A1 (fr) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP4219844A4 (fr) * | 2020-11-09 | 2024-04-24 | Hiroshima University | Dispositif d'entraînement autonome pour engin de chantier |
Families Citing this family (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9816248B2 (en) | 2015-10-30 | 2017-11-14 | Deere & Company | System and method for assisted bucket load operation |
EP3390730B1 (fr) * | 2015-12-18 | 2023-06-07 | Volvo Construction Equipment AB | Système et procédé permettant de déterminer une entité de matériau à éliminer d'un pieu et unité de commande pour un engin de chantier comprenant un tel système |
CA3129016A1 (fr) * | 2021-04-07 | 2022-10-07 | Queen's University At Kingston | Classification automatique de materiaux d'excavation |
Family Cites Families (23)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH07268897A (ja) * | 1994-03-23 | 1995-10-17 | Caterpillar Inc | 自己適合性掘削制御システムとその方法 |
US5461803A (en) * | 1994-03-23 | 1995-10-31 | Caterpillar Inc. | System and method for determining the completion of a digging portion of an excavation work cycle |
US5493798A (en) * | 1994-06-15 | 1996-02-27 | Caterpillar Inc. | Teaching automatic excavation control system and method |
US5544055A (en) * | 1994-07-29 | 1996-08-06 | Vermeer Manufacturing Company | Track trencher control system and process |
US5553407A (en) * | 1995-06-19 | 1996-09-10 | Vermeer Manufacturing Company | Excavator data acquisition and control system and method of use |
US5681312A (en) * | 1996-05-31 | 1997-10-28 | Acromed Corporation | Spine construct with band clamp |
US6233511B1 (en) * | 1997-11-26 | 2001-05-15 | Case Corporation | Electronic control for a two-axis work implement |
CN1166841C (zh) * | 1998-03-18 | 2004-09-15 | 日立建机株式会社 | 自动操作的挖土机和包括该挖土机的石头压碎系统 |
US6363632B1 (en) * | 1998-10-09 | 2002-04-02 | Carnegie Mellon University | System for autonomous excavation and truck loading |
US6205687B1 (en) * | 1999-06-24 | 2001-03-27 | Caterpillar Inc. | Method and apparatus for determining a material condition |
US6510628B1 (en) * | 2001-10-31 | 2003-01-28 | Caterpillar Inc | Method and apparatus for determining a contact force of a work tool |
US6879899B2 (en) * | 2002-12-12 | 2005-04-12 | Caterpillar Inc | Method and system for automatic bucket loading |
US6845311B1 (en) * | 2003-11-04 | 2005-01-18 | Caterpillar Inc. | Site profile based control system and method for controlling a work implement |
US7630793B2 (en) * | 2004-12-10 | 2009-12-08 | Caterpillar S.A.R.L. | Method of altering operation of work machine based on work tool performance footprint to maintain desired relationship between operational characteristics of work tool and work machine |
US8065060B2 (en) * | 2006-01-18 | 2011-11-22 | The Board Of Regents Of The University And Community College System On Behalf Of The University Of Nevada | Coordinated joint motion control system with position error correction |
US7979181B2 (en) * | 2006-10-19 | 2011-07-12 | Caterpillar Inc. | Velocity based control process for a machine digging cycle |
WO2009011630A1 (fr) * | 2007-07-13 | 2009-01-22 | Volvo Construction Equipment Ab | Procédé pour fournir des instructions d'utilisation à l'opérateur d'une machine-outil et programme informatique pour mettre en oeuvre ce procédé |
US8751114B2 (en) * | 2008-05-27 | 2014-06-10 | Volvo Construction Equipment Ab | Method for controlling a hydraulic system |
WO2009152561A1 (fr) * | 2008-06-16 | 2009-12-23 | Commonwealth Scientific And Industrial Research Organisation | Procédé et système de commande d'engin |
US8160783B2 (en) * | 2008-06-30 | 2012-04-17 | Caterpillar Inc. | Digging control system |
FI20105082A0 (fi) * | 2010-01-29 | 2010-01-29 | Waertsilae Finland Oy | Kaasunvaihtoventtiilin sähköhydraulisen käyttöjärjestelmän säätöjärjestely |
DE102010010718A1 (de) * | 2010-03-09 | 2011-09-15 | Kuka Laboratories Gmbh | Verfahren zur Montage von Bauteilen mittels eines Industrieroboters |
KR101696292B1 (ko) * | 2011-12-15 | 2017-01-13 | 현대중공업 주식회사 | 휠로더의 버켓 지면접촉 방지장치 및 제어방법 |
-
2015
- 2015-01-23 WO PCT/CA2015/000044 patent/WO2015109392A1/fr active Application Filing
- 2015-01-23 MX MX2016008819A patent/MX2016008819A/es active IP Right Grant
- 2015-01-23 CA CA2935576A patent/CA2935576C/fr active Active
- 2015-01-23 AU AU2015208631A patent/AU2015208631B2/en active Active
- 2015-01-23 RU RU2016134403A patent/RU2703086C2/ru active
- 2015-01-23 EP EP15740514.3A patent/EP3102744B1/fr active Active
-
2016
- 2016-06-30 CL CL2016001684A patent/CL2016001684A1/es unknown
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP4219844A4 (fr) * | 2020-11-09 | 2024-04-24 | Hiroshima University | Dispositif d'entraînement autonome pour engin de chantier |
Also Published As
Publication number | Publication date |
---|---|
MX2016008819A (es) | 2016-09-08 |
RU2016134403A (ru) | 2018-03-01 |
AU2015208631A1 (en) | 2016-07-28 |
EP3102744A4 (fr) | 2018-03-07 |
CA2935576C (fr) | 2022-08-02 |
RU2703086C2 (ru) | 2019-10-15 |
EP3102744B1 (fr) | 2023-07-05 |
AU2015208631B2 (en) | 2019-07-25 |
CL2016001684A1 (es) | 2016-11-18 |
RU2016134403A3 (fr) | 2018-08-21 |
CA2935576A1 (fr) | 2015-07-30 |
EP3102744C0 (fr) | 2023-07-05 |
WO2015109392A1 (fr) | 2015-07-30 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US8521371B2 (en) | Systems and methods for remapping of machine implement controls | |
US7949449B2 (en) | Constant work tool angle control | |
US8909437B2 (en) | Payload Estimation system | |
CA2935576C (fr) | Dispositif de commande de vehicule a chargement autonome | |
Bradley et al. | The development, control and operation of an autonomous robotic excavator | |
US9822507B2 (en) | Work vehicle with enhanced implement position control and bi-directional self-leveling functionality | |
Dobson et al. | Admittance control for robotic loading: design and experiments with a 1‐tonne loader and a 14‐tonne load‐haul‐dump machine | |
Blouin et al. | Review of resistive force models for earthmoving processes | |
US5974352A (en) | System and method for automatic bucket loading using force vectors | |
US8924094B2 (en) | System for work cycle detection | |
Fernando et al. | Iterative learning-based admittance control for autonomous excavation | |
Fernando et al. | Towards controlling bucket fill factor in robotic excavation by learning admittance control setpoints | |
Dadhich et al. | Machine learning approach to automatic bucket loading | |
US20060245896A1 (en) | Automatic digging and loading system for a work machine | |
CN104246747A (zh) | 铲的铲斗摆动的自动化控制 | |
CN102341548A (zh) | 建筑机械、建筑机械的控制方法以及使计算机执行该方法的程序 | |
US8972125B1 (en) | Operator induced oscillation filter to prevent instability from operator | |
Maeda et al. | Iterative autonomous excavation | |
Dobson et al. | Admittance control for robotic loading: Underground field trials with an LHD | |
Dang | Dynamic Simulation of a Hydraulic Excavator to Determine the Joint Reaction Forces of Boom, Stick, Bucket, and Driving Forces of Hydraulic Cylinders | |
Lipsett et al. | Modeling excavator-soil interaction | |
Mori et al. | Excavation model of soil sampling device based on particle image velocimetry | |
US11536007B2 (en) | On demand machine rimpull adjustment to prevent tire slip | |
Le et al. | Towards autonomous excavation | |
Chen et al. | Shovel parameter sensitivity analysis and online optimization method for unmanned loaders |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
17P | Request for examination filed |
Effective date: 20160822 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
DAX | Request for extension of the european patent (deleted) | ||
RIC1 | Information provided on ipc code assigned before grant |
Ipc: E02F 9/20 20060101AFI20171011BHEP Ipc: E21C 27/30 20060101ALI20171011BHEP Ipc: E02F 9/26 20060101ALI20171011BHEP Ipc: E02F 3/43 20060101ALI20171011BHEP |
|
A4 | Supplementary search report drawn up and despatched |
Effective date: 20180202 |
|
RIC1 | Information provided on ipc code assigned before grant |
Ipc: E21C 27/30 20060101ALI20180129BHEP Ipc: E02F 9/26 20060101ALI20180129BHEP Ipc: E02F 9/20 20060101AFI20180129BHEP Ipc: E02F 3/43 20060101ALI20180129BHEP |
|
RAP1 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: EPIROC ROCK DRILLS AKTIEBOLAG |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
17Q | First examination report despatched |
Effective date: 20190104 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: GRANT OF PATENT IS INTENDED |
|
INTG | Intention to grant announced |
Effective date: 20230202 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE PATENT HAS BEEN GRANTED |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: REF Ref document number: 1584956 Country of ref document: AT Kind code of ref document: T Effective date: 20230715 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602015084437 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D |
|
U01 | Request for unitary effect filed |
Effective date: 20230710 |
|
U07 | Unitary effect registered |
Designated state(s): AT BE BG DE DK EE FI FR IT LT LU LV MT NL PT SE SI Effective date: 20230719 |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG9D |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20231006 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230705 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20231105 |
|
U20 | Renewal fee paid [unitary effect] |
Year of fee payment: 10 Effective date: 20231219 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: RS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230705 Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20231005 Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20231105 Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230705 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20231006 Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230705 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230705 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602015084437 Country of ref document: DE |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230705 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230705 Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230705 Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230705 |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
26N | No opposition filed |
Effective date: 20240408 |