FI20196023A1 - Method for determining location and orientation of machine - Google Patents

Method for determining location and orientation of machine Download PDF

Info

Publication number
FI20196023A1
FI20196023A1 FI20196023A FI20196023A FI20196023A1 FI 20196023 A1 FI20196023 A1 FI 20196023A1 FI 20196023 A FI20196023 A FI 20196023A FI 20196023 A FI20196023 A FI 20196023A FI 20196023 A1 FI20196023 A1 FI 20196023A1
Authority
FI
Finland
Prior art keywords
tracking
machine
tracking apparatus
orientation
location
Prior art date
Application number
FI20196023A
Other languages
Finnish (fi)
Swedish (sv)
Inventor
Tuomas Kovanen
Antti Kolu
Petri Moisio
Mikko Vesanen
Arto Anttila
Original Assignee
Novatron Oy
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Novatron Oy filed Critical Novatron Oy
Priority to FI20196023A priority Critical patent/FI20196023A1/en
Priority to US17/035,876 priority patent/US11796316B2/en
Priority to JP2020170328A priority patent/JP2021085322A/en
Priority to EP20202819.7A priority patent/EP3828499A1/en
Priority to CN202011329477.6A priority patent/CN112854355B/en
Priority to EP20812314.1A priority patent/EP4065421A1/en
Priority to JP2022525311A priority patent/JP7445756B2/en
Priority to PCT/EP2020/083352 priority patent/WO2021105204A1/en
Priority to CN202080081562.7A priority patent/CN114729808A/en
Priority to FI20225526A priority patent/FI20225526A1/en
Priority to US17/773,018 priority patent/US20220389685A1/en
Publication of FI20196023A1 publication Critical patent/FI20196023A1/en

Links

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01BMEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
    • G01B11/00Measuring arrangements characterised by the use of optical techniques
    • G01B11/002Measuring arrangements characterised by the use of optical techniques for measuring two or more coordinates
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C15/00Surveying instruments or accessories not provided for in groups G01C1/00 - G01C13/00
    • G01C15/002Active optical surveying means
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R11/00Arrangements for holding or mounting articles, not otherwise provided for
    • B60R11/04Mounting of cameras operative during drive; Arrangement of controls thereof relative to the vehicle
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B66HOISTING; LIFTING; HAULING
    • B66CCRANES; LOAD-ENGAGING ELEMENTS OR DEVICES FOR CRANES, CAPSTANS, WINCHES, OR TACKLES
    • B66C13/00Other constructional features or details
    • B66C13/16Applications of indicating, registering, or weighing devices
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B66HOISTING; LIFTING; HAULING
    • B66CCRANES; LOAD-ENGAGING ELEMENTS OR DEVICES FOR CRANES, CAPSTANS, WINCHES, OR TACKLES
    • B66C23/00Cranes comprising essentially a beam, boom, or triangular structure acting as a cantilever and mounted for translatory of swinging movements in vertical or horizontal planes or a combination of such movements, e.g. jib-cranes, derricks, tower cranes
    • B66C23/18Cranes comprising essentially a beam, boom, or triangular structure acting as a cantilever and mounted for translatory of swinging movements in vertical or horizontal planes or a combination of such movements, e.g. jib-cranes, derricks, tower cranes specially adapted for use in particular purposes
    • B66C23/36Cranes comprising essentially a beam, boom, or triangular structure acting as a cantilever and mounted for translatory of swinging movements in vertical or horizontal planes or a combination of such movements, e.g. jib-cranes, derricks, tower cranes specially adapted for use in particular purposes mounted on road or rail vehicles; Manually-movable jib-cranes for use in workshops; Floating cranes
    • EFIXED CONSTRUCTIONS
    • E02HYDRAULIC ENGINEERING; FOUNDATIONS; SOIL SHIFTING
    • E02FDREDGING; SOIL-SHIFTING
    • E02F9/00Component parts of dredgers or soil-shifting machines, not restricted to one of the kinds covered by groups E02F3/00 - E02F7/00
    • E02F9/26Indicating devices
    • EFIXED CONSTRUCTIONS
    • E02HYDRAULIC ENGINEERING; FOUNDATIONS; SOIL SHIFTING
    • E02FDREDGING; SOIL-SHIFTING
    • E02F9/00Component parts of dredgers or soil-shifting machines, not restricted to one of the kinds covered by groups E02F3/00 - E02F7/00
    • E02F9/26Indicating devices
    • E02F9/261Surveying the work-site to be treated
    • EFIXED CONSTRUCTIONS
    • E02HYDRAULIC ENGINEERING; FOUNDATIONS; SOIL SHIFTING
    • E02FDREDGING; SOIL-SHIFTING
    • E02F9/00Component parts of dredgers or soil-shifting machines, not restricted to one of the kinds covered by groups E02F3/00 - E02F7/00
    • E02F9/26Indicating devices
    • E02F9/264Sensors and their calibration for indicating the position of the work tool
    • EFIXED CONSTRUCTIONS
    • E02HYDRAULIC ENGINEERING; FOUNDATIONS; SOIL SHIFTING
    • E02FDREDGING; SOIL-SHIFTING
    • E02F9/00Component parts of dredgers or soil-shifting machines, not restricted to one of the kinds covered by groups E02F3/00 - E02F7/00
    • E02F9/26Indicating devices
    • E02F9/264Sensors and their calibration for indicating the position of the work tool
    • E02F9/265Sensors and their calibration for indicating the position of the work tool with follow-up actions (e.g. control signals sent to actuate the work tool)
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C11/00Photogrammetry or videogrammetry, e.g. stereogrammetry; Photographic surveying
    • G01C11/02Picture taking arrangements specially adapted for photogrammetry or photographic surveying, e.g. controlling overlapping of pictures
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/66Tracking systems using electromagnetic waves other than radio waves
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/87Combinations of systems using electromagnetic waves other than radio waves
    • G01S17/875Combinations of systems using electromagnetic waves other than radio waves for determining attitude
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S19/00Satellite radio beacon positioning systems; Determining position, velocity or attitude using signals transmitted by such systems
    • G01S19/01Satellite radio beacon positioning systems transmitting time-stamped messages, e.g. GPS [Global Positioning System], GLONASS [Global Orbiting Navigation Satellite System] or GALILEO
    • G01S19/13Receivers
    • G01S19/14Receivers specially adapted for specific applications
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S5/00Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations
    • G01S5/16Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations using electromagnetic waves other than radio waves
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S5/00Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations
    • G01S5/16Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations using electromagnetic waves other than radio waves
    • G01S5/163Determination of attitude
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/20Image preprocessing
    • G06V10/22Image preprocessing by selection of a specific region containing or referencing a pattern; Locating or processing of specific regions to guide the detection or recognition
    • G06V10/225Image preprocessing by selection of a specific region containing or referencing a pattern; Locating or processing of specific regions to guide the detection or recognition based on a marking or identifier characterising the area
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/52Surveillance or monitoring of activities, e.g. for recognising suspicious objects
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/40Extraction of image or video features
    • G06V10/62Extraction of image or video features relating to a temporal dimension, e.g. time-based feature extraction; Pattern tracking
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V2201/00Indexing scheme relating to image or video recognition or understanding
    • G06V2201/06Recognition of objects for industrial automation

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Civil Engineering (AREA)
  • Mining & Mineral Resources (AREA)
  • Multimedia (AREA)
  • General Engineering & Computer Science (AREA)
  • Structural Engineering (AREA)
  • Electromagnetism (AREA)
  • Theoretical Computer Science (AREA)
  • Mechanical Engineering (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Operation Control Of Excavators (AREA)
  • Position Fixing By Use Of Radio Waves (AREA)
  • Length Measuring Devices With Unspecified Measuring Means (AREA)
  • Control Of Position, Course, Altitude, Or Attitude Of Moving Bodies (AREA)

Abstract

A method for determining location and orientation of a machine (1) in a worksite (13). The worksite (13) is equipped with at least one reference point (RP, RP1, RP2, RP3). The method comprises setting a tracking apparatus (TA, TA1) on the machine (1), tracking the machine (1) with the tracking apparatus (TA, TA1) by determining location of at least one reference point (RP, RP1, RP2, RP3) in the worksite (13) with respect to the tracking apparatus (TA, TA1), transmitting data from the tracking apparatus (TA, TA1) to a position determination unit (PDU) regarding the tracking, and determining by the position determination unit (PDU) based at least in part on the data received from the tracking apparatus (TA, TA1) the location and orientation of the machine (1) in the worksite (13).

Description

METHOD FOR DETERMINING LOCATION AND ORIENTATION OF MACHINE
FIELD OF THE INVENTION The invention relates to a method for determining location and orienta- tion of a machine in a worksite.
BACKGROUND OF THE INVENTION Different types of work machines may be utilized at different earth- moving work sites or construction sites for example for moving soil or rock mate- rial from one location to another or to lift or lower materials to be used in the con- structions. Examples of this kind of work sites include for example substructure construction work sites or housing construction work sites for buildings and road construction work sites. The work machines like that are for example excavators and mobile cranes. The work machines and the working tools of the work machines should — be able to be positioned very accurately in the work site in order to execute de- signed operations properly. The information regarding the accurate location of the work machine and the tool thereof may be shown to an operator of the work ma- chine so that the operator may use the information when controlling the tool and the machine. This accurate location information of the machine and the tool thereof is especially important when itis utilized in semiautomatic or fully automatic work machines, i.e. work machines operating at least some time without a constant con- trol by the operator of the machine, and whereby possible misplacement of the ma- chine or its tool is not immediately rectified by the operator of the machine. Generally automatic positioning of the machine may be based for exam- > 25 ple on a satellite-based positioning system GNSS (Global Navigation Satellite Sys- N tems), such as GPS (US), GLONASS (RU), Galileo (EU) or Compass (CN). Alterna- - tively, the positioning of the work machine may be provided by means of a total N station positioned to the work site. z However, in every work site there is not necessarily any or accurate * 30 enough satellite-based positioning system available, or the positioning system & available is not sophisticated enough for high-precision determination of the loca- 3 tion and orientation of the machine. Retrofitting of an older machine with a high- N precision system is not necessarily very cost-effective. Also, a setup of the total sta- tion-based positioning system in the work site may be laborious especially if the total station-based system should be removed from the work site daily or many times each day. Therefore, there is a need for a simple positioning solution which is easy to remove and set up again.
BRIEF DESCRIPTION OF THE INVENTION An object of the present invention is to provide a novel method for de- termining location and orientation of a machine in a worksite. The invention is characterized by the features of the independent claim. The invention is based on the idea of using at least one reference point arranged in the worksite and at least one tracking apparatus arranged in the ma- chine, the tracking apparatus being arranged to track the machine with the tracking apparatus by determining location of the at least one reference point RP in the worksite with respect to the tracking apparatus, and thereafter determining the location and orientation of the machine in the worksite based at least in part on the data received from the tracking.
The invention provides a simple solution for determining location and orientation of the machine in the worksite.
Some embodiments of the invention are disclosed in the dependent claims.
According to an embodiment of the method, the method further com- prises initializing a tracking state for the tracking apparatus by determining loca- tion and orientation of the tracking apparatus in a machine coordinate system.
According to an embodiment of the method, the method further com- prises indicating by the position determination unit a current level of accuracy re- garding the location and orientation of the machine achieved by the data received = from the tracking apparatus.
N According to an embodiment of the method, the method further com- - prises determining a level of accuracy regarding the location and orientation of the N machine to be achieved, detecting by the position determination unit a need for E 30 higher level of accuracy regarding the location and orientation of the machine, and n acquiring by the position determination unit an additional tracking data from the S tracking apparatus.
D According to an embodiment of the method, an additional tracking data N from the tracking apparatus is acguired by at least one of: semi-automatically or automatically.
According to an embodiment of the method, the additional tracking data from the tracking apparatus acquired semi-automatically comprises arranging the position determination unit to provide at least one of: indicating an operator the need for the tracking apparatus to detect at least one reference point, indicating the operator the need for the tracking apparatus to detect another reference point, and indicating the operator the need for the tracking apparatus to detect at least one further reference point; and the operator operates the machine according to the indication. According to an embodiment of the method, the setting of the tracking apparatus on the machine comprises setting the tracking apparatus on the machine on an adjustable base, and that the operator operates the adjustable base according to the indication and after each operating of the adjustable base initializing of the tracking state for the tracking apparatus by determining location and orientation of the tracking apparatus in the machine coordinate system occurs.
According to an embodiment of the method, the setting of the tracking apparatus on the machine comprises setting the tracking apparatus on the machine on an adjustable base, and that the additional tracking data from the tracking ap- paratus is acquired automatically by controlling the adjustable base by atleast one of the tracking apparatus and the position determination unit.
According to an embodiment of the method, after the controlling of the adjustable base by at least one of the tracking apparatus and the position determi- nation unit, initializing of the tracking state for the tracking apparatus by determin- ing location and orientation of the tracking apparatus in the machine coordinate system occurs.
According to an embodiment of the method, the method further com- > prises setting one or more additional tracking apparatuses to the worksite and D eguipping the machine with at least one marker point known in the machine coor- = dinate system, acguiring data by the one or more additional tracking apparatuses N by tracking reference point and marker point locations with respect to the respec- N 30 tive one or more additional tracking apparatuses, transmitting the acquired data E from the one or more additional tracking apparatuses to the at least one position 0 determination unit, and determining by the at least one position determination S unit based at least in part on the data received from at least one of the tracking 2 apparatus and the one or more additional tracking apparatuses, the location and N 35 orientation of the machine in the worksite coordinate system.
According to an embodiment of the method, the location and orientation of the tracking apparatus set in the machine may be defined in the ma- chine coordinate system using one of the additional tracking apparatuses.
BRIEF DESCRIPTION OF THE DRAWINGS In the following the invention will be described in greater detail by means of preferred embodiments with reference to the accompanying drawings, in which Figure 1 shows schematically a side view of an excavator; Figure 2 shows schematically an upper view of a worksite; Figure 3 shows schematically some components of a positioning system for determining location and orientation of a machine in a worksite; Figure 4 shows schematically an embodiment of a method for determin- ing location and orientation of a machine in a worksite; Figure 5 shows schematically a reference marker with number of refer- ence points to be arranged in the worksite for the determination of location and orientation of a machine in a worksite; Figure 6 shows schematically a marker with number of marker points to be arranged on the machine for the determination of location and orientation of a machine in a worksite; Figure 7 shows schematically an embodiment of a tracking apparatus; Figure 8 shows schematically sensors possibly arranged in a machine and/or a tracking apparatus; Figure 9 shows schematically some possible tracking states of the track- ing apparatus; Figure 10 shows schematically an upper view of a second worksite; Figure 11 shows schematically an embodiment of another method for = determining location and orientation of a machine in a worksite; and N Figure 12 shows schematically an upper view ofa third worksite. - For the sake of clarity, the figures show some embodiments of the in- N vention in a simplified manner. Like reference numerals identify like elements in E 30 the Figures. & DETAILED DESCRIPTION OF THE INVENTION 3 Figure 1 is a schematic side view of an excavator 1 at a worksite 13 wherein the excavator 1 is intended to be operated. The excavator 1 is one example of a work machine in connection with which the method and positioning system disclosed may be utilized.
The excavator 1 comprises a movable carriage 2 comprising an under carriage 2a, i.e. a lower carriage 2a, and an upper carriage 2b. The lower carriage 2a comprises caterpillar bands but could alternatively be provided with wheels. The upper carriage 2b is connected to the lower carriage 2a by means of a rotation 5 axle 3 of the upper carriage 2b. The upper carriage 2b may be rotated relative to the lower carriage 2a around a rotation axis 4 as shown schematically with an ar- row R. The rotation axis 4 coincides to a centre axis of the rotation axle 3. The excavator 1 further comprises a boom 5 connected at the upper car- riage 2b, whereby the boom 5 is arranged to turn together with the upper carriage 2b. The boom 5 may comprise at least a first boom part 5a. The boom 5 may also comprise further boom parts, such as a second boom part 5b. The boom 5 may be lifted and lowered relative to the upper carriage 2b as shown schematically with an arrow L. The second boom part 5b may be connected to the first boom part 5a by means of a joint 6, allowing the second boom part 5b to turn about the first boom part 5a as shown schematically with an arrow T6. At a distal end of the second boom part 5b there is a working tool, in this case a bucket 7, and between the bucket 7 and the second boom part 5b there may be a joint 8, allowing the bucket 7 to be turn about the second boom part 5b as shown schematically with an arrow T8.In connection with the joint 8 there may also be joints or mechanisms allowing the bucked to be tilted in a sideward direction, for example.
On the carriage 2 there may be a control cabin 9 for an operator 10 of the excavator 1. The control cabin 9 may, for example, be provided with a moving arrangement allowing a vertical position of the control cabin 9 to be adjusted rela- — tive to the carriage 2.
> The excavator 1 further comprises at least one control unit 11 which is D configured to control, in response to received control actions, operations of the ex- = cavator 1, such as operations of the carriage 2, the boom 5 and the bucket 7. N The excavator 1 may further comprise a number of satellite receiving N 30 devices, such as antennas 12, if the excavator 1 is intended to be able to utilize a E kind of a satellite-based positioning system GNSS (Global Navigation Satellite Sys- 0 tems). Antennas 12 may for example be placed on the upper carriage 2b. S Figure 2 shows schematically an upper view of the worksite 13 wherein 2 the excavator 1 is about to operate. In the example of Figure 2 there is at the N 35 worksite 13 the excavator 1 as well as some equipment of the positioning system PS for determining the location and orientation of the excavator 1, or alternatively some other machine, in the worksite coordinate system WCS. Also a control system of the excavator 1 may comprise a machine coordinate system MCS of its own, whereby the machine coordinate system MCS may be fixed to machine with marker points MP arranged in the machine such that the positioning provided by the positioning system PS allows the machine coordinate system MCS to be identi- fied with respect to the worksite coordinate system WCS. The worksite coordinate system WCS and the machine coordinate system MCS are shown schematically in Figure 1. Figure 3, in turn, shows schematically an embodiment of the positioning system PS with some additional equipment related to the positioning system PS. The positioning system PS comprises at least one reference marker RM, i.e. one or more reference markers RM set in the worksite 13. The reference marker RM arranged in the worksite 13 may for example be aruco marker, QR-code, light emitting marker, light reflecting marker, prism or the like. Each reference marker RM provides at least one reference point RP, i.e. one or more reference points RP, — whereby there is at least one reference point RP in the worksite 13 determined in the worksite coordinate system WCS for the determination of the location and ori- entation of the machine. For the sake of clarity, determining and/or defining and/or calculating an orientation of a machine and/or an apparatus in worksite and/or in a coordinate system in this description means the determining the needed three angles, such as roll, pitch and yaw, to accurately determine in which position the machine and/or the apparatus is in the worksite and/or the coordinate system. Thus, when a location of at least one point and/or spot of a machine and/or an apparatus, which point and/or spot known in its own coordinate system, is or may be determined and an orientation of the machine and/or the apparatus is or — may be determined, the machine and/or the apparatus may be fixed and/or placed > and/or set and/or positioned accurately into the worksite or the coordinate sys- > tem.
~ In the example of Figure 2 there are schematically shown three refer- N ence markers RM, i.e. a first reference marker RM1, a second reference marker RM2 N 30 and a third reference marker RM3 set or arranged in the worksite 13. Each refer- E ence marker RM1, RM2, RM3 comprises one reference point RP, i.e. the first refer- 0 ence marker RM1 comprises a first reference point RP1, the second reference S marker RM2 comprises a second reference point RP2 and the third reference 2 marker RM3 comprises a third reference point RP3. The specific reference point N 35 RP may be provided by a specific point in the aruco marker or by a specific light emitting device in the light emitting marker, for instance. In the example of Figure itis shown schematically a reference marker RM with three reference points RP, i.e. a first reference point RP1, a second reference point RP2 and a third reference point RP3. Fach of the reference points RP are identifiable and the locations of the reference points RP are determined in the worksite coordinate system WCS.
Thus, 5 having an identification data of a reference point RP, the location of the reference point RP in the worksite coordinate system WCS may be determined.
The positioning system PS further comprises at least one marker MA, i.e. one or more markers MA set on the machine, i.e. in the excavator 1. The marker MA arranged on the machine may for example be aruco marker, OR-code, light emitting marker such as optitrack, light reflecting marker or the like.
Each marker MA provides at least one marker point MP, i.e. one or more marker points MP, whereby there is at least one marker point MP on the machine for the determina- tion of the location and orientation of the machine.
Each of the marker points MP of each machine are identifiable and the locations of the marker points MP are de- termined in the machine coordinate system MCS so that the positioning system PS positioning and identifying the marker points MP may be positioning the machine coordinate system MCS, i.e. the machine.
Thus, having an identification data of a marker point MP, the location of the marker point MP in the machine coordinate system MCS may be determined.
In the example of Figure 1 there are schematically shown two markers MA, i.e. a first marker MA1 and a second marker MA2, arranged on the machine.
Each marker MA1, MA2 comprises one marker point MP, i.e. the first marker MA1 comprises a first marker point MP1 and the second marker MA2 comprises a sec- ond marker point MP2. The specific marker point MP may be provided by a specific — pointin the aruco marker or by a specific light emitting device in the light emitting > marker, for instance.
In the example of Figure 6 it is shown schematically a marker O MA with three marker points MP, i.e. a first marker point MP1, a second marker = point MP2 and a third marker point MP3. N The positioning system PS further comprises at least one tracking appa- N 30 ratus TA, i.e. one more tracking apparatuses TA arranged in the worksite 13. The E tracking apparatus TA tracks or monitors reference points RP and marker points 0 MP and especially the identification data and locations thereof relative to the track- S ing apparatus TA in the worksite 13. Based on the initialization of the tracking the 2 tracking apparatus TA tracks the locations of the atleast one identified reference N 35 point RP in the worksite 13 and the at least one identified marker point MP in the machine.
Thus, by using the identification data of the at least one reference point
RP the positioning system PS is able to locate the reference point RP in the worksite coordinate system WCS, by using the identification data of the at least one marker point MP the positioning system PS is able to locate the marker point MP in the machine coordinate system MCS and after the positioning system PS has tracked the location of the at least one identified reference point RP and at least one iden- tified marker point MP with respect to it, the positioning system PS is able to de- termine the location and orientation of the machine coordinate system MCS, i.e. the machine, in the worksite coordinate system WCS. The tracking apparatus TA com- prises at least one tracking device TD, i.e. one or more tracking devices TD to pro- vide a visual communication between the tracking apparatus TA and reference points RP and marker points MP. Furthermore, the tracking apparatus TA com- prises means, such as an input-output unit, for receiving and/or sending infor- mation.
The tracking or monitoring takes place or is carried out through a visual communication between the tracking apparatus TA and respective reference points RP and marker points MP. In the example of Figure 2 there are two tracking apparatuses TA arranged in the worksite 13, i.e. a first tracking apparatus TA1 and a second tracking apparatus TAZ. The first tracking apparatus TA1 comprises three tracking devices, i.e. a first tracking device TD1, a second tracking device TD2 and a third tracking device TD3 to provide at some time instant a first visual connection TD1_RP1 between the first tracking device TD1 and the first reference point RP1, a second visual connection TD2 RP2 between the second tracking device TD2 and the second reference point RP2 and a third visual connection TD3 RP3 between the third tracking device TD3 and the third reference point RP3. Additionally, the second tracking device TD2 is arranged to provide a fourth visual connection > TD2 RM2 between the second tracking device TD2 and the second marker point D MP2. The second tracking apparatus TA2 comprises two tracking devices, i.e. a = fourth tracking device TD4 to provide a fifth visual connection TD4 MP1 between N the fourth tracking device TD4 and the first marker point MP1 and a fifth tracking N 30 device TD5 to provide a sixth visual connection TD5 MP2 between the fifth track- E ing device TD5 and the second marker point MP2. Additionally, the fifth tracking 0 device TD5 is arranged to provide a seventh visual connection TD5 RP2 between S the fifth tracking device TD5 and the second reference point RP2. 2 In the embodiment of Figure 2 there are shown two tracking apparat- N 35 uses, i.e. the first tracking apparatus TA1 provided with three tracking devices TD1, TD2, TD3 to track at some time instant the reference point RP1, RP2, RP3 locations and the second marker point MP2 location, and the second tracking apparatus TA2 provided with two tracking devices TD4, TD5 to track at some time instant the marker point MP1, MP2 locations and the second reference point RP2 location. However, each of the tracking apparatuses TA1, TA2 could comprise only a single — tracking device to track the respective reference point RP1, RP2, RP3 locations and marker point MP1, MP2 locations. Furthermore, the positioning system could com- prise only a single tracking apparatus with one or more tracking devices TD to track the reference point RP1, RP2, RP3 and marker point MP1, MP2 locations. Fur- ther, if two or more tracking apparatuses TA, e.g. TA1, TA2, are at known orienta- tion and location with respect to each other, it corresponds to an arrangement hav- ing one tracking apparatus TA and all the tracking devices TD (such as TD1, TD2, TD3, TD4, TD5) of the two or more tracking apparatuses TA (such as TA1, TAZ), whereby, in cases TA1 manages to track only reference points RP and TAZ manages to track only marker points MP the combination of all the acguired data enables — the determination of the location and orientation of the machine in the worksite
13.
The tracking device TD1, TD2, TD3, TD4, TD5 is a device capable to es- tablish or provide a visual connection between the tracking apparatus TA and the at least one reference point RP and/or the at least one marker point MP. According to an embodiment the tracking device is a camera, a stereocamera or a tachymeter.
The camera and/or the stereocamera may be eguipped with a lens or an objective having such a focal point that the camera and/or the stereocamera is capable of establishing an accurate visual connection to objects remaining substan- tially close to the camera and/or the stereocamera or farther from the camera and/or the stereocamera, such as objects locating in the worksite 13 substantially > farther away from the camera and/or the stereocamera than the machine. The D camera and/or the stereocamera may therefore be capable of providing zooming = effect to the objects locating substantially far away from the tracking apparatus TA. N According to an embodiment of the tracking apparatus TA, the tracking N 30 apparatus TA comprises a camera, or some other tracking device TD, and a base B E for the camera or some other tracking device, whereby the tracking apparatus TA 0 may be set at a specific fixed position at a ground in the worksite 13. Figure 7 shows 3 schematically, on the left, this kind of tracking apparatus TA.
S In order to gain high accuracy using one camera, or some other tracking N 35 device TD, tracking apparatus TA, the tracked reference points RP and marker points MP should be farther apart from each other and/or they may not be too far away from the tracking apparatus TA. Using one camera, there should preferably be at least four reference points RP forming a plane and at least four marker points MP forming a plane as well. Using two, three or more tracking devices TD in track- ing apparatus TA, the distances between the tracking apparatus TA and the refer- ence points RP and marker points MP may be longer and the amount of tracked reference points RP and marker points MP may be smaller. In other words, the more tracking devices TD there is, the more tracked reference points RP there is, the more tracked marker points MP there is and the less distance between the tracking apparatus TA and the tracked reference points RP and the tracked marker points MP there are, the higher the accuracy is. Bearing in mind that the locations of the tracked reference points RP compared to each other influence on the accu- racy, as well as the locations of the tracked marker points MP compared to each other influence on the accuracy. Preferably, each tracking apparatus TA having a number of tracking devices TD, i.e. one or more tracking devices, tracks constantly atleast one reference point RP and at least one marker point MP.
According to another embodiment of the tracking apparatus TA, the tracking apparatus TA may comprise a base that is capable to move within bound- aries of the worksite 13, whereby a position of the tracking apparatus TA in the worksite 13 may be easily changed. This kind of tracking apparatus TA may for example be a drone provided with two or more tracking devices TD. A control unit of the drone may be configured in such a way that the drone is not allowed to ex- ceed the boundaries of the worksite 13. During the determination of location and orientation of a machine in the worksite 13 the drone is preferably stationary. Al- ternatively, the drone may be stationary only in times when a threshold level re- garding requested accuracy of position and orientation of a machine may not oth- > erwise be exceeded. S The base B of the tracking apparatus TA may be adjustable, whereby an ~ alignment of the tracking apparatus TA may be adjusted by adjusting the alignment N of the base B. Therefore, according to an embodiment of the positioning system PS, N 30 atleast one of the tracking devices TD may be installed on an adjustable base. The E adjustable base of the tracking device TD allows the orientation of the base B and 0 thereby the orientation of the tracking device TD to be adjusted conveniently by, S for example, taking into account the area where the machine will be working 2 and/or the locations of the nearest reference points RP. N 35 According to an embodiment of the positioning system, the tracking ap- paratus TA comprises means for acguiring data relating to the orientation of each of the tracking devices TD on adjustable bases B with respect to the tracking appa- ratus TA. When the orientation of the tracking device TD with respect to the track- ing apparatus TA is known, the position and orientation of the machine may be de- termined accurately. The adjustment of the base B may be automated or remote controlled, butit may also be manually operated, whereby there may be in the base B a scale division to indicate the orientation of the base B, for example, mounting points selectable in the direction of rotation, for example, in every 5 to 15 degrees.
The positioning system PS further comprises at least one position de- termination unit PDU, i.e. one or more position determination units PDU. The posi- — tion determination unit PDU comprises receiving means for receiving data ac- quired by the at least one tracking apparatus TA. The data acquired by the at least one tracking apparatus TA comprises identification data for identifying reference points RP and marker points MP as well as the locations thereof relative to the tracking apparatus TA, i.e. the locations of the reference points RP identified and the locations of the marker points MP identified relative to the location of the de- tecting tracking apparatus TA, the identification data associating each specific ref- erence point RP in the worksite coordinate system WCS and each specific marker point MP in the machine coordinate system MCS with respective location data of each reference point RP and each marker point MP relative to the tracking appa- ratus TA.
The locations relative to the location of the tracking apparatus are, for example, three dimensional coordinates in the coordinate system of the tracking apparatus. Alternatively, the locations may be three-dimensional coordinates in the worksite coordinate system WCS and/or three-dimensional coordinates in the — machine coordinate system MCS.
> The position determination unit PDU further comprises determining O means for determining, based at least in part on the received data, i.e. based at least = in part on the data acguired by the tracking apparatus TA, the location and orien- N tation of the machine in the worksite coordinate system WCS. If there is also avail- N 30 able the machine coordinate system MCS fixed to the machine, the location and ori- E entation of the machine in the worksite coordinate system WCS may be trans- n formed to the location and orientation of the worksite in the machine coordinate S system MCS to implement work tasks to be carried out by the machine. 2 The at least one position determination unit PDU may be implemented N 35 byacombination of hardware and software. The implementation comprises an in- put/output-unit to communicate with other devices connected with the position determination unit PDU and a microprocessor or some other processing means ca- pable to carry out a computer program that is configured to process the data re- ceived by the position determination unit PDU. The implementation may also com- prise at least one memory unit to store at least temporarily the data received by the position determination unit PDU and/or the data to be sent forward from the position determination unit PDU.
The at least one position determination unit PDU may for example re- side in a computer reachable by any wired or wireless network, and/or the ma- chine and/or the at least one tracking apparatus TA. When the position determina- — tion unit PDU resides in the computer reachable by any wired or wireless network, the physical location of the position determination unit PDU may be selected freely, the position determination unit PDU may thus be inside or outside of the worksite
13. When the position determination unit PDU resides in the machine, it may for example be implemented in the control unit 11 of the machine. When the position determination unit PDU resides in the at least one tracking apparatus TA, the track- ing apparatus TA is configured to comprise necessary means to implement the op- eration of the position determination unit PDU.
In the case of the at least one position determination unit PDU residing in a computer reachable by any wired or wireless network or in the at least one tracking apparatus TA, or at least one position determination unit PDU not residing in the control unit of the machine, the machine comprises at least one control unit, such as the control unit 11, acquiring data regarding the location and orientation of the machine, wherein the control unit is configured to select at least one position determination unit PDU from which it receives the determined location and orien- tation of the machine in the worksite 13.
> According to an embodiment, at least one position determination unit D PDU comprises receiving means for receiving data acguired by the machine. The = data acguired by the machine may for example regard to data acguired by at least N one sensor SM (Figure 1), i.e. one or more sensors SM possibly installed in the ma- N 30 chine for determining position and/or orientation and/or inclination and/or head- E ing of the machine. The one or more sensors SM possibly installed in the machine n are discussed in more detail later. S When the location and orientation of the machine in the worksite 13 is 2 determined, at least one marker point MP is arranged on the machine and at least N 35 one reference point RP is arranged in the worksite 13. The method further com- prises arranging at least one tracking apparatus TA in the worksite 13, for acquiring data by tracking reference point RP locations and by tracking marker point MP locations with respect to the tracking apparatus TA. The data acquired by the tracking apparatus TA is transmitted from the tracking apparatus TA to the po- sition determination unit PDU. The position determination unit PDU determines, based at least in part on the acquired data received from the tracking apparatus TA, the location and orientation of the machine in the worksite 13. Figure 4 shows schematically an embodiment of the method for determining location and orienta- tion of the machine in the worksite 13. The installation of the tracking apparatus TA at the worksite 13 may be implemented only by arranging the tracking apparatus TA in the worksite 13, and thereafter the tracking apparatus TA may itself track or find the at least one refer- ence point RP and the at least one marker point MP in the worksite 13 and acquir- ing data about the locations of the at least one reference point RP and the at least one marker point MP in the worksite 13. There is thus no need to accurately adjust — or position the tracking apparatus TA in the worksite 13 unlike generally known tachymeter or similar device.
Basically, the tracking apparatus TA is configured to find all the refer- ence points RP and the marker points MP that are in an operating range of the tracking apparatus TA. If there is not any reference point RP or any marker point MP setin the worksite 13, the tracking apparatus TA is not able to acguire data from the at least one reference point RP and/or from the at least one marker point MP and will therefore not provide the respective data about the location of the at least one reference point RP and/or the at least one marker point MP. In case where the tracking apparatus TA is arranged in the worksite 13 and it is unable to identify any reference points RP and/or marker points MP, the tracking apparatus may sig- > nal it by any known means. Also, the tracking apparatus may signal by any known D means how many reference points and/or marker points MP it is able to identify = from its current location. Thus, the person who is arranging the tracking apparatus N TA in the worksite may get feedback regarding what kind of place the person is N 30 arranging the tracking apparatus TA to. The feedback may indicate the accuracy E level reachable by the current location of the tracking apparatus TA.
0 The minimum requirement for the tracking apparatus TA to start assist- S ing in determining the location and orientation of a machine is to identify at least 2 one reference point RP and track its location with respect to the tracking apparatus N 35 and to identify at least one marker point MP and track its location with respect to the tracking apparatus and transmit the data regarding the tracked reference point
RP identification and tracked marker point MP identification and their tracked lo- cations with respect to the tracking apparatus to at least one position determina- tion unit PDU. If the minimum requirements are not fulfilled, the tracking appa- ratus TA may indicate it.
Further, in addition to all the information transmitted by the tracking apparatus TA to the position determination unit PDU, the position determination unit PDU need to acquire the location information of the identified reference point RP in the worksite coordinate system WCS and to acquire the location information of the identified marker point MP location in the machine coordinate system MCS.
The location information relating to the reference points RP in the worksite coor- dinate system WCS and the marker points MP in the machine coordinate system MCS may be received by the position determination unit PDU in any known method. To start determining the location and orientation of a machine, the po- — sition determination unit PDU may need additional information. The additional in- formation needed depends on how much information the position determination unit PDU receives from a tracking apparatus TA. Thus, regarding the arranging the tracking apparatus TA, it need be ar- ranged such that it is able to identify at least one reference point RP and at least one marker point MP. The person arranging the tracking apparatus TA may be aware of that the machine has not arrived in the worksite 13 yet, so if the tracking apparatus TA informs it cannot find any marker points MP, the person may ignore that information. Or, if some temporary barrier prevents the tracking apparatus TA to identify one or more reference points RP and it leads to a situation that the track- ing apparatus TA is not able to identify any reference point RP, the person may > ignore that information and be aware that the tracking may begin only after the S temporary barrier has been moved away. ~ According to an embodiment of the positioning system PS, at least one N tracking apparatus TA comprises at least one sensor STA (Figure 7), i.e. one or N 30 more sensors STA for determining position and/or orientation and/or inclination E and/or heading of the tracking apparatus TA. The data including the information 0 about the position and/or orientation and/or inclination and/or heading of the 3 tracking apparatus TA is also considered to be data acquired by the tracking appa- S ratus TA, whereby the data acguired by the tracking apparatus TA and communi- N 35 cated to the position determination unit PDU may also comprise the data including the information about the position and/or orientation and/or inclination and/or heading of the tracking apparatus TA.
According to an embodiment of the positioning system PS, the machine comprises at least one sensor SM (Figure 1), i.e. one or more sensors SM for deter- mining position and/or orientation and/or inclination and/or heading of the ma- chine. The sensors in the machine may also include sensors relating to the deter- mination of the orientation of the working tool of the machine. The effect of this embodiment is that in the event of the visual communication lacking between the tracking apparatus TA and the at least one reference point RP in the worksite 13 and/or the at least one marker point MP in the machine, for example due to an obstacle occurring between the machine and the at least one reference point RP and/or the marker point MP, the machine may still be able to continue, at least to some time, the operation thereof because of information acquired by the at least one sensor SM in the machine. The machine may for example remain at its current state which has been already determined by the position determination unit PDU — before the obstacle occurring between the tracking apparatus TA and the at least one reference point RP and/or the marker point MP and continue to determine or track the position of the working tool relative to the machine. The time period how long the machine may be able to continue its operation may depend on the accuracy required at current task and the data acquired by the tracking apparatus TA before the obstacle occurring between the machine and the at least one reference point RP and/or the at least one marker point MP. The time period may as well depend on how accurate the at least one sensor SM in the machine is as well as how many sensors SM there are. Another effect relating to that the sensors in the machine may also include sensors relating to the determination of the orientation of the working — tool of the machine is that if one or more marker points MP reside a place that is > not fixedly connected to the part of the machine where, for example, the origin of D the machine coordinate system MCS locates, the position determination unit PDU = needs the information on how was the place oriented with respect to the machine N coordinate system MCS or which was the location of the marker point MP in gues- N 30 tion in machine coordinate system MCS in the exact time of tracking. This kind of E places may be found, for example, from the boom 5 of the excavator 1, where, for n example, MP2 of FIG. 1 resides.
S The one or more sensors in the machine and/or in the tracking appa- 2 ratus TA may be at least one of: a gyroscope, an accelerometer, an inclinometer, a N 35 magnetic compass, a satellite-based compass, an angle sensor, a position sensor, a pendulum, a spirit level measuring device and any other sensor, such as camera sensors, laser receiver/detector or lidar, suitable for the purpose of determining at least one of position, location and orientation of at least one of an object and one or more objects attached to each other.
Figure 8 shows schematically some of these sensors.
When considering for example the excavator 1, the term object herein re- fers to the boom 5, the boom parts 5a, 5b thereof and the working tool, such as the bucket 7. In the excavator 1 the sensors are preferably selected in such a way that it is possible to determine the mutual orientation of the under carriage 2a and up- per carriage 2b as well as the orientation of the boom 5 and/or the parts 5a, 5b thereof and the working tool, such as the bucket 7, relative to the under carriage 2a and upper carriage 2b.
When considering for example the excavator 1, the term object herein refers to the mutual orientation of the tracking devices TD in the tracking apparatus TA and mutual orientation of the tracking device TD and a pos- sible base B thereof.
According to an embodiment the tracking apparatus TA further ac- quires data relating to stability of the tracking apparatus TA.
The stability of the tracking apparatus describes reliability of the data acquired by the tracking appa- ratus.
According to an embodiment for acquiring data relating to the stability of the tracking apparatus TA, the tracking apparatus TA comprises at least one gy- roscope and/or at least one accelerometer for determining the stability of the tracking apparatus TA.
The at least one gyroscope and/or the at least one accel- erometer may be used to determine for example swinging or shaking of the track- ing apparatus TA, an amount of swinging or shaking of the tracking apparatus TA depicting the stability of the tracking apparatus TA which, in turn, describes the accuracy of the data acquired by the tracking apparatus TA. > According to a further embodiment for acquiring data relating to the D stability of the tracking apparatus TA, it may be consecutively observed from the = data acguired by the tracking apparatus TA relating to the at least one reference N point RP.
According to an embodiment like this, the position determination unit N 30 PDU,for example, may be configured to determine a variation of the data acquired E by the tracking apparatus TA, and in case of the variation being significant, i.e. 0 higher than the accuracy needed to carry out the work, it may be assumed that at 3 least one of the reference point RP and the tracking apparatus TA is swinging or S shaking, whereby the accuracy of the data acguired by the tracking apparatus TA N 35 may be lower than expected.
Being significant may depend on the current accuracy needed.
The accuracy for the specific work task may for example be setin a building information model (BIM-model) set for the worksite 13. The position determina- tion unit PDU may indicate the variation level, for example, in millimetres and/or in degrees and the operator may take it into account as lowered accuracy.
Alterna- tively, the PDU may analyse the data acquired by the tracking apparatus TA and indicate the operator the cause of the variation.
According to an embodiment a tracking state of the tracking apparatus TA is to be determined.
The tracking state of the tracking apparatus TA describes a current prevailing operation state of the tracking apparatus TA.
The tracking state of the tracking apparatus TA may be determined based on the data acquired by the — tracking apparatus TA.
The operation of the tracking apparatus TA may comprise at least the states Active, Tracking, Positive, Pending and Out, one stage of those prevailing at a time.
Figure 9 shows schematically some possible tracking states of the tracking apparatus TA.
When the tracking apparatus TA is on Active-state, the tracking appa- ratus TA acquires data by tracking the reference point RP and the marker point MP locations and transmits the acquired data forward to the position determination unit PDU.
The tracking apparatus TA does not, however, provide any indication about the accuracy, reliability or validity of the acquired data.
When the tracking apparatus TA is on Tracking-state, the tracking ap- — paratus TA acquires data by tracking the reference point RP and the marker point MP locations as well as acquires data from the sensors STA installed on the tracking apparatus TA and transmits the acquired data forward to the position determina- tion unit PDU.
Additionally, the tracking apparatus TA is actively conscious, for ex- ample, based on the determined accuracy and/or the amount of the acquired data asdisclosed above, that it is capable of tracking a point and/or spot of any kind in > the worksite coordinate system WCS accurately, i.e. correctly enough.
Alterna- D tively, based on what amount and which kind of sensors STA (disclosed above) are = installed on the tracking apparatus TA, there may be determined the minimum N amount of reference points RP and/or marker points MP to be tracked in each sit- N 30 uation to be able to deem that the tracking apparatus TA is on Tracking-state.
Thus, E if itis tracked at least the minimum amount of reference points RP and/or marker 0 points MP, the tracking apparatus is on Tracking-state and otherwise it is in some S other state. 2 When the tracking apparatus TA is on Positive-state, the tracking appa- N 35 —ratus TA acquires data by tracking reference point RP and marker point MP loca- tions and transmits the acguired data forward to the position determination unit
PDU. Additionally, the tracking apparatus TA is conscious of that it is operating cor- rectly but for some reason, the correct operation of the tracking apparatus TA can- not be verified. One of the reasons may be that while being on Tracking-state, the minimum amount of tracked reference points RP is not fulfilled but, for example, the sensors installed on the tracking apparatus TA are able to verify that the stabil- ity of the tracking apparatus TA has not changed to a lower level after the situation the tracked reference points RP dropped below the minimum amount. The reason for this kind of situation may be, for example, people walking between one or more tracked reference points RP and the tracking apparatus TA. If this kind of situation lasts too long, the tracking state will be deemed to Active-state or, for example, someone approached to the tracking apparatus TA to shut it down.
When the tracking apparatus TA in on Out-state, the tracking apparatus TA is out of operation. It may, for example, have been shut down.
When the tracking apparatus TA in on Pending-state, the tracking appa- — ratus TA is initializing its operation and changing its state from the Out-state to- wards the Tracking-state or the Active-state.
According to an embodiment the tracking apparatus TA is configured to determine the tracking state thereof and the tracking apparatus TA is further con- figured to transmit to the position determination unit PDU the tracking state and/or a change in the tracking state. The tracking apparatus TA may thus com- prise necessary data processing means to identify its state and to transmit the state information forward.
According to an embodiment an availability of location-based features of the machine is dependent on the tracking state. According to this embodiment it is possible, depending on the tracking state of the tracking apparatus TA, that there > is not available for the machine any position data at all or position data is not suf- S ficient enough for work tasks reguiring high accuracy, whereby the work task, that ~ require utilizing position data the needed accuracy of which is above the current N accuracy available, cannot be carried out but still it may be possible to carry out N 30 some other work tasks requiring accuracy that is equal or below current accuracy E available. As well, some work tasks may reguire high certainty in minimum level of 0 accuracy, thus, these work tasks may be unavailable if the tracking state is not S Tracking. Alternatively, if the machine has many sensors SM assisting the position 2 determination unit PDU, also Active and Positive tracking states may be enough, at N 35 least, for example, in cases where the state has a short period of time ago been Tracking.
According to an embodiment the tracking state of the tracking appa- ratus TA reaching the level of tracking accuracy capable of tracking a point and/or spot of any kind in the worksite coordinate system WCS accurately may be deter- mined by at least one of: a) acquiring data by tracking at least three reference points RP with respect to the tracking apparatus TA; b) acquiring data by tracking one to two reference points RP with respect to the tracking apparatus TA in addi- tion to acquiring data relating to an inclination of the tracking apparatus TA, and c) acquiring data by determining locations of at least four satellites with respect to the tracking apparatus TA.
According to an embodiment the tracking state of the tracking appa- ratus TA reaching the level of tracking accuracy capable of tracking a point and/or spot of any kind in the worksite coordinate system WCS accurately may thus be determined by acquiring data by tracking at least three reference points RP with respect to the tracking apparatus TA. These reference points may not lie on one — line observed in three dimensions. The farther the reference points RP are from one line in three-dimensional space, the better the accuracy is to be achieved. If the tracking apparatus TA does not comprise any sensors STA for determining an in- clination of the tracking apparatus TA, at least three reference points RP that does notlie on one line in three-dimensional space are needed so that the necessary data isavailable for reaching the level of capable of tracking the machine in the worksite coordinate system. As discussed above, the state could be named as Tracking.
In addition to or alternatively to the acquiring data by tracking at least three reference points RP with respect to the tracking apparatus TA, the tracking state of the tracking apparatus TA reaching the level of tracking accuracy capable — of trackinga point and/or spot of any kind in the worksite coordinate system WCS > accurately may be determined by acquiring data by tracking two reference points S RP with respect to the tracking apparatus TA in addition to acguiring data relating ~ to at least one of: the inclination of the tracking apparatus TA and the direction to N North from the tracking apparatus TA. So, in this embodiment, the inclination in- N 30 formation of the tracking apparatus TA and/or the direction to North from the E tracking apparatus TA is acguired by some means as described for example above, 0 whereby the tracking of only two reference points RP is enough for determining 3 the tracking state of the tracking apparatus TA reaching the level of capable of S tracking the machine in the worksite coordinate system WCS. N 35 It should be noted that in cases where inclination of the tracking appa- ratus TA is used with tracking two reference points RP, the reference points may not reside one above the other, or parallel, with respect to the gravitational field of the earth - if they are, direction to North remains unsolved. Thus, in this case, the farther (measured in angle) the reference points are from being one above the other, or the more perpendicular, the better the accuracy achieved.
Further, it should be noted that in cases where direction to North from the tracking apparatus TA is used with tracking two reference points RP, the refer- ence points may not reside at the same height from the earth, meaning at the same level with respect to the gravitational field of the earth -if they are, inclination of the tracking apparatus TA remains unsolved. Thus, in this case, the farther (meas- ured in angle) the reference points RP are from being at the same height from the earth, meaning at the same level, or the more parallel, with respect to the gravita- tional field of the earth the better the accuracy achieved.
In addition to or alternatively to the acquiring data by tracking at least three reference points RP with respect to the tracking apparatus TA and/or the acquiring data by tracking two reference points RP with respect to the tracking ap- paratus TA in addition to acquiring data relating to at least one of: the inclination of the tracking apparatus TA and the direction to North from the tracking appa- ratus TA, the tracking state of the tracking apparatus TA reaching the level of track- ing accuracy capable of tracking a point and/or spot of any kind in the worksite coordinate system WCS accurately may be determined by acquiring data by track- ing one reference point RP with respect to the tracking apparatus TA in addition to acquiring data relating to an inclination of the tracking apparatus and acquiring data relating to a direction to North from the tracking apparatus. Thus, in this em- bodiment, the inclination information of the tracking apparatus TA and the direc- — tion to North from the tracking apparatus TA is acquired by some means as de- > scribed for example above, whereby the tracking of only one reference point RP is D enough for determining the tracking state of the tracking apparatus TA reaching = the level of capable of tracking the machine in the worksite coordinate system WCS. N In addition to or alternatively to the acguiring data by tracking at least N 30 three reference points RP with respect to the tracking apparatus TA and/or the E acguiring data by tracking two reference points RP with respect to the tracking ap- 0 paratus TA in addition to acguiring data relating to at least one of: the inclination 3 of the tracking apparatus TA and the direction to North from the tracking appa- S ratus TA and/or the acguiring data by tracking one reference point RP with respect N 35 to the tracking apparatus TA in addition to acquiring data relating to an inclination of the tracking apparatus and acquiring data relating to a direction to North from the tracking apparatus, the tracking state of the tracking apparatus TA reaching the level of tracking accuracy capable of tracking a point and/or spot of any kind in the work site coordinate system WCS accurately may be determined by acquiring data by determining locations of at least four satellites with respect to the tracking ap- paratus TA.
In this embodiment the at least two antennas 12 in the tracking appa- ratus TA determine the location of the at least four satellites with respect to the tracking apparatus TA.
Figure 7 shows schematically, on the right, a tracking appa- ratus TA with two antennas 12. With less than four satellites the acquired data does not provide accurate information unless the tracking apparatus TA comprises more than two antennas 12. In this embodiment, instead of equipping all the ma- chines in the worksite with at least two antennas 12 the tracking apparatus TA may be equipped with at least two antennas 12. Further, regarding to this embodiment, according to which the tracking apparatus TA is equipped with at least two anten- nas 12, at least one of the at least two antennas 12 may reside in the worksite 13. In this embodiment the antenna 12 residing in the worksite 13 needs to be located optically with respect to the tracking apparatus TA by using, for example, at least one of the tracking devices TD of the tracking apparatus TA.
According to the above stated embodiments regarding the tracking ap- paratus TA to reach the level of capable of tracking the machine in the worksite coordinate system WCS, i.e. the Tracking-state, after the level is reached, the level may remain although the minimum requirements are not fulfilled in every time in- stant if the tracking apparatus TA is able to determine that it has remained it's sta- bility.
Similarly, according to the above stated embodiments itis possible to detect if the tracking state changes or if the tracking state is in the Pending-state or Out- — state. > According to an embodiment, acquiring data by tracking locations of the D one or more reference points RP with respect to the tracking apparatus TA is ac- = companied by identifying the initial locations of the one or more reference points N RP by semi-automatically and/or automatically.
N 30 When the initial locations of the one or more reference points RP are E identified semi-automatically, the operator 10 finds the at least one reference point 0 RP at the worksite 13 and guides the tracking apparatus TA to focus to the at least 3 one reference point RP.
Alternatively, the operator 10 may direct the tracking ap- S paratus TA towards the area comprising the at least one reference point RP and the N 35 tracking apparatus TA itself identifies the at least one reference point RP at the worksite 13 and focuses to the at least one reference point RP.
The operator 10 may for example select the at least one reference point RP in a menu or a database of the reference points RP to be the specific at least one identified reference point RP or the positioning system PS itself identifies the at least one reference point RP in the menu or the database of the reference points RP. The menu or the database of the reference points RP may for example be retrieved from a cloud service into the control unit 11 of the excavator 1, whereby they are retrievable from the exca- vator 1 by the at least one position determination unit PDU.
When the initial locations of the one or more reference points RP are identified automatically, the tracking apparatus TA itself identifies a necessary number of the reference points RP at the worksite 13 and allocates them with the information in a database comprising worksite information.
The identification of the initial locations of the one or more reference points RP by semi-automatically and/or automatically may be controlled by the control unit 11 of the excavator 1 and/or by the tracking apparatus TA and/or by — the position determination unit PDU. The identification of the initial locations of the one or more reference points RP is done in order to individualize the reference points RP to the position determination unit PDU and retrieve the location infor- mation regarding each identified reference point RP so that the position determi- nation unit PDU can operate correctly. The location information regarding each ref- erence point RP in the worksite 13 may be input using a wireless or wired 1/0 device and/or may be retrievable from any known location such as worksite com- puter, cloud service and/or any computer or memory medium reachable by any wired or wireless network.
According to an embodiment, the tracking apparatus TA further deter- mines a location and an orientation of the tracking apparatus TA itself based on the > acquired data, and that the acquired data transmitted from the tracking apparatus D TA to the at least one position determination unit PDU comprises at least location = and orientation data of the tracking apparatus TA, tracking data regarding at least N three marker points MP and data wherefrom the tracking state of the tracking ap- N 30 — paratus TA may be determined. The tracking apparatus TA may be able to deter- E mine the location and orientation thereof for example with the sensors disclosed 0 above. The position determination unit PDU thereafter determines the location and S orientation of the machine based on the acquired data transmitted to the position 2 determination unit PDU from the tracking apparatus. This embodiment is suitable N 35 tobe used with machines that do not comprise any sensors or comprises only a few sensors regarding determining position and orientation of the machine therein but,
however, comprises the position determination unit PDU. Based on the features disclosed herein the machine and especially the position determination unit PDU therein receives sufficiently data to be able to determine the location and orienta- tion of the machine and the accuracy of the determined location and orientation. According to this embodiment the tracking apparatus TA determines beforehand its own position so that it does not need to be momentarily aware about the data based on which the location and orientation thereof is determined. Further, accord- ing to this embodiment the tracking apparatus TA may be used as a temporary ref- erence point to other tracking apparatuses TA. In this case, the temporary refer- ence point should by some generally known means indicate when it may be used as a temporary reference point. Accordingly, tracking apparatus may comprise re- spective temporary reference marker comprising atleast one temporary reference pointand the location information should thus be available likewise is available the location information regarding each reference point RP disclosed above.
According to an embodiment the position determination unit PDU fur- ther determines a level of accuracy of the determined location and orientation of the machine, and based on the determined level of accuracy, the machine provides at least one of the following options: a) enables the operation modes that may be selected at the current level of accuracy, b) indicates an operator if the current level of accuracy is below and/or falling below threshold level regarding the operation mode of the machine selected; and c) disables operation modes that need more ac- curate location and orientation of the machine. According to this embodiment the operation modes of the machine, i.e. the work tasks of the machine, may be classi- fied based on the accuracy of the location and orientation of the machine needed to — carry out the specific work task with the machine. If the present location or orien- > tation accuracy of the machine is not high enough for carrying out a specific work D task, the machine is prevented to carry out that specific work task until the location = and orientation accuracy is high enough or at least the operator may be informed N that the specific work task may not be recorded and/or considered as done since N 30 the location and orientation accuracy is not above threshold level required in this E work task. The location accuracy is considered to be the higher the more there are 0 acguired reference point RP and marker point MP data, the newer the data are and S the more versatile the acquired data are. The location accuracy depends, as well, 2 on how near from each other the reference points RP and the marker points MP N 35 whose data is acquired are from each other and which are the location of these reference points RP and marker points MP with respect to each other and what sensor information is additionally available, such as inclination and/or direction to North as disclosed above. The acquired reference point RP and marker point MP data are versatile if there are location and orientation data about reference points RP and marker points MP being both substantially close to the tracking apparatus TA and substan- tially far away from the tracking apparatus TA. In addition to the information con- taining the reference point RP and marker point MP data, the positioning accuracy may depend on possible information regarding to stability and inclination of the machine as received from machine and the sensors therein.
According to an embodiment of the positioning system PS, at least one tracking apparatus TA comprises at least one tachymeter, and at least one marker point MP is a prism or a tag that can be detected by the tachymeter. Furthermore, according to this embodiment the machine comprises at least one gyroscope and/or at least one acceleration sensor in known position with respect to the at least one marker point MP, and the at least one position determination unit PDU further comprises receiving means for receiving data relating to the position of the at least one gyroscope and/or the at least one acceleration sensor with respect to the at least one marker point MP and for receiving data from the at least one gyro- scope and/or the at least one acceleration sensor. The gyroscope in the machine provides information about the orientation changes of the machine and in some circumstances a direction to North, the gyroscope being able to learn for example the orientation of the upper carriage 2b of the excavator 1 by a few revolutions of the upper carriage 2b relative to the under carriage 2a. The acceleration sensor in the machine provides information about the direction of gravitational field of the — earth, thus, information regarding the inclination of the machine. In this embodi- > ment there are thus available also data from the gyroscope and/or the acceleration D sensor, which data may be utilized to define changes in location and orientation of = the machine between operation cycles of the tachymeter. N According an embodiment of a method for determining location and ori- N 30 entation of a machine in a worksite 13, the worksite 13 is equipped with at least E one reference point RP, and the method comprises setting a tracking apparatus TA 0 on the machine, tracking the machine with the tracking apparatus TA by determin- S ing location of at least one reference point RP in the worksite 13 with respect to the 2 tracking apparatus TA, transmitting data from the tracking apparatus TA to a posi- N 35 — tion determination unit PDU regarding the tracking, and determining by the posi- tion determination unit PDU based at least in part on the data received from the tracking apparatus TA the location and orientation of the machine in the worksite
13. According to this embodiment the machine itself, such as the excavator 1, is provided with the tracking apparatus TA that is arranged to track the machine by determining location of at least one reference point RP in the worksite 13 with re- spect to the tracking apparatus TA. Figure 10 shows schematically an upper view of a worksite 13 with a machine provided with the tracking apparatus TA, whereby there is a visual connection TD_RP between a tracking device TD of the tracking apparatus TA and the reference point RP at a reference marker RM. Figure 11 shows schematically the method according to this embodiment for determining lo- cation and orientation of the machine in the worksite 13. In this embodiment marker points MP intended to be set to the machine may be omitted or one or more marker points MP known in the machine coordinate system MCS may be used in verifying that the tracking apparatus TA re-attached to the machine resides at the same position and orientation as when previously attached, thus, making it possi- ble to detach the tracking apparatus TA after day’s work. According to an embodiment of the method, wherein the machine is provided with the tracking apparatus TA, the method further comprises initializing a tracking state for the tracking apparatus TA by determining location and orienta- tion of the tracking apparatus TA in a machine coordinate system MCS. According to this embodiment the tracking apparatus TA may be introduced by setting the tracking apparatus TA on the machine and allowing the tracking apparatus TA to check or verify its position relative to the machine. According to an embodiment of the method, wherein the machine is provided with the tracking apparatus TA, the method further comprises indicating — by the position determination unit PDU the current level of accuracy regarding the > location and orientation of the machine achieved by the data received from the S tracking apparatus TA. The level of accuracy regarding the location and orientation ~ of the machine achieved by the data received from the tracking apparatus TA may N cause, if the level of the accuracy is low, that work tasks requiring high level of ac- N 30 curacy is prevented to be carried out or carrying out is finished, as long as the level E of accuracy is not high enough. n According to an embodiment of the method, wherein the machine is S provided with the tracking apparatus TA, the method further comprises determin- 2 ing a level of accuracy regarding the location and orientation of the machine to be N 35 achieved, meaning above the minimum threshold level pre-determined, detecting by the position determination unit a need for higher level of accuracy regarding the location and orientation of the machine, and acquiring by the position determina- tion unit an additional tracking data from the tracking apparatus. According to this embodiment the level of accuracy regarding the location and orientation of the ma- chine to be achieved may be determined, for example, as a minimum threshold level, for example by a control unit of the machine, the position determination unit PDU or the building information modeling (BIM) -model residing, for example in cloud service or the worksite computer, on the basis of the specific work task to be carried out by the machine, or on the basis of the information provided by the op- erator. Thereafter the position determination unit PDU may detect the need for the higher level of accuracy regarding the location and orientation of the machine and acquire additional tracking data from the tracking apparatus TA. The additional tracking data may be acquired from the tracking apparatus TA semi-automatically and/or automatically.
The acquiring of the additional tracking data from the tracking appa- ratus TA semi-automatically comprises arranging the position determination unit PDU to provide at least one of: indicating the operator 10 the need for the tracking apparatus TA to detect at least one reference point RP, indicating the operator the need for the tracking apparatus TA to detect another reference point RP, and indi- cating the operator the need for the tracking apparatus TA to detect at least one — furtherreference point RP, whereby the operator may operate the machine accord- ing to the indication. The acguiring of the additional tracking data from the tracking apparatus TA thus comprises retrieving information from the location and orien- tation of at least one reference point RP in a case where the tracking apparatus TA is not able to detect any reference point RP, or from the location and orientation of atleast one additional reference point RP in a case where the reference points RP > already tracked by the tracking apparatus TA are not able to provide sufficiently O information to determine the location and orientation of the machine in the = worksite 13 accurately enough. N According to an embodiment of the method for acguiring the additional N 30 tracking data from the tracking apparatus TA semi-automatically, the setting of the E tracking apparatus TA on the machine comprises setting the tracking apparatus TA 0 on the machine on an adjustable base B, whereby the operator 10 may operate the S adjustable base B according to the indication received from the position determi- 2 nation unit PDU, and after each operating of the adjustable base B initializing of the N 35 — tracking state for the tracking apparatus TA by determining location and orienta- tion of the tracking apparatus TA in the machine coordinate system MCS occurs.
According to this embodiment the operator 10 may adjust, by operating the adjust- able base B, the tracking apparatus TA to find or localize the at least one reference point RP intended to be tracked by the tracking apparatus TA.
According to an embodiment of the method for acquiring the additional tracking data from the tracking apparatus TA automatically, the setting of the tracking apparatus TA on the machine comprises setting the tracking apparatus TA on the machine on an adjustable base B, and the additional tracking data from the tracking apparatus TA is acquired automatically by controlling the adjustable base B by at least one of the tracking apparatus TA and the position determination unit PDU.
According to this embodiment, the at least one of the tracking apparatus TA and the position determination unit PDU is configured to adjust the adjustable base B such that the tracking apparatus TA finds or localizes the at least one reference point RP intended to be tracked by the tracking apparatus TA.
According to an embodiment of the method, wherein the machine is — provided with the tracking apparatus TA, the method further comprises setting one or more additional tracking apparatuses TA to the worksite 13 and equipping the machine with at least one marker point MP known in the machine coordinate sys- tem MCS, acquiring data by the one or more additional tracking apparatuses TA by tracking reference point RP and marker point MP locations with respect to the re- spective one or more additional tracking apparatuses TA, transmitting the ac- quired data from the one or more additional tracking apparatuses TA to the at least one position determination unit PDU, and determining by the at least one position determination unit PDU based at least in part on the data received from at least one of: the tracking apparatus and the one or more additional tracking apparatuses, the location and orientation of the machine in the worksite coordinate system WCS.
In > other words, in this embodiment one or more additional tracking apparatuses TA O are set at the worksite 13 and at least one marker point MP is set at the machine, = the marker point MP intended to be tracked by the at least one additional tracking N apparatus TA.
Figure 12 shows schematically an upper view of a worksite 13 with N 30 — the machine provided with a first tracking apparatus TA1 and the worksite 13 pro- E vided with a second tracking apparatus TA2, whereby there is a visual connection 0 TD1 RP between a first tracking device TD1 in the first tracking apparatus TA1 set S on the machine and the reference point RP at a reference marker RM in the 2 worksite 13 and visual connections TD2 MP between the second tracking device N 35 TD2 in the second tracking apparatus TAZ set in the worksite 13 and the marker MP at a marker MA set in the machine and TD2 RP between the second tracking device TD2 in the second tracking apparatus TAZ set in the worksite 13 and the reference point RP at the reference marker RM in the worksite 13.
According to an embodiment of the method comprising one or more ad- ditional tracking apparatuses TA, determining of the location and orientation of the tracking apparatus TA in the machine coordinate system MCS may be determined using one of the additional tracking apparatuses TA. According to this embodiment determining of the location and orientation of the tracking apparatus TA, that is set in the machine, may be determined in the machine coordinate system MCS using one of the additional tracking apparatuses TA.
The excavator 1 is an example of a mobile earthworks machine in con- nection with which the solution for determining location and orientation of the ma- chine in a worksite may be utilized. In addition to the excavators like that the meas- uring arrangement disclosed herein could also be utilized for example in mobile cranes comprising a carriage part arranged to rotate relative to the rest of the mo- bile crane, and wherein the rotatable carriage part comprises a lifting boom, and a hook at the distal end of the boom providing a working tool of the crane. The solu- tion for determining location and orientation of the machine in the worksite is sub- stantially similar in the mobile cranes. Other machines, in addition to the excava- tors and mobile cranes, wherein the disclosed solution could also be utilized, are for example dozers, wheel loader, rollers, backhoes, dump trucks, forwarders, har- vesters and the like.
It will be obvious to a person skilled in the art that, as the technology advances, the inventive concept can be implemented in various ways. The inven- tion and its embodiments are not limited to the examples described above but may — vary within the scope of the claims.
oO
O N N N
I Ac a ™
N O O O O N

Claims (11)

1. A method for determining location and orientation of a machine in a worksite, the worksite being equipped with at least one reference point (RP), the method comprising: setting a tracking apparatus on the machine, tracking the machine with the tracking apparatus by determining loca- tion of at least one reference point (RP) in the worksite with respect to the tracking apparatus; transmitting data from the tracking apparatus to a position determina- — tion unit regarding the tracking; and determining by the position determination unit based at least in part on the data received from the tracking apparatus the location and orientation of the machine in the worksite.
2. The method according to claim 1, characterized in that the method further comprises: initializing a tracking state for the tracking apparatus by determining location and orientation of the tracking apparatus in a machine coordinate system.
3. The method according to claim 1or2, characterized in that the method further comprises: indicating by the position determination unit a current level of accuracy regarding the location and orientation of the machine achieved by the data re- ceived from the tracking apparatus.
4. The method according to claim lor2, characterized in that the method further comprises: determining a level of accuracy regarding the location and orientation o of the machine to be achieved, > detecting by the position determination unit a need for higher level of — accuracy regarding the location and orientation of the machine, and n acquiring by the position determination unit an additional tracking data from the tracking apparatus.
E 5. The method according to claim 4, characterized in that an O additional tracking data from the tracking apparatus is acguired by at least one of: 3 semi-automatically or automatically.
5
6. The method according to claim 5,characterized in that the N 35 additional tracking data from the tracking apparatus acquired semi-automatically comprises:
arranging the position determination unit to provide at least one of: indicating an operator the need for the tracking apparatus to detect at least one reference point (RP), indicating the operator the need for the tracking apparatus to detect another reference point (RP), and indicating the operator the need for the tracking apparatus to detect at least one further reference point (RP); and the operator operates the machine according to the indication.
7. The method according to claim 6 characterized in that the setting of the tracking apparatus on the machine comprises setting the tracking apparatus on the machine on an adjustable base, in that the operator operates the adjustable base according to the indication, and in that after each operating of the adjustable base initializing of the tracking — state for the tracking apparatus by determining location and orientation of the tracking apparatus in the machine coordinate system occurs.
8. The method according to claim 5,characterized in that the setting of the tracking apparatus on the machine comprises setting the tracking apparatus on the machine on an adjustable base, and in that the additional tracking data from the tracking apparatus is acquired au- tomatically by controlling the adjustable base by at least one of: the tracking apparatus and the position determination unit.
9. The method according to claim 8, characterized in that after the controlling of the adjustable base by at least one of: the tracking apparatus and — the position determination unit, initializing of the tracking state for the tracking > apparatus by determining location and orientation of the tracking apparatus in the D machine coordinate system occurs. =
10. The method according to any one of the preceding claims, char - N acterized in that the method further comprises: N 30 setting one or more additional tracking apparatuses to the worksite and E eguipping the machine with at least one marker point (MP) known in the machine n coordinate system, 3 acquiring data by the one or more additional tracking apparatuses by S tracking reference point (RP) and marker point (MP) locations with respect to the N 35 respective one or more additional tracking apparatuses, transmitting the acquired data from the one or more additional tracking apparatuses to the at least one position determination unit, and determining by the at least one position determination unit based at least in part on the data received from at least one of: the tracking apparatus and the one or more additional tracking apparatuses, the location and orientation of — the machine in the worksite coordinate system.
11. The method according to claim 10,characterized in thatthe location and orientation of the tracking apparatus set in the machine may be de- fined in the machine coordinate system (MCS) using one of the additional tracking apparatuses.
o
O
N
N
N
I Ac a ™
N
O
O
O
O
N
FI20196023A 2019-11-27 2019-11-27 Method for determining location and orientation of machine FI20196023A1 (en)

Priority Applications (11)

Application Number Priority Date Filing Date Title
FI20196023A FI20196023A1 (en) 2019-11-27 2019-11-27 Method for determining location and orientation of machine
US17/035,876 US11796316B2 (en) 2019-11-27 2020-09-29 Method for determining location and orientation of machine
JP2020170328A JP2021085322A (en) 2019-11-27 2020-10-08 Method for determining place and direction of machine
EP20202819.7A EP3828499A1 (en) 2019-11-27 2020-10-20 Method for determining location and orientation of machine
CN202011329477.6A CN112854355B (en) 2019-11-27 2020-11-24 Method for determining the position and orientation of a machine
EP20812314.1A EP4065421A1 (en) 2019-11-27 2020-11-25 Method for determining situational awareness in worksite
JP2022525311A JP7445756B2 (en) 2019-11-27 2020-11-25 Methods for determining situational awareness at the work site
PCT/EP2020/083352 WO2021105204A1 (en) 2019-11-27 2020-11-25 Method for determining situational awareness in worksite
CN202080081562.7A CN114729808A (en) 2019-11-27 2020-11-25 Method for determining situational awareness in a work site
FI20225526A FI20225526A1 (en) 2019-11-27 2020-11-25 Method for determining situational awareness in worksite
US17/773,018 US20220389685A1 (en) 2019-11-27 2020-11-25 Method for determining situational awareness in worksite

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
FI20196023A FI20196023A1 (en) 2019-11-27 2019-11-27 Method for determining location and orientation of machine

Publications (1)

Publication Number Publication Date
FI20196023A1 true FI20196023A1 (en) 2021-05-28

Family

ID=72944046

Family Applications (1)

Application Number Title Priority Date Filing Date
FI20196023A FI20196023A1 (en) 2019-11-27 2019-11-27 Method for determining location and orientation of machine

Country Status (5)

Country Link
US (1) US11796316B2 (en)
EP (1) EP3828499A1 (en)
JP (1) JP2021085322A (en)
CN (1) CN112854355B (en)
FI (1) FI20196023A1 (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11840823B2 (en) * 2021-03-30 2023-12-12 Darrell Cobb Backhoe camera assembly
WO2023228244A1 (en) * 2022-05-23 2023-11-30 日本電気株式会社 Information processing device, information processing method, and recording medium

Family Cites Families (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS59195936A (en) 1983-04-21 1984-11-07 Komatsu Ltd Monitoring of operating condition of excavating machine
GB2301185B (en) 1995-05-09 1998-05-20 Cementation Piling & Found Improved positioning system
EP1517117A1 (en) 2003-09-22 2005-03-23 Leica Geosystems AG Method and system for the determination of the actual position of a positioning apparatus
US8381982B2 (en) * 2005-12-03 2013-02-26 Sky-Trax, Inc. Method and apparatus for managing and controlling manned and automated utility vehicles
US8345926B2 (en) 2008-08-22 2013-01-01 Caterpillar Trimble Control Technologies Llc Three dimensional scanning arrangement including dynamic updating
KR101314588B1 (en) 2009-10-26 2013-10-07 한국전자통신연구원 Method and apparatus for producing map of artificial mark, method and apparatus for measuring position of mobile object by using same
US9131119B2 (en) 2012-11-27 2015-09-08 Caterpillar Inc. Perception based loading
US10203412B2 (en) 2013-09-20 2019-02-12 Caterpillar Inc. Positioning system
US20150098079A1 (en) 2013-10-09 2015-04-09 Hilti Aktiengesellschaft System and method for camera based position and orientation measurement
US20150168136A1 (en) 2013-12-12 2015-06-18 The Regents Of The University Of Michigan Estimating three-dimensional position and orientation of articulated machine using one or more image-capturing devices and one or more markers
US10030358B2 (en) * 2014-02-13 2018-07-24 Trimble Inc. Non-contact location and orientation determination of an implement coupled with a mobile machine
NL2013409B1 (en) * 2014-09-03 2016-09-27 Fugro N V Spatial positioning of offshore structures.
US9757859B1 (en) 2016-01-21 2017-09-12 X Development Llc Tooltip stabilization
WO2018008627A1 (en) 2016-07-05 2018-01-11 国立研究開発法人宇宙航空研究開発機構 Satellite positioning system and satellite positioning method
US10094662B1 (en) 2017-03-28 2018-10-09 Trimble Inc. Three-dimension position and heading solution
JP6966218B2 (en) 2017-04-27 2021-11-10 株式会社小松製作所 Imaging equipment calibration equipment, work machines and calibration methods
WO2018225596A1 (en) * 2017-06-07 2018-12-13 パイオニア株式会社 Information processing device
JP6947659B2 (en) 2018-02-16 2021-10-13 株式会社神戸製鋼所 Construction machine position estimation device
JP6994427B2 (en) 2018-04-20 2022-01-14 株式会社安藤・間 Posture recognition system for construction machinery
JP6529058B1 (en) 2018-12-12 2019-06-12 J Think株式会社 Construction machine management system, construction machine management program, construction machine management method, construction machine and external management device for construction machine

Also Published As

Publication number Publication date
EP3828499A1 (en) 2021-06-02
CN112854355B (en) 2023-08-18
CN112854355A (en) 2021-05-28
JP2021085322A (en) 2021-06-03
US20210156119A1 (en) 2021-05-27
US11796316B2 (en) 2023-10-24

Similar Documents

Publication Publication Date Title
EP3828497A1 (en) Method and positioning system for determining location and orientation of machine
US9510150B2 (en) Integrating position information into a handheld tool
US20080109141A1 (en) Systems and methods for augmenting an inertial navigation system
US11719536B2 (en) Apparatus, system, and method for aerial surveying
US20150204149A1 (en) Laser alignment device for use with a drill rig
US11796316B2 (en) Method for determining location and orientation of machine
EP3119660A1 (en) System and method for positioning construction machine
CN106767676A (en) A kind of space vertical characteristics point location measurement method and system
US20220389685A1 (en) Method for determining situational awareness in worksite
AU2016308671A1 (en) A drill rig positioning and drill rod alignment system
US9002539B2 (en) Vehicle operated in a self-propelled program-controlled manner for measuring, marking and at least pre-punching or pre-drilling holes for foundation devices
KR102608741B1 (en) Underground facility survey survey system using GPS
US11499297B2 (en) Measuring arrangement for measuring three dimensional location and orientation of the center axis of first axle in relation to the center axis of second axle
El‐Sheimy et al. GNSS Applications in Surveying and Mobile Mapping
JP2024045799A (en) Pile core location survey system
Schiffbauer Accurate navigation and control of continuous mining machines for coal mining
JP2021169714A (en) Construction method and construction system
KR20220050705A (en) Location measuring system
JP2024046573A (en) Robotic system for traveling on outdoor ground at construction site
KR20150102445A (en) Apparatus and method for controlling work using geographic information