CA2745501C - Synchronization of the position and orientation of a 3d measurement device and the position and orientation of an intelligent guidance device - Google Patents
Synchronization of the position and orientation of a 3d measurement device and the position and orientation of an intelligent guidance device Download PDFInfo
- Publication number
- CA2745501C CA2745501C CA2745501A CA2745501A CA2745501C CA 2745501 C CA2745501 C CA 2745501C CA 2745501 A CA2745501 A CA 2745501A CA 2745501 A CA2745501 A CA 2745501A CA 2745501 C CA2745501 C CA 2745501C
- Authority
- CA
- Canada
- Prior art keywords
- igd
- earth
- coordinate system
- internal
- axes
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000005259 measurement Methods 0.000 title claims abstract description 53
- 230000005484 gravity Effects 0.000 claims abstract description 53
- 238000000034 method Methods 0.000 claims abstract description 33
- 230000009466 transformation Effects 0.000 claims description 86
- 230000001133 acceleration Effects 0.000 claims description 11
- 230000008859 change Effects 0.000 claims description 3
- 238000004590 computer program Methods 0.000 claims description 3
- 238000012544 monitoring process Methods 0.000 claims description 2
- 230000001360 synchronised effect Effects 0.000 abstract description 13
- 230000008569 process Effects 0.000 abstract description 6
- 238000011960 computer-aided design Methods 0.000 description 10
- 238000004891 communication Methods 0.000 description 7
- 238000000844 transformation Methods 0.000 description 6
- 239000011159 matrix material Substances 0.000 description 5
- 230000001131 transforming effect Effects 0.000 description 5
- 238000010586 diagram Methods 0.000 description 4
- 238000012545 processing Methods 0.000 description 4
- 238000004519 manufacturing process Methods 0.000 description 3
- 238000013519 translation Methods 0.000 description 3
- 230000014616 translation Effects 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 2
- 238000012546 transfer Methods 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 1
- 238000004883 computer application Methods 0.000 description 1
- 238000006073 displacement reaction Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 238000000275 quality assurance Methods 0.000 description 1
- 239000000523 sample Substances 0.000 description 1
Classifications
-
- G06T3/02—
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
- G01B21/00—Measuring arrangements or details thereof, where the measuring technique is not covered by the other groups of this subclass, unspecified or not relevant
- G01B21/02—Measuring arrangements or details thereof, where the measuring technique is not covered by the other groups of this subclass, unspecified or not relevant for measuring length, width, or thickness
- G01B21/04—Measuring arrangements or details thereof, where the measuring technique is not covered by the other groups of this subclass, unspecified or not relevant for measuring length, width, or thickness by measuring coordinates of points
- G01B21/045—Correction of measurements
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C15/00—Surveying instruments or accessories not provided for in groups G01C1/00 - G01C13/00
Abstract
There is described herein a method to synchronize the position and orientation of an IGD 3D Coordinate System with the position and orientation of a 3DM 3D Coordinate System, in which the IGD's gravity direction measurement device and electronic compass are used explicitly. There is also described a method for maintaining the synchronization while the IGD is moving, in which the IGD's three-axis accelerometer is used explicitly. There is further described how an IGD, once its position and orientation have been synchronized to the position and orientation of a 3DM, can be used to display 3D graphics that guide the measurement process.
Description
MEASUREMENT DEVICE AND THE POSITION AND ORIENTATION OF AN
INTELLIGENT GUIDANCE DEVICE
TECHNICAL FIELD
The present invention relates to the field of the use of Intelligent Guidance Devices (IGD) for guiding measurement processes using 3D graphics.
BACKGROUND
A 3D Measurement Device (3DM) is a measurement system capable of measuring the (x, y, z) coordinates of points on physical parts in the 3-dimensional space, using anyone of many known measurement principles. These devices are used in many different manufacturing industries for quality assurance procedures.
In some instances, the devices are made to be portable such that they may be easier to handle and manipulate.
However, since they have their own coordinate system, they are not necessarily compatible with other existing technologies. Images or measurements taken with these devices cannot easily be transferred to other imaging devices without losing some information attached to the coordinate system.
Therefore, there is a need to adapt 3D measurement devices to be used with other technologies.
SUMMARY
There is described herein a method to synchronize the position and orientation of an IGD 3D Coordinate System with the position and orientation of a 3DM 3D Coordinate System, in which the IGD's gravity direction measurement device and electronic compass are used explicitly. There is also described a method for maintaining the synchronization while the IGD is moving, in which the IGD's three-axis accelerometer is used explicitly. There is further described how an IGD, once its position and orientation have been synchronized to the position and orientation of a 3DM, can be used to display 3D graphics that guide the measurement-process.
In accordance with a first broad aspect, there is provided a method for synchronizing a three-dimensional measurement device (3DM) having a 3DM internal 3D coordinate system 3DM, X3DM, Y3DM, and Z3DM, with an intelligent guidance device (IGD) having a display device, a gravity direction measurement device, an electronic compass, and an IGD
internal 3D coordinate system IGD, XIGD, YIGD, ZIGD, the method comprising: determining coordinates RPXIGD, RPYIGD, RPZIGD of a reference point RP in the IGD internal 3D coordinate system OIGD, XIGD, YIGD, ZIGD; defining a coordinate system OEarth, XIGD-Earth, YIGD-Earth, ZIGD-Earth using a direction opposite to gravity as ZIGD-Earth and a direction corresponding to a magnetic north pole as YIGD-Earth, from a perspective of the IGD; computing and applying a rigid transformation TIGD-To-IGDEarth to transform axes XIGD, YIGDr ZIGD of the IGD internal 3D coordinate system to XIGD-Earth, YIGD-Earth, ZIGD-Earth and the reference point RP having the coordinates RPXIGD, RPYIGD, RPZIGD to Earth. determining coordinates RPX3DM, RPY3DM, RPZ3DM of the reference point RP in the 3DM internal 3D coordinate system 3DM, X3DM, Y3DM, and Z3DM;
defining a coordinate system Earth, X3DM-Earth, Y3DM-Earth, Z31DM-Earth using a direction opposite to gravity as Z3DM-Earth and the direction corresponding to the magnetic north pole as Y3DM-Earth, from a perspective of the 3DM; and computing and applying a rigid transformation T3DM-To-3DMEarth to transform axes X3DM, Y3DM, and Z3DM of the 3DM internal 3D coordinate system to axes X3DM-Earth, Y3DM-Earth, Z3DM-Earth and the reference point RP
having the coordinates RPX3DM, RPY3DM, RPZ3DM to OEarth In accordance with a second broad aspect, there is provided a system for synchronizing a three-dimensional measurement device (3DM) having a 3DM internal 3D coordinate system 3DM, X3DM, Y3DM, and Z3DM, with an intelligent guidance device (IGD) having a display device, a gravity direction measurement device, an electronic compass, and an IGD
internal 3D coordinate system OIGD, XIGD, YIGD, ZIGD, the system comprising: an IGD transformation module operatively connected to the IGD and adapted to define a coordinate system OEarth, XIGD-Earth, YIGD-Earth, ZIGD-Earth using a direction opposite to gravity as ZIGD-Earth and a direction corresponding to a magnetic north pole as YIGD-Earth, from a perspective of the IGD, and compute and apply a rigid transformation TIGD-To-IGDEarth to transform axes XIGD, YIGD, ZIGD of the IGD internal 3D
coordinate system to axes XIGD-Earth, YIGD-Earth, ZIGD-Earth and a reference point RP having coordinates RPXIGD, RPYIGD, RPZIGD in the IGD internal 3D coordinate system to OEarth; and a 3DM
transformation module operatively connected to the 3DM and adapted to define a coordinate system OEarth, X3DM-Earth, Y3DM-Earth, Z3DM-Earth using a direction opposite to gravity as Z3DM-Earth and the direction corresponding to the magnetic north pole as Y3DM-Earth, from a perspective of the 3DM, compute and apply a rigid transformation T3DM-To-3DMEarth to transform axes X3DM, Y3DM, and Z3DM of the 3DM internal 3D coordinate system to axes X3DM-Earth, Y3DM-Earth, Z3DM-Earth and the reference point RP having coordinates RPX3DM, RPY3DM, RPZ3DM in the 3DM internal 3D
coordinate system to Earth-In accordance with another broad aspect, there is provided an intelligent guidance device (IGD) having an IGD
internal 3D coordinate system OIGD, XIGD, YIGD, ZIGD, the device comprising: a gravity direction measurement device; an electronic compass; an IGD transformation module operatively connected to the IGD and adapted to define a coordinate system Earth, XIGD-Earth, YIGD-Earth, ZIGD-Earth using a direction opposite to gravity as ZIGD-Earth and a direction corresponding to a magnetic north pole as YIGD-Earth, and to compute and apply a rigid transformation TIGD-To-IGDEarth to transform axes XIGD, YIGD, ZIGD of the IGD internal 3D coordinate system to axes XIGD-Earth, YIGD-Earth, ZIGD-Earth and a reference point RP having coordinates RPXIGD, RPYIGD, RPZIGD in the IGD internal 3D
coordinate system to Earth; and a display device for displaying 3D graphics in a 3D coordinate system synchronized with a 3D coordinate system of a three-dimensional measurement device.
In accordance with a further broad aspect, there is provided at least one computer program product for synchronizing a three-dimensional measurement device (3DM) having a 3DM internal 3D coordinate system 3DM, X3DM, Y3DM, and Z3DM, with an intelligent guidance device (IGD) having a display device, a gravity direction measurement device, an electronic compass, and an IGD internal 3D coordinate system OIGD, XIGD, YIGD, ZIGD, comprising instruction means encoded on a computer-readable medium, for causing operations of: defining a coordinate system Earth, XIGD-Earth, YIGD-Earth, ZIGD-Earth using a direction opposite to gravity as ZIGD-Earth and a direction corresponding to a magnetic north pole as YIGD-Earth, from a perspective of the IGD; computing and applying a rigid transformation TIGD-To-IGDEarth to transform axes XIGD, YIGD, ZIGD Of the IGD internal 3D coordinate system to axes XIGD-Earth, YIGD-Earth, ZIGD-Earth and a reference point RP having coordinates RPXIGD, RPYIGD, RPZIGD in the IGD internal 3D coordinate system to OEarth, defining a coordinate system OEarth, X3DM-Earth, Y3DM-Earth, Z3DM-Earth using a direction opposite to gravity as Z3DM-Earth and the direction corresponding to the magnetic north pole as Y3DM-Earth, from a perspective of the 3DM; and computing and applying a rigid transformation T3DM-To-3DMEarth to transform axes X3DM, Y3DM, and Z3DM of the 3DM internal 3D coordinate system to the axes X3DM-Earth, Y3DM-Earth, Z3DM-Earth and the reference point RP
having coordinates RPX3DM, RPY3DM, RPZ3DM in the 3DM internal 3D
coordinate system to Earth=
In the present specification, the following definitions are to be used throughout.
3D Coordinate System: A system for assigning 3 numbers to each point in a 3-dimensional space. A common instance of a 3D Coordinate System is the Cartesian coordinate system where three X, Y, Z axes perpendicular to each other and meeting each other at an origin point (0, 0, 0) are used to parameterize the 3-dimensional space (see Figure 1). An infinite number of 3D Coordinate Systems can be derived from the basic Cartesian coordinate system by moving (or translating) the origin point in 3-dimensional space, defining a new origin 0', and rotating the original X, Y, Z
axes to define new axes X', Y', and Z' (see Figure 2). In such a case, the X', Y', and Z' axes can each be expressed by using a triplet of (x, y, z) coordinates, expressed in the Cartesian coordinate system. The triplet of (x, y, z) coordinates representing a particular axis is computed by determining a point P located at a distance of 1 from the origin 0' along the direction of the axis, and then subtracting the origin 0' from this point P.
A 3D Coordinate System is said to be right-handed if the vector product between the first axis (for example X) and the second axis (for example Y) produces the third axis (for example Z). A 3D Coordinate System would be left-handed if the vector product between the second axis and the first axis would produce the third axis. This document uses right-handed 3D Coordinate Systems in all explanations. However, left-handed 3D Coordinate Systems could be used as well without loss of generality.
3D Transformation: A mathematical operation that transforms any input point (xi, yi, zi) in 3-dimensional space into an output point (x0, yo, z0) .
Rigid 3D Transformation: Rigid 3D Transformations are subsets of the possible 3D Transformations applicable to input points by which only rotations and translations are applied to these points. Such a 3D Transformation is called rigid because it preserves the original shape and dimensions of any 3-dimensional object. For example, let's imagine a box having a width of 1 meter, a height of 2 meters, and a depth of 3 meters. Then, let's consider any possible Rigid 3D
Transformation that can be applied to this box. If any of these possible Rigid 3D Transformations are applied to the box, the box dimensions would always remain 1 meter by 2 meters by 3 meters under all circumstances.
A Rigid 3D Transformation RT can be expressed by six numbers (rx, ry, rZ, tX, ty, tZ) . The numbers r, ry, and rZ
represent successive rotations to be applied about the X, Y, and Z axes of the Cartesian coordinate system. The numbers tX, ty, and tz represent successive translations to be applied along the X, Y, and Z axes of the Cartesian coordinate system. There are various mathematical techniques available to represent Rigid 3D Transformation using 4 by 4 matrices and to extract the three rotations and three translations from a 4 by 4 Rigid 3D Transformation matrix.
In addition to being applicable to points, Rigid 3D
Transformations can also be applied to 3D Coordinate Systems.
Four points are needed to define an arbitrary 3D Coordinate System: the origin O', and the points at a unitary distance of 1 from O' along the X', Y', and Z' axes. A Rigid 3D
Transformation is applied to a 3D Coordinate System by transforming the four points that are needed to describe it.
The origin and three axes of the transformed 3D Coordinate System may then be rebuilt from the four transformed points by subtracting the transformed origin from the three transformed points at the extremity of the unitary axes (see Figure 3).
Gravity Direction Measurement Device: A measurement device that is capable of measuring the direction of gravity, such as a three-axis inclinometer. Gravity direction measurement devices can be incorporated in computing devices.
INTELLIGENT GUIDANCE DEVICE
TECHNICAL FIELD
The present invention relates to the field of the use of Intelligent Guidance Devices (IGD) for guiding measurement processes using 3D graphics.
BACKGROUND
A 3D Measurement Device (3DM) is a measurement system capable of measuring the (x, y, z) coordinates of points on physical parts in the 3-dimensional space, using anyone of many known measurement principles. These devices are used in many different manufacturing industries for quality assurance procedures.
In some instances, the devices are made to be portable such that they may be easier to handle and manipulate.
However, since they have their own coordinate system, they are not necessarily compatible with other existing technologies. Images or measurements taken with these devices cannot easily be transferred to other imaging devices without losing some information attached to the coordinate system.
Therefore, there is a need to adapt 3D measurement devices to be used with other technologies.
SUMMARY
There is described herein a method to synchronize the position and orientation of an IGD 3D Coordinate System with the position and orientation of a 3DM 3D Coordinate System, in which the IGD's gravity direction measurement device and electronic compass are used explicitly. There is also described a method for maintaining the synchronization while the IGD is moving, in which the IGD's three-axis accelerometer is used explicitly. There is further described how an IGD, once its position and orientation have been synchronized to the position and orientation of a 3DM, can be used to display 3D graphics that guide the measurement-process.
In accordance with a first broad aspect, there is provided a method for synchronizing a three-dimensional measurement device (3DM) having a 3DM internal 3D coordinate system 3DM, X3DM, Y3DM, and Z3DM, with an intelligent guidance device (IGD) having a display device, a gravity direction measurement device, an electronic compass, and an IGD
internal 3D coordinate system IGD, XIGD, YIGD, ZIGD, the method comprising: determining coordinates RPXIGD, RPYIGD, RPZIGD of a reference point RP in the IGD internal 3D coordinate system OIGD, XIGD, YIGD, ZIGD; defining a coordinate system OEarth, XIGD-Earth, YIGD-Earth, ZIGD-Earth using a direction opposite to gravity as ZIGD-Earth and a direction corresponding to a magnetic north pole as YIGD-Earth, from a perspective of the IGD; computing and applying a rigid transformation TIGD-To-IGDEarth to transform axes XIGD, YIGDr ZIGD of the IGD internal 3D coordinate system to XIGD-Earth, YIGD-Earth, ZIGD-Earth and the reference point RP having the coordinates RPXIGD, RPYIGD, RPZIGD to Earth. determining coordinates RPX3DM, RPY3DM, RPZ3DM of the reference point RP in the 3DM internal 3D coordinate system 3DM, X3DM, Y3DM, and Z3DM;
defining a coordinate system Earth, X3DM-Earth, Y3DM-Earth, Z31DM-Earth using a direction opposite to gravity as Z3DM-Earth and the direction corresponding to the magnetic north pole as Y3DM-Earth, from a perspective of the 3DM; and computing and applying a rigid transformation T3DM-To-3DMEarth to transform axes X3DM, Y3DM, and Z3DM of the 3DM internal 3D coordinate system to axes X3DM-Earth, Y3DM-Earth, Z3DM-Earth and the reference point RP
having the coordinates RPX3DM, RPY3DM, RPZ3DM to OEarth In accordance with a second broad aspect, there is provided a system for synchronizing a three-dimensional measurement device (3DM) having a 3DM internal 3D coordinate system 3DM, X3DM, Y3DM, and Z3DM, with an intelligent guidance device (IGD) having a display device, a gravity direction measurement device, an electronic compass, and an IGD
internal 3D coordinate system OIGD, XIGD, YIGD, ZIGD, the system comprising: an IGD transformation module operatively connected to the IGD and adapted to define a coordinate system OEarth, XIGD-Earth, YIGD-Earth, ZIGD-Earth using a direction opposite to gravity as ZIGD-Earth and a direction corresponding to a magnetic north pole as YIGD-Earth, from a perspective of the IGD, and compute and apply a rigid transformation TIGD-To-IGDEarth to transform axes XIGD, YIGD, ZIGD of the IGD internal 3D
coordinate system to axes XIGD-Earth, YIGD-Earth, ZIGD-Earth and a reference point RP having coordinates RPXIGD, RPYIGD, RPZIGD in the IGD internal 3D coordinate system to OEarth; and a 3DM
transformation module operatively connected to the 3DM and adapted to define a coordinate system OEarth, X3DM-Earth, Y3DM-Earth, Z3DM-Earth using a direction opposite to gravity as Z3DM-Earth and the direction corresponding to the magnetic north pole as Y3DM-Earth, from a perspective of the 3DM, compute and apply a rigid transformation T3DM-To-3DMEarth to transform axes X3DM, Y3DM, and Z3DM of the 3DM internal 3D coordinate system to axes X3DM-Earth, Y3DM-Earth, Z3DM-Earth and the reference point RP having coordinates RPX3DM, RPY3DM, RPZ3DM in the 3DM internal 3D
coordinate system to Earth-In accordance with another broad aspect, there is provided an intelligent guidance device (IGD) having an IGD
internal 3D coordinate system OIGD, XIGD, YIGD, ZIGD, the device comprising: a gravity direction measurement device; an electronic compass; an IGD transformation module operatively connected to the IGD and adapted to define a coordinate system Earth, XIGD-Earth, YIGD-Earth, ZIGD-Earth using a direction opposite to gravity as ZIGD-Earth and a direction corresponding to a magnetic north pole as YIGD-Earth, and to compute and apply a rigid transformation TIGD-To-IGDEarth to transform axes XIGD, YIGD, ZIGD of the IGD internal 3D coordinate system to axes XIGD-Earth, YIGD-Earth, ZIGD-Earth and a reference point RP having coordinates RPXIGD, RPYIGD, RPZIGD in the IGD internal 3D
coordinate system to Earth; and a display device for displaying 3D graphics in a 3D coordinate system synchronized with a 3D coordinate system of a three-dimensional measurement device.
In accordance with a further broad aspect, there is provided at least one computer program product for synchronizing a three-dimensional measurement device (3DM) having a 3DM internal 3D coordinate system 3DM, X3DM, Y3DM, and Z3DM, with an intelligent guidance device (IGD) having a display device, a gravity direction measurement device, an electronic compass, and an IGD internal 3D coordinate system OIGD, XIGD, YIGD, ZIGD, comprising instruction means encoded on a computer-readable medium, for causing operations of: defining a coordinate system Earth, XIGD-Earth, YIGD-Earth, ZIGD-Earth using a direction opposite to gravity as ZIGD-Earth and a direction corresponding to a magnetic north pole as YIGD-Earth, from a perspective of the IGD; computing and applying a rigid transformation TIGD-To-IGDEarth to transform axes XIGD, YIGD, ZIGD Of the IGD internal 3D coordinate system to axes XIGD-Earth, YIGD-Earth, ZIGD-Earth and a reference point RP having coordinates RPXIGD, RPYIGD, RPZIGD in the IGD internal 3D coordinate system to OEarth, defining a coordinate system OEarth, X3DM-Earth, Y3DM-Earth, Z3DM-Earth using a direction opposite to gravity as Z3DM-Earth and the direction corresponding to the magnetic north pole as Y3DM-Earth, from a perspective of the 3DM; and computing and applying a rigid transformation T3DM-To-3DMEarth to transform axes X3DM, Y3DM, and Z3DM of the 3DM internal 3D coordinate system to the axes X3DM-Earth, Y3DM-Earth, Z3DM-Earth and the reference point RP
having coordinates RPX3DM, RPY3DM, RPZ3DM in the 3DM internal 3D
coordinate system to Earth=
In the present specification, the following definitions are to be used throughout.
3D Coordinate System: A system for assigning 3 numbers to each point in a 3-dimensional space. A common instance of a 3D Coordinate System is the Cartesian coordinate system where three X, Y, Z axes perpendicular to each other and meeting each other at an origin point (0, 0, 0) are used to parameterize the 3-dimensional space (see Figure 1). An infinite number of 3D Coordinate Systems can be derived from the basic Cartesian coordinate system by moving (or translating) the origin point in 3-dimensional space, defining a new origin 0', and rotating the original X, Y, Z
axes to define new axes X', Y', and Z' (see Figure 2). In such a case, the X', Y', and Z' axes can each be expressed by using a triplet of (x, y, z) coordinates, expressed in the Cartesian coordinate system. The triplet of (x, y, z) coordinates representing a particular axis is computed by determining a point P located at a distance of 1 from the origin 0' along the direction of the axis, and then subtracting the origin 0' from this point P.
A 3D Coordinate System is said to be right-handed if the vector product between the first axis (for example X) and the second axis (for example Y) produces the third axis (for example Z). A 3D Coordinate System would be left-handed if the vector product between the second axis and the first axis would produce the third axis. This document uses right-handed 3D Coordinate Systems in all explanations. However, left-handed 3D Coordinate Systems could be used as well without loss of generality.
3D Transformation: A mathematical operation that transforms any input point (xi, yi, zi) in 3-dimensional space into an output point (x0, yo, z0) .
Rigid 3D Transformation: Rigid 3D Transformations are subsets of the possible 3D Transformations applicable to input points by which only rotations and translations are applied to these points. Such a 3D Transformation is called rigid because it preserves the original shape and dimensions of any 3-dimensional object. For example, let's imagine a box having a width of 1 meter, a height of 2 meters, and a depth of 3 meters. Then, let's consider any possible Rigid 3D
Transformation that can be applied to this box. If any of these possible Rigid 3D Transformations are applied to the box, the box dimensions would always remain 1 meter by 2 meters by 3 meters under all circumstances.
A Rigid 3D Transformation RT can be expressed by six numbers (rx, ry, rZ, tX, ty, tZ) . The numbers r, ry, and rZ
represent successive rotations to be applied about the X, Y, and Z axes of the Cartesian coordinate system. The numbers tX, ty, and tz represent successive translations to be applied along the X, Y, and Z axes of the Cartesian coordinate system. There are various mathematical techniques available to represent Rigid 3D Transformation using 4 by 4 matrices and to extract the three rotations and three translations from a 4 by 4 Rigid 3D Transformation matrix.
In addition to being applicable to points, Rigid 3D
Transformations can also be applied to 3D Coordinate Systems.
Four points are needed to define an arbitrary 3D Coordinate System: the origin O', and the points at a unitary distance of 1 from O' along the X', Y', and Z' axes. A Rigid 3D
Transformation is applied to a 3D Coordinate System by transforming the four points that are needed to describe it.
The origin and three axes of the transformed 3D Coordinate System may then be rebuilt from the four transformed points by subtracting the transformed origin from the three transformed points at the extremity of the unitary axes (see Figure 3).
Gravity Direction Measurement Device: A measurement device that is capable of measuring the direction of gravity, such as a three-axis inclinometer. Gravity direction measurement devices can be incorporated in computing devices.
The gravitational force generally points towards the center of Earth with a relatively stable intensity locally.
Electronic Compass: A measurement device that can determine the direction of the Earth's North magnetic pole.
An electronic compass can be incorporated in computing devices. Locally, the measurements produced by an electronic compass are fairly constant. The North direction can be used not only for geographical navigation purposes, but also as a fixed reference direction to define a coordinate system.
Three-Axis Accelerometer: A measurement device that can determine the acceleration along three axes perpendicular to each other. A three-axis accelerometer can be incorporated in computing devices. By letting a computing device that incorporates a three-axis accelerometer in a stable position for a predetermined period of time such as a few seconds for example, then starting to move it in 3D space, the three-axis accelerometer can be used to determine the speed and relative position of the computing device along the three axes.
Display Device: A material support to visually output information to an end-user, such as text, images, videos, etc. Computing devices are generally equipped with display devices.
Intelligent Guidance Device (IGD): A computing device equipped with a communication unit, a display device, a gravity direction measurement device, and an electronic compass. An IGD may further be provided with a three-axis accelerometer. Examples of an IGD comprise the iPhoneTM 3GS
model, the iPhoneTM 4 model, and the like.
Electronic Compass: A measurement device that can determine the direction of the Earth's North magnetic pole.
An electronic compass can be incorporated in computing devices. Locally, the measurements produced by an electronic compass are fairly constant. The North direction can be used not only for geographical navigation purposes, but also as a fixed reference direction to define a coordinate system.
Three-Axis Accelerometer: A measurement device that can determine the acceleration along three axes perpendicular to each other. A three-axis accelerometer can be incorporated in computing devices. By letting a computing device that incorporates a three-axis accelerometer in a stable position for a predetermined period of time such as a few seconds for example, then starting to move it in 3D space, the three-axis accelerometer can be used to determine the speed and relative position of the computing device along the three axes.
Display Device: A material support to visually output information to an end-user, such as text, images, videos, etc. Computing devices are generally equipped with display devices.
Intelligent Guidance Device (IGD): A computing device equipped with a communication unit, a display device, a gravity direction measurement device, and an electronic compass. An IGD may further be provided with a three-axis accelerometer. Examples of an IGD comprise the iPhoneTM 3GS
model, the iPhoneTM 4 model, and the like.
3D Measurement Device (3DM): A measurement system capable of measuring the (x, y, z) coordinates of points on physical parts in the 3-dimensional space. Any measurement principle can be used.
BRIEF DESCRIPTION OF THE DRAWINGS
Further features and advantages of the present invention will become apparent from the following detailed description, taken in combination with the appended drawings, in which:
Fig. 1 illustrates a Cartesian coordinate system with a point parametrized in a 3-dimensional space, in accordance with one embodiment;
Fig. 2 illustrates the Cartesian coordinate system of Fig. 1 and a second 3D coordinate system defined by translating and rotating the Cartesian coordinate system, in accordance with one embodiment;.
Fig. 3 illustrates how a 3D coordinate system is transformed by a Rigid 3D Transformation, in accordance with one embodiment;
Fig. 4a illustrates an exemplary transformation of an IGD 3D coordinate system to orient it with respect to gravity and the North direction and transform a reference point RPIGD
into OEarth, in accordance with one embodiment;
Fig. 4b illustrates the axis adjustment operation, in accordance with one embodiment;
Fig. 5 illustrates an exemplary transformation of a 3DM
3D coordinate system to orient it with respect to gravity and the North direction and transform reference point RP3DM into Earth, in accordance with one embodiment;
Fig. 6 is a block diagram of a system for synchronizing a 3DM and an IGD where the transformation modules are integrated onto the respective devices, in accordance with one embodiment;
Fig. 7 is a block diagram of a system for synchronizing a 3DM and an IGD where a separate computing device is used for one of the transformation modules, in accordance with one embodiment; and Fig. 8 is a block diagram of a system for synchronizing a 3DM and an IGD where a separate computing device is used for both of the transformation modules, in accordance with one embodiment.
It will be noted that throughout the appended drawings, like features are identified by like reference numerals.
DETAILED DESCRIPTION
A 3DM is a device designed to measure the (x, y, z) coordinates of points and report these measured coordinates from the perspective of its internal 3D Coordinate System defined by an origin 3DM and three axes X3DM, Y3DM, and Z3DM- An IGD is a device that also has an internal 3D Coordinate System defined by an origin OIGD and three axes XIGD, YIGD, ZIGD-Figure 1 illustrates a Cartesian coordinate system having axes X, Y, and Z and an origin (0, 0, 0) . A point (2, 3, 0) is parametrized in the 3-dimensional space. Figure 2 illustrates a new coordinate system defined by translating and rotating the Cartesian coordinate system of figure 1.
This new coordinate system has axes X', Y', Z' . In figure 3, the coordinate system defined by X', Y', Z' is further transformed by rigid 3D transformation RT by transforming four points and recomputing the axes such that we have X '' , Y '' , Z' . These principles are used in order to synchronize the position and orientation of a 3DM 3D Coordinate System with the position and orientation of an IGD 3D Coordinate System.
In order to synchronize the position of an IGD 3D
Coordinate System with the position of a 3DM 3D Coordinate System, the first step consists in selecting a reference point RP and determining the coordinates RPXIGD, RPYIGD, RPZIGD
of the reference point RP in the internal coordinate system of the IGD and the coordinates RPX3DM, RPY3DM, RPZ3DM of the reference point RP in the internal coordinate system of the 3DM. It should be understood that any reference point could be used and any method could be used to determine the reference point coordinates in both IGD or 3DM 3D Coordinate Systems.
For example, the IGD could rest in a stable position and a mark such as a circle or a point for example, could be displayed on the Display Device of the IGD. The coordinates of the point or the circle's center would be determined with respect to the IGD 3D Coordinate System by setting up a coordinate system based on the IGD manufacturer specifications. The 3DM could then be used to measure the displayed circle or point and determine the point or circle's center coordinates in the 3DM 3D Coordinate System.
BRIEF DESCRIPTION OF THE DRAWINGS
Further features and advantages of the present invention will become apparent from the following detailed description, taken in combination with the appended drawings, in which:
Fig. 1 illustrates a Cartesian coordinate system with a point parametrized in a 3-dimensional space, in accordance with one embodiment;
Fig. 2 illustrates the Cartesian coordinate system of Fig. 1 and a second 3D coordinate system defined by translating and rotating the Cartesian coordinate system, in accordance with one embodiment;.
Fig. 3 illustrates how a 3D coordinate system is transformed by a Rigid 3D Transformation, in accordance with one embodiment;
Fig. 4a illustrates an exemplary transformation of an IGD 3D coordinate system to orient it with respect to gravity and the North direction and transform a reference point RPIGD
into OEarth, in accordance with one embodiment;
Fig. 4b illustrates the axis adjustment operation, in accordance with one embodiment;
Fig. 5 illustrates an exemplary transformation of a 3DM
3D coordinate system to orient it with respect to gravity and the North direction and transform reference point RP3DM into Earth, in accordance with one embodiment;
Fig. 6 is a block diagram of a system for synchronizing a 3DM and an IGD where the transformation modules are integrated onto the respective devices, in accordance with one embodiment;
Fig. 7 is a block diagram of a system for synchronizing a 3DM and an IGD where a separate computing device is used for one of the transformation modules, in accordance with one embodiment; and Fig. 8 is a block diagram of a system for synchronizing a 3DM and an IGD where a separate computing device is used for both of the transformation modules, in accordance with one embodiment.
It will be noted that throughout the appended drawings, like features are identified by like reference numerals.
DETAILED DESCRIPTION
A 3DM is a device designed to measure the (x, y, z) coordinates of points and report these measured coordinates from the perspective of its internal 3D Coordinate System defined by an origin 3DM and three axes X3DM, Y3DM, and Z3DM- An IGD is a device that also has an internal 3D Coordinate System defined by an origin OIGD and three axes XIGD, YIGD, ZIGD-Figure 1 illustrates a Cartesian coordinate system having axes X, Y, and Z and an origin (0, 0, 0) . A point (2, 3, 0) is parametrized in the 3-dimensional space. Figure 2 illustrates a new coordinate system defined by translating and rotating the Cartesian coordinate system of figure 1.
This new coordinate system has axes X', Y', Z' . In figure 3, the coordinate system defined by X', Y', Z' is further transformed by rigid 3D transformation RT by transforming four points and recomputing the axes such that we have X '' , Y '' , Z' . These principles are used in order to synchronize the position and orientation of a 3DM 3D Coordinate System with the position and orientation of an IGD 3D Coordinate System.
In order to synchronize the position of an IGD 3D
Coordinate System with the position of a 3DM 3D Coordinate System, the first step consists in selecting a reference point RP and determining the coordinates RPXIGD, RPYIGD, RPZIGD
of the reference point RP in the internal coordinate system of the IGD and the coordinates RPX3DM, RPY3DM, RPZ3DM of the reference point RP in the internal coordinate system of the 3DM. It should be understood that any reference point could be used and any method could be used to determine the reference point coordinates in both IGD or 3DM 3D Coordinate Systems.
For example, the IGD could rest in a stable position and a mark such as a circle or a point for example, could be displayed on the Display Device of the IGD. The coordinates of the point or the circle's center would be determined with respect to the IGD 3D Coordinate System by setting up a coordinate system based on the IGD manufacturer specifications. The 3DM could then be used to measure the displayed circle or point and determine the point or circle's center coordinates in the 3DM 3D Coordinate System.
Once the position of a common reference point, i.e. the reference point RP, has been established in both IGD and 3DM
3D Coordinate Systems, the orientation of the IGD and 3DM 3D
Coordinate Systems can be determined. Using the gravity direction measurement device of the IGD, the direction of gravity is measured and a vector ZIGD-Earth pointing in a direction opposite to gravity (up) is determined. Using the electronic compass of the IGD, the direction of the North magnetic pole is measured and a vector YIGD-Earth pointing in the North direction is determined.
Since the ZIGD-Earth and YIGD-Earth axes are computed from separate measurement devices, they are not perfectly perpendicular to each other. An adjustment operation is used to make them perpendicular to each other. A plane formed by ZIGD-Earth and YIGD-Earth is defined. One of the two axes, for example ZIGD-Earthy is fixed. The adjusted axis, for example YIGD-Earthy is then rotated in the plane to make it perpendicular to the fixed axis. There are two positive rotation angles below or equal to 180 degrees that make the adjusted axis perpendicular to the fixed axis. The one closest to 0 is used. Alternately, the YIGD-Earth could be used as the fixed axis, and the ZIGD-Earth axis could be rotated to make it perpendicular to YIGD-Earth using the same method.
The adjustment operation is illustrated in figure 4b. In the plane formed by the fixed axis and the adjusted axis, two positive rotation angles a and (3 less than or equal to 180 can be applied to the adjusted axis to make it perpendicular to the fixed axis. The smallest of a and (3 is used.
3D Coordinate Systems, the orientation of the IGD and 3DM 3D
Coordinate Systems can be determined. Using the gravity direction measurement device of the IGD, the direction of gravity is measured and a vector ZIGD-Earth pointing in a direction opposite to gravity (up) is determined. Using the electronic compass of the IGD, the direction of the North magnetic pole is measured and a vector YIGD-Earth pointing in the North direction is determined.
Since the ZIGD-Earth and YIGD-Earth axes are computed from separate measurement devices, they are not perfectly perpendicular to each other. An adjustment operation is used to make them perpendicular to each other. A plane formed by ZIGD-Earth and YIGD-Earth is defined. One of the two axes, for example ZIGD-Earthy is fixed. The adjusted axis, for example YIGD-Earthy is then rotated in the plane to make it perpendicular to the fixed axis. There are two positive rotation angles below or equal to 180 degrees that make the adjusted axis perpendicular to the fixed axis. The one closest to 0 is used. Alternately, the YIGD-Earth could be used as the fixed axis, and the ZIGD-Earth axis could be rotated to make it perpendicular to YIGD-Earth using the same method.
The adjustment operation is illustrated in figure 4b. In the plane formed by the fixed axis and the adjusted axis, two positive rotation angles a and (3 less than or equal to 180 can be applied to the adjusted axis to make it perpendicular to the fixed axis. The smallest of a and (3 is used.
A vector XIGD-Earth is found by computing the vector product between YIGD-Earth and ZIGD-Earth. An arbitrary origin OEarth is defined at (0, 0 , 0) . OEarth, XIGD-Earth, YIGD-Earth, ZIGD-Earth represent a 3D Coordinate System where one of the axes points in a direction opposite to gravity and the other points towards North.
A Rigid 3D Transformation TIGD-To-IGDEarth is computed to both transform the XIGD, YIGD, ZIGD axes to the XIGD-Earth YIGD-Earth, ZIGD-Earth axes and transform the reference point (RPXIGD, RPYIGD, RPZIGD) to the origin OEarth, as illustrated in Figure 4a.
The direction of gravity is measured from the standpoint of the 3DM 3D Coordinate System. Any method known to the person skilled in the art may be used. For example, adjust a flat physical part using a level to bring its flat section perpendicular to gravity, measure the flat section with the 3DM, fit a plane on the measured points, and use the plane's normal vector to determine the direction of gravity.
Alternatively, a gravity direction measurement device integrated to the 3DM may be used to determine the direction of gravity.
From the gravity vector measured from the standpoint of the 3DM 3D Coordinate System, a vector Z3DM-Earth pointing in a direction opposite to gravity (up) may be determined. The direction of the North magnetic pole is measured from the standpoint of the 3DM 3D Coordinate System. Any method known to a person skilled in the art may be used. For example, use an electronic compass integrated to the 3DM, display the North direction on the IGD display device and use the 3DM to measure the displayed direction, or use a standard compass and use the 3DM to measure the direction indicated by the standard compass.
From the North direction measured from the standpoint of the 3DM 3D Coordinate System, a vector Y3DM-Earth pointing in the North direction may be determined. A plane formed by Z3DM-Earth and Y3DM-Earth is then defined. If Y3DM-Earth is not perfectly perpendicular to Z3DM-Earth, either one of Z3DM-Earth or Y3DM-Earth may be rotated in the plane to bring the two perfectly perpendicular. Two positive rotation angles are possible, the smallest is used.
A vector X3DM-Earth is determined by computing the vector product between Y3DM-Earth and Z3DM-Earth = An origin OEarth is defined at (0, 0, 0) = OEarth, X3DM-Earth, Y3DM-Earth, Z3DM-Earth represent a 3D Coordinate System where one of the axes points in a direction opposite to gravity and the other points towards North.
A Rigid 3D Transformation T3DM-To-3DMEarth is computed to both transform the X3DM, Y3DM, Z3DM axes of the 3DM coordinate system to the X3DM-Earth, Y3DM-Earth, Z3DM-Earth axes and transform the reference point (RPX3DM, RPY3DM, RPZ3DM) to the origin Earth, as illustrated in Figure 5.
The position and orientation of the IGD and the position and orientation of the 3DM are synchronized by transforming the internal 3D Coordinate System of the IGD by Rigid 3D
Transformation TIGD-TO-IGDEarth and transforming the internal 3D
Coordinate System of the 3DM by Rigid 3D Transformation T3DM-To-3DMEarth= The position and orientation of the IGD and the position and orientation of the 3DM are synchronized since a reference point RP whose coordinates are known in both IGD
and 3DM internal 3D Coordinate Systems has been used to define the origin OEarth, the transformed XIGD and X3DM axes are parallel to each other and point in the same direction, the transformed YIGD and Y3DM axes are parallel to each other and point in the same direction, and the transformed ZIGD and Z3DM
axes are parallel to each other and point in the same direction.
Once the position and orientation of the IGD and the position and orientation of the 3DM are synchronized, the synchronization should be maintained at all times. Three cases may need to be specifically addressed.
The first case is related to the nature of a typical IGD, i.e. an IDG is hand-held and can be moved freely.
Therefore, changes in the position of the IGD are to be monitored. The three-axis accelerometer of the IGD is used for this monitoring purpose. The IGD must be kept in a stable position when its position is synchronized to the 3DM
position so that the IGD speed be zero along all three axes.
Once the positions of the IGD and 3DM have been synchronized as described above, the tracking of the motion of the IGD
starts and the three-axis accelerometer is used to measure the current acceleration of the IGD along the three axes XIGD, YIGD, ZIGD. From the acceleration measurements, the IGD
determines its current speed and position along three axes XIGD, YIGD, ZIGD, and its position variation.
From the position variation of the IGD, three offset values OXoffset, DYoffset, AZoffset along the IGD three axes XIGD, YIGD, ZIGD, which correspond to the displacement vector for the IGD, are determined and applied to the coordinates RPXIGD, RPYIGD, RPZIGD of the reference point RP in the internal IGD 3D
coordinate system to obtain an updated reference point RP' having the coordinates RPXIGD+LXoffset, RPYIGD+LYoffset, RPZIGD+LZoffset in the internal IGD 3D coordinate system. The updated reference point RP' is then used to update the Rigid 3D Transformation TIGD-To-IGDEarth and maintain the synchronization of the positions of the IGD and 3DM while the IGD is in motion. The updated Rigid 3D Transformation TIGD-To-IGDEarth both transforms the XIGD, YIGD, ZIGD axes to the XIGD-Earth, YIGD-Earth, ZIGD-Earth axes and transform the updated reference point RP' to OEarth The second case is related to the nature of a typical IGD, which is that it is hand-held and can be rotated freely.
Therefore, changes in the orientation of the IGD are to be monitored. If a change in the orientation of the IGD is detected, the Rigid 3D Transformation TIGD-To-IGDEarth should be updated by re-measuring the directions of gravity and North magnetic pole using the IGD gravity direction measurement device and electronic compass, and then updating the Rigid 3D
Transformation TIGD-To-IGDEarth=
In addition, measurement processes generally require the transformation of the 3DM 3D Coordinate System into other 3D
Coordinate Systems, typically ones created in Computer-Aided Design (CAD) software. To maintain the synchronization of the position and orientation of the IGD and the position and orientation of the 3DM, the invert of the Rigid 3D
Transformation T3DM-To-3DMEarth should be applied to both the 3D
Coordinate System OEarth, XIGD-Earth, YIGD-Earth, ZIGD-Earth and the 3D
Coordinate System DEarth, X3DM-Earth, Y3DM-Earth, Z3DM-Earth. This operation transforms the IGD 3D Coordinate System into the internal 3DM 3D Coordinate System, while keeping the positions and orientations synchronized. Then, an operator can determine a Rigid 3D Transformation transforming the internal 3DM 3D Coordinate System into the 3D Coordinate System of a model designed in CAD (Computer-Aided Design) software. This Rigid 3D Transformation would then be applied to both IGD and 3DM 3D Coordinate Systems in order to maintain their position and orientation synchronized.
Once the position and orientation of the IGD and the position and orientation of the 3DM are synchronized, the IGD
can be used to guide a measurement process by means of 3D
graphics displayed on the IGD display device. The following methodology demonstrates measurement guidance by means of 3D
graphics.
First, the position and orientation of the IGD and the position and orientation of the 3DM 3D Coordinate Systems are synchronized, as described above. Then, the 3DM 3D Coordinate System is usually transformed to bring it into a more useful position and orientation. For example, points are measured on a physical part or assembly, and these measured points are used to construct a transformation that transforms the 3DM 3D
Coordinate System into a CAD 3D Coordinate System. Since synchronization is achieved and maintained, the IGD 3D
Coordinate System is also transformed, and the IGD 3D
Coordinate System will have the same position and orientation compared to the corresponding CAD 3D Coordinate System.
It then becomes possible to use the IGD display device to display 3D graphics of the CAD model and ensure that these 3D graphics have the same position and orientation as the CAD
3D Coordinate System. In the above example, 3D graphics to be displayed on the IGD are determined by geometry defined in the CAD 3D Coordinate System. In order to produce 3D graphics of this geometry and display these 3D graphics on the IGD
display device, the following Rigid 3D Transformations are applied successively to this geometry: the invert of the 3DM-to-CAD Rigid 3D Transformation; T3DM-To-3DMEarth; the invert of TIGD-TO-IGDEarth-If the operator needs to measure a specific section of the CAD model during a measurement routine, the IGD display device may be used to display the specific section using 3D
graphics. Guidance 3D graphics such as 3D geometry, 3D arrows and 3D text annotations can be used to supply information to the operator and guide the measurement process. For example, if a given target point needs to be measured, the target point and 3D arrows indicating the current distance between the 3DM and the target point along the three axes can be displayed on the IGD display device. Because the target point position on the display is close to what the operator sees on the physical part in front of his eyes, and the 3D arrows are oriented along the axes of the physical part or assembly, they help the operator reaching the target position more quickly.
Figure 6 illustrates an embodiment for a system for synchronizing the internal coordinate systems of a 3DM 600 and an IGD 604 in order to allow measurement guidance using the IGD 604. In this embodiment, the 3DM 600 comprises a processing unit 601, a display device 606, a 3DM
transformation module 602, and a coordinate measurement module 603. The 3DM coordinates measurement module 603 comprises at least one 3D measurement probe and is adapted to measure the 3D coordinates of points in the 3D space, such as the coordinates of the reference point RP. The 3DM
transformation module 602 is a software product adapted to define the coordinate system OEarth, X3DM-Earth, Y3DM-Earth, Z3DM-Earth using the direction opposite to gravity as Z3DM-Earth and the direction corresponding to the magnetic north pole as Y3DM-Earth, from the perspective of the 3DM. The 3DM transformation module 602 will then compute the rigid transformation T3DM-TO-3DMEarth to both transform the X3DM, Y3DM, Z3DM axes of the 3DM
coordinate system to the X3DM-Earth, Y3DM-Earth, Z3DM-Earth axes and the reference point (RPX3DM, RPY3DM, RPZ3DM) to the origin OEarth=
This rigid transformation can then be applied to the internal coordinate system of the 3DM 600.
Figure 6 also illustrates the IGD 604 with which the 3DM
600 is being synchronized. In the embodiment illustrated, the IGD 604 also has a display device 606 and a processing unit 607. A gravity direction measurement device 608, an electronic compass 612, and a three-axis accelerometer 613 are integrated inside the IGD 604. The IGD 604 also comprises an IGD coordinates module 614 which is a software product adapted to receive the coordinates RPXIGD, RPYIGD, RPZIGD of the reference point RP, receive the measured acceleration of the IGD along the three axes XIGD, YIGD, ZIGD from the three-axis accelerometer 613, determine the three offset values AXoffset, Lyoffset, OZoffset along the IGD three axes XIGD, YIGD, ZIGD
corresponding to the IGD position variation, and compute the updated reference point RP' having the coordinates RPXIGD+LXoffset, RPYIGD+8Yoffset, RPZIGD+tZoffset While in this embodiment, the coordinates of the reference point RP are entered by the user and received by the IGD coordinates module 614, the IGD coordinates module 614 may be further adapted to determine the coordinates of the reference point RP. For example, the IGD coordinates module 614 may be adapted to display on the display 606 a mark such as a circle for example, and determine the 3D
coordinates of the mark in the IGD internal 3D coordinate system.
Also integrated is an IGD transformation module 610, which is a software product adapted to define the coordinate system OEarth, XIGD-Earths YIGD-Earth, ZIGD-Earth using the direction opposite to gravity as ZIGD-Earth and the direction corresponding to the magnetic north pole as YIGD-Earth, from the perspective of the IGD 604. The IGD transformation module 610 receives the coordinates of the reference point from the IGD
coordinate module 614, and computes and applies a rigid transformation TIGD-To-IGDEarth to both transform the XIGD, YIGD, ZIGD axes of the IGD coordinate system to the XIGD-Earth, YIGD-Earthy ZIGD-Earth axes and the reference point RPXIGD, RPYIGD, RPZIGD
to OEarth= The IGD transformation module 610 also receives the coordinates of the updated reference point RP' from the IGD
coordinate module 614, and computes and applies an updated rigid transformation TIGD-To-IGDEarth to both transform the XIGD, YIGD, ZIGD axes of the IGD coordinate system to the XIGD-Earth, YIGD-Earth, ZIGD-Earth axes and the updated reference point RP' to the origin OEarth in order to maintain the position and orientation synchronization between the IGD and the 3DM while the IGD is moving.
A Rigid 3D Transformation TIGD-To-IGDEarth is computed to both transform the XIGD, YIGD, ZIGD axes to the XIGD-Earth YIGD-Earth, ZIGD-Earth axes and transform the reference point (RPXIGD, RPYIGD, RPZIGD) to the origin OEarth, as illustrated in Figure 4a.
The direction of gravity is measured from the standpoint of the 3DM 3D Coordinate System. Any method known to the person skilled in the art may be used. For example, adjust a flat physical part using a level to bring its flat section perpendicular to gravity, measure the flat section with the 3DM, fit a plane on the measured points, and use the plane's normal vector to determine the direction of gravity.
Alternatively, a gravity direction measurement device integrated to the 3DM may be used to determine the direction of gravity.
From the gravity vector measured from the standpoint of the 3DM 3D Coordinate System, a vector Z3DM-Earth pointing in a direction opposite to gravity (up) may be determined. The direction of the North magnetic pole is measured from the standpoint of the 3DM 3D Coordinate System. Any method known to a person skilled in the art may be used. For example, use an electronic compass integrated to the 3DM, display the North direction on the IGD display device and use the 3DM to measure the displayed direction, or use a standard compass and use the 3DM to measure the direction indicated by the standard compass.
From the North direction measured from the standpoint of the 3DM 3D Coordinate System, a vector Y3DM-Earth pointing in the North direction may be determined. A plane formed by Z3DM-Earth and Y3DM-Earth is then defined. If Y3DM-Earth is not perfectly perpendicular to Z3DM-Earth, either one of Z3DM-Earth or Y3DM-Earth may be rotated in the plane to bring the two perfectly perpendicular. Two positive rotation angles are possible, the smallest is used.
A vector X3DM-Earth is determined by computing the vector product between Y3DM-Earth and Z3DM-Earth = An origin OEarth is defined at (0, 0, 0) = OEarth, X3DM-Earth, Y3DM-Earth, Z3DM-Earth represent a 3D Coordinate System where one of the axes points in a direction opposite to gravity and the other points towards North.
A Rigid 3D Transformation T3DM-To-3DMEarth is computed to both transform the X3DM, Y3DM, Z3DM axes of the 3DM coordinate system to the X3DM-Earth, Y3DM-Earth, Z3DM-Earth axes and transform the reference point (RPX3DM, RPY3DM, RPZ3DM) to the origin Earth, as illustrated in Figure 5.
The position and orientation of the IGD and the position and orientation of the 3DM are synchronized by transforming the internal 3D Coordinate System of the IGD by Rigid 3D
Transformation TIGD-TO-IGDEarth and transforming the internal 3D
Coordinate System of the 3DM by Rigid 3D Transformation T3DM-To-3DMEarth= The position and orientation of the IGD and the position and orientation of the 3DM are synchronized since a reference point RP whose coordinates are known in both IGD
and 3DM internal 3D Coordinate Systems has been used to define the origin OEarth, the transformed XIGD and X3DM axes are parallel to each other and point in the same direction, the transformed YIGD and Y3DM axes are parallel to each other and point in the same direction, and the transformed ZIGD and Z3DM
axes are parallel to each other and point in the same direction.
Once the position and orientation of the IGD and the position and orientation of the 3DM are synchronized, the synchronization should be maintained at all times. Three cases may need to be specifically addressed.
The first case is related to the nature of a typical IGD, i.e. an IDG is hand-held and can be moved freely.
Therefore, changes in the position of the IGD are to be monitored. The three-axis accelerometer of the IGD is used for this monitoring purpose. The IGD must be kept in a stable position when its position is synchronized to the 3DM
position so that the IGD speed be zero along all three axes.
Once the positions of the IGD and 3DM have been synchronized as described above, the tracking of the motion of the IGD
starts and the three-axis accelerometer is used to measure the current acceleration of the IGD along the three axes XIGD, YIGD, ZIGD. From the acceleration measurements, the IGD
determines its current speed and position along three axes XIGD, YIGD, ZIGD, and its position variation.
From the position variation of the IGD, three offset values OXoffset, DYoffset, AZoffset along the IGD three axes XIGD, YIGD, ZIGD, which correspond to the displacement vector for the IGD, are determined and applied to the coordinates RPXIGD, RPYIGD, RPZIGD of the reference point RP in the internal IGD 3D
coordinate system to obtain an updated reference point RP' having the coordinates RPXIGD+LXoffset, RPYIGD+LYoffset, RPZIGD+LZoffset in the internal IGD 3D coordinate system. The updated reference point RP' is then used to update the Rigid 3D Transformation TIGD-To-IGDEarth and maintain the synchronization of the positions of the IGD and 3DM while the IGD is in motion. The updated Rigid 3D Transformation TIGD-To-IGDEarth both transforms the XIGD, YIGD, ZIGD axes to the XIGD-Earth, YIGD-Earth, ZIGD-Earth axes and transform the updated reference point RP' to OEarth The second case is related to the nature of a typical IGD, which is that it is hand-held and can be rotated freely.
Therefore, changes in the orientation of the IGD are to be monitored. If a change in the orientation of the IGD is detected, the Rigid 3D Transformation TIGD-To-IGDEarth should be updated by re-measuring the directions of gravity and North magnetic pole using the IGD gravity direction measurement device and electronic compass, and then updating the Rigid 3D
Transformation TIGD-To-IGDEarth=
In addition, measurement processes generally require the transformation of the 3DM 3D Coordinate System into other 3D
Coordinate Systems, typically ones created in Computer-Aided Design (CAD) software. To maintain the synchronization of the position and orientation of the IGD and the position and orientation of the 3DM, the invert of the Rigid 3D
Transformation T3DM-To-3DMEarth should be applied to both the 3D
Coordinate System OEarth, XIGD-Earth, YIGD-Earth, ZIGD-Earth and the 3D
Coordinate System DEarth, X3DM-Earth, Y3DM-Earth, Z3DM-Earth. This operation transforms the IGD 3D Coordinate System into the internal 3DM 3D Coordinate System, while keeping the positions and orientations synchronized. Then, an operator can determine a Rigid 3D Transformation transforming the internal 3DM 3D Coordinate System into the 3D Coordinate System of a model designed in CAD (Computer-Aided Design) software. This Rigid 3D Transformation would then be applied to both IGD and 3DM 3D Coordinate Systems in order to maintain their position and orientation synchronized.
Once the position and orientation of the IGD and the position and orientation of the 3DM are synchronized, the IGD
can be used to guide a measurement process by means of 3D
graphics displayed on the IGD display device. The following methodology demonstrates measurement guidance by means of 3D
graphics.
First, the position and orientation of the IGD and the position and orientation of the 3DM 3D Coordinate Systems are synchronized, as described above. Then, the 3DM 3D Coordinate System is usually transformed to bring it into a more useful position and orientation. For example, points are measured on a physical part or assembly, and these measured points are used to construct a transformation that transforms the 3DM 3D
Coordinate System into a CAD 3D Coordinate System. Since synchronization is achieved and maintained, the IGD 3D
Coordinate System is also transformed, and the IGD 3D
Coordinate System will have the same position and orientation compared to the corresponding CAD 3D Coordinate System.
It then becomes possible to use the IGD display device to display 3D graphics of the CAD model and ensure that these 3D graphics have the same position and orientation as the CAD
3D Coordinate System. In the above example, 3D graphics to be displayed on the IGD are determined by geometry defined in the CAD 3D Coordinate System. In order to produce 3D graphics of this geometry and display these 3D graphics on the IGD
display device, the following Rigid 3D Transformations are applied successively to this geometry: the invert of the 3DM-to-CAD Rigid 3D Transformation; T3DM-To-3DMEarth; the invert of TIGD-TO-IGDEarth-If the operator needs to measure a specific section of the CAD model during a measurement routine, the IGD display device may be used to display the specific section using 3D
graphics. Guidance 3D graphics such as 3D geometry, 3D arrows and 3D text annotations can be used to supply information to the operator and guide the measurement process. For example, if a given target point needs to be measured, the target point and 3D arrows indicating the current distance between the 3DM and the target point along the three axes can be displayed on the IGD display device. Because the target point position on the display is close to what the operator sees on the physical part in front of his eyes, and the 3D arrows are oriented along the axes of the physical part or assembly, they help the operator reaching the target position more quickly.
Figure 6 illustrates an embodiment for a system for synchronizing the internal coordinate systems of a 3DM 600 and an IGD 604 in order to allow measurement guidance using the IGD 604. In this embodiment, the 3DM 600 comprises a processing unit 601, a display device 606, a 3DM
transformation module 602, and a coordinate measurement module 603. The 3DM coordinates measurement module 603 comprises at least one 3D measurement probe and is adapted to measure the 3D coordinates of points in the 3D space, such as the coordinates of the reference point RP. The 3DM
transformation module 602 is a software product adapted to define the coordinate system OEarth, X3DM-Earth, Y3DM-Earth, Z3DM-Earth using the direction opposite to gravity as Z3DM-Earth and the direction corresponding to the magnetic north pole as Y3DM-Earth, from the perspective of the 3DM. The 3DM transformation module 602 will then compute the rigid transformation T3DM-TO-3DMEarth to both transform the X3DM, Y3DM, Z3DM axes of the 3DM
coordinate system to the X3DM-Earth, Y3DM-Earth, Z3DM-Earth axes and the reference point (RPX3DM, RPY3DM, RPZ3DM) to the origin OEarth=
This rigid transformation can then be applied to the internal coordinate system of the 3DM 600.
Figure 6 also illustrates the IGD 604 with which the 3DM
600 is being synchronized. In the embodiment illustrated, the IGD 604 also has a display device 606 and a processing unit 607. A gravity direction measurement device 608, an electronic compass 612, and a three-axis accelerometer 613 are integrated inside the IGD 604. The IGD 604 also comprises an IGD coordinates module 614 which is a software product adapted to receive the coordinates RPXIGD, RPYIGD, RPZIGD of the reference point RP, receive the measured acceleration of the IGD along the three axes XIGD, YIGD, ZIGD from the three-axis accelerometer 613, determine the three offset values AXoffset, Lyoffset, OZoffset along the IGD three axes XIGD, YIGD, ZIGD
corresponding to the IGD position variation, and compute the updated reference point RP' having the coordinates RPXIGD+LXoffset, RPYIGD+8Yoffset, RPZIGD+tZoffset While in this embodiment, the coordinates of the reference point RP are entered by the user and received by the IGD coordinates module 614, the IGD coordinates module 614 may be further adapted to determine the coordinates of the reference point RP. For example, the IGD coordinates module 614 may be adapted to display on the display 606 a mark such as a circle for example, and determine the 3D
coordinates of the mark in the IGD internal 3D coordinate system.
Also integrated is an IGD transformation module 610, which is a software product adapted to define the coordinate system OEarth, XIGD-Earths YIGD-Earth, ZIGD-Earth using the direction opposite to gravity as ZIGD-Earth and the direction corresponding to the magnetic north pole as YIGD-Earth, from the perspective of the IGD 604. The IGD transformation module 610 receives the coordinates of the reference point from the IGD
coordinate module 614, and computes and applies a rigid transformation TIGD-To-IGDEarth to both transform the XIGD, YIGD, ZIGD axes of the IGD coordinate system to the XIGD-Earth, YIGD-Earthy ZIGD-Earth axes and the reference point RPXIGD, RPYIGD, RPZIGD
to OEarth= The IGD transformation module 610 also receives the coordinates of the updated reference point RP' from the IGD
coordinate module 614, and computes and applies an updated rigid transformation TIGD-To-IGDEarth to both transform the XIGD, YIGD, ZIGD axes of the IGD coordinate system to the XIGD-Earth, YIGD-Earth, ZIGD-Earth axes and the updated reference point RP' to the origin OEarth in order to maintain the position and orientation synchronization between the IGD and the 3DM while the IGD is moving.
In the embodiment of figure 6, a specially adapted 3DM
600 and a specially adapted IGD 604 are sufficient to perform the above-described synchronization and allow the IGD 604 to be used to display 3D graphics in a known position and orientation. The IGD transformation module 610, the 3DM
transformation module 602, and the IGD coordinates module 614 can be downloaded onto the respective devices via the Internet or transferred from a storage medium such as a USB
key, a scandisk, or any other type of memory device. The transfer of the software program onto the devices may be done in a wireless manner or a connected manner using one or more wires or cables. The modules 602, 610, 614 may also be provided on the devices at the time of fabrication or manufacturing. The IGD 604 and the 3DM 600 may also be in communication together to transfer 3D images from one device to the other. This communication may be done in a wireless manner, such as Radio Frequency, WiFi, infrared, microwaves, etc. This communication may also be done in a connected manner using one or more wires or cables.
Figure 7 illustrates a second embodiment of the system for synchronizing the IGD 604 and the 3DM 600. In this case, one of the transformation modules, namely the 3DM
transformation module 602 is on a computing device 615 separate from the 3DM 600. Alternatively, the transformation module on the computing device 615 may comprise the IGD
transformation module 610 while the 3DM transformation module 602 is integrated in the 3DM 600, as per figure 6. It should be understood that the updating of the reference point RP
while the IGD 604 is moving may be performed by the computing device 615. In this case, the computing device 615 receives the measured acceleration of the IGD along the three axes XIGD, YIGD, ZIGD from the IGD 604, determines the three offset values LXoffset, AYoffset, QZoffset, and computes the updated reference point RP' having the coordinates RPXIGD+XXoffset, RPYIGD+QYoffset, RPZIGD+AZoffset In this embodiment, the computing device 615 has a display device 606. The computing device 615 may be a Personal Computer (PC), a laptop, a Personal Digital Assistant (PDA), or any other programmable machine that can store, retrieve, and process data and therefore includes at least one Central Processing Unit (CPU) that performs most calculations and includes a main memory, a control unit, and an arithmetic logic unit. Communications, wireless or connected, may occur between the 3DM 600 and the computing device 615, and between the computing device 615 and the IGD
604.
Figure 8 illustrates a third embodiment of the system for synchronizing the IGD 604 and the 3DM 600. In this case, both of the transformation modules 602 and 610 are present on the separate computing device 615. It should be understood that the computing device 615 may be made up of one or more computers, or a network of computers, and is adapted to be in communication with the IGD 604 and the 3DM 600.
In one embodiment, the coordinates of the reference point RP expressed in the IGD internal coordinate system are input in the computing device 615. In another embodiment, the computing device is adapted to receive the coordinates of the reference point RP expressed in the IGD internal 3D
coordinate system from the IGD 604 which may be adapted to determine the coordinates of a reference mark displayed on the display 606, as described above.
Other devices, besides the iPhoneTM may be used as an IGD. For example, the iPod TouchTm and the Nexus OneTM also include all of the elements of an IGD. Any devices which have a processing unit, a display device, a gravity direction measurement device, an electronic compass, and a three-axis accelerometer may be used. Examples of 3DM devices are the FaroArmTM, the Romer Absolute Arm, and the Leica Absolute TrackerTM .
It should be understood that the rigid transformations described above may be performed via a single matrix which simultaneously transform the axes and the origin or via at least two matrices which successively transform the axes and the origin. For example, the rigid transformation TIGD-To-IGDEarth may be performed by applying a single matrix which simultaneously transforms the axes XIGD, YIGD, ZIGD to the axes XIGD-Earth, YIGD-Earth, ZIGD-Earth and the reference point RP to the origin OEarth, i.e. simultaneously aligns the axes XIGD, YIGD, ZIGD with the axes XIGD-Earth, YIGD-Earth, ZIGD-Earth, respectively, and translate the reference point RP to the origin OEarth=
Alternatively, the rigid transformation TIGD-To-IGDEarth may be performed by applying a two matrices, i.e. one matrix which transforms the axes XIGD, YIGD, ZIGD to the axes XIGD-Earth, YIGD-Earth, ZIGD-Earth and another matrix which transforms the reference point RP to the origin OEarth=
While illustrated in the block diagrams as groups of discrete components communicating with each other via distinct data signal connections, it will be understood by those skilled in the art that the preferred embodiments are provided by a combination of hardware and software components, with some components being implemented by a given function or operation of a hardware or software system, and many of the data paths illustrated being implemented by data communication within a computer application or operating system. The structure illustrated is thus provided for efficiency of teaching the present preferred embodiment.
It should be noted that the present invention can be carried out as a method, can be embodied in a system, a computer readable medium or an electrical or electro-magnetic signal. The embodiments of the invention described above are intended to be exemplary only. The scope of the invention is therefore intended to be limited solely by the scope of the appended claims.
600 and a specially adapted IGD 604 are sufficient to perform the above-described synchronization and allow the IGD 604 to be used to display 3D graphics in a known position and orientation. The IGD transformation module 610, the 3DM
transformation module 602, and the IGD coordinates module 614 can be downloaded onto the respective devices via the Internet or transferred from a storage medium such as a USB
key, a scandisk, or any other type of memory device. The transfer of the software program onto the devices may be done in a wireless manner or a connected manner using one or more wires or cables. The modules 602, 610, 614 may also be provided on the devices at the time of fabrication or manufacturing. The IGD 604 and the 3DM 600 may also be in communication together to transfer 3D images from one device to the other. This communication may be done in a wireless manner, such as Radio Frequency, WiFi, infrared, microwaves, etc. This communication may also be done in a connected manner using one or more wires or cables.
Figure 7 illustrates a second embodiment of the system for synchronizing the IGD 604 and the 3DM 600. In this case, one of the transformation modules, namely the 3DM
transformation module 602 is on a computing device 615 separate from the 3DM 600. Alternatively, the transformation module on the computing device 615 may comprise the IGD
transformation module 610 while the 3DM transformation module 602 is integrated in the 3DM 600, as per figure 6. It should be understood that the updating of the reference point RP
while the IGD 604 is moving may be performed by the computing device 615. In this case, the computing device 615 receives the measured acceleration of the IGD along the three axes XIGD, YIGD, ZIGD from the IGD 604, determines the three offset values LXoffset, AYoffset, QZoffset, and computes the updated reference point RP' having the coordinates RPXIGD+XXoffset, RPYIGD+QYoffset, RPZIGD+AZoffset In this embodiment, the computing device 615 has a display device 606. The computing device 615 may be a Personal Computer (PC), a laptop, a Personal Digital Assistant (PDA), or any other programmable machine that can store, retrieve, and process data and therefore includes at least one Central Processing Unit (CPU) that performs most calculations and includes a main memory, a control unit, and an arithmetic logic unit. Communications, wireless or connected, may occur between the 3DM 600 and the computing device 615, and between the computing device 615 and the IGD
604.
Figure 8 illustrates a third embodiment of the system for synchronizing the IGD 604 and the 3DM 600. In this case, both of the transformation modules 602 and 610 are present on the separate computing device 615. It should be understood that the computing device 615 may be made up of one or more computers, or a network of computers, and is adapted to be in communication with the IGD 604 and the 3DM 600.
In one embodiment, the coordinates of the reference point RP expressed in the IGD internal coordinate system are input in the computing device 615. In another embodiment, the computing device is adapted to receive the coordinates of the reference point RP expressed in the IGD internal 3D
coordinate system from the IGD 604 which may be adapted to determine the coordinates of a reference mark displayed on the display 606, as described above.
Other devices, besides the iPhoneTM may be used as an IGD. For example, the iPod TouchTm and the Nexus OneTM also include all of the elements of an IGD. Any devices which have a processing unit, a display device, a gravity direction measurement device, an electronic compass, and a three-axis accelerometer may be used. Examples of 3DM devices are the FaroArmTM, the Romer Absolute Arm, and the Leica Absolute TrackerTM .
It should be understood that the rigid transformations described above may be performed via a single matrix which simultaneously transform the axes and the origin or via at least two matrices which successively transform the axes and the origin. For example, the rigid transformation TIGD-To-IGDEarth may be performed by applying a single matrix which simultaneously transforms the axes XIGD, YIGD, ZIGD to the axes XIGD-Earth, YIGD-Earth, ZIGD-Earth and the reference point RP to the origin OEarth, i.e. simultaneously aligns the axes XIGD, YIGD, ZIGD with the axes XIGD-Earth, YIGD-Earth, ZIGD-Earth, respectively, and translate the reference point RP to the origin OEarth=
Alternatively, the rigid transformation TIGD-To-IGDEarth may be performed by applying a two matrices, i.e. one matrix which transforms the axes XIGD, YIGD, ZIGD to the axes XIGD-Earth, YIGD-Earth, ZIGD-Earth and another matrix which transforms the reference point RP to the origin OEarth=
While illustrated in the block diagrams as groups of discrete components communicating with each other via distinct data signal connections, it will be understood by those skilled in the art that the preferred embodiments are provided by a combination of hardware and software components, with some components being implemented by a given function or operation of a hardware or software system, and many of the data paths illustrated being implemented by data communication within a computer application or operating system. The structure illustrated is thus provided for efficiency of teaching the present preferred embodiment.
It should be noted that the present invention can be carried out as a method, can be embodied in a system, a computer readable medium or an electrical or electro-magnetic signal. The embodiments of the invention described above are intended to be exemplary only. The scope of the invention is therefore intended to be limited solely by the scope of the appended claims.
Claims (18)
1. A method for synchronizing a three-dimensional measurement device (3DM) having a 3DM internal 3D
coordinate system O3DM, X3DM, Y3DM, and Z3DM , with an intelligent guidance device (IGD) having a display device, a gravity direction measurement device, an electronic compass, and an IGD internal 3D coordinate system O IGD, X IGD, Y IGD, Z IGD, the method comprising:
determining coordinates RPX IGD, RPY IGD, RPZ IGD of a reference point RP in the IGD internal 3D coordinate system O IGD, X IGD , Y IGD , Z IGD ;
defining a coordinate system O Earth, X IGD-Earth, Y IGD Earth, Z IGD-Earth us ing a direction opposite to gravity as Z IGD-Earth and a direction corresponding to a magnetic north pole as Y IGD-Earth , from a perspective of the IGD;
computing and applying a rigid transformation T IGD-To-IGDEarth to transform axes X IGD , Y IGD , Z IGD of the IGD internal 3D coordinate system to X IGD-Earth , Y IGD-Earth , Z IGD- Earth ;
applying the rigid transformation T IGD-To-IGDEarth to transform the reference point RP having the coordinates RPX IGD, RP YIGD, RPZ IGD to O Earth ;
determining coordinates RPX3DM, RPY 3DM, RPZ3DM of the reference point RP in the 3DM internal 3D coordinate system O3DM , X3DM , Y3DM , and Z3DM ;
defining a coordinate system O Earth, X3DM-Earth, Y3DM-Earth , Z3DM-Earth using a direction opposite to gravity as Z3DM-Earth and the direction corresponding to the magnetic north pole as Y3DM-Earth , from a perspective of the 3DM;
computing and applying a rigid transformation T3DM-To-3DMEarth to transform axes X3DM, Y3DM, and Z3DM of the 3DM
internal 3D coordinate system to axes X3DM- Earth , Y3DM-Earth , Z3DM-Earth ; and applying the rigid transformation T3DM-To-3DMEarth to transform the reference point RP having the coordinates RPX3DM, RPY3DM, RPZ3DM to O Earth.
coordinate system O3DM, X3DM, Y3DM, and Z3DM , with an intelligent guidance device (IGD) having a display device, a gravity direction measurement device, an electronic compass, and an IGD internal 3D coordinate system O IGD, X IGD, Y IGD, Z IGD, the method comprising:
determining coordinates RPX IGD, RPY IGD, RPZ IGD of a reference point RP in the IGD internal 3D coordinate system O IGD, X IGD , Y IGD , Z IGD ;
defining a coordinate system O Earth, X IGD-Earth, Y IGD Earth, Z IGD-Earth us ing a direction opposite to gravity as Z IGD-Earth and a direction corresponding to a magnetic north pole as Y IGD-Earth , from a perspective of the IGD;
computing and applying a rigid transformation T IGD-To-IGDEarth to transform axes X IGD , Y IGD , Z IGD of the IGD internal 3D coordinate system to X IGD-Earth , Y IGD-Earth , Z IGD- Earth ;
applying the rigid transformation T IGD-To-IGDEarth to transform the reference point RP having the coordinates RPX IGD, RP YIGD, RPZ IGD to O Earth ;
determining coordinates RPX3DM, RPY 3DM, RPZ3DM of the reference point RP in the 3DM internal 3D coordinate system O3DM , X3DM , Y3DM , and Z3DM ;
defining a coordinate system O Earth, X3DM-Earth, Y3DM-Earth , Z3DM-Earth using a direction opposite to gravity as Z3DM-Earth and the direction corresponding to the magnetic north pole as Y3DM-Earth , from a perspective of the 3DM;
computing and applying a rigid transformation T3DM-To-3DMEarth to transform axes X3DM, Y3DM, and Z3DM of the 3DM
internal 3D coordinate system to axes X3DM- Earth , Y3DM-Earth , Z3DM-Earth ; and applying the rigid transformation T3DM-To-3DMEarth to transform the reference point RP having the coordinates RPX3DM, RPY3DM, RPZ3DM to O Earth.
2. The method of claim 1, wherein said determining the coordinates RPX3DM, RPY3DM, RPZ3DM comprises measuring the coordinates RPX3DM, RPY3DM, RPZ3DM Using the 3DM.
3. The method of claim 1, wherein said determining coordinates RPX IGD, RPY IGD, RPZ IGD comprises:
displaying a reference mark on the display device of the IGD; and determining the coordinates RPX IGD, RPY IGD, RPZ IGD of the reference mark in the IGD internal 3D coordinate system.
displaying a reference mark on the display device of the IGD; and determining the coordinates RPX IGD, RPY IGD, RPZ IGD of the reference mark in the IGD internal 3D coordinate system.
4. The method of claim 3, wherein said determining the coordinates RPX3DM, RPY3Dp4, RPZ3Dm comprising measuring the coordinates RPX3Dr4, RPY3DM, RPZ3DM of the reference mark displayed on the display of the IGD using the 3DM.
5. The method of claim 1, further comprising:
determining a variation of position for the IGD in the IGD internal 3D coordinate system O IGD, X IGD, Y IGD, Z IGD;
applying the variation of position to the reference point, thereby obtaining an updated reference point; and computing and applying an updated rigid transformation T IGD-To-IGDEarth to transform the axes X IGD, Y IGD, Z IGD to the axes X IGD-Earth, Y IGD-Earth, Z IGD-Earth and the updated reference point to O Earth.
determining a variation of position for the IGD in the IGD internal 3D coordinate system O IGD, X IGD, Y IGD, Z IGD;
applying the variation of position to the reference point, thereby obtaining an updated reference point; and computing and applying an updated rigid transformation T IGD-To-IGDEarth to transform the axes X IGD, Y IGD, Z IGD to the axes X IGD-Earth, Y IGD-Earth, Z IGD-Earth and the updated reference point to O Earth.
6. The method of claim 5, wherein said determining a variation of position comprises measuring an acceleration of the IGD along the axes X IGD, Y IGD, Z IGD using a three-axis accelerometer comprised in the IGD and calculating the variation of position for the IGD in the IGD internal 3D
coordinate system from the measured acceleration.
coordinate system from the measured acceleration.
7. The method of claim 1, wherein defining a coordinate system O Earth / X IGD-Earth , Y IGD-Earth, Z IGD -Earth comprises:
measuring a direction of gravity using the gravity direction measurement device and defining a vector Z IGD-Earth as opposite to the direction of gravity;
measuring a direction of North magnetic pole using the electronic compass and defining a vector Y IGD-Earth pointing in the North magnetic pole direction; and computing a vector product of Y IGD-Earth and Z IGD-Earth defining vector X IGD-Earth .
measuring a direction of gravity using the gravity direction measurement device and defining a vector Z IGD-Earth as opposite to the direction of gravity;
measuring a direction of North magnetic pole using the electronic compass and defining a vector Y IGD-Earth pointing in the North magnetic pole direction; and computing a vector product of Y IGD-Earth and Z IGD-Earth defining vector X IGD-Earth .
8. The method of claim 1, wherein defining a coordinate system O Earth, X 3DM-Earth , Y 3DM- Earth , Z 3DM-Earth comprises:
measuring a direction of gravity using a second gravity direction measurement device integrated in the 3DM
and defining a vector Z 3DM-Earth as opposite to the direction of gravity;
measuring a direction of North magnetic pole using a second electronic compass integrated in the 3DM and defining a vector Y 3DM-Earth pointing in the North magnetic pole direction; and computing a vector product of Y 3DM-Earth and Z 3DM-Earth defining vector X3DM-Earth .
measuring a direction of gravity using a second gravity direction measurement device integrated in the 3DM
and defining a vector Z 3DM-Earth as opposite to the direction of gravity;
measuring a direction of North magnetic pole using a second electronic compass integrated in the 3DM and defining a vector Y 3DM-Earth pointing in the North magnetic pole direction; and computing a vector product of Y 3DM-Earth and Z 3DM-Earth defining vector X3DM-Earth .
9. The method of claim 1, further comprising defining a plane formed by Z IGD-Earth and Y IGD - Earth and Y IGD-Earth, and rotating one of Y IGD-Earth and Z IGD-Earth to make Z IGD- Earth and Y IGD-Earth perpendicular to each other.
10. The method of claim 1, further comprising defining a plane formed by Z3DM-Earth and Y3DM-Earth, and rotating one of Y3DM-Earth and Z3DM-Earth to make Z3DM-Earth and Y3DM-Earth perpendicular to each other.
11. The method of claim 1, further comprising:
monitoring a change in orientation of the IGD; and when a change is detected, updating the rigid transformation T IGD-To-IGDEarth by re-measuring gravity and north magnetic pole and re-applying the rigid transformation.
monitoring a change in orientation of the IGD; and when a change is detected, updating the rigid transformation T IGD-To-IGDEarth by re-measuring gravity and north magnetic pole and re-applying the rigid transformation.
12. A system for synchronizing a three-dimensional measurement device (3DM) having a 3DM internal 3D
coordinate system O3DM, X3DM, Y3DM, and Z3DM, with an intelligent guidance device (IGD) having a display device, a gravity direction measurement device, an electronic compass, and an IGD internal 3D coordinate system O IGD, X IGD, Y IGD, Z IGD, the system comprising:
an IGD transformation module operatively connected to the IGD and adapted to define a coordinate system O Earth, X IGD-Earth, Y IGD-Earth, Z IGD-Earth using a direction opposite to gravity as Z IGD-Earth and a direction corresponding to a magnetic north pole as Y IGD-Earth, from a perspective of the IGD, compute and apply a rigid transformation T IGD-To-IGDEarth to transform axes X IGD, Y IGD, Z IGD of the IGD internal 3D
coordinate system to axes X IGD-Earth, Y IGD-Earth, Z IGD-Earth, and apply the rigid transformation T IGD-To-IGDEarth to transform a reference point RP having coordinates RPX IGD, RPY IGD, RPZ IGD
in the IGD internal 3D coordinate system to O Earth; and a 3DM transformation module operatively connected to the 3DM and adapted to define a coordinate system O Earth, X3DM-Earth, Y3DM-Earth, Z3DM-Earth using a direction opposite to gravity as Z3DM-Earth and the direction corresponding to the magnetic north pole as Y-3DM-Earth, from a perspective of the 3DM, compute and apply a rigid transformation T-3DM-To-3DMEarth to transform axes X3DM, Y3DM, and Z3DM of the 3DM internal 3D
coordinate system to axes X3DM-Earth, Y3DM-Earth, Z3DM-Earth, and apply the rigid transformation T3DM-To-3DMEarth to transform the reference point RP having coordinates RPX3DM, RPY3DM, RPZ3DM
in the 3DM internal 3D coordinate system to O Earth.
coordinate system O3DM, X3DM, Y3DM, and Z3DM, with an intelligent guidance device (IGD) having a display device, a gravity direction measurement device, an electronic compass, and an IGD internal 3D coordinate system O IGD, X IGD, Y IGD, Z IGD, the system comprising:
an IGD transformation module operatively connected to the IGD and adapted to define a coordinate system O Earth, X IGD-Earth, Y IGD-Earth, Z IGD-Earth using a direction opposite to gravity as Z IGD-Earth and a direction corresponding to a magnetic north pole as Y IGD-Earth, from a perspective of the IGD, compute and apply a rigid transformation T IGD-To-IGDEarth to transform axes X IGD, Y IGD, Z IGD of the IGD internal 3D
coordinate system to axes X IGD-Earth, Y IGD-Earth, Z IGD-Earth, and apply the rigid transformation T IGD-To-IGDEarth to transform a reference point RP having coordinates RPX IGD, RPY IGD, RPZ IGD
in the IGD internal 3D coordinate system to O Earth; and a 3DM transformation module operatively connected to the 3DM and adapted to define a coordinate system O Earth, X3DM-Earth, Y3DM-Earth, Z3DM-Earth using a direction opposite to gravity as Z3DM-Earth and the direction corresponding to the magnetic north pole as Y-3DM-Earth, from a perspective of the 3DM, compute and apply a rigid transformation T-3DM-To-3DMEarth to transform axes X3DM, Y3DM, and Z3DM of the 3DM internal 3D
coordinate system to axes X3DM-Earth, Y3DM-Earth, Z3DM-Earth, and apply the rigid transformation T3DM-To-3DMEarth to transform the reference point RP having coordinates RPX3DM, RPY3DM, RPZ3DM
in the 3DM internal 3D coordinate system to O Earth.
13. The system of claim 12, wherein the reference point RP
is a reference mark to be displayed on the display device of the IGD, the IGD is adapted to determine the coordinates RPX IGD, RPY IGD, RPZ IGD of the reference mark, and the 3DM is adapted to measure the coordinates of the reference RPX3DM, RPY3DM, RPZ3DM mark displayed on the display device of the IGD.
is a reference mark to be displayed on the display device of the IGD, the IGD is adapted to determine the coordinates RPX IGD, RPY IGD, RPZ IGD of the reference mark, and the 3DM is adapted to measure the coordinates of the reference RPX3DM, RPY3DM, RPZ3DM mark displayed on the display device of the IGD.
14. The system of claim 12, further comprising an IGD
coordinate module adapted to determine a variation of position for the IGD in the IGD internal 3D coordinate system O IGD, X IGD, Y IGD, Z IGD, applying the variation of position to the reference point RP to obtain an updated reference point, and compute and apply an updated rigid transformation T IGD-To-IGDEarth to transform the axes X IGD, Y IGD, Z IGD tO the axes X IGD-Earth Y IGD-Earth, Z IGD-Earth and the updated reference point to O Earth.
coordinate module adapted to determine a variation of position for the IGD in the IGD internal 3D coordinate system O IGD, X IGD, Y IGD, Z IGD, applying the variation of position to the reference point RP to obtain an updated reference point, and compute and apply an updated rigid transformation T IGD-To-IGDEarth to transform the axes X IGD, Y IGD, Z IGD tO the axes X IGD-Earth Y IGD-Earth, Z IGD-Earth and the updated reference point to O Earth.
15. The system of claim 14, wherein the IGD further comprises a three-axis accelerometer for measuring an acceleration of the IGD in the IGD internal 3D coordinate system and the IGD coordinate module is further adapted to calculate the variation of position for the IGD in the IGD
internal 3D coordinate system from the measured acceleration.
internal 3D coordinate system from the measured acceleration.
16. The system of claim 12, wherein at least one the 3DM
transformation module and the IGD transformation module is integrated inside the 3DM and the IGD, respectively.
transformation module and the IGD transformation module is integrated inside the 3DM and the IGD, respectively.
17. A computer program product for synchronizing a three-dimensional measurement device (3DM) having a 3DM internal 3D coordinate system O3Dm, X3DM, Y3DM, and Z3DM, with an intelligent guidance device (IGD) having a display device, a gravity direction measurement device, an electronic compass, and an IGD internal 3D coordinate system O IGD, X IGD, Y IGD, Z IGD, comprising instruction means encoded on a computer-readable medium, the instruction means being machine-executable code that when executed on a computer causes the computer to perform the steps:
defining a coordinate system O Earth, X IGD- Earth, Y IGD-Earth, Z IGD-Earth using a direction opposite to gravity as Z IGD- Earth and a direction corresponding to a magnetic north pole as Y IGD-Earth from a perspective of the IGD;
computing and applying a rigid transformation T IGD-To-IGDEarth to transform axes X IGD, Y IGD, Z IGD of the IGD internal 3D coordinate system to axes X IGD-Earth, Y IGD -Earth Z IGD-Earth ;
applying the rigid transformation T IGD-To-IGDEarth to transform a reference point RP having coordinates RPX IGD, RPY IGD, RPZ IGD in the IGD internal 3D coordinate system to O Earth;
defining a coordinate system O Earth, X3DM-Earth Y3DM-Earth, Z3DM-Earth using a direction opposite to gravity as Z3DM-Earth and the direction corresponding to the magnetic north pole as Y3DM-Earth, from a perspective of the 3DM; and computing and applying a rigid transformation T3DM-To-3DMEarth to transform axes X3DM, Y3DM, and Z3DM of the 3DM
internal 3D coordinate system to the axes X3DM-Earth , Y3DM-Earth , Z3DM-Earth ; and applying the rigid transformation T3DM-TO-3DMEarth to transform the reference point RP having coordinates RPX3DM, RPY3DM, RPZ3DM in the 3DM internal 3D coordinate system to O Earth .
defining a coordinate system O Earth, X IGD- Earth, Y IGD-Earth, Z IGD-Earth using a direction opposite to gravity as Z IGD- Earth and a direction corresponding to a magnetic north pole as Y IGD-Earth from a perspective of the IGD;
computing and applying a rigid transformation T IGD-To-IGDEarth to transform axes X IGD, Y IGD, Z IGD of the IGD internal 3D coordinate system to axes X IGD-Earth, Y IGD -Earth Z IGD-Earth ;
applying the rigid transformation T IGD-To-IGDEarth to transform a reference point RP having coordinates RPX IGD, RPY IGD, RPZ IGD in the IGD internal 3D coordinate system to O Earth;
defining a coordinate system O Earth, X3DM-Earth Y3DM-Earth, Z3DM-Earth using a direction opposite to gravity as Z3DM-Earth and the direction corresponding to the magnetic north pole as Y3DM-Earth, from a perspective of the 3DM; and computing and applying a rigid transformation T3DM-To-3DMEarth to transform axes X3DM, Y3DM, and Z3DM of the 3DM
internal 3D coordinate system to the axes X3DM-Earth , Y3DM-Earth , Z3DM-Earth ; and applying the rigid transformation T3DM-TO-3DMEarth to transform the reference point RP having coordinates RPX3DM, RPY3DM, RPZ3DM in the 3DM internal 3D coordinate system to O Earth .
18. The computer program product of claim 17, comprising further instruction means encoded on the computer-readable medium, for causing operations of:
determining an acceleration of the IGD in the IGD
internal 3D coordinate system using a three-axis accelerometer integrated in the IGD;
calculating a variation of position for the IGD in the IGD internal 3D coordinate system from the acceleration;
applying the variation of position to the reference point RP to obtain an updated reference point; and computing and applying an updated rigid transformation T IGD-TO-IGDEarth to transform the axes X IGD, Y IGD , Z IGD to the axes X IGD-Earth , Y IGD-Earth, Z IGD-Earth and the updated reference point to O Earth.
determining an acceleration of the IGD in the IGD
internal 3D coordinate system using a three-axis accelerometer integrated in the IGD;
calculating a variation of position for the IGD in the IGD internal 3D coordinate system from the acceleration;
applying the variation of position to the reference point RP to obtain an updated reference point; and computing and applying an updated rigid transformation T IGD-TO-IGDEarth to transform the axes X IGD, Y IGD , Z IGD to the axes X IGD-Earth , Y IGD-Earth, Z IGD-Earth and the updated reference point to O Earth.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CA2745501A CA2745501C (en) | 2011-07-05 | 2011-07-05 | Synchronization of the position and orientation of a 3d measurement device and the position and orientation of an intelligent guidance device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CA2745501A CA2745501C (en) | 2011-07-05 | 2011-07-05 | Synchronization of the position and orientation of a 3d measurement device and the position and orientation of an intelligent guidance device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CA2745501A1 CA2745501A1 (en) | 2013-01-05 |
| CA2745501C true CA2745501C (en) | 2014-08-05 |
Family
ID=47430191
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CA2745501A Active CA2745501C (en) | 2011-07-05 | 2011-07-05 | Synchronization of the position and orientation of a 3d measurement device and the position and orientation of an intelligent guidance device |
Country Status (1)
| Country | Link |
|---|---|
| CA (1) | CA2745501C (en) |
-
2011
- 2011-07-05 CA CA2745501A patent/CA2745501C/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CA2745501A1 (en) | 2013-01-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8903656B2 (en) | Synchronization of the position and orientation of a 3D measurement device and the position and orientation of an intelligent guidance device | |
| EP2747034B1 (en) | Location correction of virtual objects | |
| US20130268226A1 (en) | System and Method for Error Correction for CNC Machines | |
| Wang et al. | A screw axis identification method for serial robot calibration based on the POE model | |
| CN104019799A (en) | Relative orientation method by using optimization of local parameter to calculate basis matrix | |
| JP4967858B2 (en) | Calibration method and apparatus between camera and robot | |
| Wu et al. | A novel calibration method for non-orthogonal shaft laser theodolite measurement system | |
| Xu et al. | Multi-camera global calibration for large-scale measurement based on plane mirror | |
| Zhao et al. | Transmitter parameter calibration of the workspace measurement and positioning system by using precise three-dimensional coordinate control network | |
| CA2691246C (en) | Synchronization of the orientation of a 3d measurement device and the orientation of an intelligent guidance device | |
| de Araujo et al. | Cloud-based approach for automatic CNC workpiece origin localization based on image analysis | |
| US11644297B2 (en) | Three-dimensional position sensor systems and methods | |
| CN115272476A (en) | Parameter calibration method, calibration device and storage medium for mobile robot | |
| CN104697466A (en) | Multi-axis type three-dimensional measuring apparatus | |
| KR20200076924A (en) | Jig for matching coordinates of VR and AR devices and method for sharing physical space by using the jig | |
| CA2745501C (en) | Synchronization of the position and orientation of a 3d measurement device and the position and orientation of an intelligent guidance device | |
| EP2543962B1 (en) | Synchronization of the position and orientation of a 3D measurement device with the position and orientation of an intelligent guidance device | |
| Shao et al. | Calibration method for a vision guiding-based laser-tracking measurement system | |
| Wang et al. | Assembly accuracy analysis for small components with a planar surface in large-scale metrology | |
| BR102019013390B1 (en) | AUGMENTED REALITY SYSTEM | |
| Liu et al. | Real-time position and orientation measurement with occlusion handling for distributed optical large-scale metrology systems | |
| Aydar et al. | A low-cost laser scanning system design | |
| Pham et al. | Remote length measurement system using a single point laser distance sensor and an inertial measurement unit | |
| Schmitt et al. | Estimation of the absolute camera pose for environment recognition of industrial robotics | |
| KR20150137856A (en) | Remote control method and system for synchronization |