CN108827260A - The measurement method based on coordinate transform, system and the device positioned by picture - Google Patents
The measurement method based on coordinate transform, system and the device positioned by picture Download PDFInfo
- Publication number
- CN108827260A CN108827260A CN201810683315.9A CN201810683315A CN108827260A CN 108827260 A CN108827260 A CN 108827260A CN 201810683315 A CN201810683315 A CN 201810683315A CN 108827260 A CN108827260 A CN 108827260A
- Authority
- CN
- China
- Prior art keywords
- laser
- coordinate system
- laser beam
- camera
- point
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C15/00—Surveying instruments or accessories not provided for in groups G01C1/00 - G01C13/00
- G01C15/002—Active optical surveying means
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
- G01S7/4804—Auxiliary means for detecting or identifying lidar signals or the like, e.g. laser illuminators
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/02—Systems using the reflection of electromagnetic waves other than radio waves
- G01S17/06—Systems determining position data of a target
- G01S17/42—Simultaneous measurement of distance and other co-ordinates
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Electromagnetism (AREA)
- Computer Networks & Wireless Communication (AREA)
- Optics & Photonics (AREA)
- Length Measuring Devices By Optical Means (AREA)
Abstract
The present invention relates to fields of measurement more particularly to a kind of measurement method based on coordinate transform, system and devices positioned by picture.If the laser beam of the optical axis of camera and laser measurer be it is coplanar and non-coaxial, obtain determinand be located at the ranging on the laser beam of laser measurer apart from and camera on optical axis center point to the laser beam emitting point on laser measurer the first spacing；Ranging distance and the first spacing are substituted into arctan function, angle number is calculated；Camera shooting head-turned angle is adjusted according to the angle number, intersects the optical axis on camera on the test object with the laser beam on laser measurer.Under different ranges, the laser facula of laser measurer is in the center of the video pictures of camera always, in the case where laser facula can not be seen clearly, pass through video pictures centre-lock target measurement position, and then measurement is completed, solve the problems, such as that light is strong, not can determine that laser drop point site apart from remote etc..
Description
This case is so that application No. is 201710353551.X, the applying date is on May 18th, 2017, entitled《Measurement side
Method, system and device》Patent application be female case divisional application.
Technical field
The present invention relates to fields of measurement more particularly to it is a kind of by picture position the measurement method based on coordinate transform,
System and device.
Background technique
It is that each department is concerned about and the work taken a lot of trouble that ground investigation, house, which are measured, and the data surveyed zhang are the protections as property right
Object has legal effect.According to traditional measurement means, artificial race point is needed, is measured using tape measure or steel tape, though
It is also so able to satisfy basic demand, however in terms of long range measurements, such as survey layer height and be not easy in the measurement for reaching place, it deposits
In low efficiency, low precision, the time is long, implements the problems such as operation is difficult.
With the development of new and high technology, there is laser range finder, the instrument is especially suitable in building structure complexity
High-rise, long range house measurement.The instrument is using easy (can non-cpntact measurement), and measurement data is accurate, and working efficiency improves,
The method that a traditional root skin ruler (or steel tape) measures house has been abandoned completely, a zhang error is surveyed in reduction, and the amount of ensure that calculates precision,
Amount is calculated result and is more convinced.But current laser range finder, which still has, needs the aspect that improves, and such as light is too bright indoors, room
Outer sunlight leads to not the laser point for seeing laser range finder sending clearly, also can not will just swash too by force or in the case where long range
Luminous point is accurately positioned onto target object, at this time need to be by auxiliary appliances such as telescopes.
Summary of the invention
The technical problem to be solved by the present invention is to：It is precisely right to provide a kind of realization in the case where measurement environment is bad
Burnt, precise measurement the measurement method based on coordinate transform, system and device.
In order to solve the above-mentioned technical problem, the first technical solution that the present invention uses for：
A kind of measurement method based on coordinate transform, including focusing step：
If the laser beam of the optical axis of camera and laser measurer be it is coplanar and non-coaxial, obtain determinand and be located at Laser Measuring
Ranging distance on the laser beam of measuring device and the optical axis center point on camera are to the laser beam emitting point on laser measurer
The first spacing, the connecting line and laser of the optical axis center point on the camera and the laser beam emitting point on laser measurer
The laser beam of measuring appliance is perpendicular；
Ranging distance and the first spacing are substituted into arctan function, angle number is calculated；
Camera shooting head-turned angle is adjusted according to the angle number, makes swashing on the optical axis and laser measurer on camera
Light beam intersects on the test object.
The second technical solution that the present invention uses for：
A kind of measuring system based on coordinate transform, including Focusing module；
The Focusing module includes first acquisition unit, the first computing unit and adjusting unit；
The first acquisition unit, if being coplanar and non-same for the optical axis of camera and the laser beam of laser measurer
Axis, acquisition determinand are located at the optical axis center point on the distance of the ranging on the laser beam of laser measurer and camera to laser
First spacing of the laser beam emitting point on measuring appliance, the laser on optical axis center point and laser measurer on the camera
The connecting line of beam launch point and the laser beam of laser measurer are perpendicular；
Angle is calculated for ranging distance and the first spacing to be substituted into arctan function in first computing unit
Number；
The adjusting unit makes the optical axis on camera for adjusting camera shooting head-turned angle according to the angle number
Intersect on the test object with the laser beam on laser measurer.
The third technical solution that the present invention uses for：
A kind of measuring device based on coordinate transform, including measurement end；The measurement end includes laser measurer, camera
And angle adjustor；The connecting line and Laser Measuring of optical axis center point on the camera and the laser beam emitting point on laser measurer
The laser beam of measuring device is perpendicular；The angle adjustor is connect with camera, for adjusting the angle of camera, makes the light on camera
Axis intersects on the test object with the laser beam on laser measurer.
The beneficial effects of the present invention are：
Measurement method based on coordinate transform, system and device provided by the invention, by establishing the optical axis of camera, swashing
It is several between the first spacing between the laser beam of flash ranging measuring device and the optical axis center of camera and the laser beam of laser measurer
What angular relationship is calculated and both is located at the optical axis of camera with the laser beam of laser measurer when intersecting in object to be measured
Angle degree, and camera shooting head-turned angle is adjusted according to the angle degree, realize precisely focusing, under different ranges,
The laser facula of laser measurer is in the center of the video pictures of camera always, the case where can not see laser facula clearly
Under, by video pictures centre-lock target measurement position, and then measurement is completed, solving that light is strong, distance is remote etc. cannot be true
The problem of determining laser drop point site.
Detailed description of the invention
Fig. 1 is the focusing flow chart of steps of the measurement method of the invention based on coordinate transform；
Fig. 2 is the measuring process flow chart of the measurement method of the invention based on coordinate transform；
Fig. 3 is the coordinate transform schematic diagram of the measurement method of the invention based on coordinate transform；
Fig. 4 is the structural schematic diagram of the measuring system of the invention based on coordinate transform；
Label declaration：
1, laser measurer；2, camera；3, angle adjustor.
Specific embodiment
To explain the technical content, the achieved purpose and the effect of the present invention in detail, below in conjunction with embodiment and cooperate attached
Figure is explained.
Please refer to Fig. 1, a kind of measurement method based on coordinate transform provided by the invention, including focusing step：
If the laser beam of the optical axis of camera and laser measurer be it is coplanar and non-coaxial, obtain determinand and be located at Laser Measuring
Ranging distance L on the laser beam of measuring device and the optical axis center point on camera are to the laser beam emitting point on laser measurer
The first spacing H, the connecting line of the optical axis center point on the camera and the laser beam emitting point on laser measurer and swash
The laser beam of flash ranging measuring device is perpendicular；
Ranging distance and the first spacing are substituted into arctan function, angle number arctan (H/L) is calculated；
Camera shooting head-turned angle is adjusted according to the angle number, makes swashing on the optical axis and laser measurer on camera
Light beam intersects on the test object.
Measurement method provided by the invention based on coordinate transform, by establishing the optical axis of camera, laser measurer
Geometric angle relationship between the first spacing between the laser beam of the optical axis center and laser measurer of laser beam and camera,
It is calculated and the optical axis of camera both is located to when intersecting in object to be measured angle degree with the laser beam of laser measurer
Number, and camera shooting head-turned angle is adjusted according to the angle degree, realize precisely focusing, under different ranges, laser measurer
The centers of the laser facula video pictures that are in camera always pass through video in the case where laser facula can not be seen clearly
Picture centre-lock target measurement position, and then measurement is completed, solving light not can determine that laser drop point position by force, apart from remote etc.
The problem of setting.
If Fig. 2 and Fig. 3 further include further measuring process：
When the starting point of object to be measured is located at the optical axis center point of camera, the focusing step of first time is executed, makes to take the photograph
As the optical axis on head intersects in the starting point of object to be measured with the laser beam on laser measurer, the starting of object to be measured is obtained
First distance of the point to the laser beam emitting point on laser measurer；
Using the laser beam of laser measurer as Z coordinate axis, the first coordinate system of three-dimensional space is established, is obtained according to first distance
To first coordinate value of the starting point under the first coordinate system of object to be measured；
In the present embodiment, pass through the laser facula of the video pictures centralized positioning laser measurer of camera to mesh to be measured
Target starting point P, using laser measurer as origin Ow, it is Z with laser beamwAxis establishes the first coordinate system of three-dimensional space XwYwZw, lead to
Cross laser measurer obtain starting point to laser measurer distanceLength Z1w, starting point P is obtained in the first coordinate system
XwYwZwUnder coordinate be (0,0, Z1w), it is assumed that the terminating point Q of object to be measured is in the first coordinate system X at this timewYwZwUnder coordinate be
(X2w, Y2w, Z2w)。
When the terminating point of object to be measured is located at the optical axis center point of camera, secondary focusing step is executed, makes to take the photograph
As the optical axis on head intersects on the terminating point of object to be measured with the laser beam on laser measurer, the termination of object to be measured is obtained
Second distance of the point to the laser beam emitting point on laser measurer；
Using the laser beam of laser measurer as Z coordinate axis, the second coordinate system of three-dimensional space is established, is obtained according to second distance
To second coordinate value of the terminating point under the second coordinate system of object to be measured；
In the present embodiment, using the starting point of object to be measured as reference point, laser beam rotates vertical angle α, level angle β
The terminating point Q for reaching object to be measured afterwards, equally using laser measurer as origin Ow', it is Z with laser beamw' axis, establishes three-dimensional space
Second coordinate system Xw′Yw′Zw', pass through the distance of laser measurer acquisition terminating point to laser measurerLength Zrw,
Terminating point Q is obtained in the second coordinate system Xw′Yw′Zw' under coordinate be (0,0, Zrw)。
According to the transformational relation of the first coordinate system and the second coordinate system, by the terminating point of object to be measured under the second coordinate system
The second coordinate value be converted to the third coordinate value under the first coordinate system；Or according to the first coordinate system and the second coordinate system
First coordinate value of the starting point of object to be measured under the first coordinate system is converted under the second coordinate system by transformational relation
Three coordinate values；
In the present embodiment, from the first coordinate system XwYwZwTo the second coordinate system Xw′Yw′Zw', coordinate origin does not move
(i.e. OwWith Ow' be overlapped), it only carries out around x-axis and around the transformation of y-axis, so spatial point Q is in coordinate system XwYwZwWith coordinate system Xw′
Yw′Zw' between transformation meet following relationship：
Wherein, R (x, α) is around OwYwThe transformation matrix form of axis rotation alpha degree indicates that R (y, β) is around OwYwAxis rotation β degree
Transformation matrix form indicate.Due to α, β, ZrwFor known quantity, then spatial point Q can be calculated in the first coordinate system XwYwZwUnder
Coordinate (X2w, Y2w, Z2w)；
According to the first coordinate value and third coordinate value under the first coordinate system, starting point and the end of object to be measured is calculated
The distance between stop.Or according to the second coordinate value and third coordinate value under the second coordinate system, object to be measured is calculated
Starting point and the distance between terminating point.
In the present embodiment, the distance L of P, Q two o'clock in space can be calculated according to formula；
Further, further include：
Operational order is received, respective operations are executed；The operational order includes focusing instruction and measurement instruction.
The present invention also provides a kind of measuring system based on coordinate transform, including Focusing module；The Focusing module packet
It includes first acquisition unit, the first computing unit and adjusts unit；
The first acquisition unit, if being coplanar and non-same for the optical axis of camera and the laser beam of laser measurer
Axis, acquisition determinand are located at the optical axis center point on the distance of the ranging on the laser beam of laser measurer and camera to laser
First spacing of the laser beam emitting point on measuring appliance, the laser on optical axis center point and laser measurer on the camera
The connecting line of beam launch point and the laser beam of laser measurer are perpendicular；
Angle is calculated for ranging distance and the first spacing to be substituted into arctan function in first computing unit
Number；
The adjusting unit makes the optical axis on camera for adjusting camera shooting head-turned angle according to the angle number
Intersect on the test object with the laser beam on laser measurer.
Measuring system provided by the invention based on coordinate transform, by establishing the optical axis of camera, laser measurer
Geometric angle relationship between the first spacing between the laser beam of the optical axis center and laser measurer of laser beam and camera,
It is calculated and the optical axis of camera both is located to when intersecting in object to be measured angle degree with the laser beam of laser measurer
Number, and camera shooting head-turned angle is adjusted according to the angle degree, realize precisely focusing, under different ranges, laser measurer
The centers of the laser facula video pictures that are in camera always pass through video in the case where laser facula can not be seen clearly
Picture centre-lock target measurement position, and then measurement is completed, solving light not can determine that laser drop point position by force, apart from remote etc.
The problem of setting.
It further, further include measurement module；The measurement module includes second acquisition unit, first establishing unit,
Three acquiring units, second establish unit, converting unit and the second computing unit；
The second acquisition unit when for being located at the optical axis center point of camera when the starting point of object to be measured, executes
The focusing step of first time, make the optical axis on camera with the laser beam on laser measurer the phase in the starting point of object to be measured
It hands over, obtains the first distance of the laser beam emitting point in the starting point to laser measurer of object to be measured；
The first establishing unit, for establishing the first of three-dimensional space using the laser beam of laser measurer as Z coordinate axis
Coordinate system obtains first coordinate value of the starting point of object to be measured under the first coordinate system according to first distance；
The third acquiring unit when for being located at the optical axis center point of camera when the terminating point of object to be measured, executes
Secondary focusing step, make the optical axis on camera with the laser beam on laser measurer the phase on the terminating point of object to be measured
It hands over, obtains the second distance of the laser beam emitting point on the terminating point to laser measurer of object to be measured；
Described second establishes unit, for establishing the second of three-dimensional space using the laser beam of laser measurer as Z coordinate axis
Coordinate system obtains second coordinate value of the terminating point of object to be measured under the second coordinate system according to second distance；
The converting unit, for the transformational relation according to the first coordinate system and the second coordinate system, by the end of object to be measured
Second coordinate value of the stop under the second coordinate system is converted to the third coordinate value under the first coordinate system；
Second computing unit, for calculating according to the first coordinate value and third coordinate value under the first coordinate system
To the distance between the starting point of object to be measured and terminating point.
It further, further include measurement module；The measurement module includes second acquisition unit, first establishing unit,
Three acquiring units, second establish unit, converting unit and the second computing unit；
The second acquisition unit when for being located at the optical axis center point of camera when the starting point of object to be measured, executes
The focusing step of first time, make the optical axis on camera with the laser beam on laser measurer the phase in the starting point of object to be measured
It hands over, obtains the first distance of the laser beam emitting point in the starting point to laser measurer of object to be measured；
The first establishing unit, for establishing the first of three-dimensional space using the laser beam of laser measurer as Z coordinate axis
Coordinate system obtains first coordinate value of the starting point of object to be measured under the first coordinate system according to first distance；
The third acquiring unit when for being located at the optical axis center point of camera when the terminating point of object to be measured, executes
Secondary focusing step, make the optical axis on camera with the laser beam on laser measurer the phase on the terminating point of object to be measured
It hands over, obtains the second distance of the laser beam emitting point on the terminating point to laser measurer of object to be measured；
Described second establishes unit, for establishing the second of three-dimensional space using the laser beam of laser measurer as Z coordinate axis
Coordinate system obtains second coordinate value of the terminating point of object to be measured under the second coordinate system according to second distance；
The converting unit, for the transformational relation according to the first coordinate system and the second coordinate system, by rising for object to be measured
First coordinate value of the initial point under the first coordinate system is converted to the third coordinate value under the second coordinate system；
Second computing unit, for calculating according to the second coordinate value and third coordinate value under the second coordinate system
To the distance between the starting point of object to be measured and terminating point.
Further, further include receiving module, for receiving operational order, execute respective operations；The operational order
Including focusing instruction and measurement instruction.
Such as Fig. 4, the present invention also provides a kind of measuring device based on coordinate transform, including measurement end；The measurement end
Including laser measurer 1, camera 2 and angle adjustor 3；Optical axis center point on the camera and the laser on laser measurer
The connecting line of beam launch point and the laser beam of laser measurer are perpendicular；The angle adjustor is connect with camera, is taken the photograph for adjusting
As the angle of head, intersect the optical axis on camera on the test object with the laser beam on laser measurer.Camera is adopted in real time
The image for collecting object to be measured and laser facula realizes the size of video pictures scaling adjustment acquisition image by focusing.
Angle adjustor is connect with camera, for adjusting the angle of camera, under different ranges the optical axis of camera and swash
The laser beam of flash ranging measuring device forms different geometric angle relationships, so that the laser facula in target falls in the optical axis of camera
On.Laser measurer ranging obtains the laser facula in target to the distance L of laser measurer, camera and laser measurer
Physics spacing is H, as long as the optical axis of angle adjustor adjustment camera and the laser beam of laser measurer are at an angle of arctan (H/L),
Laser facula in target can be fallen on the optical axis of camera.After the completion of calibration, locked by video pictures center at a distance
Measurement position, video pictures center show and visually aim at the bull's-eye, and carry out secondary locking distant place measurement position.
Further, the measurement end further includes processor, holder and the angular transducer being arranged on holder；It is described to take the photograph
As head, laser measurer and angle adjustor are arranged on holder；The processor by communication bus or signal wire respectively with laser
Measuring appliance, camera, holder, angle adjustor are connected with angular transducer；
In the present embodiment, holder drives laser measurer to be rotated with camera, detects holder by angular transducer
The angle of rotation.Processor by communication bus or signal wire respectively with laser measurer, camera, holder, angle adjustor and angle
Spend sensor connection.Processor controls these interface units, for example, control holder is rotated, obtains angular transducer detection
Cloud platform rotation angle, control camera execute image scaling, control angle adjustor adjustment camera angle, control laser measurement
Device executes measurement operation.
The measuring device based on coordinate transform further includes the terminal of server-side and at least more than one；The server-side
It is connect respectively with measurement end and terminal by network.
In a specific embodiment, the present apparatus further includes server-side and terminal.Server-side is logical with measurement end and terminal respectively
Cross network connection.Server-side provides the communication interface between measurement end and terminal, and server-side, which receives to come from/send, goes to measurement end
Or the electric signal of terminal.Terminal shows visual output to user, including video pictures, measurement process/result text information, figure
Shape information and any combination thereof.Terminal receives the control input of user, sends control signal, performance objective measurement to measurement end.
In conclusion the measurement method based on coordinate transform, system and device provided by the invention, by establishing camera
Optical axis, between first between the laser beam of laser measurer and the optical axis center of camera and the laser beam of laser measurer
The geometric angle relationship away between is calculated the optical axis of camera and the laser beam of laser measurer being located at phase in object to be measured
Angle degree both when friendship, and camera shooting head-turned angle is adjusted according to the angle degree, precisely focusing is realized, in difference
Under range, the laser facula of laser measurer is in the center of the video pictures of camera always, can not see laser facula clearly
In the case where, by video pictures centre-lock target measurement position, and then measurement is completed, solves light is strong, distance is remote etc.
Not the problem of not can determine that laser drop point site.
The above description is only an embodiment of the present invention, is not intended to limit the scope of the invention, all to utilize this hair
Equivalents made by bright specification and accompanying drawing content are applied directly or indirectly in relevant technical field, similarly include
In scope of patent protection of the invention.
Claims (6)
1. a kind of measurement method based on coordinate transform positioned by picture, which is characterized in that including step of focusing：
If the laser beam of the optical axis of camera and laser measurer be it is coplanar and non-coaxial, obtain determinand and be located at laser measurer
Laser beam on ranging distance and optical axis center point on camera to the of the laser beam emitting point on laser measurer
One spacing, the connecting line and laser measurement of the optical axis center point on the camera and the laser beam emitting point on laser measurer
The laser beam of device is perpendicular；
Ranging distance and the first spacing are substituted into arctan function, angle number is calculated；
Camera shooting head-turned angle is adjusted according to the angle number, makes the laser beam on the optical axis and laser measurer on camera
Intersect on the test object；
The measurement method based on coordinate transform, further includes measuring process：
When the starting point of object to be measured is located at the optical axis center point of camera, the focusing step of first time is executed, camera is made
On optical axis intersect in the starting point of object to be measured with the laser beam on laser measurer, the starting point for obtaining object to be measured arrives
The first distance of laser beam emitting point on laser measurer；
Using the laser beam of laser measurer as reference axis, establish the first coordinate system of three-dimensional space, according to first distance obtain to
Survey first coordinate value of the starting point of target under the first coordinate system；
When the terminating point of object to be measured is located at the optical axis center point of camera, secondary focusing step is executed, camera is made
On optical axis intersect on the terminating point of object to be measured with the laser beam on laser measurer, the terminating point for obtaining object to be measured arrives
The second distance of laser beam emitting point on laser measurer；
Using the laser beam of laser measurer as reference axis, establish the second coordinate system of three-dimensional space, according to second distance obtain to
Survey second coordinate value of the terminating point of target under the second coordinate system；
According to the transformational relation of the first coordinate system and the second coordinate system, by the terminating point of object to be measured under the second coordinate system
Two coordinate values are converted to the third coordinate value under the first coordinate system；First coordinate system is XwYwZw, second coordinate system
For Xw′Yw′Zw', coordinate origin does not move, i.e. OwWith Ow' be overlapped, the transformational relation of first coordinate system and the second coordinate system
For：
Wherein, R (x, α) is around OwXwThe transformation matrix form of axis rotation alpha degree indicates that R (y, β) is around OwYwThe change of axis rotation β degree
Change matrix form expression；
According to the first coordinate value and third coordinate value under the first coordinate system, the starting point and terminating point of object to be measured is calculated
The distance between；
Alternatively, further including measuring process：
When the starting point of object to be measured is located at the optical axis center point of camera, the focusing step of first time is executed, camera is made
On optical axis intersect in the starting point of object to be measured with the laser beam on laser measurer, the starting point for obtaining object to be measured arrives
The first distance of laser beam emitting point on laser measurer；
Using the laser beam of laser measurer as reference axis, establish the first coordinate system of three-dimensional space, according to first distance obtain to
Survey first coordinate value of the starting point of target under the first coordinate system；
When the terminating point of object to be measured is located at the optical axis center point of camera, secondary focusing step is executed, camera is made
On optical axis intersect on the terminating point of object to be measured with the laser beam on laser measurer, the terminating point for obtaining object to be measured arrives
The second distance of laser beam emitting point on laser measurer；
Using the laser beam of laser measurer as reference axis, establish the second coordinate system of three-dimensional space, according to second distance obtain to
Survey second coordinate value of the terminating point of target under the second coordinate system；
According to the transformational relation of the first coordinate system and the second coordinate system, by the starting point of object to be measured under the first coordinate system
One coordinate value is converted to the third coordinate value under the second coordinate system；First coordinate system is XwYwZw, second coordinate system
For Xw′Yw′Zw', coordinate origin does not move, i.e. OwWith Ow' be overlapped, the transformational relation of first coordinate system and the second coordinate system
For：
Wherein, R (x, α) is around OwXwThe transformation matrix form of axis rotation alpha degree indicates that R (y, β) is around OwYwThe change of axis rotation β degree
Change matrix form expression；
According to the second coordinate value and third coordinate value under the second coordinate system, the starting point and terminating point of object to be measured is calculated
The distance between.
2. the measurement method based on coordinate transform according to claim 1 positioned by picture, which is characterized in that also wrap
It includes：
Operational order is received, respective operations are executed；The operational order includes focusing instruction and measurement instruction.
3. a kind of measuring system based on coordinate transform positioned by picture, which is characterized in that including Focusing module；It is described right
Burnt module includes first acquisition unit, the first computing unit and adjusting unit；
The first acquisition unit, if for camera optical axis and laser measurer laser beam be it is coplanar and non-coaxial, obtain
The optical axis center point in ranging distance and camera for taking determinand to be located on the laser beam of laser measurer is to laser measurement
First spacing of the laser beam emitting point on device, the laser beam hair on the optical axis center point and laser measurer on the camera
The connecting line of exit point and the laser beam of laser measurer are perpendicular；
Angle number is calculated for ranging distance and the first spacing to be substituted into arctan function in first computing unit；
The adjusting unit, for adjusting camera shooting head-turned angle according to the angle number, making the optical axis on camera and swashing
Laser beam on flash ranging measuring device intersects on the test object；
The measuring system based on coordinate transform, further includes measurement module；The measurement module includes second acquisition unit,
One establishes unit, third acquiring unit, second establishes unit, converting unit and the second computing unit；
The second acquisition unit when for being located at the optical axis center point of camera when the starting point of object to be measured, executes first
Secondary focusing step intersects the optical axis on camera in the starting point of object to be measured with the laser beam on laser measurer,
Obtain the first distance of the laser beam emitting point in the starting point to laser measurer of object to be measured；
The first establishing unit, for using the laser beam of laser measurer as reference axis, establishing the first coordinate of three-dimensional space
System, obtains first coordinate value of the starting point of object to be measured under the first coordinate system according to first distance；
The third acquiring unit when for being located at the optical axis center point of camera when the terminating point of object to be measured, executes second
Secondary focusing step intersects the optical axis on camera on the terminating point of object to be measured with the laser beam on laser measurer,
Obtain the second distance of the laser beam emitting point on the terminating point to laser measurer of object to be measured；
Described second establishes unit, for using the laser beam of laser measurer as reference axis, establishing the second coordinate of three-dimensional space
System, obtains second coordinate value of the terminating point of object to be measured under the second coordinate system according to second distance；
The converting unit, for the transformational relation according to the first coordinate system and the second coordinate system, by the terminating point of object to be measured
The second coordinate value under the second coordinate system is converted to the third coordinate value under the first coordinate system；First coordinate system is
XwYwZw, second coordinate system is Xw′Yw′Zw', coordinate origin does not move, i.e. OwWith Ow' be overlapped, first coordinate system with
The transformational relation of second coordinate system is：
Wherein, R (x, α) is around OwXwThe transformation matrix form of axis rotation alpha degree indicates that R (y, β) is around OwYwThe change of axis rotation β degree
Change matrix form expression；
Second computing unit, for according to the first coordinate value and third coordinate value under the first coordinate system, be calculated to
Survey the distance between starting point and the terminating point of target；
Alternatively, further including measurement module；The measurement module includes second acquisition unit, first establishing unit, third acquisition list
Member, second establish unit, converting unit and the second computing unit；
The second acquisition unit when for being located at the optical axis center point of camera when the starting point of object to be measured, executes first
Secondary focusing step intersects the optical axis on camera in the starting point of object to be measured with the laser beam on laser measurer,
Obtain the first distance of the laser beam emitting point in the starting point to laser measurer of object to be measured；
The first establishing unit, for using the laser beam of laser measurer as reference axis, establishing the first coordinate of three-dimensional space
System, obtains first coordinate value of the starting point of object to be measured under the first coordinate system according to first distance；
The third acquiring unit when for being located at the optical axis center point of camera when the terminating point of object to be measured, executes second
Secondary focusing step intersects the optical axis on camera on the terminating point of object to be measured with the laser beam on laser measurer,
Obtain the second distance of the laser beam emitting point on the terminating point to laser measurer of object to be measured；
Described second establishes unit, for using the laser beam of laser measurer as reference axis, establishing the second coordinate of three-dimensional space
System, obtains second coordinate value of the terminating point of object to be measured under the second coordinate system according to second distance；
The converting unit, for the transformational relation according to the first coordinate system and the second coordinate system, by the starting point of object to be measured
The first coordinate value under the first coordinate system is converted to the third coordinate value under the second coordinate system；First coordinate system is
XwYwZw, second coordinate system is Xw′Yw′Zw', coordinate origin does not move, i.e. OwWith Ow' be overlapped, first coordinate system with
The transformational relation of second coordinate system is：
Wherein, R (x, α) is around OwXwThe transformation matrix form of axis rotation alpha degree indicates that R (y, β) is around OwYwThe change of axis rotation β degree
Change matrix form expression；
Second computing unit, for according to the second coordinate value and third coordinate value under the second coordinate system, be calculated to
Survey the distance between starting point and the terminating point of target.
4. the measuring system based on coordinate transform according to claim 3 positioned by picture, which is characterized in that also wrap
Receiving module is included, for receiving operational order, executes respective operations；The operational order includes that focusing instruction and measurement refer to
It enables.
5. a kind of measuring device based on coordinate transform positioned by picture, which is characterized in that including measurement end；The measurement
End includes laser measurer, camera and angle adjustor；Optical axis center point on the camera and the laser on laser measurer
The connecting line of beam launch point and the laser beam of laser measurer are perpendicular；The angle adjustor is connect with camera, is taken the photograph for adjusting
As the angle of head, intersect the optical axis on camera on the test object with the laser beam on laser measurer；
The measurement end further includes processor, holder and the angular transducer being arranged on holder；The camera, laser measurement
Device and angle adjustor are arranged on holder；The processor by communication bus or signal wire respectively with laser measurer, camera,
Holder, angle adjustor are connected with angular transducer；
The processor is used for when the starting point of object to be measured is located at the optical axis center point of camera, executes the focusing of first time
Step intersects the optical axis on camera in the starting point of object to be measured with the laser beam on laser measurer, obtains to be measured
The first distance of laser beam emitting point in the starting point to laser measurer of target；Using the laser beam of laser measurer as coordinate
Axis establishes the first coordinate system of three-dimensional space, obtains the starting point of object to be measured under the first coordinate system according to first distance
First coordinate value；
When the terminating point of object to be measured is located at the optical axis center point of camera, secondary focusing step is executed, camera is made
On optical axis intersect on the terminating point of object to be measured with the laser beam on laser measurer, the terminating point for obtaining object to be measured arrives
The second distance of laser beam emitting point on laser measurer；
Using the laser beam of laser measurer as reference axis, establish the second coordinate system of three-dimensional space, according to second distance obtain to
Survey second coordinate value of the terminating point of target under the second coordinate system；
According to the transformational relation of the first coordinate system and the second coordinate system, by the terminating point of object to be measured under the second coordinate system
Two coordinate values are converted to the third coordinate value under the first coordinate system；First coordinate system is XwYwZw, second coordinate system
For Xw′Yw′Zw', coordinate origin does not move, i.e. OwWith Ow' be overlapped, the transformational relation of first coordinate system and the second coordinate system
For：
Wherein, R (x, α) is around OwXwThe transformation matrix form of axis rotation alpha degree indicates that R (y, β) is around OwYwThe change of axis rotation β degree
Change matrix form expression；
According to the first coordinate value and third coordinate value under the first coordinate system, the starting point and terminating point of object to be measured is calculated
The distance between；
Alternatively, executing the focusing step of first time when the starting point of object to be measured is located at the optical axis center point of camera, making to take the photograph
As the optical axis on head intersects in the starting point of object to be measured with the laser beam on laser measurer, the starting of object to be measured is obtained
First distance of the point to the laser beam emitting point on laser measurer；
Using the laser beam of laser measurer as reference axis, establish the first coordinate system of three-dimensional space, according to first distance obtain to
Survey first coordinate value of the starting point of target under the first coordinate system；
When the terminating point of object to be measured is located at the optical axis center point of camera, secondary focusing step is executed, camera is made
On optical axis intersect on the terminating point of object to be measured with the laser beam on laser measurer, the terminating point for obtaining object to be measured arrives
The second distance of laser beam emitting point on laser measurer；
Using the laser beam of laser measurer as reference axis, establish the second coordinate system of three-dimensional space, according to second distance obtain to
Survey second coordinate value of the terminating point of target under the second coordinate system；
According to the transformational relation of the first coordinate system and the second coordinate system, by the starting point of object to be measured under the first coordinate system
One coordinate value is converted to the third coordinate value under the second coordinate system；First coordinate system is XwYwZw, second coordinate system
For Xw′Yw′Zw', coordinate origin does not move, i.e. OwWith Ow' be overlapped, the transformational relation of first coordinate system and the second coordinate system
For：
Wherein, R (x, α) is around OwXwThe transformation matrix form of axis rotation alpha degree indicates that R (y, β) is around OwYwThe change of axis rotation β degree
Change matrix form expression；
According to the second coordinate value and third coordinate value under the second coordinate system, the starting point and terminating point of object to be measured is calculated
The distance between；
Wherein, the focusing step includes：
If the laser beam of the optical axis of camera and laser measurer be it is coplanar and non-coaxial, obtain determinand and be located at laser measurer
Laser beam on ranging distance and optical axis center point on camera to the of the laser beam emitting point on laser measurer
One spacing, the connecting line and laser measurement of the optical axis center point on the camera and the laser beam emitting point on laser measurer
The laser beam of device is perpendicular；
Ranging distance and the first spacing are substituted into arctan function, angle number is calculated；
Camera shooting head-turned angle is adjusted according to the angle number, makes the laser beam on the optical axis and laser measurer on camera
Intersect on the test object.
6. the measuring device based on coordinate transform according to claim 5 positioned by picture, which is characterized in that described
Measuring device based on coordinate transform further includes the terminal of server-side and at least more than one；The server-side is distinguished by network
It is connect with measurement end and terminal.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810683315.9A CN108827260B (en) | 2017-05-18 | 2017-05-18 | The measurement method based on coordinate transform, system and the device positioned by picture |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810683315.9A CN108827260B (en) | 2017-05-18 | 2017-05-18 | The measurement method based on coordinate transform, system and the device positioned by picture |
| CN201710353551.XA CN107101623B (en) | 2017-05-18 | 2017-05-18 | Measurement method, system and device |
Related Parent Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710353551.XA Division CN107101623B (en) | 2017-05-18 | 2017-05-18 | Measurement method, system and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108827260A true CN108827260A (en) | 2018-11-16 |
| CN108827260B CN108827260B (en) | 2019-05-28 |
Family
ID=59669358
Family Applications (6)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810683249.5A Active CN108828555B (en) | 2017-05-18 | 2017-05-18 | Accurate measurement method, system and device based on coordinate transformation |
| CN201810683217.5A Active CN108709542B (en) | 2017-05-18 | 2017-05-18 | Coordinate transformation-based rapid measurement method, system and device |
| CN201710353551.XA Active CN107101623B (en) | 2017-05-18 | 2017-05-18 | Measurement method, system and device |
| CN201810683315.9A Active CN108827260B (en) | 2017-05-18 | 2017-05-18 | The measurement method based on coordinate transform, system and the device positioned by picture |
| CN201810683233.4A Active CN108828554B (en) | 2017-05-18 | 2017-05-18 | Coordinate transformation-based measuring method, system and device without laser drop point |
| CN201810683734.2A Active CN109029391B (en) | 2017-05-18 | 2017-05-18 | Coordinate transformation-based real object measurement method, system and device |
Family Applications Before (3)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810683249.5A Active CN108828555B (en) | 2017-05-18 | 2017-05-18 | Accurate measurement method, system and device based on coordinate transformation |
| CN201810683217.5A Active CN108709542B (en) | 2017-05-18 | 2017-05-18 | Coordinate transformation-based rapid measurement method, system and device |
| CN201710353551.XA Active CN107101623B (en) | 2017-05-18 | 2017-05-18 | Measurement method, system and device |
Family Applications After (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810683233.4A Active CN108828554B (en) | 2017-05-18 | 2017-05-18 | Coordinate transformation-based measuring method, system and device without laser drop point |
| CN201810683734.2A Active CN109029391B (en) | 2017-05-18 | 2017-05-18 | Coordinate transformation-based real object measurement method, system and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (6) | CN108828555B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112731343A (en) * | 2020-12-18 | 2021-04-30 | 福建汇川物联网技术科技股份有限公司 | Target measuring method and device of measuring camera |
| CN113050113A (en) * | 2021-03-10 | 2021-06-29 | 广州南方卫星导航仪器有限公司 | Laser point positioning method and device |
Families Citing this family (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108828555B (en) * | 2017-05-18 | 2020-08-04 | 金钱猫科技股份有限公司 | Accurate measurement method, system and device based on coordinate transformation |
| CN108398123B (en) * | 2018-02-06 | 2020-10-20 | 中国人民解放军战略支援部队信息工程大学 | Total station and dial calibration method thereof |
| CN109227551B (en) * | 2018-11-21 | 2021-08-20 | 中国科学院合肥物质科学研究院 | Hand-eye coordinate conversion method for visual positioning robot |
| CN111435070A (en) * | 2019-01-14 | 2020-07-21 | 深圳中科飞测科技有限公司 | Conversion relation obtaining method, detection equipment and detection method |
| CN110231023B (en) * | 2019-04-29 | 2020-02-21 | 金钱猫科技股份有限公司 | Intelligent visual sampling method, system and device |
| CN112179210B (en) * | 2020-08-31 | 2022-09-02 | 河北汉光重工有限责任公司 | Method for correcting shot hit deviation of naval gun |
| CN113358332B (en) * | 2021-07-15 | 2022-03-22 | 中国科学院长春光学精密机械与物理研究所 | Dynamic imaging telescope performance detection device and method |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102901448A (en) * | 2012-10-17 | 2013-01-30 | 福建汇川数码技术科技有限公司 | Video camera and laser range finder coaxial photoelectric measuring device |
| CN103426166A (en) * | 2013-07-09 | 2013-12-04 | 杭州电子科技大学 | Robot hand-eye co-location method based on laser and single eye |
| JP2014232095A (en) * | 2013-05-29 | 2014-12-11 | 株式会社Ｃｕｂｉｃ | Apparatus and method for measurement of building structure |
| CN105758314A (en) * | 2016-01-15 | 2016-07-13 | 清华大学 | Long-distance laser ranging method |
| CN105865350A (en) * | 2016-04-30 | 2016-08-17 | 广东工业大学 | 3D object point cloud imaging method |
Family Cites Families (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP4339166B2 (en) * | 2003-11-28 | 2009-10-07 | サンクス株式会社 | Angle measuring device and tilt angle measuring method thereof |
| US7429999B2 (en) * | 2004-05-24 | 2008-09-30 | CENTRE DE RECHERCHE INDUSTRIELLE DU QUéBEC | Camera calibrating apparatus and method |
| CN1333231C (en) * | 2005-07-01 | 2007-08-22 | 清华大学 | Method for measuring light-beam central position by array CCD |
| CN101334277B (en) * | 2007-06-28 | 2010-12-08 | 鸿富锦精密工业（深圳）有限公司 | Point laser automatic focusing scanning image measurement system and method |
| CN101334270B (en) * | 2008-07-25 | 2010-06-23 | 西安交通大学 | Laser line scanning feeler geometric transformation calibration and curved face interpolation correcting method and apparatus |
| CN101699313B (en) * | 2009-09-30 | 2012-08-22 | 北京理工大学 | Method and system for calibrating external parameters based on camera and three-dimensional laser radar |
| US20110147615A1 (en) * | 2009-12-23 | 2011-06-23 | Kintz Gregory J | Method and apparatus for microscopic imaging system with wide field of view and high collection efficiency |
| CN102445148A (en) * | 2010-09-30 | 2012-05-09 | 西门子公司 | Method, device and system for acquiring position parameters |
| US9188973B2 (en) * | 2011-07-08 | 2015-11-17 | Restoration Robotics, Inc. | Calibration and transformation of a camera system's coordinate system |
| US10107887B2 (en) * | 2012-04-13 | 2018-10-23 | Qualcomm Incorporated | Systems and methods for displaying a user interface |
| CN103198524B (en) * | 2013-04-27 | 2015-08-12 | 清华大学 | A kind of three-dimensional reconstruction method for large-scale outdoor scene |
| US9043146B2 (en) * | 2013-06-19 | 2015-05-26 | The Boeing Company | Systems and methods for tracking location of movable target object |
| CN104501779A (en) * | 2015-01-09 | 2015-04-08 | 中国人民解放军63961部队 | High-accuracy target positioning method of unmanned plane on basis of multi-station measurement |
| CN105547295A (en) * | 2016-01-25 | 2016-05-04 | 西安应用光学研究所 | Ground target passive speed measuring method for airborne photoelectric observing and aiming system on basis of gyroscope speed measurement |
| CN105486289B (en) * | 2016-01-31 | 2018-03-23 | 山东科技大学 | A kind of laser photography measuring system and camera calibration method |
| CN106056587B (en) * | 2016-05-24 | 2018-11-09 | 杭州电子科技大学 | Full view line laser structured light three-dimensional imaging caliberating device and method |
| CN108828555B (en) * | 2017-05-18 | 2020-08-04 | 金钱猫科技股份有限公司 | Accurate measurement method, system and device based on coordinate transformation |
| CN107339935B (en) * | 2017-06-27 | 2020-11-06 | 中国航空工业集团公司北京长城航空测控技术研究所 | Target space intersection measuring method for full-view scanning measuring system |
-
2017
- 2017-05-18 CN CN201810683249.5A patent/CN108828555B/en active Active
- 2017-05-18 CN CN201810683217.5A patent/CN108709542B/en active Active
- 2017-05-18 CN CN201710353551.XA patent/CN107101623B/en active Active
- 2017-05-18 CN CN201810683315.9A patent/CN108827260B/en active Active
- 2017-05-18 CN CN201810683233.4A patent/CN108828554B/en active Active
- 2017-05-18 CN CN201810683734.2A patent/CN109029391B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102901448A (en) * | 2012-10-17 | 2013-01-30 | 福建汇川数码技术科技有限公司 | Video camera and laser range finder coaxial photoelectric measuring device |
| JP2014232095A (en) * | 2013-05-29 | 2014-12-11 | 株式会社Ｃｕｂｉｃ | Apparatus and method for measurement of building structure |
| CN103426166A (en) * | 2013-07-09 | 2013-12-04 | 杭州电子科技大学 | Robot hand-eye co-location method based on laser and single eye |
| CN105758314A (en) * | 2016-01-15 | 2016-07-13 | 清华大学 | Long-distance laser ranging method |
| CN105865350A (en) * | 2016-04-30 | 2016-08-17 | 广东工业大学 | 3D object point cloud imaging method |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112731343A (en) * | 2020-12-18 | 2021-04-30 | 福建汇川物联网技术科技股份有限公司 | Target measuring method and device of measuring camera |
| CN112731343B (en) * | 2020-12-18 | 2023-12-12 | 福建汇川物联网技术科技股份有限公司 | Target measurement method and device for measurement camera |
| CN113050113A (en) * | 2021-03-10 | 2021-06-29 | 广州南方卫星导航仪器有限公司 | Laser point positioning method and device |
| CN113050113B (en) * | 2021-03-10 | 2023-08-01 | 广州南方卫星导航仪器有限公司 | Laser spot positioning method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108709542B (en) | 2020-11-17 |
| CN108709542A (en) | 2018-10-26 |
| CN108828555B (en) | 2020-08-04 |
| CN107101623A (en) | 2017-08-29 |
| CN108827260B (en) | 2019-05-28 |
| CN109029391B (en) | 2020-09-15 |
| CN109029391A (en) | 2018-12-18 |
| CN108828554B (en) | 2020-06-26 |
| CN107101623B (en) | 2018-07-27 |
| CN108828554A (en) | 2018-11-16 |
| CN108828555A (en) | 2018-11-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108827260B (en) | The measurement method based on coordinate transform, system and the device positioned by picture | |
| CN108844457B (en) | A kind of exact image measurement method and system | |
| CN106017436B (en) | BIM augmented reality setting-out system based on total station and photogrammetric technology | |
| CN106644410B (en) | A kind of camera module optical center location measurement method and system | |
| CN204718553U (en) | Buildings displacement measurement system | |
| CN103090845B (en) | Remote distance measurement method based on plurality of images | |
| CN109696158A (en) | Distance measurement method, distance-measuring device and electronic equipment | |
| CN109887041B (en) | Method for controlling position and posture of shooting center of digital camera by mechanical arm | |
| CN110220461A (en) | Embedded real-time detection method and device for identification point displacement measurement | |
| JP2019060754A (en) | Cloud altitude and wind velocity measurement method using optical image | |
| CN203100724U (en) | Device for ranging by utilizing photo taken by camera | |
| CN112419425B (en) | Anti-disturbance high-precision camera group measuring method for structural deformation measurement | |
| CN110971791A (en) | Method for adjusting consistency of optical axis of camera zoom optical system and display instrument | |
| CN114046768B (en) | Laser ranging method, device, laser ranging equipment and storage medium | |
| CN106839994B (en) | A kind of measuring system for image | |
| CN202133392U (en) | Spatial distance remote-viewing measuring instrument for works | |
| CN215639285U (en) | Sag measuring device and system for high-voltage tower line | |
| WO2022126339A1 (en) | Method for monitoring deformation of civil structure, and related device | |
| WO2020134412A1 (en) | Measurement and adjustment apparatus for included angle between optical axes | |
| CN110675445B (en) | Visual positioning method, device and storage medium | |
| CN110736438A (en) | antiaircraft gun detection device and detection method thereof | |
| CN212058660U (en) | Real-time remote vegetation monitoring system | |
| CN112509059B (en) | Large-view-field binocular stereo calibration and positioning method based on coplanar targets | |
| CN108489392A (en) | Mechanical arm tail end repetitive positioning accuracy measuring device and method | |
| CN110645963A (en) | Method and system for acquiring three-dimensional coordinates of unknown point at top of high tower |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |