CN109060607B - Compliant operation device based on visual feedback and liquid bridge force automatic detection method - Google Patents
Compliant operation device based on visual feedback and liquid bridge force automatic detection method Download PDFInfo
- Publication number
- CN109060607B CN109060607B CN201810501668.2A CN201810501668A CN109060607B CN 109060607 B CN109060607 B CN 109060607B CN 201810501668 A CN201810501668 A CN 201810501668A CN 109060607 B CN109060607 B CN 109060607B
- Authority
- CN
- China
- Prior art keywords
- liquid bridge
- microscope
- condensation
- actuator
- electric platform
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N13/00—Investigating surface or boundary effects, e.g. wetting power; Investigating diffusion effects; Analysing materials by determining surface, boundary, or diffusion effects
- G01N13/02—Investigating surface tension of liquids
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D23/00—Control of temperature
- G05D23/19—Control of temperature characterised by the use of electric means
- G05D23/20—Control of temperature characterised by the use of electric means with sensing elements having variation of electric or magnetic properties with change of temperature
- G05D23/24—Control of temperature characterised by the use of electric means with sensing elements having variation of electric or magnetic properties with change of temperature the sensing element having a resistance varying with temperature, e.g. a thermistor
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Automation & Control Theory (AREA)
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Chemical & Material Sciences (AREA)
- Analytical Chemistry (AREA)
- Biochemistry (AREA)
- General Health & Medical Sciences (AREA)
- Immunology (AREA)
- Pathology (AREA)
- Manipulator (AREA)
Abstract
The invention discloses a compliant operation device and a liquid bridge force automatic detection method based on visual feedback, relating to an automatic detection technology of compliant operation of a micron-sized object, with the operation liquid drop that relies on passive acquireing in solving traditional capillary force operation process carries out passive operation, unable real-time detection, the problem of feedback liquid bridge power, it includes the motion control module, vision feedback module and end effector module, the shock insulation platform, the operation base, the motion control module includes x to the accurate electronic platform of triaxial, y to the accurate electronic platform of triaxial of manipulator, the vision feedback module includes x to the microscope, x is to microscope anchor clamps, y is to the microscope, y is to microscope anchor clamps, the end effector module includes executor accommodate motor, the connecting plate, the executor chuck, the chuck fixture, the condensing unit, the condensation executor, the condensation controller. The invention is used for the automatic real-time detection of the liquid bridge force based on vision in the compliant operation of the micron-sized object.
Description
Technical Field
The invention relates to an automatic detection technology of capillary force compliance operation, in particular to a compliance operation device based on visual feedback and an automatic liquid bridge force detection method.
Background
As a nondestructive micro-operation technology, the micro-object (0.1 mu m-1 mm) operation method based on the liquid bridge capillary force has operation flexibility, can effectively avoid local stress concentration caused by traditional mechanical clamping (clamping, vacuum adsorption and the like), avoids the damage of key characteristics of the micro-object, and is suitable for the grabbing of micro-objects in different shapes. The existing capillary force operation method is mainly divided into a single-needle type and a capillary type, wherein the single-needle type mainly utilizes a liquid medium obtained from the tail end of an operation probe to realize the grabbing of a micro object; the capillary type is to use the meniscus at the end of the capillary to grab the micro-object. In order to evaluate the picking capacity of the micro-object, the generated liquid bridge force needs to be calculated, a corresponding liquid bridge action model is established according to liquid bridge modes with different configurations (plane-spherical surface, plane-plane, spherical surface-spherical surface, plane-conical surface and the like), the liquid bridge force can be theoretically solved, and factors influencing the liquid bridge action force are analyzed. However, in the actual operation process based on the capillary force, neither the single-needle type operation method nor the capillary type operation method can observe the capillary force in the operation process in real time, and can not realize the real-time control of the operation liquid drop in the operation process, thereby limiting the further application development of the method. The image processing technology based on visual feedback is beneficial to acquiring the liquid bridge profile in real time, the mathematical equation of the liquid bridge profile can be acquired through processes such as binarization processing, angular point detection, profile fitting and the like, and a foundation is laid for solving the liquid bridge force by combining theories. Therefore, a real-time liquid bridge force automatic detection method based on capillary force operation and a corresponding operation device are still important to research.
Aiming at the key scientific and technical problem that the liquid bridge force based on the liquid medium operation process cannot be automatically detected in real time, the invention discloses a compliant operation device based on visual feedback and an automatic liquid bridge force detection method.
Disclosure of Invention
The invention aims to solve the problem that the traditional capillary force operation method cannot detect the liquid bridge force in real time and can not effectively guide an operation task on line, and further provides a compliant operation device based on visual feedback and an automatic liquid bridge force detection method.
The technical scheme adopted by the invention for solving the problems is as follows:
the invention relates to a compliant operation device based on visual feedback, which is characterized in that: the device comprises a motion control module, a visual feedback module, an end effector module, a shock insulation table and an operation substrate, wherein the motion control module comprises an x-direction three-axis precision electric platform, a y-direction three-axis precision electric platform and an operator three-axis precision electric platform; x is to the accurate electric platform of triaxial, y is to the accurate electric platform of triaxial, the accurate electric platform of operative hand triaxial is arranged respectively on the shock insulation platform, x passes through x to microscope to fix on x to the accurate electric platform of triaxial through microscope anchor clamps to the microscope, y passes through y to fix on y to the accurate electric platform of triaxial through microscope anchor clamps to the microscope, the vertical setting of executor accommodate motor, fix on the accurate electric platform of operative hand triaxial through the connecting plate, the vertical setting of executor chuck, one end is passed through chuck fixture and is adorned on executor accommodate motor admittedly, other end centre gripping condensation executor, process the condensation duct on the condensation unit, the two coaxial settings of condensation executor and condensation duct.
The invention relates to a liquid bridge force automatic detection method based on visual feedback, which comprises the following steps:
the method comprises the following steps: adjusting the three-axis precise electric platform of the manipulator to be above the micron-sized object;
step two: controlling an actuator adjusting motor to enable a condensation actuator to extend out of a condensation unit channel;
step three: the condensation controller adjusts the temperature of the channel of the condensation unit, so that the temperature of the tail end of the condensation actuator is lower than the ambient saturation temperature, and operation liquid drops are generated;
step four: adjusting a three-axis precision electric platform of an operator to enable the condensed liquid drops to contact with the micron-sized object to form a liquid bridge;
step five: acquiring initial contour information of a liquid bridge by an x-direction microscope, determining the position of a micron-sized object through Hough transformation, selecting a real-time tracking window and a liquid bridge ROI for operating a probe, and calculating a region between the tracking window and the micron-sized object to be a liquid bridge region after the liquid bridge is formed;
step six: carrying out Ostu threshold segmentation on the liquid bridge area to obtain a binary image, and taking the center of the liquid bridge with the extracted contour as the boundary of the left contour and the right contour;
step seven: extracting the corner points of the liquid bridge profile based on a Shi-Tomasi corner point detection method, and calculating the intersection points of the contour of the microsphere and the operation tool as the end points of the liquid bridge profile;
step eight: based on the determined end points, obtaining a mathematical equation of the liquid bridge profile through least square parabolic fitting;
step nine: and solving a partial differential Yankee equation of the liquid bridge profile, automatically acquiring the acting force of the liquid bridge, and synchronously detecting the positions of the operation tool, the micro object and the liquid bridge in real time by the x-direction microscope and the y-direction microscope.
The invention has the beneficial effects that: the compliance operation device based on visual feedback combines the visual feedback technology, can control the quantitative acquisition of capillary force operation liquid drops in real time through the adjustment of a condensation actuator, and solves the problem of real-time control of the operation liquid drops; the length of the actuator of the compliance operation device based on visual feedback, which extends out of a refrigerating unit channel, can be changed through the control of an actuator adjusting motor, so that the refrigerating capacity is regulated and controlled; the liquid bridge force automatic detection method based on visual feedback obtains the liquid bridge profile in real time through the liquid bridge area, utilizes the image processing technology to obtain the liquid bridge profile, solves the liquid bridge force, and solves the automatic real-time detection problem of the liquid bridge force in the capillary force operation process.
Drawings
FIG. 1 is a schematic perspective view of a compliant operating device based on visual feedback according to the present invention.
Figure 2 is a schematic diagram of the condensate droplet control pickup according to the present invention.
FIG. 3 is a flow chart of the liquid bridge force calculation process based on image processing according to the present invention.
Fig. 4 is a test result chart based on automatic detection of visual liquid bridge force according to the present invention.
Detailed Description
The first embodiment is as follows: with reference to fig. 1 and 2, a compliant operating device based on visual feedback in this embodiment includes a motion control module, a visual feedback module, an end effector module, a vibration isolation table 1-15, and an operation substrate 1-12, where the motion control module includes an x-direction three-axis precision electric platform 1-9, a y-direction three-axis precision electric platform 1-1, and an operator three-axis precision electric platform 1-8, the visual feedback module includes an x-direction microscope 1-11, an x-direction microscope clamp 1-10, a y-direction microscope 1-3, and a y-direction microscope clamp 1-2, the end effector module includes an effector adjusting motor 1-5, a connecting plate 1-7, an effector clamp 1-4, a clamp 1-6, a condensing unit 1-14, a condensing effector 1-13, a condensing actuator, a condensing lens, a condensation controller 2-3; the X-direction three-axis precise electric platform 1-9, the Y-direction three-axis precise electric platform 1-1 and the manipulator three-axis precise electric platform 1-8 are respectively arranged on a shock insulation platform 1-15, the X-direction microscope 1-11 is fixed on the X-direction three-axis precise electric platform 1-9 through an X-direction microscope clamp 1-10, the Y-direction microscope 1-3 is fixed on the Y-direction three-axis precise electric platform 1-1 through a Y-direction microscope clamp 1-2, an actuator adjusting motor 1-5 is vertically arranged and is fixed on the manipulator three-axis precise electric platform 1-8 through a connecting plate 1-7, an actuator chuck 1-4 is vertically arranged, one end of the actuator chuck is fixedly arranged on the actuator adjusting motor 1-5 through a chuck clamp 1-6, the other end of the actuator chuck holds a condensation actuator 1-, the condensing units 1-14 are provided with condensing channels, and the condensing actuators 1-13 and the condensing channels are coaxially arranged.
The second embodiment is as follows: referring to fig. 1, the x-direction microscope 1-11 and the y-direction microscope gripper 1-2 of the compliant manipulation device based on visual feedback of the present embodiment are vertically disposed in the same plane.
The third concrete implementation mode: as described in conjunction with FIGS. 1 and 2, the temperature of the condensing units 1-14 channels of a compliant operating device based on visual feedback of the present embodiment is regulated in real time by the condensing controllers 2-3.
The fourth concrete implementation mode: referring to FIG. 1, the operation substrates 1-12 of the compliant operation device based on visual feedback of the present embodiment are mounted on vibration isolation tables 1-15.
The fifth concrete implementation mode: with reference to fig. 3 and 4, the method for automatically detecting a liquid bridge force based on visual feedback by using a compliant operating device according to this embodiment of the present invention includes the following steps:
the method comprises the following steps: adjusting a three-axis precision electric platform 1-8 of an operator to be above a micron-sized object 2-2;
step two: controlling an actuator adjusting motor 1-5 to enable a condensation actuator 1-13 to extend out of a channel of a condensation unit 1-14;
step three: the condensation controller 2-3 adjusts the temperature of the channels of the condensation unit 1-14, so that the temperature of the tail end of the condensation actuator 1-13 is lower than the ambient saturation temperature, and operation liquid drops are generated;
step four: adjusting a three-axis precision electric platform 1-8 of an operator to enable condensed liquid drops to be in contact with a micron-sized object 2-2 to form a liquid bridge 2-1;
step five: acquiring initial contour information of a liquid bridge 2-1 by an x-direction microscope 1-11, determining the position of a micron-sized object 2-2 through Hough transformation, selecting a real-time tracking window 4-1 and a liquid bridge ROI 4-2 for operating a probe, and calculating a region between the tracking window 4-1 and the micron-sized object 2-2 to be a liquid bridge region 4-3 after the liquid bridge 2-1 is formed;
step six: carrying out Ostu threshold segmentation on the liquid bridge area to obtain a binary image, and taking the center 4-4 of the liquid bridge for extracting the outline as the boundary of the left outline and the right outline;
step seven: extracting corner points 4-6 of the liquid bridge profile based on a Shi-Tomasi corner point detection method, and calculating intersection points with the microsphere profile 4-8 and an operation tool to be liquid bridge profile end points 4-5;
step eight: based on the determined end points 4-5, obtaining a mathematical equation of the liquid bridge profile 4-7 through least square parabola fitting;
step nine: and solving partial differential Poisson equation of the liquid bridge profile 4-7 to automatically obtain liquid bridge acting force, and synchronously carrying out real-time detection on the positions of the operation tool, the micro object and the liquid bridge in the X-direction microscope 1-11 and the Y-direction microscope 1-3.
The sixth specific implementation mode: the present embodiment is described with reference to fig. 1 to 4, and the compliant operation apparatus and the liquid bridge force automatic detection method based on visual feedback in the present embodiment perform an operation task of a micron-sized object to operate a BGA solder ball with an outer dimension of 760 μm; test experiments show that the compliance operation device based on visual feedback and the liquid bridge force automatic detection method can realize real-time control of operation liquid drops in a micro-object operation process and can realize real-time feedback and display of liquid bridge force, and the other methods are the same as the first, second, third, fourth or fifth embodiment modes.
Claims (4)
1. The method is characterized in that the compliant operating device based on visual feedback comprises a motion control module, a visual feedback module, an end effector module, a shock insulation platform (1-15) and an operating substrate (1-12), wherein the motion control module comprises an x-direction three-axis precise electric platform (1-9), a y-direction three-axis precise electric platform (1-1) and an operator three-axis precise electric platform (1-8), the visual feedback module comprises an x-direction microscope (1-11), an x-direction microscope clamp (1-10), a y-direction microscope (1-3) and a y-direction microscope clamp (1-2), the end effector module comprises an effector adjusting motor (1-5), a connecting plate (1-7), The device comprises an actuator chuck (1-4), a chuck fixture (1-6), a condensing unit (1-14), a condensing actuator (1-13) and a condensing controller (2-3); the X-direction triaxial precision electric platform (1-9), the Y-direction triaxial precision electric platform (1-1) and the manipulator triaxial precision electric platform (1-8) are respectively arranged on a shock insulation platform (1-15), an X-direction microscope (1-11) is fixed on the X-direction triaxial precision electric platform (1-9) through an X-direction microscope clamp (1-10), a Y-direction microscope (1-3) is fixed on the Y-direction triaxial precision electric platform (1-1) through a Y-direction microscope clamp (1-2), an actuator adjusting motor (1-5) is vertically arranged and fixed on the manipulator triaxial precision electric platform (1-8) through a connecting plate (1-7), an actuator chuck (1-4) is vertically arranged, one end of the actuator adjusting motor is fixedly arranged on the actuator adjusting motor (1-5) through a chuck clamp (1-6), the other end clamps a condensation actuator (1-13), a condensation channel is processed on the condensation unit (1-14), and the condensation actuator (1-13) and the condensation channel are coaxially arranged;
the method mainly comprises the following steps:
the method comprises the following steps: adjusting a three-axis precise electric platform (1-8) of an operator to be above a micron-sized object (2-2);
step two: controlling an actuator adjusting motor (1-5) to enable a condensation actuator (1-13) to extend out of a channel of a condensation unit (1-14);
step three: the condensation controller (2-3) adjusts the temperature of the channels of the condensation units (1-14) to enable the temperature of the tail ends of the condensation actuators (1-13) to be lower than the ambient saturation temperature, and operation liquid drops are generated;
step four: adjusting a three-axis precision electric platform (1-8) of an operator to enable the condensed liquid drop to contact with a micron-sized object (2-2) to form a liquid bridge (2-1);
step five: acquiring initial contour information of a liquid bridge (2-1) by an x-direction microscope (1-11), determining the position of a micron-sized object (2-2) through Hough transformation, selecting a real-time tracking window (4-1) and a liquid bridge ROI (4-2) for operating a probe, and calculating a region between the tracking window (4-1) and the micron-sized object (2-2) to be a liquid bridge region (4-3) after the liquid bridge (2-1) is formed;
step six: carrying out Ostu threshold segmentation on the liquid bridge region to obtain a binary image, and taking the liquid bridge with the extracted contour as the boundary of the left contour and the right contour by taking the center (4-4) of the liquid bridge;
step seven: extracting corner points (4-6) of the liquid bridge profile based on a Shi-Tomasi corner point detection method, and calculating intersection points with the microsphere profile (4-8) and an operation tool as end points (4-5) of the liquid bridge profile;
step eight: based on the determined end points (4-5) of the liquid bridge profile, obtaining a mathematical equation of the liquid bridge profile (4-7) through least square parabolic fitting;
step nine: and solving a partial differential Poisson equation of the liquid bridge profile (4-7), automatically acquiring the acting force of the liquid bridge, and synchronously detecting the positions of the operation tool, the micro object and the liquid bridge in real time by the x-direction microscope (1-11) and the y-direction microscope (1-3).
2. The method for automatic detection of liquid bridge force using compliant manipulator based on visual feedback according to claim 1, wherein the x-microscope (1-11) and the y-microscope holder (1-2) are vertically arranged in the same plane.
3. A method for automatic detection of liquid bridge force using a compliant operating device based on visual feedback according to claim 1, characterized in that the temperature of the condensing unit (1-14) channels is regulated in real time by a condensing controller (2-3).
4. The method for automatically detecting liquid bridge force by using the compliant operating device based on visual feedback as claimed in claim 1, wherein: the device also comprises an operation substrate (1-12), and the operation substrate (1-12) is arranged on the vibration isolation table (1-15).
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201810501668.2A CN109060607B (en) | 2018-05-23 | 2018-05-23 | Compliant operation device based on visual feedback and liquid bridge force automatic detection method |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201810501668.2A CN109060607B (en) | 2018-05-23 | 2018-05-23 | Compliant operation device based on visual feedback and liquid bridge force automatic detection method |
Publications (2)
Publication Number | Publication Date |
---|---|
CN109060607A CN109060607A (en) | 2018-12-21 |
CN109060607B true CN109060607B (en) | 2021-02-26 |
Family
ID=64820189
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201810501668.2A Active CN109060607B (en) | 2018-05-23 | 2018-05-23 | Compliant operation device based on visual feedback and liquid bridge force automatic detection method |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN109060607B (en) |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112986059A (en) * | 2021-03-17 | 2021-06-18 | 哈尔滨工程大学 | Static and dynamic liquid bridge observation system and method between two balls |
Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH05232009A (en) * | 1992-02-18 | 1993-09-07 | Nagoyashi | Method and device for measuring contact angle by computer image analysis system |
CN103940703A (en) * | 2014-03-07 | 2014-07-23 | 浙江大学 | Precise observation apparatus for rapid liquid bridge separation between parallel plates |
CN104290056A (en) * | 2014-09-19 | 2015-01-21 | 哈尔滨工业大学 | Single-needle type micron-sized object picking and releasing device and method |
CN104760928A (en) * | 2015-04-15 | 2015-07-08 | 哈尔滨工业大学 | Hydrophobic surface dropwise condensation capillary force pickup and vibration control micro-object operation device and method |
CN106767406A (en) * | 2016-12-20 | 2017-05-31 | 华南理工大学 | Micro-nano alignment system and its closed-loop On-Line Control Method to compliant mechanism platform |
CN106968012A (en) * | 2017-05-09 | 2017-07-21 | 临沂大学 | A kind of automatic feed liquor formula liquid bridge generation system and method |
CN107942933A (en) * | 2017-12-29 | 2018-04-20 | 华南理工大学 | A kind of grand micro- compound alignment system of the planar three freedom of visual servo and method |
-
2018
- 2018-05-23 CN CN201810501668.2A patent/CN109060607B/en active Active
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH05232009A (en) * | 1992-02-18 | 1993-09-07 | Nagoyashi | Method and device for measuring contact angle by computer image analysis system |
CN103940703A (en) * | 2014-03-07 | 2014-07-23 | 浙江大学 | Precise observation apparatus for rapid liquid bridge separation between parallel plates |
CN104290056A (en) * | 2014-09-19 | 2015-01-21 | 哈尔滨工业大学 | Single-needle type micron-sized object picking and releasing device and method |
CN104760928A (en) * | 2015-04-15 | 2015-07-08 | 哈尔滨工业大学 | Hydrophobic surface dropwise condensation capillary force pickup and vibration control micro-object operation device and method |
CN106767406A (en) * | 2016-12-20 | 2017-05-31 | 华南理工大学 | Micro-nano alignment system and its closed-loop On-Line Control Method to compliant mechanism platform |
CN106968012A (en) * | 2017-05-09 | 2017-07-21 | 临沂大学 | A kind of automatic feed liquor formula liquid bridge generation system and method |
CN107942933A (en) * | 2017-12-29 | 2018-04-20 | 华南理工大学 | A kind of grand micro- compound alignment system of the planar three freedom of visual servo and method |
Also Published As
Publication number | Publication date |
---|---|
CN109060607A (en) | 2018-12-21 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20150142171A1 (en) | Methods and apparatus to calibrate an orientation between a robot gripper and a camera | |
US20080308727A1 (en) | Sample Preparation for Micro-Analysis | |
CN206317070U (en) | A kind of manipulator and the detecting instrument with manipulator | |
CN101706256A (en) | Full-automatic quality detection device of micro drill point for drilling PCB | |
CN110044909A (en) | A kind of rotor welding point defect detection device and method based on image procossing | |
JP2007139704A (en) | Regulator for reference height position of nozzle tip, and sampler | |
CN215728339U (en) | Positioning tool for cantilever probe | |
CN109060607B (en) | Compliant operation device based on visual feedback and liquid bridge force automatic detection method | |
JP2009099937A5 (en) | ||
CN107167474B (en) | Microstructure three-dimensional reconstruction system and method based on laser precision machining | |
CN109470698B (en) | Cross-scale inclusion rapid analysis instrument and method based on photomicrography matrix | |
Nguyen et al. | Automated micromanipulation for a microhand with all-in-focus imaging system | |
CN1319892C (en) | Automatic bonding machine for MEMS high temp. pressure sensor | |
CN102607880B (en) | Piezoelectric micro-dissection system, dissection depth positioning method and dissection method | |
CN107015525A (en) | A kind of micro-displacement control platform and application method observed suitable for micro-fluidic chip | |
Xu et al. | Characteristic of monocular microscope vision and its application on assembly of micro-pipe and micro-sphere | |
CN205246712U (en) | Full -automatic probe station image positioner | |
CN111982908A (en) | Fiber automatic analysis equipment based on visual analysis technology and analysis method thereof | |
CN207816562U (en) | A kind of intelligent test device | |
CN106525624A (en) | Hardness test apparatus and hardness testing method | |
CN211047019U (en) | Multi-angle image acquisition system | |
Chen et al. | A fast positioning method with pattern tracking for automatic wafer alignment | |
US11637039B2 (en) | Method of processing wafer, and chip measuring apparatus | |
CN103149150B (en) | Hanging type test bench | |
Jasper et al. | Automated robot-based separation and palletizing of microcomponents |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |