CN108044627A - Detection method, device and the mechanical arm of crawl position - Google Patents
Detection method, device and the mechanical arm of crawl position Download PDFInfo
- Publication number
- CN108044627A CN108044627A CN201711481188.6A CN201711481188A CN108044627A CN 108044627 A CN108044627 A CN 108044627A CN 201711481188 A CN201711481188 A CN 201711481188A CN 108044627 A CN108044627 A CN 108044627A
- Authority
- CN
- China
- Prior art keywords
- target object
- image information
- mechanical arm
- crawl position
- geometric
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J9/00—Programme-controlled manipulators
- B25J9/16—Programme controls
- B25J9/1694—Programme controls characterised by use of sensors other than normal servo-feedback from position, speed or acceleration sensors, perception control, multi-sensor controlled systems, sensor fusion
- B25J9/1697—Vision controlled systems
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J9/00—Programme-controlled manipulators
- B25J9/16—Programme controls
- B25J9/1602—Programme controls characterised by the control system, structure, architecture
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/60—Analysis of geometric attributes
- G06T7/66—Analysis of geometric attributes of image moments or centre of gravity
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/70—Determining position or orientation of objects or cameras
- G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Computer Vision & Pattern Recognition (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Robotics (AREA)
- Mechanical Engineering (AREA)
- Automation & Control Theory (AREA)
- Geometry (AREA)
- Image Analysis (AREA)
- Manipulator (AREA)
Abstract
The application is suitable for intelligent testing technology field, provides a kind of detection method of crawl position, device and mechanical arm, including：Mechanical arm obtains the first image information and the second image information of target object in first position and the second place respectively, and determines the three-dimensional geometric shapes of the shape of target object；If the three-dimensional geometric shapes are regular geometric figure, the crawl position of target object is determined according to its geometric center；Otherwise at least two characteristic point of irregular geometric figures is obtained, the crawl position of target object is determined according to characteristic point.According to the image information of the target object obtained at different locations during this, determine the three-dimensional geometric shapes of its shape, improve the accuracy of the shape of the target object detected；Crawl position is determined using different methods to the target object of different shapes, so as to fast and accurately find suitable crawl position according to target object unique characteristics, improves the probability that mechanical arm successfully captures.
Description
Technical field
The application belongs to a kind of intelligent testing technology field more particularly to detection method of crawl position, device and machinery
Arm.
Background technology
As the mechanical structures such as the continuous development of computer technology, robot are constantly applied in all trades and professions, such as
In some enterprises, the working condition of some equipment being in extreme environment is checked by robot or to equipment into
Row repairs or some industrial products is sorted, captures movement etc..Some knots are often used when being captured to product
The relatively simple mechanical arm of structure, by the movement of control centre's control machinery arm and the crawl to article.Mechanical arm is generally set
There is actuating station, target object is captured by actuating station.Due to the influence of the factors such as the shape of object, quality, mechanical arm to object into
It during row crawl, tends not to accurately determine suitable crawl position, and occurs grabbing less than article or after object is picked up
The phenomenon that object drops in moving process causes the efficiency that mechanical arm successfully captures low.
The content of the invention
In view of this, the embodiment of the present application provides a kind of detection method of crawl position, device and mechanical arm, to solve
In the prior art due to crawl position be difficult to accurately determine, caused by mechanical arm successfully capture the problem of efficiency is low.
The first aspect of the embodiment of the present application provides a kind of detection method of crawl position, the detection of the crawl position
Method includes：
Mechanical arm obtains the first image information of target object at first position；
According to the second image information that the target object is obtained after preset rules mobile mechanical arm to the second place；
Determine that the three-dimensional of the shape of the target object is several according to described first image information and second image information
What figure；
If the three-dimensional geometric shapes are regular geometric figure, determined according to the geometric center of the regular geometric figure
The crawl position of the target object；
If the three-dimensional geometric shapes are irregular geometric figures, at least two of the irregular geometric figures are obtained
Characteristic point, the crawl position of the target object is determined according to the characteristic point.
The second aspect of the embodiment of the present application provides a kind of detection device of crawl position, the detection of the crawl position
Device includes：
Image information acquisition module, for mechanical arm to be made to obtain the first image information of target object at first position；
It is additionally operable to according to the second image information that the target object is obtained after preset rules mobile mechanical arm to the second place；
Three-dimensional geometric shapes determining module, for determining institute according to described first image information and second image information
State the three-dimensional geometric shapes of the shape of target object；
Crawl position determining module, for the three-dimensional geometric shapes be regular geometric figure when, according to the rule
The geometric center of geometric figure determines the crawl position of the target object；It is irregular to be additionally operable in the three-dimensional geometric shapes
During geometric figure, at least two characteristic point of the irregular geometric figures is obtained, the mesh is determined according to the characteristic point
Mark the crawl position of object.
The third aspect of the embodiment of the present application provides a kind of mechanical arm, including memory, processor and is stored in institute
The computer program that can be run in memory and on the processor is stated, the processor performs real during the computer program
Now as any one of the detection method of the crawl position the step of method.
The fourth aspect of the embodiment of the present application provides a kind of computer readable storage medium, the computer-readable storage
Media storage has computer program, and the detection method such as the crawl position is realized when the computer program is executed by processor
Any one of method the step of.
After mechanical arm obtains the first image information of target object at first position in the embodiment that the application provides, press
The second image information of second position acquisition target object is moved to according to preset rules, is determined according to the first and second image informations
The three-dimensional geometric shapes of the shape of target object, when the three-dimensional geometric shapes of target object are regular geometric figure, direct root
The crawl position to target object is determined according to the geometric center of regular geometric figure；If the three-dimensional geometric shapes are irregular several
What figure then determines the crawl position of target object according to the characteristic point of irregular figure.According in different positions during this
The image information for the target object that place obtains is put, the three-dimensional geometric shapes of its shape is determined, improves the target object detected
Shape accuracy；Crawl position is determined using different methods to the target object of different shapes, so as to according to target
Object unique characteristics fast and accurately find suitable crawl position, improve the probability that mechanical arm successfully captures.
Description of the drawings
It, below will be to embodiment or description of the prior art in order to illustrate more clearly of the technical solution in the embodiment of the present application
Needed in attached drawing be briefly described, it should be apparent that, the accompanying drawings in the following description is only some of the application
Embodiment, for those of ordinary skill in the art, without having to pay creative labor, can also be according to these
Attached drawing obtains other attached drawings.
Fig. 1 is a kind of flow diagram of the detection method for crawl position that the embodiment of the present application one provides；
Fig. 2 is that provided in another embodiment of the application described is believed according to described first image information and second image
Breath determines the realization flow diagram of the three-dimensional geometric shapes of the shape of the target object；
Fig. 3 is a kind of schematic diagram of the detection device for crawl position that the embodiment of the present application two provides；
Fig. 4 is the schematic diagram for the mechanical arm that the embodiment of the present application three provides.
Specific embodiment
In being described below, in order to illustrate rather than in order to limit, it is proposed that such as tool of particular system structure, technology etc
Body details, to understand thoroughly the embodiment of the present application.However, it will be clear to one skilled in the art that there is no these specifically
The application can also be realized in the other embodiments of details.In other situations, omit to well-known system, device, electricity
Road and the detailed description of method, in case unnecessary details interferes the description of the present application.
After mechanical arm obtains the first image information of target object at first position in the embodiment that the application provides, press
The second image information of second position acquisition target object is moved to according to preset rules, is determined according to the first and second image informations
The three-dimensional geometric shapes of target object shape, when the three-dimensional geometric shapes of target object shape are regular geometric figure, directly
Crawl position to target object is determined according to the geometric center of regular geometric figure；If the three-dimensional geometric shapes are irregular
Geometric figure then determines the crawl position of target object according to the characteristic point of irregular figure.
In order to illustrate technical solution described herein, illustrated below by specific embodiment.
Embodiment one：
Fig. 1 shows a kind of flow diagram of the detection method for crawl position that the embodiment of the present application one provides, and is described in detail
It is as follows：
Step S11, mechanical arm obtain the first image information of target object at first position；
In the embodiment that the application provides, mechanical arm is believed first in the first image of certain position photographic subjects object
Breath.First position therein can be the position that mechanical arm is currently located or mechanical arm is moved through to target object
The position for being suitable for shooting the target object selected in journey.
Optionally, when obtaining described first image information, the binocular camera being arranged in mechanical arm can be started, passed through
The binocular camera obtains the first image information of the target object.
Optionally, mechanical arm obtains target object at first position described in another embodiment of the application offer
First image information, further includes：
According to the first position and the distance of target object, it is left to obtain the target object respectively by monocular cam
The image information of right both sides；
The image information at left and right sides of the target object is synthesized, obtains described first image information.
Specifically, when obtaining the first image information of target image by monocular cam, at the first position,
A mesh is shot after the mobile pre-determined distance of shooting direction (direction between mechanical arm and target object indicated by line)
Mark the photo of object, then after the pre-determined distance that the negative direction that moves before moves 2 times of length, again to target object into
Row shooting synthesizes the image information that shoots twice into described first image information.
Step S12, according to the second figure that the target object is obtained after preset rules mobile mechanical arm to the second place
As information；
According to default rule mobile mechanical arm to the second position in the embodiment that the application provides, then to target object
Shot to obtain the second image information of target object again.Wherein, the preset rules are included from the first position
Along preset direction traveling pre-determined distance etc.；The style of shooting of second image information and the shooting side of described first image information
Formula is identical.
Step S13 determines the shape of the target object according to described first image information and second image information
Three-dimensional geometric shapes；
It is identified respectively according to the first image information and the second image information in the step and extracts the shape of target object
Three-dimensional geometric shapes；The three-dimensional geometric shapes extracted twice are compared, to the place that the two has differences, to its equalization
Processing, with the final three-dimensional geometric shapes that target object shape is determined according to extraction result twice.
Wherein, when handling the difference equalization of the extraction result of shape twice, optional position fixing determines different positions
The coordinate information at place is put, equalization processing is then carried out according to coordinate information.
Step S14, if the three-dimensional geometric shapes are regular geometric figure, according to the geometry of the regular geometric figure
Center determines the crawl position of the target object；
In the step, the three-dimensional geometric shapes of the target object shape to extracting judge, if the three-dimensional geometry
Figure is regular geometric figure, then captures target by the location of geometric center of the regular geometric figure and mechanical arm
During object, the plane formed with target object contact point determines the crawl position to target object.Optionally, crawl position institute
Center of gravity of the plane in the target object below (compared with ground level).
Optionally, conventional regular geometric figure formation rule shape library is stored in mechanical arm in advance, such as square is stood
Cube, cylinder etc.；When being judged, the regular geometric figure in the three-dimensional geometric shapes and regular figure storehouse is carried out
It compares, if there are the diversity factoies of a regular geometric figure and the three-dimensional geometric shapes to be less than preset value, judges described three
Dimension geometric figure is regular geometric figure.
Optionally, the geometric center according to the regular geometric figure determines the crawl position of the target object,
Including：
Obtain the position where the geometric center of the regular geometric figure；
When mechanical arm captures the target object, the plane geometry figure that mechanical arm is formed with target object contact point is obtained
The central point of shape；
The position of contact point therebetween is adjusted, until the central point and the line of the geometric center, perpendicular to institute
State the plane geometric figure that mechanical arm is formed with target object contact point；
The contact point of mechanical arm and target object is the crawl position to record at this time.
Specifically, when the three-dimensional geometric shapes of target object shape are regular geometric figure, the regular geometric figure is detected
Position where the geometric center of shape；Then mobile mechanical arm makes mechanical arm capture target object in advance, when mechanical arm touches
When contacting target object, plane that both detections contact position is formed obtains the central point of the plane, then adjust it is described in
The line of heart point is formed with the line that the geometric center of the regular geometric figure is formed perpendicular to both described contact position
Plane.Or, the central point of the plane of adjustment the two contact position formation is overlapped with the geometric center.Wherein, described two
Person's contact position formed plane the target location center of gravity lower section (compared with ground level), record at this time mechanical arm with
Target object contact point is the crawl position.
Step S15 if the three-dimensional geometric shapes are irregular geometric figures, obtains the irregular geometric figures
At least two characteristic point determines the crawl position of the target object according to the characteristic point.
In the step, if judging, the three-dimensional geometric shapes are not regular geometric figures, determine that it is irregular several
What figure.At this point, obtaining the characteristic point of each plane of the three-dimensional geometric shapes, one or more of each plane feature is chosen
Point when choosing the characteristic point of each plane, enables selected all characteristic points to form a new plane, and described
New plane is located at below the center of gravity of target object.The crawl position to target object is determined according to the new plane.
Optionally, Fig. 2 shows the realization flow chart of the above-mentioned steps S13 provided in another embodiment of the application, including：
Step S21 obtains the target object respectively according to described first image information and second image information
First outline drawing and the second outline drawing；
Extract the first shape of target object in the step from described first image information and the second image information respectively
Figure and the second outline drawing, first outline drawing and second outline drawing are the three-dimensional geometry figure of the target object shape
Shape.
Step S22 obtains at least two characteristic points in first outline drawing and second outline drawing；
To two outline drawings extracted, more than two characteristic point in each plane of figure is obtained respectively.
Step S23 extracts characteristic point identical in first outline drawing and second outline drawing, according to described respectively
Identical characteristic point obtains the three-dimensional geometric shapes of the shape of the target object.
The characteristic point that position is identical in two images is extracted, is then obtained according to the identical characteristic point outside target image
The three-dimensional geometric shapes of shape.
Optionally, the detection method of crawl position further includes described in another embodiment of the application offer：
According to being captured at the mechanical arm to the crawl position to the target object；
After the mechanical arm touches the target object, the deformation of the target object is detected；
The grip of mechanical arm is determined according to the deformation of the target object；
The target object is captured at the crawl position with identified grip.
Specifically, when mechanical arm captures target object in the crawl position, in order to ensure that target object is successfully picked up,
Mechanical arm is moved to crawl position first, until touching the target object.Then touched by sensor detection mechanical arm
After contacting target object, the deformation of target object surface generation.It is determined according to the deformation of target object to current object
The grip of the suitable size of body；When being exerted a force due to mechanical arm to target item, target object surface can generate deformation, the deformation
Degree and the power that is applied there are certain relation, therefore, can be determined according to the variation of the surface deformation degree of target object
Mechanical arm is to the suitable grip of target object.The dynamics of the target object size to be suitble to complete the crawl to target object.
After mechanical arm obtains the first image information of target object at first position in the embodiment that the application provides, press
The second image information of second position acquisition target object is moved to according to preset rules, is determined according to the first and second image informations
The three-dimensional geometric shapes of the shape of target object, when the three-dimensional geometric shapes of target object are regular geometric figure, direct root
The crawl position to target object is determined according to the geometric center of regular geometric figure；If the three-dimensional geometric shapes are irregular several
What figure then determines the crawl position of target object according to the characteristic point of irregular figure.According in different positions during this
The image information for the target object that place obtains is put, the three-dimensional geometric shapes of its shape is determined, improves the target object detected
Shape accuracy；Crawl position is determined using different methods to the target object of different shapes, so as to according to target
Object unique characteristics fast and accurately find suitable crawl position, improve the probability that mechanical arm successfully captures.
Embodiment two：
Corresponding to the detection method of the crawl position described in foregoing embodiments, Fig. 3 shows provided by the embodiments of the present application
The structure diagram of the detection device of crawl position for convenience of description, illustrates only and the relevant part of the embodiment of the present application.
With reference to Fig. 3, the detection device of the crawl position includes：Image information acquisition module 31, three-dimensional geometric shapes determine
Module 32, crawl position determining module 33, wherein：
Image information acquisition module 31, for mechanical arm to be made to obtain the first image letter of target object at first position
Breath；It is additionally operable to according to the second image information that the target object is obtained after preset rules mobile mechanical arm to the second place；
Three-dimensional geometric shapes determining module 32, for being determined according to described first image information and second image information
The three-dimensional geometric shapes of the shape of the target object；
Crawl position determining module 33, for the three-dimensional geometric shapes be regular geometric figure when, according to the rule
Then the geometric center of geometric figure determines the crawl position of the target object；It is not advise to be additionally operable in the three-dimensional geometric shapes
Then during geometric figure, at least two characteristic point of the irregular geometric figures is obtained, according to determining the characteristic point
The crawl position of target object.
Further, the mechanical arm obtains the first image information of target object at first position, including：
By the first image information for setting the binocular camera acquisition target object on the robotic arm.
Further, described image data obtaining module 31 includes：
Image information shooting unit for the distance according to the first position and target object, passes through monocular cam
The image information at left and right sides of the target object is obtained respectively；
Synthesis unit for synthesizing the image information at left and right sides of the target object, obtains described first image information.
Further, the three-dimensional geometric shapes determining module 32, including：
First acquisition unit, for obtaining the mesh respectively according to described first image information and second image information
Mark the first outline drawing and the second outline drawing of object；
Second acquisition unit, for obtaining at least two spies in first outline drawing and second outline drawing respectively
Sign point；
Extraction unit, for extracting characteristic point identical in first outline drawing and second outline drawing, according to institute
State the three-dimensional geometric shapes that identical characteristic point obtains the shape of the target object.
Further, the crawl position determining module 33, including：
Position determination unit, for obtaining the position where the geometric center of the regular geometric figure；
Central point acquiring unit, for when mechanical arm captures the target object, obtaining mechanical arm and being connect with target object
The central point for the plane geometric figure that contact is formed；
Recording unit is adjusted, for adjusting the position of contact point therebetween, until in the central point and the geometry
The line of the heart, the plane geometric figure formed perpendicular to the mechanical arm and target object contact point；Record mechanical arm at this time
Contact point with target object is the crawl position.
Further, the detection device of the crawl position, further includes：
Handling module, for according to being captured at the mechanical arm to the crawl position to the target object；
After the mechanical arm touches the target object, the deformation of the target object is detected；According to the deformation of the target object
Determine the grip of mechanical arm；The target object is captured at the crawl position with identified grip.
It is to be understood that the size of the sequence number of each step is not meant to the priority of execution sequence, each process in above-described embodiment
Execution sequence should determine that the implementation process without tackling the embodiment of the present application forms any limit with its function and internal logic
It is fixed.
Embodiment three：
Fig. 4 is the schematic diagram for the mechanical arm that one embodiment of the application provides.As shown in figure 4, the mechanical arm 4 of the embodiment wraps
It includes：Processor 40, memory 41 and it is stored in the computer that can be run in the memory 41 and on the processor 40
Program 42.The processor 40 realizes that the crawl control method of above-mentioned each mechanical arm is implemented when performing the computer program 42
Step in example, such as step S11 to S15 shown in FIG. 1.Alternatively, when the processor 40 performs the computer program 42
Realize the function of each module/unit in above-mentioned each device embodiment, such as the function of module 31 to 33 shown in Fig. 3.
Illustratively, the computer program 42 can be divided into one or more module/units, it is one or
Multiple module/units are stored in the memory 41, and are performed by the processor 40, to complete the application.Described one
A or multiple module/units can be the series of computation machine program instruction section that can complete specific function, which is used for
Implementation procedure of the computer program 42 in the mechanical arm 4 is described.For example, the computer program 42 can be divided
Into：Image information acquisition module, three-dimensional geometric shapes determining module, crawl position determining module, wherein：
Image information acquisition module, for mechanical arm to be made to obtain the first image information of target object at first position；
It is additionally operable to according to the second image information that the target object is obtained after preset rules mobile mechanical arm to the second place；
Three-dimensional geometric shapes determining module, for determining institute according to described first image information and second image information
State the three-dimensional geometric shapes of the shape of target object；
Crawl position determining module, for the three-dimensional geometric shapes be regular geometric figure when, according to the rule
The geometric center of geometric figure determines the crawl position of the target object；It is irregular to be additionally operable in the three-dimensional geometric shapes
During geometric figure, at least two characteristic point of the irregular geometric figures is obtained, the mesh is determined according to the characteristic point
Mark the crawl position of object.
Further, the three-dimensional geometric shapes determining module, including：
First acquisition unit, for obtaining the mesh respectively according to described first image information and second image information
Mark the first outline drawing and the second outline drawing of object；
Second acquisition unit, for obtaining at least two spies in first outline drawing and second outline drawing respectively
Sign point；
Extraction unit, for extracting characteristic point identical in first outline drawing and second outline drawing, according to institute
State the three-dimensional geometric shapes that identical characteristic point obtains the shape of the target object.
Further, the crawl position determining module 33, including：
Position determination unit, for obtaining the position where the geometric center of the regular geometric figure；
Central point acquiring unit, for when mechanical arm captures the target object, obtaining mechanical arm and being connect with target object
The central point for the plane geometric figure that contact is formed；
Recording unit is adjusted, for adjusting the position of contact point therebetween, until in the central point and the geometry
The line of the heart, the plane geometric figure formed perpendicular to the mechanical arm and target object contact point；Record mechanical arm at this time
Contact point with target object is the crawl position.
Further, the detection device of the crawl position, further includes：
Handling module, for according to being captured at the mechanical arm to the crawl position to the target object；
After the mechanical arm touches the target object, the deformation of the target object is detected；According to the deformation of the target object
Determine the grip of mechanical arm；The target object is captured at the crawl position with identified grip.
Further, the mechanical arm obtains the first image information of target object at first position, including：
By the first image information for setting the binocular camera acquisition target object on the robotic arm.
Further, image information acquisition module includes：
Image information shooting unit for the distance according to the first position and target object, passes through monocular cam
The image information at left and right sides of the target object is obtained respectively；
Synthesis unit for synthesizing the image information at left and right sides of the target object, obtains described first image information.
The mechanical arm may include, but be not limited only to, processor 40, memory 41.It will be understood by those skilled in the art that
Fig. 4 is only the example of mechanical arm 4, does not form the restriction to mechanical arm 4, can be included than illustrating more or fewer portions
Part either combines some components or different components, such as the mechanical arm can also include input-output equipment, network
Access device, bus etc..
Alleged processor 40 can be central processing unit (Central Processing Unit, CPU), can also be
Other general processors, digital signal processor (Digital Signal Processor, DSP), application-specific integrated circuit
(Application Specific Integrated Circuit, ASIC), ready-made programmable gate array (Field-
Programmable Gate Array, FPGA) either other programmable logic device, discrete gate or transistor logic,
Discrete hardware components etc..General processor can be microprocessor or the processor can also be any conventional processor
Deng.
The memory 41 can be the internal storage unit of the mechanical arm 4, such as the hard disk or memory of mechanical arm 4.
The memory 41 can also be the External memory equipment of the mechanical arm 4, such as the plug-in type being equipped on the mechanical arm 4 is hard
Disk, intelligent memory card (Smart Media Card, SMC), secure digital (Secure Digital, SD) card, flash card
(Flash Card) etc..Further, the memory 41 can also both include the internal storage unit of the mechanical arm 4 or wrap
Include External memory equipment.The memory 41 is used to store the computer program and other programs needed for the mechanical arm
And data.The memory 41 can be also used for temporarily storing the data that has exported or will export.
It is apparent to those skilled in the art that for convenience of description and succinctly, only with above-mentioned each work(
Can unit, module division progress for example, in practical application, can be as needed and by above-mentioned function distribution by different
Functional unit, module are completed, i.e., the internal structure of described device are divided into different functional units or module, more than completion
The all or part of function of description.Each functional unit, module in embodiment can be integrated in a processing unit, also may be used
To be that unit is individually physically present, can also two or more units integrate in a unit, it is above-mentioned integrated
The form that hardware had both may be employed in unit is realized, can also be realized in the form of SFU software functional unit.In addition, each function list
Member, the specific name of module are not limited to the protection domain of the application also only to facilitate mutually distinguish.Above system
The specific work process of middle unit, module may be referred to the corresponding process in preceding method embodiment, and details are not described herein.
In the above-described embodiments, all emphasize particularly on different fields to the description of each embodiment, be not described in detail or remember in some embodiment
The part of load may refer to the associated description of other embodiments.
Those of ordinary skill in the art may realize that each exemplary lists described with reference to the embodiments described herein
Member and algorithm steps can be realized with the combination of electronic hardware or computer software and electronic hardware.These functions are actually
It is performed with hardware or software mode, specific application and design constraint depending on technical solution.Professional technician
Described function can be realized using distinct methods to each specific application, but this realization is it is not considered that exceed
Scope of the present application.
In embodiment provided herein, it should be understood that disclosed device/terminal device and method, it can be with
It realizes by another way.For example, device described above/terminal device embodiment is only schematical, for example, institute
The division of module or unit is stated, is only a kind of division of logic function, there can be other dividing mode in actual implementation, such as
Multiple units or component may be combined or can be integrated into another system or some features can be ignored or does not perform.Separately
A bit, shown or discussed mutual coupling or direct-coupling or communication connection can be by some interfaces, device
Or the INDIRECT COUPLING of unit or communication connection, can be electrical, machinery or other forms.
The unit illustrated as separating component may or may not be physically separate, be shown as unit
The component shown may or may not be physical location, you can be located at a place or can also be distributed to multiple
In network element.Some or all of unit therein can be selected to realize the mesh of this embodiment scheme according to the actual needs
's.
In addition, each functional unit in each embodiment of the application can be integrated in a processing unit, it can also
That unit is individually physically present, can also two or more units integrate in a unit.Above-mentioned integrated list
The form that hardware had both may be employed in member is realized, can also be realized in the form of SFU software functional unit.
If the integrated module/unit realized in the form of SFU software functional unit and be independent production marketing or
In use, it can be stored in a computer read/write memory medium.Based on such understanding, the application realizes above-mentioned implementation
All or part of flow in example method, can also instruct relevant hardware to complete, the meter by computer program
Calculation machine program can be stored in a computer readable storage medium, the computer program when being executed by processor, it can be achieved that on
The step of stating each embodiment of the method..Wherein, the computer program includes computer program code, the computer program
Code can be source code form, object identification code form, executable file or some intermediate forms etc..Computer-readable Jie
Matter can include：Can carry the computer program code any entity or device, recording medium, USB flash disk, mobile hard disk,
Magnetic disc, CD, computer storage, read-only memory (ROM, Read-Only Memory), random access memory (RAM,
Random Access Memory), electric carrier signal, telecommunication signal and software distribution medium etc..It is it should be noted that described
The content that computer-readable medium includes can carry out appropriate increasing according to legislation in jurisdiction and the requirement of patent practice
Subtract, such as in some jurisdictions, according to legislation and patent practice, computer-readable medium do not include be electric carrier signal and
Telecommunication signal.
Embodiment described above is only to illustrate the technical solution of the application, rather than its limitations；Although with reference to foregoing reality
Example is applied the application is described in detail, it will be understood by those of ordinary skill in the art that：It still can be to foregoing each
Technical solution recorded in embodiment modifies or carries out equivalent substitution to which part technical characteristic；And these are changed
Or replace, the essence of appropriate technical solution is not made to depart from the spirit and scope of each embodiment technical solution of the application, it should all
Within the protection domain of the application.
Claims (10)
1. a kind of detection method of crawl position, which is characterized in that the detection method of the crawl position includes：
Mechanical arm obtains the first image information of target object at first position；
According to the second image information that the target object is obtained after preset rules mobile mechanical arm to the second place；
The three-dimensional geometry figure of the shape of the target object is determined according to described first image information and second image information
Shape；
If the three-dimensional geometric shapes are regular geometric figure, according to determining the geometric center of the regular geometric figure
The crawl position of target object；
If the three-dimensional geometric shapes are irregular geometric figures, at least two spy of the irregular geometric figures is obtained
Point is levied, the crawl position of the target object is determined according to the characteristic point.
2. the detection method of crawl position as described in claim 1, which is characterized in that described according to described first image information
The three-dimensional geometric shapes of the shape of the target object are determined with second image information, including：
According to described first image information and second image information obtain respectively the target object the first outline drawing and
Second outline drawing；
At least two characteristic points in first outline drawing and second outline drawing are obtained respectively；
Characteristic point identical in first outline drawing and second outline drawing is extracted, is obtained according to the identical characteristic point
The three-dimensional geometric shapes of the shape of the target object.
3. the detection method of crawl position as described in claim 1, which is characterized in that described according to the regular geometric figure
Geometric center determine the crawl position of the target object, including：
Obtain the position where the geometric center of the regular geometric figure；
When mechanical arm captures the target object, the plane geometric figure that mechanical arm is formed with target object contact point is obtained
Central point；
The position of contact point therebetween is adjusted, until the central point and the line of the geometric center, perpendicular to the machine
The plane geometric figure that tool arm is formed with target object contact point；
The contact point of mechanical arm and target object is the crawl position to record at this time.
4. the detection method of crawl position as described in claim 1, which is characterized in that the mechanical arm obtains at first position
The first image information of target object is taken, is further included：
According to the first position and the distance of target object, described target object or so two is obtained respectively by monocular-camera
The image information of side；
The image information at left and right sides of the target object is synthesized, obtains described first image information.
5. the detection method of crawl position as described in claim 1, which is characterized in that the detection method of the crawl position is also
Including：
According to being captured at the mechanical arm to the crawl position to the target object；
After the mechanical arm touches the target object, the deformation of the target object is detected；
The grip of mechanical arm is determined according to the deformation of the target object；
The target object is captured at the crawl position with identified grip.
6. a kind of detection device of crawl position, which is characterized in that the detection device of the crawl position includes：
Image information acquisition module, for mechanical arm to be made to obtain the first image information of target object at first position；Also use
The second image information of the target object is obtained after according to preset rules mobile mechanical arm to the second place；
Three-dimensional geometric shapes determining module, for determining the mesh according to described first image information and second image information
Mark the three-dimensional geometric shapes of the shape of object；
Crawl position determining module, for the three-dimensional geometric shapes be regular geometric figure when, according to the regular geometric
The geometric center of figure determines the crawl position of the target object；It is irregular geometry to be additionally operable in the three-dimensional geometric shapes
During figure, at least two characteristic point of the irregular geometric figures is obtained, the object is determined according to the characteristic point
The crawl position of body.
7. the detection device of crawl position as claimed in claim 6, which is characterized in that the three-dimensional geometric shapes determine mould
Block, including：
First acquisition unit, for obtaining the object respectively according to described first image information and second image information
The first outline drawing and the second outline drawing of body；
Second acquisition unit, for obtaining at least two features in first outline drawing and second outline drawing respectively
Point；
Extraction unit, for extracting characteristic point identical in first outline drawing and second outline drawing, according to the phase
Same characteristic point obtains the three-dimensional geometric shapes of the shape of the target object.
8. the detection device of crawl position as claimed in claim 6, which is characterized in that the detection device of the crawl position,
It further includes：
Handling module, for according to being captured at the mechanical arm to the crawl position to the target object；Described
After mechanical arm touches the target object, the deformation of the target object is detected；It is determined according to the deformation of the target object
The grip of mechanical arm；The target object is captured at the crawl position with identified grip.
9. a kind of mechanical arm, including memory, processor and it is stored in the memory and can transports on the processor
Capable computer program, which is characterized in that the processor realizes such as claim 1 to 5 times when performing the computer program
The step of one the method.
10. a kind of computer readable storage medium, the computer-readable recording medium storage has computer program, and feature exists
In when the computer program is executed by processor the step of realization such as any one of claim 1 to 5 the method.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711481188.6A CN108044627B (en) | 2017-12-29 | 2017-12-29 | Method and device for detecting grabbing position and mechanical arm |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711481188.6A CN108044627B (en) | 2017-12-29 | 2017-12-29 | Method and device for detecting grabbing position and mechanical arm |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108044627A true CN108044627A (en) | 2018-05-18 |
| CN108044627B CN108044627B (en) | 2020-07-31 |
Family
ID=62129186
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711481188.6A Active CN108044627B (en) | 2017-12-29 | 2017-12-29 | Method and device for detecting grabbing position and mechanical arm |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108044627B (en) |
Cited By (19)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108785064A (en) * | 2018-06-11 | 2018-11-13 | 珠海市万瑙特健康科技有限公司 | Control method, device, computer equipment and the storage medium of manipulator |
| CN109241964A (en) * | 2018-08-17 | 2019-01-18 | 上海非夕机器人科技有限公司 | The acquisition methods and equipment of the crawl point of mechanical arm |
| CN109579698A (en) * | 2018-12-05 | 2019-04-05 | 普达迪泰（天津）智能装备科技有限公司 | A kind of intelligence cargo detection system and its detection method |
| CN109911645A (en) * | 2019-03-22 | 2019-06-21 | 深圳蓝胖子机器人有限公司 | Ladle-to-ladle control method, device and robot |
| CN109919999A (en) * | 2019-01-31 | 2019-06-21 | 深兰科技（上海）有限公司 | A kind of method and device of target position detection |
| CN109956251A (en) * | 2019-04-19 | 2019-07-02 | 深圳蓝胖子机器人有限公司 | A kind of cargo identification grasping means, equipment and storage medium |
| CN110104359A (en) * | 2019-04-19 | 2019-08-09 | 深圳蓝胖子机器人有限公司 | A kind of warehouse goods sorting method, system and equipment |
| CN110253575A (en) * | 2019-06-17 | 2019-09-20 | 深圳前海达闼云端智能科技有限公司 | Robot grabbing method, terminal and computer readable storage medium |
| CN110271001A (en) * | 2019-06-19 | 2019-09-24 | 北京微链道爱科技有限公司 | Robot recognition methods, control method, device, storage medium and main control device |
| CN110271000A (en) * | 2019-06-18 | 2019-09-24 | 清华大学深圳研究生院 | A kind of grasping body method based on oval face contact |
| CN111724444A (en) * | 2020-06-16 | 2020-09-29 | 中国联合网络通信集团有限公司 | Method and device for determining grabbing point of target object and grabbing system |
| CN113532710A (en) * | 2020-04-17 | 2021-10-22 | 清华大学 | Test device and test platform for grabbing information |
| CN113524258A (en) * | 2020-04-17 | 2021-10-22 | 清华大学 | Testing device and testing platform for selecting grabbing points |
| WO2021249570A1 (en) * | 2020-06-12 | 2021-12-16 | 深圳市海柔创新科技有限公司 | Control method and apparatus for warehouse robot, and robot and warehouse system |
| CN113927590A (en) * | 2020-06-29 | 2022-01-14 | 配天机器人技术有限公司 | Workpiece moving method, device, industrial robot and readable storage medium |
| CN114054166A (en) * | 2021-10-11 | 2022-02-18 | 深圳市中金岭南有色金属股份有限公司凡口铅锌矿 | Automatic adding method and system of grinding body and terminal equipment |
| CN116330304A (en) * | 2023-05-29 | 2023-06-27 | 广东隆崎机器人有限公司 | Six-axis robot motion adjustment method, system, six-axis robot and medium |
| CN117961912A (en) * | 2024-03-18 | 2024-05-03 | 威海联科智能装备有限公司 | Mechanical arm control method and device, electronic equipment and medium |
| CN117961913A (en) * | 2024-03-18 | 2024-05-03 | 威海联科智能装备有限公司 | Mechanical arm management method and device, electronic equipment and medium |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1293752A (en) * | 1999-03-19 | 2001-05-02 | 松下电工株式会社 | Three-D object recognition method and pin picking system using the method |
| JP2012101320A (en) * | 2010-11-10 | 2012-05-31 | Canon Inc | Image generation apparatus, image generation method and program |
| CN104766309A (en) * | 2015-03-19 | 2015-07-08 | 江苏国典艺术品保真科技有限公司 | Plane feature point navigation and positioning method and device |
| CN105459134A (en) * | 2014-09-29 | 2016-04-06 | 发那科株式会社 | Detection method and detection apparatus for detecting three-dimensional position of objects |
| CN105835056A (en) * | 2015-02-03 | 2016-08-10 | 佳能株式会社 | Robot hand controlling method and robotics device |
| CN106934813A (en) * | 2015-12-31 | 2017-07-07 | 沈阳高精数控智能技术股份有限公司 | A kind of industrial robot workpiece grabbing implementation method of view-based access control model positioning |
| CN107030687A (en) * | 2016-02-04 | 2017-08-11 | 上海晨兴希姆通电子科技有限公司 | Position bias detecting method and module, crawl position calibration method, grasping system |
-
2017
- 2017-12-29 CN CN201711481188.6A patent/CN108044627B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1293752A (en) * | 1999-03-19 | 2001-05-02 | 松下电工株式会社 | Three-D object recognition method and pin picking system using the method |
| JP2012101320A (en) * | 2010-11-10 | 2012-05-31 | Canon Inc | Image generation apparatus, image generation method and program |
| CN105459134A (en) * | 2014-09-29 | 2016-04-06 | 发那科株式会社 | Detection method and detection apparatus for detecting three-dimensional position of objects |
| CN105835056A (en) * | 2015-02-03 | 2016-08-10 | 佳能株式会社 | Robot hand controlling method and robotics device |
| CN104766309A (en) * | 2015-03-19 | 2015-07-08 | 江苏国典艺术品保真科技有限公司 | Plane feature point navigation and positioning method and device |
| CN106934813A (en) * | 2015-12-31 | 2017-07-07 | 沈阳高精数控智能技术股份有限公司 | A kind of industrial robot workpiece grabbing implementation method of view-based access control model positioning |
| CN107030687A (en) * | 2016-02-04 | 2017-08-11 | 上海晨兴希姆通电子科技有限公司 | Position bias detecting method and module, crawl position calibration method, grasping system |
Non-Patent Citations (1)
| Title |
|---|
| 杜金波: "《现代高技术概况与发展趋势》", 31 July 1997 * |
Cited By (28)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108785064A (en) * | 2018-06-11 | 2018-11-13 | 珠海市万瑙特健康科技有限公司 | Control method, device, computer equipment and the storage medium of manipulator |
| CN109241964A (en) * | 2018-08-17 | 2019-01-18 | 上海非夕机器人科技有限公司 | The acquisition methods and equipment of the crawl point of mechanical arm |
| CN109579698A (en) * | 2018-12-05 | 2019-04-05 | 普达迪泰（天津）智能装备科技有限公司 | A kind of intelligence cargo detection system and its detection method |
| CN109919999A (en) * | 2019-01-31 | 2019-06-21 | 深兰科技（上海）有限公司 | A kind of method and device of target position detection |
| CN109919999B (en) * | 2019-01-31 | 2021-06-11 | 深兰科技（上海）有限公司 | Target position detection method and device |
| CN109911645A (en) * | 2019-03-22 | 2019-06-21 | 深圳蓝胖子机器人有限公司 | Ladle-to-ladle control method, device and robot |
| CN110104359A (en) * | 2019-04-19 | 2019-08-09 | 深圳蓝胖子机器人有限公司 | A kind of warehouse goods sorting method, system and equipment |
| WO2020211552A1 (en) * | 2019-04-19 | 2020-10-22 | 深圳蓝胖子机器人有限公司 | Commodity recognition and grabbing method and device, and storage medium |
| CN109956251A (en) * | 2019-04-19 | 2019-07-02 | 深圳蓝胖子机器人有限公司 | A kind of cargo identification grasping means, equipment and storage medium |
| CN110253575A (en) * | 2019-06-17 | 2019-09-20 | 深圳前海达闼云端智能科技有限公司 | Robot grabbing method, terminal and computer readable storage medium |
| CN110253575B (en) * | 2019-06-17 | 2021-12-24 | 达闼机器人有限公司 | Robot grabbing method, terminal and computer readable storage medium |
| CN110271000A (en) * | 2019-06-18 | 2019-09-24 | 清华大学深圳研究生院 | A kind of grasping body method based on oval face contact |
| CN110271000B (en) * | 2019-06-18 | 2020-09-22 | 清华大学深圳研究生院 | Object grabbing method based on elliptical surface contact |
| CN110271001A (en) * | 2019-06-19 | 2019-09-24 | 北京微链道爱科技有限公司 | Robot recognition methods, control method, device, storage medium and main control device |
| CN113532710A (en) * | 2020-04-17 | 2021-10-22 | 清华大学 | Test device and test platform for grabbing information |
| CN113532710B (en) * | 2020-04-17 | 2022-04-22 | 清华大学 | Test device and test platform for grabbing information |
| CN113524258A (en) * | 2020-04-17 | 2021-10-22 | 清华大学 | Testing device and testing platform for selecting grabbing points |
| CN113524258B (en) * | 2020-04-17 | 2022-05-20 | 清华大学 | Testing device and testing platform for selecting grabbing points |
| WO2021249570A1 (en) * | 2020-06-12 | 2021-12-16 | 深圳市海柔创新科技有限公司 | Control method and apparatus for warehouse robot, and robot and warehouse system |
| CN111724444B (en) * | 2020-06-16 | 2023-08-22 | 中国联合网络通信集团有限公司 | Method, device and system for determining grabbing point of target object |
| CN111724444A (en) * | 2020-06-16 | 2020-09-29 | 中国联合网络通信集团有限公司 | Method and device for determining grabbing point of target object and grabbing system |
| CN113927590A (en) * | 2020-06-29 | 2022-01-14 | 配天机器人技术有限公司 | Workpiece moving method, device, industrial robot and readable storage medium |
| CN113927590B (en) * | 2020-06-29 | 2024-02-06 | 配天机器人技术有限公司 | Workpiece moving method, device, industrial robot and readable storage medium |
| CN114054166A (en) * | 2021-10-11 | 2022-02-18 | 深圳市中金岭南有色金属股份有限公司凡口铅锌矿 | Automatic adding method and system of grinding body and terminal equipment |
| CN116330304A (en) * | 2023-05-29 | 2023-06-27 | 广东隆崎机器人有限公司 | Six-axis robot motion adjustment method, system, six-axis robot and medium |
| CN116330304B (en) * | 2023-05-29 | 2023-08-01 | 广东隆崎机器人有限公司 | Six-axis robot motion adjustment method, system, six-axis robot and medium |
| CN117961912A (en) * | 2024-03-18 | 2024-05-03 | 威海联科智能装备有限公司 | Mechanical arm control method and device, electronic equipment and medium |
| CN117961913A (en) * | 2024-03-18 | 2024-05-03 | 威海联科智能装备有限公司 | Mechanical arm management method and device, electronic equipment and medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108044627B (en) | 2020-07-31 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108044627A (en) | Detection method, device and the mechanical arm of crawl position | |
| Loncomilla et al. | Object recognition using local invariant features for robotic applications: A survey | |
| CN107748890A (en) | A kind of visual grasping method, apparatus and its readable storage medium storing program for executing based on depth image | |
| CN108115688A (en) | Crawl control method, system and the mechanical arm of a kind of mechanical arm | |
| CN111844019B (en) | Method and device for determining grabbing position of machine, electronic device and storage medium | |
| CN112528831B (en) | Multi-target attitude estimation method, multi-target attitude estimation device and terminal equipment | |
| CN108615247A (en) | Method for relocating, device, equipment and the storage medium of camera posture tracing process | |
| CN107636727A (en) | Target detection method and device | |
| CN112336342B (en) | Hand key point detection method and device and terminal equipment | |
| CN107506754A (en) | Iris identification method, device and terminal device | |
| CN104006740B (en) | Object detecting method and article detection device | |
| CN108133477A (en) | A kind of object detecting method and intelligent machine arm | |
| CN110298314A (en) | The recognition methods of gesture area and device | |
| CN107257440A (en) | It is a kind of to detect method, equipment and storage medium that video tracking is shot | |
| JP2017182785A (en) | System and method for efficiently scoring probes in image with vision system | |
| CN107918767A (en) | Object detection method, device, electronic equipment and computer-readable medium | |
| CN108127666A (en) | A kind of grasping means of mechanical arm, system and mechanical arm | |
| CN117190866B (en) | Polarity discrimination detection method, device and equipment for multiple stacked electronic components | |
| CN115713547A (en) | Motion trail generation method and device and processing equipment | |
| KR20210088437A (en) | Image recognition method and apparatus, computer readable storage medium | |
| CN111401184A (en) | Machine vision processing method and device, storage medium and electronic equipment | |
| CN109829401A (en) | Traffic sign recognition method and device based on double capture apparatus | |
| CN114972492A (en) | Position and pose determination method and device based on aerial view and computer storage medium | |
| JP2015045919A (en) | Image recognition method and robot | |
| JP6041710B2 (en) | Image recognition method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |