CN110781907A - Cutting line generation method and device - Google Patents

Cutting line generation method and device Download PDF

Info

Publication number
CN110781907A
CN110781907A CN201910667543.1A CN201910667543A CN110781907A CN 110781907 A CN110781907 A CN 110781907A CN 201910667543 A CN201910667543 A CN 201910667543A CN 110781907 A CN110781907 A CN 110781907A
Authority
CN
China
Prior art keywords
template
processed
matching
local
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201910667543.1A
Other languages
Chinese (zh)
Inventor
周飞
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Mai Technology Co Ltd
Original Assignee
Shenzhen Mai Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Mai Technology Co Ltd filed Critical Shenzhen Mai Technology Co Ltd
Publication of CN110781907A publication Critical patent/CN110781907A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/70Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/74Image or video pattern matching; Proximity measures in feature spaces
    • G06V10/75Organisation of the matching processes, e.g. simultaneous or sequential comparisons of image or video features; Coarse-fine approaches, e.g. multi-scale approaches; using context analysis; Selection of dictionaries
    • G06V10/752Contour matching
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/002D [Two Dimensional] image generation
    • G06T11/20Drawing from basic elements, e.g. lines or circles
    • G06T11/203Drawing of straight lines or curves

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Artificial Intelligence (AREA)
  • Health & Medical Sciences (AREA)
  • Computing Systems (AREA)
  • Databases & Information Systems (AREA)
  • Evolutionary Computation (AREA)
  • General Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Software Systems (AREA)
  • Multimedia (AREA)
  • Image Analysis (AREA)

Abstract

The embodiment of the invention discloses a cutting line generation method and a device, wherein the method comprises the following steps: generating an integral template and a local template in advance, wherein the integral template is a template generated based on a pattern to be cut, and the local template is a template generated based on a part of pattern in the pattern to be cut; matching the integral template with the image, determining a matching position in the image according to a matching result, and obtaining a contour line of the integral template when the integral template is positioned at the matching position; the image area at the matching position can be understood as a pattern to be cut, the image area is matched with the local template, and the contour line is adjusted based on the matching result to obtain a cutting line; therefore, according to the scheme, the contour line template is not generated in advance, the cutting line which is consistent with the pattern to be cut in the image is generated through template matching twice, and even if the flexible material is deformed, the cutting line still reflects the contour of the pattern to be cut, so that the accurate cutting line is generated.

Description

Cutting line generation method and device
Technical Field
The present invention relates to the field of image processing technologies, and in particular, to a method and an apparatus for generating a cutting line.
Background
In the apparel industry or the footwear industry, it is often necessary to cut a predetermined shape of clothing or footwear, etc. into a cloth or other flexible material. In the existing scheme, a contour line template of the clothing material or the shoe pattern is generally generated in advance, and the corresponding clothing material or the shoe pattern is cut out of the flexible material according to the contour line template.
In the scheme, the shape of the pre-generated cutting line template is fixed, but the flexible material is easy to deform, the deformation conditions are various, the contour line template is not necessarily the real contour of the clothing material or the shoe sample in the flexible material, or the accuracy of the contour line template is poor, and the cutting is inaccurate.
Disclosure of Invention
In view of the above, the present invention provides a method and a device for generating a cutting line to generate a more accurate cutting line.
Based on the above object, the present invention provides a cutting line generating method, including:
acquiring an image acquired aiming at a flexible material as an image to be processed, wherein the flexible material comprises a pattern to be cut;
matching a preset integral template with the image to be processed, and determining a matching position in the image to be processed according to a matching result; the integral template is generated based on a pattern to be cut;
obtaining the contour line of the integral template at the matching position as the contour line to be processed;
matching a preset local template with the image area at the matching position, and adjusting the contour line to be processed based on the matching result to obtain a cutting line; wherein the local template is a template generated based on a part of patterns in the pattern to be cut; the relative position relationship between the local template and the whole template is fixed.
Optionally, after the preset integral template is matched with the image to be processed and the matching position in the image to be processed is determined according to the matching result, the method further includes:
adjusting the integral template at the matching position until the contact ratio of the integral template and the image area at the matching position meets a preset condition to obtain an adjusted integral template;
obtaining a contour line when the whole template is located at the matching position, and taking the contour line as a contour line to be processed, wherein the contour line comprises the following steps:
and obtaining the contour line of the adjusted integral template as the contour line to be processed.
Optionally, the adjusting the overall template at the matching position includes:
and adjusting the integral template at the matching position by any one or more of the following items: adjusting position, angle and size.
Optionally, the matching the preset local template with the image area at the matching position, and adjusting the contour line to be processed based on the matching result to obtain the cutting line includes:
aiming at each local template, matching the local template with the image area at the position of the local template, and determining the displacement deviation corresponding to the local template according to the matching result;
and adjusting the contour line to be processed according to the displacement deviation corresponding to each local template to obtain the cutting line.
Optionally, the contour line to be processed includes a plurality of control points; according to the displacement deviation corresponding to each local template, the contour line to be processed is adjusted to obtain a cutting line, and the method comprises the following steps:
aiming at each local template, adjusting the control point corresponding to the local template according to the displacement deviation corresponding to the local template;
and smoothing each adjusted control point to obtain a cutting line consisting of each smoothed control point.
Optionally, the integral template is generated by the following steps:
acquiring an image acquired aiming at a pattern to be cut as a template image;
determining the position of the pattern to be cut in the template image as a position to be processed;
determining a region to be processed in the template image based on the position to be processed;
and modeling based on the area to be processed to obtain the integral template.
Optionally, the determining a region to be processed in the template image based on the position to be processed includes:
generating a frame of a preset shape at the position to be processed; determining an inner area of the frame as an area to be processed;
or identifying the edge line of the pattern to be cut at the position to be processed, and determining the inner area of the edge line as the area to be processed;
or identifying the edge line of the pattern to be cut at the position to be processed, performing external expansion on the edge line, and determining the internal area of the externally expanded edge line as the area to be processed;
or identifying the edge line of the pattern to be cut at the position to be processed, carrying out retraction on the edge line, and determining the internal area of the retracted edge line as the area to be processed.
Optionally, the local template is generated by the following steps:
sequentially determining a plurality of local areas in the area to be processed along the control points in the contour line of the integral template;
and respectively modeling based on each determined local area to obtain a plurality of local templates.
In view of the above object, the present invention also provides a cutting line generating device, including:
the device comprises a first acquisition module, a second acquisition module and a processing module, wherein the first acquisition module is used for acquiring an image acquired aiming at a flexible material as an image to be processed, and the flexible material comprises a pattern to be cut;
the first matching module is used for matching a preset integral template with the image to be processed and determining a matching position in the image to be processed according to a matching result; the integral template is generated based on a pattern to be cut;
the obtaining module is used for obtaining the contour line of the integral template when the integral template is positioned at the matching position and taking the contour line as a contour line to be processed;
the second matching module is used for matching a preset local template with the image area at the matching position and adjusting the contour line to be processed based on the matching result to obtain a cutting line; wherein the local template is a template generated based on a part of patterns in the pattern to be cut; the relative position relationship between the local template and the whole template is fixed.
Optionally, the apparatus further comprises:
the adjusting module is used for adjusting the whole template at the matching position until the contact ratio of the whole template and the image area at the matching position meets a preset condition, so that the adjusted whole template is obtained;
the obtaining module is specifically configured to: and obtaining the contour line of the adjusted integral template as the contour line to be processed.
Optionally, the adjusting module is specifically configured to: and adjusting the integral template at the matching position by any one or more of the following items: adjusting position, angle and size.
Optionally, the second matching module is specifically configured to:
aiming at each local template, matching the local template with the image area at the position of the local template, and determining the displacement deviation corresponding to the local template according to the matching result;
and adjusting the contour line to be processed according to the displacement deviation corresponding to each local template to obtain the cutting line.
Optionally, the second matching module is further configured to:
aiming at each local template, adjusting the control point corresponding to the local template according to the displacement deviation corresponding to the local template;
and smoothing each adjusted control point to obtain a cutting line consisting of each smoothed control point.
Optionally, the apparatus further comprises:
the second acquisition module is used for acquiring an image acquired aiming at the pattern to be cut as a template image;
the first determining module is used for determining the position of the pattern to be cut in the template image as a position to be processed;
a second determining module, configured to determine a region to be processed in the template image based on the position to be processed;
and the first modeling module is used for modeling based on the area to be processed to obtain the whole template.
Optionally, the second determining module is specifically configured to:
generating a frame of a preset shape at the position to be processed; determining an inner area of the frame as an area to be processed;
or identifying the edge line of the pattern to be cut at the position to be processed, and determining the inner area of the edge line as the area to be processed;
or identifying the edge line of the pattern to be cut at the position to be processed, performing external expansion on the edge line, and determining the internal area of the externally expanded edge line as the area to be processed;
or identifying the edge line of the pattern to be cut at the position to be processed, carrying out retraction on the edge line, and determining the internal area of the retracted edge line as the area to be processed.
Optionally, the apparatus further comprises:
a third determining module, configured to sequentially determine a plurality of local regions in the region to be processed along the control point in the contour line of the integral template;
and the second modeling module is used for respectively modeling based on each determined local area to obtain a plurality of local templates.
By applying the embodiment of the invention, an integral template and a local template are generated in advance, wherein the integral template is a template generated based on a pattern to be cut, and the local template is a template generated based on a part of pattern in the pattern to be cut; matching the integral template with the image, determining a matching position in the image according to a matching result, and obtaining a contour line of the integral template when the integral template is positioned at the matching position as a contour line to be processed; the image area at the matching position can be understood as a pattern to be cut, the image area is matched with the local template, and the contour line to be processed is adjusted based on the matching result to obtain a cutting line; therefore, according to the scheme, the contour line template is not generated in advance, the cutting line which is consistent with the pattern to be cut in the image is generated through template matching twice, and even if the flexible material is deformed, the cutting line still reflects the contour of the pattern to be cut, so that the accurate cutting line is generated.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a first schematic flow chart of a cutting line generating method according to an embodiment of the present invention;
FIG. 2 is a schematic diagram of a template provided by an embodiment of the present invention;
FIG. 3 is a second flowchart of a cutting line generation method according to an embodiment of the present invention;
FIG. 4 is a third schematic flow chart of a cutting line generating method according to an embodiment of the present invention;
FIG. 5 is a schematic structural diagram of a cutting line generating apparatus according to an embodiment of the present invention;
fig. 6 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is described in further detail below with reference to specific embodiments and the accompanying drawings.
It should be noted that all expressions using "first" and "second" in the embodiments of the present invention are used for distinguishing two entities with the same name but different names or different parameters, and it should be noted that "first" and "second" are merely for convenience of description and should not be construed as limitations of the embodiments of the present invention, and they are not described in any more detail in the following embodiments.
In order to solve the above technical problems, embodiments of the present invention provide a method and an apparatus for generating a cut line, which may be applied to various electronic devices, such as an image processing device or a cutting device, and are not limited in particular. First, a method for generating a cutting line according to an embodiment of the present invention will be described below.
Fig. 1 is a first schematic flow chart of a cutting line generation method provided in an embodiment of the present invention, including:
s101: acquiring an image acquired aiming at a flexible material as an image to be processed, wherein the flexible material comprises a pattern to be cut.
For example, the flexible material may be a material for making a garment, in which case, the pattern to be cut may be a pattern of a garment to be cut, the flexible material may include a plurality of garment patterns, and the plurality of garment patterns may be cut from the flexible material. As another example, the flexible material may be a material for making shoes, in which case the pattern to be cut may be a shoe pattern, and a plurality of shoe patterns may be cut from the flexible material. Alternatively, the flexible material may also include a pattern to be cut, and the number of patterns to be cut is not limited. The image to be processed is an image collected for the flexible material, and the image to be processed may also include one or more patterns to be cut.
S102: matching the preset integral template with the image to be processed, and determining a matching position in the image to be processed according to a matching result; and the integral template is generated based on the pattern to be cut.
It can be understood that the image to be processed includes one or more patterns to be cut, and the whole template is a template generated based on the patterns to be cut, so that the whole template can be successfully matched with the patterns to be cut in the image to be processed. The matching position determined in S102 may be understood as a position of the pattern to be cut in the image.
S102 may be understood as coarse positioning, for example, the matching position of the whole template may be determined in the image to be processed by controlling the matching similarity. In other words, a matching condition may be set in advance, and if the similarity between the image region at a certain position and the entire template satisfies the matching condition, the position may be determined as a matching position.
In the embodiment of the present invention, an integral template is generated in advance, and in one implementation, the integral template may be generated by the following steps:
acquiring an image acquired aiming at a pattern to be cut as a template image;
determining the position of the pattern to be cut in the template image as a position to be processed;
determining a region to be processed in the template image based on the position to be processed;
and modeling based on the area to be processed to obtain the integral template.
For the purpose of distinguishing descriptions, an image used when the template is generated is referred to as a template image, and an image used when the cut line is generated is referred to as an image to be processed.
In one case, the template image may include a pattern to be cut, and a position of the pattern in the template image may be detected by using a target detection algorithm or a feature recognition algorithm, and for convenience of description, the position is referred to as a position to be processed. For example, based on the position to be processed, the area to be processed is determined in the template image, and various ways can be adopted:
in a first mode, a frame with a preset shape is generated at the position to be processed; and determining the inner area of the frame as an area to be processed. The frame of the preset shape may be a rectangular frame, a circular frame, an oval frame, etc., and the specific shape is not limited.
In one embodiment, the frame of the predetermined shape may be slightly larger than the pattern to be cut, such that the interior area of the frame (i.e., the area to be processed) also includes some background area. In some cases, the background region in the template image has less influence on the pattern to be cut, so that the accuracy of the template modeled based on the region to be processed is less influenced by the background region even if the region to be processed includes the background region.
In another embodiment, the pre-shaped frame may be slightly smaller than the pattern to be cut, such that the interior area of the frame (i.e., the area to be processed) may not include the edges of the pattern to be cut. In some cases, the edge of the pattern to be cut has less impact on the pattern to be cut, so that the accuracy of the template modeled based on the area to be processed is less affected by the background area even if the edge of the pattern to be cut is not included in the area to be processed.
For example, if more edge features of the pattern of interest are needed, a box that completely contains the pattern (larger than the frame of the pattern) may be generated, with the area inside the box being the area to be processed. If the edge feature of the pattern does not need to be focused on, a frame smaller than the pattern may be generated, and the area inside the frame is taken as the area to be processed.
In a second mode, the edge line of the pattern to be cut is identified at the position to be processed, and the internal area of the edge line is determined as the area to be processed.
In a third mode, the edge line of the pattern to be cut is identified at the position to be processed, the edge line is subjected to external expansion, and the internal area of the external expanded edge line is determined as the area to be processed.
In this embodiment, the region to be processed further includes some background regions. In some cases, the background region in the template image has less influence on the pattern to be cut, so that the accuracy of the template modeled based on the region to be processed is less influenced by the background region even if the region to be processed includes the background region.
In a fourth mode, the edge line of the pattern to be cut is identified at the position to be processed, the edge line is retracted, and the internal area of the retracted edge line is determined as the area to be processed.
In this manner, the area to be processed may not include the edge of the pattern to be cut. In some cases, the edge of the pattern to be cut has less impact on the pattern to be cut, so that the accuracy of the template modeled based on the area to be processed is less affected by the background area even if the edge of the pattern to be cut is not included in the area to be processed.
For example, if more edge features of the pattern of interest are needed, the edge lines of the pattern may be expanded, and the inner region of the expanded edge lines is determined as the region to be processed. If the edge feature of the pattern does not need to be paid attention to, the edge line of the pattern can be retracted, and the inner area of the retracted edge line is determined as the area to be processed.
The modeling is performed based on the region to be processed, and in one case, the modeling may be performed based on various features such as image features and edge features of the region to be processed, so that the overall template may include contour information and content information of the pattern. Or, in another case, the modeling may be performed based on only the edge features of the region to be processed, so that the overall template may include the contour information of the pattern.
S103: and obtaining the contour line of the whole template at the matching position as the contour line to be processed.
The matching position is determined in S102, and it may be understood that the entire template is superimposed on the matching position, and the entire template coincides with the image area at the matching position, as described above, the similarity between the image area at the matching position and the entire template satisfies the matching condition, and the image area at the matching position may be understood as the image area where the pattern to be cut is located. In this case, the contour of the entire template is used as the contour to be processed, which may be understood as a rough contour of the pattern to be cut, or a contour that needs to be further adjusted.
In one embodiment, after S102, the whole template at the matching position may be adjusted until the overlap ratio of the whole template and the image area at the matching position meets a preset condition, so as to obtain an adjusted whole template; thus, S103 may include: and obtaining the contour line of the adjusted integral template as the contour line to be processed.
As described above, S102 can be understood as coarse positioning, and if the contour line is generated directly based on the coarse positioning result, the accuracy of the contour line is low, and the workload of subsequently adjusting the contour line to the cutting line is large; in this embodiment, the coarse positioning result is adjusted first, and then the contour line is generated. The preset condition may be that the preset condition is greater than a preset overlap threshold, that is, in the present embodiment, the entire template is adjusted to improve the overlap between the entire template and the image area at the matching position.
For example, the overall template at the matching location may be adjusted by any one or more of: adjusting position, angle and size. After the rough positioning in S102, the whole template at the matching position may be adjusted by translation, rotation, scaling, and the like, so as to improve the contact ratio between the whole template and the image area at the matching position, that is, improve the contact ratio between the whole template and the pattern to be cut in the image.
For example, if the flexible material is used for manufacturing shoes, the flexible material includes a plurality of shoe patterns, in some cases, the rotation angles of the shoe patterns are different, so that the flexible material can be reasonably utilized, and the material waste can be reduced; in some cases, the shoe pattern is also of different sizes to allow for different sizes of shoes. Assuming that the initial rotation angle of the integral template is 0 and the initial size corresponds to 39 yards of shoes, the integral template is successfully matched with the pattern A to be cut in the image in S102, the rotation angle of the pattern A to be cut is 60 degrees, and the pattern A to be cut corresponds to 40 yards of shoes, so that the integral template can be rotated and amplified to enable the coincidence degree of the integral template and the pattern A to be cut to be higher, and then the contour line of the integral template is obtained.
S104: matching the preset local template with the image area at the matching position, and adjusting the contour line to be processed based on the matching result to obtain a cutting line; wherein the local template is a template generated based on a part of patterns in the pattern to be cut; the relative position relationship between the local template and the whole template is fixed.
As described above, the image area at the matching position can be understood as the image area where the pattern to be cut is located, and the local template is a template generated based on a part of the pattern in the pattern to be cut, so that the local template can be successfully matched with a certain part of the image area at the matching position.
In the above embodiment, the whole template is adjusted to improve the coincidence degree of the whole template and the image region at the matching position, and the position, angle, etc. of the local template in the whole template are fixed, so that the local template is also adjusted accordingly. For example, the whole template rotates clockwise by 5 degrees, the local template also rotates clockwise by 5 degrees, the whole template scales by 1.5 times, the local template scales by 1.5 times, and so on, which are not listed one by one.
In the embodiment of the present invention, the local template is generated in advance, and in one implementation, the local template may be generated by the following steps: sequentially determining a plurality of local areas in the area to be processed along the control points in the contour line of the integral template; and respectively modeling based on each determined local area to obtain a plurality of local templates.
Referring to fig. 2, the outermost frame of the pattern in fig. 2 may be understood as a whole template, various small frames in fig. 2 may be understood as various local templates, the hollow dots in fig. 2 may be understood as control points in the contour line of the whole template, and some rules may be set along the peripheries of the control points, for example, a rectangular region with a length or a width specified by taking the control point as a center may be used as a local region, or a circular region with a radius specified by taking the control point as a center may be used as a local region, and the specific rules are not limited. The outline of the local area may be rectangular, circular, trapezoidal, etc., and the specific shape is not limited. A local area may be selected around each control point, or some control points may be selected, and a local area is selected around these control points, and the specific manner of selecting the control points is not limited. And then modeling is carried out based on the local area to obtain a local template.
In one case, modeling may be performed based on various features such as image features and edge features of the local region, and thus, contour information and content information of the pattern may be included in the local template. Or, in another case, the modeling may be performed based on only the edge features of the local area, so that the local template may include the contour information of the pattern.
In one embodiment, a plurality of local templates may be matched with the image region at the matching position, in which case S104 may include: aiming at each local template, matching the local template with the image area at the position of the local template, and determining the displacement deviation corresponding to the local template according to the matching result; and adjusting the contour line to be processed according to the displacement deviation corresponding to each local template to obtain the cutting line.
For example, assume that the displacement deviation corresponding to the local template 1 is: shift left by 4 pixels, which can be understood as: the local template 1 is moved leftwards by 4 pixel points and then has the highest contact ratio with the image area. Under the condition, the contour line image to be processed at the position of the local template 1 can be deviated by 4 pixel points to the left, so that a more accurate cutting line can be obtained.
In this embodiment, the contour obtained in S103 can be more finely adjusted, and the adjusted contour (i.e., the cutting line) can reflect the detailed portion of the pattern to be cut (the image area portion corresponding to the local template) in the image.
In one embodiment, the contour line to be processed includes a plurality of control points; aiming at each local template, adjusting the control point corresponding to the local template according to the displacement deviation corresponding to the local template; and smoothing each adjusted control point to obtain a cutting line consisting of each smoothed control point.
As described above, the region around the control point may be used as a local region, and a local template may be generated based on the local region; assuming that a local template 1 is generated based on the area around the control point 1, the displacement deviation corresponding to the local template 1 is assumed as: shift left by 4 pixels. This can be understood as: the local template 1 is moved leftwards by 4 pixel points and then has the highest contact ratio with the image area. In this case, the control point 1 can be left-shifted by 4 pixels, the control point can be understood as a point for controlling the generation of the contour line, each control point forms the contour line, and adjusting the control point is also the adjustment of the contour line.
In the present embodiment, the control points are adjusted and then smoothed, so that the smoothness of the obtained cutting line is good, and the cutter is less jammed when cutting a pattern from a flexible material based on the cutting line.
After the cutting line is obtained in S104, the cutter may cut a pattern from the flexible material according to the cutting line to obtain a certain shape of clothing or shoe pattern, etc. The knife may be a laser knife or other types of knives, and is not limited.
By applying the embodiment of the invention, an integral template and a local template are generated in advance, wherein the integral template is a template generated based on a pattern to be cut, and the local template is a template generated based on a part of pattern in the pattern to be cut; matching the integral template with the image, determining a matching position in the image according to a matching result, and obtaining a contour line of the integral template when the integral template is positioned at the matching position as a contour line to be processed; the image area at the matching position can be understood as a pattern to be cut, the image area is matched with the local template, and the contour line to be processed is adjusted based on the matching result to obtain a cutting line; therefore, according to the scheme, the contour line template is not generated in advance, the cutting line which is consistent with the pattern to be cut in the image is generated through template matching twice, and even if the flexible material is deformed, the cutting line still reflects the contour of the pattern to be cut, so that the accurate cutting line is generated.
Since flexible materials are generally easy to deform, in some related schemes, various deformed contour line templates are generated in advance, and corresponding clothes or shoe patterns are cut out of the flexible materials based on the deformed contour line templates. However, flexible materials are deformed in various ways, and if the scheme is adopted, various templates need to be generated in advance, so that the cost is high. In the scheme, the whole template and the local template are generated in advance, and compared with the production of various deformed templates, the cost is reduced.
Fig. 3 is a second flowchart of the cutting line generating method according to the embodiment of the present invention, including:
step 301: making an integral template of a pattern to be cut, and making a local template for at least one local area of the pattern to be cut;
step 302: shooting a picture of a flexible material containing a pattern to be cut at present;
step 303: superposing the integral template in a shot picture for position matching, and matching the integral template with a pattern to be cut in the picture;
step 304: superposing a local template in a shot picture for position matching, matching the local template with a local area of a pattern to be cut in the picture, and adjusting a local contour to match the local template with the edge of the local area of the pattern to be cut;
step 305: and smoothing the contour line of the integral template and the contour line of the adjusted local template to obtain a cutting line of the pattern to be cut on the flexible material.
In the embodiment of the invention, a rough contour line is obtained based on an integral template, and then the rough contour line is adjusted based on a local template to obtain a cutting line; the specific implementation manner may be that, in fig. 3, the contour line of the entire template and the contour line of the adjusted local template are fused and smoothed to obtain the cutting line.
In fig. 3, local contour adjustment is performed first, and then the contour line of the whole template is fused with the contour line of the adjusted local template, which may be equivalent to that in the above embodiment, for each local template, the local template is matched with the image area at the position where the local template is located, and the displacement deviation corresponding to the local template is determined according to the matching result; and adjusting the contour line to be processed according to the displacement deviation corresponding to each local template to obtain the cutting line.
Optionally, step 303 may include:
and searching the integral template by the model, preliminarily matching the position of the pattern, and properly adjusting by controlling the similarity of the pattern matched with the integral template so as to realize more stable rough positioning. The model search is explained as follows: the template is obtained based on image area modeling, the template can comprise contour information and content information of the pattern, and the matching template in the image is the contour information and the content information of the matching template.
Or, the contour searches the whole template, preliminarily matches the pattern position, and properly adjusts by controlling the similarity of matching the whole template so as to realize more stable rough positioning. The profile search is explained as follows: the template comprises the contour information of the pattern, and the matching template in the image is the contour information of the matching template.
Optionally, step 304 may include:
the method comprises the steps of searching a local template by levels, grading the whole template to the local template layer by layer, translating and rotating the local template to a candidate position of the whole template, enabling the local template in the template to fall on a target position subjected to rough positioning, matching the levels of the local template one by one, and finding an optimal matching position;
or, searching a local template through the characteristics without uniformity, searching patterns near the local template through the characteristics, translating and rotating the local template to the candidate position of the whole template, enabling the local template in the template to fall on the target position subjected to rough positioning, matching the patterns near the corresponding position of the local template one by one, and searching for the optimal matching position;
or directly searching a local template, translating and rotating the local template to the candidate position of the whole template, directly searching the local template in the template to find the optimal matching position, wherein the local template in the template falls on the target position subjected to rough positioning.
Optionally, in the process of searching for the local template without feature uniformity, an image of a certain area may be selected as a feature area for template matching, for example, the feature area is selected by a rectangular frame, the feature area is selected by a contour line enclosure, or the feature area is formed based on contour line expansion/contraction.
Optionally, the local template may be located inside the overall template or outside the overall template, the local template arrangement mode may be rectangular arrangement or trapezoidal arrangement, and the specific arrangement mode is not limited.
Alternatively, the characteristics of the global template and the local template may be expressed by cubic spline functions.
Fig. 4 is a schematic flow chart of a third method for generating a cut line according to an embodiment of the present invention, including:
step 401: firstly, acquiring an image of a clothing material, and displaying the image in a software CAD (Computer Aided Design) interactive environment;
step 402: loading the contour line into a CAD environment;
step 403: aligning the contour lines with the pattern;
step 404: selecting one or more image areas as characteristic areas matched with the template;
step 405: establishing an integral template based on the characteristic region;
the entire area of the pattern may be used as a feature area in step 404, based on which an overall template of the pattern may be created. Step 404 may also divide the pattern into a plurality of regions, and use these regions as a plurality of feature regions, based on which an overall template of the pattern may also be established.
Step 406: the method comprises the following steps that a certain rule is arranged around control points (such as control points of a spline function) along a contour line, for example, the control points are symmetrical to a certain width, small areas are divided into certain lengths, local templates are obtained through division, and the positions of the control points and the positions of the local templates in the small areas are recorded;
step 407: storing the whole template and the local template;
in the embodiment shown in fig. 4, the partial template is a part of the overall template.
Step 408: a camera shoots an image of a flexible material to be positioned;
step 409: searching the whole template by the whole image to preliminarily match the pattern position. The matching similarity is controlled and properly adjusted to realize more stable coarse positioning (x, y, theta); x and y represent the abscissa and ordinate in the image coordinate system, and θ represents the rotation angle.
Step 410: translating, rotating (and scaling, if necessary) the template to the candidate location; the local template falls on the candidate position subjected to rough positioning;
step 411: matching the patterns of the local template near the corresponding positions one by one, and searching for an optimal matching position;
step 412: based on the matching result of the local template, carrying out fusion and smoothing treatment on the contour red of the whole template;
step 413: the processed profile is obtained as a cutting line.
Optionally, the step 409 may include:
and searching the integral template by the model, preliminarily matching the position of the pattern, and properly adjusting by controlling the similarity of the pattern matched with the integral template so as to realize more stable rough positioning. The model search is explained as follows: the template is obtained based on image area modeling, the template can comprise contour information and content information of the pattern, and the matching template in the image is the contour information and the content information of the matching template.
Or searching the outline of the whole template, preliminarily matching the position of the pattern, and properly adjusting by controlling the similarity of the outline of the matched whole template so as to realize more stable rough positioning. In this embodiment, a model search is used to search the entire template. The profile search is explained as follows: the template comprises the contour information of the pattern, and the matching template in the image is the contour information of the matching template.
Optionally, the matching manner of the local template and the local edge of the pattern to be cut in step 410 and step 411 may include:
the method comprises the steps of searching a local template by levels, grading the whole template to the local template layer by layer, translating and rotating the local template to a candidate position of the whole template, enabling the local template in the template to fall on a target position subjected to rough positioning, matching the levels of the local template one by one, and finding an optimal matching position;
or, searching a local template through the characteristics without uniformity, searching patterns near the local template through the characteristics, translating and rotating the local template to the candidate position of the whole template, enabling the local template in the template to fall on the target position subjected to rough positioning, matching the patterns near the corresponding position of the local template one by one, and searching for the optimal matching position;
or directly searching a local template, translating and rotating the local template to the candidate position of the whole template, directly searching the local template in the template to find the optimal matching position, wherein the local template in the template falls on the target position subjected to rough positioning.
Optionally, in the process of searching for the local template without feature uniformity, an image of a certain area may be selected as a feature area for template matching, for example, the feature area is selected by a rectangular frame, the feature area is selected by a contour line enclosure, or the feature area is formed based on contour line expansion/contraction.
Optionally, the local template may be located inside the overall template or outside the overall template, the local template arrangement mode may be rectangular arrangement or trapezoidal arrangement, and the specific arrangement mode is not limited.
Alternatively, the characteristics of the global template and the local template may be expressed by cubic spline functions.
It can be seen from the above embodiments that, on the basis of primarily matching the profile, secondary correction is performed through local features around the profile, so that elastic deformation of the profile is accurately positioned, the high-precision requirement of a high-end brand is met, and the user friendliness is improved.
Corresponding to the above method embodiment, an embodiment of the present invention further provides a cutting line generating device, as shown in fig. 5, including:
a first obtaining module 501, configured to obtain an image acquired for a flexible material as an image to be processed, where the flexible material includes a pattern to be cut;
a first matching module 502, configured to match a preset integral template with the image to be processed, and determine a matching position in the image to be processed according to a matching result; the integral template is generated based on a pattern to be cut;
an obtaining module 503, configured to obtain a contour line when the overall template is located at the matching position, as a contour line to be processed;
a second matching module 504, configured to match a preset local template with the image area at the matching position, and adjust the contour line to be processed based on a matching result to obtain a cutting line; wherein the local template is a template generated based on a part of patterns in the pattern to be cut; the relative position relationship between the local template and the whole template is fixed.
As an embodiment, the apparatus further comprises:
an adjusting module (not shown in the figure) for adjusting the whole template at the matching position until the contact ratio of the whole template and the image area at the matching position meets a preset condition, so as to obtain an adjusted whole template;
the obtaining module 503 is specifically configured to: and obtaining the contour line of the adjusted integral template as the contour line to be processed.
As an embodiment, the adjusting module is specifically configured to: and adjusting the integral template at the matching position by any one or more of the following items: adjusting position, angle and size.
As an implementation manner, the second matching module 504 is specifically configured to:
aiming at each local template, matching the local template with the image area at the position of the local template, and determining the displacement deviation corresponding to the local template according to the matching result;
and adjusting the contour line to be processed according to the displacement deviation corresponding to each local template to obtain the cutting line.
As an embodiment, the second matching module 504 is further configured to:
aiming at each local template, adjusting the control point corresponding to the local template according to the displacement deviation corresponding to the local template;
and smoothing each adjusted control point to obtain a cutting line consisting of each smoothed control point.
As an embodiment, the apparatus further comprises: a second obtaining module, a first determining module, a second determining module, and a first modeling module (not shown in the figure), wherein,
the second acquisition module is used for acquiring an image acquired aiming at the pattern to be cut as a template image;
the first determining module is used for determining the position of the pattern to be cut in the template image as a position to be processed;
a second determining module, configured to determine a region to be processed in the template image based on the position to be processed;
and the first modeling module is used for modeling based on the area to be processed to obtain the whole template.
As an embodiment, the second determining module is specifically configured to:
generating a frame of a preset shape at the position to be processed; determining an inner area of the frame as an area to be processed;
or identifying the edge line of the pattern to be cut at the position to be processed, and determining the inner area of the edge line as the area to be processed;
or identifying the edge line of the pattern to be cut at the position to be processed, performing external expansion on the edge line, and determining the internal area of the externally expanded edge line as the area to be processed;
or identifying the edge line of the pattern to be cut at the position to be processed, carrying out retraction on the edge line, and determining the internal area of the retracted edge line as the area to be processed.
As an embodiment, the apparatus further comprises: a third determination module and a second modeling module (not shown), wherein,
a third determining module, configured to sequentially determine a plurality of local regions in the region to be processed along the control point in the contour line of the integral template;
and the second modeling module is used for respectively modeling based on each determined local area to obtain a plurality of local templates.
The apparatus of the foregoing embodiment is used to implement the corresponding method in the foregoing embodiment, and has the beneficial effects of the corresponding method embodiment, which are not described herein again.
An embodiment of the present invention further provides an electronic device, as shown in fig. 6, which includes a memory 602, a processor 601, and a computer program stored on the memory 602 and capable of running on the processor 601, where when the processor 601 executes the program, any of the above-mentioned cutting line generation methods is implemented.
The electronic device may be an image processing device, a cutting device, or the like, and is not limited in particular.
Embodiments of the present invention also provide a non-transitory computer-readable storage medium storing computer instructions for causing a computer to execute any of the above-described cutting line generation methods.
Those of ordinary skill in the art will understand that: the discussion of any embodiment above is meant to be exemplary only, and is not intended to intimate that the scope of the disclosure, including the claims, is limited to these examples; within the idea of the invention, also features in the above embodiments or in different embodiments may be combined, steps may be implemented in any order, and there are many other variations of the different aspects of the invention as described above, which are not provided in detail for the sake of brevity.
In addition, well known power/ground connections to Integrated Circuit (IC) chips and other components may or may not be shown within the provided figures for simplicity of illustration and discussion, and so as not to obscure the invention. Furthermore, devices may be shown in block diagram form in order to avoid obscuring the invention, and also in view of the fact that specifics with respect to implementation of such block diagram devices are highly dependent upon the platform within which the present invention is to be implemented (i.e., specifics should be well within purview of one skilled in the art). Where specific details (e.g., circuits) are set forth in order to describe example embodiments of the invention, it should be apparent to one skilled in the art that the invention can be practiced without, or with variation of, these specific details. Accordingly, the description is to be regarded as illustrative instead of restrictive.
While the present invention has been described in conjunction with specific embodiments thereof, many alternatives, modifications, and variations of these embodiments will be apparent to those of ordinary skill in the art in light of the foregoing description. For example, other memory architectures (e.g., dynamic ram (dram)) may use the discussed embodiments.
The embodiments of the invention are intended to embrace all such alternatives, modifications and variances that fall within the broad scope of the appended claims. Therefore, any omissions, modifications, substitutions, improvements and the like that may be made without departing from the spirit and principles of the invention are intended to be included within the scope of the invention.

Claims (16)

1. A cut line generation method, characterized by comprising:
acquiring an image acquired aiming at a flexible material as an image to be processed, wherein the flexible material comprises a pattern to be cut;
matching a preset integral template with the image to be processed, and determining a matching position in the image to be processed according to a matching result; the integral template is generated based on a pattern to be cut;
obtaining the contour line of the integral template at the matching position as the contour line to be processed;
matching a preset local template with the image area at the matching position, and adjusting the contour line to be processed based on the matching result to obtain a cutting line; wherein the local template is a template generated based on a part of patterns in the pattern to be cut; the relative position relationship between the local template and the whole template is fixed.
2. The method according to claim 1, wherein after the matching a preset overall template with the image to be processed and determining a matching position in the image to be processed according to a matching result, the method further comprises:
adjusting the integral template at the matching position until the contact ratio of the integral template and the image area at the matching position meets a preset condition to obtain an adjusted integral template;
obtaining a contour line when the whole template is located at the matching position, and taking the contour line as a contour line to be processed, wherein the contour line comprises the following steps:
and obtaining the contour line of the adjusted integral template as the contour line to be processed.
3. The method of claim 2, wherein the adjusting the overall template at the matching location comprises:
and adjusting the integral template at the matching position by any one or more of the following items: adjusting position, angle and size.
4. The method according to claim 3, wherein the matching a preset local template with the image area at the matching position and adjusting the contour line to be processed based on the matching result to obtain a cutting line comprises:
aiming at each local template, matching the local template with the image area at the position of the local template, and determining the displacement deviation corresponding to the local template according to the matching result;
and adjusting the contour line to be processed according to the displacement deviation corresponding to each local template to obtain the cutting line.
5. The method according to claim 4, wherein the contour line to be processed comprises a plurality of control points; according to the displacement deviation corresponding to each local template, the contour line to be processed is adjusted to obtain a cutting line, and the method comprises the following steps:
aiming at each local template, adjusting the control point corresponding to the local template according to the displacement deviation corresponding to the local template;
and smoothing each adjusted control point to obtain a cutting line consisting of each smoothed control point.
6. The method of claim 1, wherein the monolithic template is generated by:
acquiring an image acquired aiming at a pattern to be cut as a template image;
determining the position of the pattern to be cut in the template image as a position to be processed;
determining a region to be processed in the template image based on the position to be processed;
and modeling based on the area to be processed to obtain the integral template.
7. The method of claim 6, wherein determining a region to be processed in the template image based on the location to be processed comprises:
generating a frame of a preset shape at the position to be processed; determining an inner area of the frame as an area to be processed;
or identifying the edge line of the pattern to be cut at the position to be processed, and determining the inner area of the edge line as the area to be processed;
or identifying the edge line of the pattern to be cut at the position to be processed, performing external expansion on the edge line, and determining the internal area of the externally expanded edge line as the area to be processed;
or identifying the edge line of the pattern to be cut at the position to be processed, carrying out retraction on the edge line, and determining the internal area of the retracted edge line as the area to be processed.
8. The method of claim 6, wherein the local template is generated by:
sequentially determining a plurality of local areas in the area to be processed along the control points in the contour line of the integral template;
and respectively modeling based on each determined local area to obtain a plurality of local templates.
9. A cut line generating device, characterized by comprising:
the device comprises a first acquisition module, a second acquisition module and a processing module, wherein the first acquisition module is used for acquiring an image acquired aiming at a flexible material as an image to be processed, and the flexible material comprises a pattern to be cut;
the first matching module is used for matching a preset integral template with the image to be processed and determining a matching position in the image to be processed according to a matching result; the integral template is generated based on a pattern to be cut;
the obtaining module is used for obtaining the contour line of the integral template when the integral template is positioned at the matching position and taking the contour line as a contour line to be processed;
the second matching module is used for matching a preset local template with the image area at the matching position and adjusting the contour line to be processed based on the matching result to obtain a cutting line; wherein the local template is a template generated based on a part of patterns in the pattern to be cut; the relative position relationship between the local template and the whole template is fixed.
10. The apparatus of claim 9, further comprising:
the adjusting module is used for adjusting the whole template at the matching position until the contact ratio of the whole template and the image area at the matching position meets a preset condition, so that the adjusted whole template is obtained;
the obtaining module is specifically configured to: and obtaining the contour line of the adjusted integral template as the contour line to be processed.
11. The apparatus of claim 10, wherein the adjustment module is specifically configured to: and adjusting the integral template at the matching position by any one or more of the following items: adjusting position, angle and size.
12. The apparatus of claim 11, wherein the second matching module is specifically configured to:
aiming at each local template, matching the local template with the image area at the position of the local template, and determining the displacement deviation corresponding to the local template according to the matching result;
and adjusting the contour line to be processed according to the displacement deviation corresponding to each local template to obtain the cutting line.
13. The apparatus of claim 12, wherein the second matching module is further configured to:
aiming at each local template, adjusting the control point corresponding to the local template according to the displacement deviation corresponding to the local template;
and smoothing each adjusted control point to obtain a cutting line consisting of each smoothed control point.
14. The apparatus of claim 9, further comprising:
the second acquisition module is used for acquiring an image acquired aiming at the pattern to be cut as a template image;
the first determining module is used for determining the position of the pattern to be cut in the template image as a position to be processed;
a second determining module, configured to determine a region to be processed in the template image based on the position to be processed;
and the first modeling module is used for modeling based on the area to be processed to obtain the whole template.
15. The apparatus of claim 14, wherein the second determining module is specifically configured to:
generating a frame of a preset shape at the position to be processed; determining an inner area of the frame as an area to be processed;
or identifying the edge line of the pattern to be cut at the position to be processed, and determining the inner area of the edge line as the area to be processed;
or identifying the edge line of the pattern to be cut at the position to be processed, performing external expansion on the edge line, and determining the internal area of the externally expanded edge line as the area to be processed;
or identifying the edge line of the pattern to be cut at the position to be processed, carrying out retraction on the edge line, and determining the internal area of the retracted edge line as the area to be processed.
16. The apparatus of claim 14, further comprising:
a third determining module, configured to sequentially determine a plurality of local regions in the region to be processed along the control point in the contour line of the integral template;
and the second modeling module is used for respectively modeling based on each determined local area to obtain a plurality of local templates.
CN201910667543.1A 2018-07-27 2019-07-23 Cutting line generation method and device Pending CN110781907A (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201810844021X 2018-07-27
CN201810844021 2018-07-27

Publications (1)

Publication Number Publication Date
CN110781907A true CN110781907A (en) 2020-02-11

Family

ID=69383895

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910667543.1A Pending CN110781907A (en) 2018-07-27 2019-07-23 Cutting line generation method and device

Country Status (1)

Country Link
CN (1) CN110781907A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112021731A (en) * 2020-09-11 2020-12-04 东莞市爱玛数控科技有限公司 Vamp cutter changing method and system based on visual recognition technology
CN116071429A (en) * 2023-03-29 2023-05-05 天津市再登软件有限公司 Method and device for identifying outline of sub-pattern, electronic equipment and storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030118229A1 (en) * 2001-12-10 2003-06-26 Andrews Randall G. System for cutting shapes preset in a continuous stream of sheet material
JP2005346232A (en) * 2004-06-01 2005-12-15 Matsushita Electric Ind Co Ltd Pattern matching method, pattern matching device, and electronic component mounting method
CN102501714A (en) * 2011-10-26 2012-06-20 尹昭曦 Three-dimensional wall sticker
CN206652889U (en) * 2017-01-06 2017-11-21 东莞市新亮点自动化设备科技有限公司 A kind of diel in resistor disc riveting press
CN107433628A (en) * 2017-09-15 2017-12-05 佛山世科智能技术有限公司 A kind of cutter head and implementation method with visual identity positioning

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030118229A1 (en) * 2001-12-10 2003-06-26 Andrews Randall G. System for cutting shapes preset in a continuous stream of sheet material
JP2005346232A (en) * 2004-06-01 2005-12-15 Matsushita Electric Ind Co Ltd Pattern matching method, pattern matching device, and electronic component mounting method
CN102501714A (en) * 2011-10-26 2012-06-20 尹昭曦 Three-dimensional wall sticker
CN206652889U (en) * 2017-01-06 2017-11-21 东莞市新亮点自动化设备科技有限公司 A kind of diel in resistor disc riveting press
CN107433628A (en) * 2017-09-15 2017-12-05 佛山世科智能技术有限公司 A kind of cutter head and implementation method with visual identity positioning

Non-Patent Citations (4)

* Cited by examiner, † Cited by third party
Title
"纺织品图案主结构的快速提取方法", 《纺织学报》, vol. 39, no. 4, 15 April 2018 (2018-04-15), pages 137 - 143 *
PETER MAHLER LARSEN等: "Robust structural identification via polyhedral template matching", 《ARXIV》, 18 April 2016 (2016-04-18), pages 1 - 20 *
魏艳艳: "主动搜索耦合图案匹配的PCB板基准点识别算法", 《计算技术与自动化》, vol. 35, no. 4, 15 December 2016 (2016-12-15), pages 71 - 75 *
黄胜: "裁割机中圆Mark点定位技术的研究与应用", 《中国优秀硕士学位论文全文数据库 (信息科技辑)》, no. 3, 15 March 2018 (2018-03-15), pages 138 - 1775 *

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112021731A (en) * 2020-09-11 2020-12-04 东莞市爱玛数控科技有限公司 Vamp cutter changing method and system based on visual recognition technology
CN116071429A (en) * 2023-03-29 2023-05-05 天津市再登软件有限公司 Method and device for identifying outline of sub-pattern, electronic equipment and storage medium
CN116071429B (en) * 2023-03-29 2023-06-16 天津市再登软件有限公司 Method and device for identifying outline of sub-pattern, electronic equipment and storage medium

Similar Documents

Publication Publication Date Title
US9785819B1 (en) Systems and methods for biometric image alignment
US20200167595A1 (en) Information detection method, apparatus, and device
EP3690700A1 (en) Image similarity calculation method and device, and storage medium
CN108381549B (en) Binocular vision guide robot rapid grabbing method and device and storage medium
US20230252664A1 (en) Image Registration Method and Apparatus, Electronic Apparatus, and Storage Medium
US20240096123A1 (en) Methods and apparatus for testing multiple fields for machine vision
CN107240130B (en) Remote sensing image registration method, device and system
US10977767B2 (en) Propagation of spot healing edits from one image to multiple images
WO2021051868A1 (en) Target location method and apparatus, computer device, computer storage medium
CN110781907A (en) Cutting line generation method and device
CN112085033A (en) Template matching method and device, electronic equipment and storage medium
US7941008B2 (en) Pattern search method
TW202105237A (en) Method and device for joint point detection
JP2004012429A (en) Self-position/attitude identification device and self-position/attitude identification method
CN103995864A (en) Image retrieval method and device
CN107423738A (en) A kind of paper topic localization method and device based on template matches
US20150235399A1 (en) Variable Patch Shape Synthesis
CN116881515B (en) Method and electronic equipment for comparing capacitance results solved by different algorithms
JP2010029958A (en) Apparatus, method and program for extracting contour
WO2020209046A1 (en) Object detection device
US20150125069A1 (en) Method and system for wafer alignment
US20110150339A1 (en) Apparatus, method, and program for image processing
CN111178266A (en) Method and device for generating face key points
JP2010204837A (en) Featured value extraction device
JP2001148014A (en) Method of automatically deciding template pattern

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination