CN112881408A - Visual inspection camera system with automatic tracking workpiece foreign matter light supplementing structure and method - Google Patents

Visual inspection camera system with automatic tracking workpiece foreign matter light supplementing structure and method Download PDF

Info

Publication number
CN112881408A
CN112881408A CN202110056215.5A CN202110056215A CN112881408A CN 112881408 A CN112881408 A CN 112881408A CN 202110056215 A CN202110056215 A CN 202110056215A CN 112881408 A CN112881408 A CN 112881408A
Authority
CN
China
Prior art keywords
component
assembly
workpiece
turntable
camera
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202110056215.5A
Other languages
Chinese (zh)
Other versions
CN112881408B (en
Inventor
罗时帅
钱根
柳洪哲
朱文兵
钱曙光
汪炉生
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Rongcheer Industrial Technology Suzhou Co ltd
Original Assignee
Rongcheer Industrial Technology Suzhou Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Rongcheer Industrial Technology Suzhou Co ltd filed Critical Rongcheer Industrial Technology Suzhou Co ltd
Priority to CN202110056215.5A priority Critical patent/CN112881408B/en
Publication of CN112881408A publication Critical patent/CN112881408A/en
Application granted granted Critical
Publication of CN112881408B publication Critical patent/CN112881408B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/84Systems specially adapted for particular applications
    • G01N21/88Investigating the presence of flaws or contamination
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/01Arrangements or apparatus for facilitating the optical investigation

Landscapes

  • Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Chemical & Material Sciences (AREA)
  • Analytical Chemistry (AREA)
  • Biochemistry (AREA)
  • General Health & Medical Sciences (AREA)
  • General Physics & Mathematics (AREA)
  • Immunology (AREA)
  • Pathology (AREA)
  • Investigating Materials By The Use Of Optical Means Adapted For Particular Applications (AREA)

Abstract

The invention discloses a visual inspection camera system with an automatic workpiece foreign matter tracking and light supplementing structure and a method, the visual inspection camera system comprises a logistics line assembly, a feeding and discharging assembly, a visual inspection assembly, an NG assembly and a rack assembly, wherein the logistics line assembly is located on the front side of the upper surface of the rack assembly, the logistics line assembly is fixedly connected with the upper surface of the rack assembly, the feeding and discharging assembly is located behind the logistics line assembly, the bottom of the feeding and discharging assembly is installed on a cross beam inside the rack assembly, the middle part and the bottom of the visual inspection assembly are connected with the rack assembly, the visual inspection position is the upper surface and the lower surface of a workpiece, the NG assembly is located on one side of the rear of the logistics line assembly, the bottom of the NG assembly is connected with the top of the. The workpiece enters the equipment from the logistics line assembly, the material is taken by the feeding and discharging assembly and is placed below the visual detection assembly for detection, the unqualified product is placed into the NG assembly by the feeding and discharging assembly after detection, and the qualified product is placed back to the logistics line assembly.

Description

Visual inspection camera system with automatic tracking workpiece foreign matter light supplementing structure and method
Technical Field
The invention relates to the technical field of automation, in particular to a visual inspection camera system with a light supplementing structure for automatically tracking foreign matters of a workpiece and a method.
Background
CCD visual inspection has extensive application prospect in the automation technology field, compare in traditional artifical detection mode, CCD visual inspection has that detection accuracy is high, check-out time is short and labour cost low grade advantage, visual inspection system has gradually become automation equipment's eyes, but traditional visual inspection equipment lacks the mark to unqualified product after detecting, mostly all adopt the inside sequencing of system to confirm unqualified product position, this kind of judgement mode appears the confusion easily when rebooting again after system fault shuts down. On the other hand, when the traditional equipment is used for visual detection, the workpiece needs to stay at the visual detection station for a certain time, and the detection mode influences the working efficiency to a certain extent.
Disclosure of Invention
The invention aims to provide a visual inspection camera system with a light supplement structure for automatically tracking foreign matters on a workpiece and a method thereof, so as to solve the problems in the background technology.
In order to solve the technical problems, the invention provides the following technical scheme: the visual inspection camera system with the light supplementing structure for automatically tracking the foreign matters on the workpiece comprises a logistics line assembly, a feeding and discharging assembly, a visual inspection assembly, an NG assembly and a rack assembly, the material flow line component is positioned at the front side of the upper surface of the rack component, the material flow line component is fixedly connected with the upper surface of the rack component, the feeding and discharging assembly is positioned behind the logistics line assembly, the bottom of the feeding and discharging assembly is arranged on a cross beam in the rack assembly, the middle part and the bottom of the visual detection assembly are connected with the rack assembly, the visual detection position is the upper surface and the lower surface of the workpiece, the NG assembly is positioned on one side behind the logistics line assembly, the bottom of the bracket is connected with the top of the rack component, the NG component is used for receiving defective products rejected by the feeding and discharging component, the visual detection assembly comprises a foreign matter light supplementing component, the foreign matter light supplementing component is installed on the feeding and discharging assembly, and the light irradiation positions of the foreign matter light supplementing component correspond to the upper surface and the lower surface of each workpiece. The workpiece enters the equipment from the logistics line assembly, the material is taken by the feeding and discharging assembly and is placed below the visual detection assembly for detection, the unqualified product is placed into the NG assembly by the feeding and discharging assembly after detection, and the qualified product is placed back to the logistics line assembly. According to the visual detection assembly, the foreign matter light supplementing component is used for tracking and supplementing light to the detected unqualified workpiece, and the color code of reflected light of the unqualified workpiece is changed, so that the unqualified product is marked, and the probability of NG misjudgment is reduced. Meanwhile, the camera of the invention synchronously rotates with the turntable in the detection process, so that the workpiece does not need to be kept static in the detection process, and the production efficiency is greatly improved.
The foreign matter light supplementing component corresponds to each workpiece position on the rotary table, 6 foreign matter light supplementing components are respectively installed on the upper and lower parts of the rotary table, when a workpiece is placed on the rotary table, the corresponding upper and lower foreign matter light supplementing components irradiate the upper and lower surfaces of the workpiece to ensure that the CCD camera component can shoot clear pictures, when the shot pictures are compared with template pictures, the light supplementing of the foreign matter light supplementing component is stopped if the workpiece is qualified, when the workpiece reaches the position of the feeding manipulator, a color code sensor on the manipulator detects that the color of the reflected light of the workpiece is beyond a set value and belongs to a qualified product, the feeding manipulator places the workpiece on a tray of a material discharge streamline, when the shot pictures are unqualified compared with the template pictures, the foreign matter is determined, the foreign matter light supplementing device continues supplementing light, the light supplementing device irradiates the surface of the workpiece, the color code of the reflected light is changed, and the color code sensor detects, and the blanking manipulator puts the workpiece on the NG component.
Further, the material flow line assembly comprises a material taking material flow line, a transfer material flow line and a material discharging material flow line, the material taking material flow line comprises an input motor, a synchronous belt pulley, a driving shaft, a conveying synchronous belt, a material flow support frame, a jacking cylinder, a tray support table, a flange cylinder, a limiting cylinder, a guide pin lifting cylinder and a guide pin, the input motor, the jacking cylinder, the bottom of the material flow support frame and the upper surface of a table plate of the frame assembly are fixedly connected, an output wheel of the input motor is driven by the synchronous belt and the synchronous belt pulley on the driving shaft, two ends of the driving shaft are arranged on the material flow support frame, two synchronous belt pulleys are further arranged at two ends of the driving shaft and are driven by the material flow synchronous belt and the two synchronous belt pulleys on the material flow support frame, the top of the jacking cylinder is fixedly, spacing cylinder installs on logistics line support frame afterbody horizontal bar, and flange cylinder and uide pin lift cylinder are installed on logistics line support frame both sides baffle, and wherein the flange cylinder is horizontal installation, and uide pin lift cylinder is vertical installation, the uide pin is installed at uide pin lift cylinder top, the blowing material logistics line is the same with getting material logistics line structure, and the transit logistics line lacks uide pin lift cylinder and uide pin, and other structures are also the same with getting material logistics line. The material taking logistics line is provided with a tray which is being loaded, the transfer logistics line is provided with a tray which is completely loaded before, and the material discharging logistics line is provided with a tray which is being discharged. When the tray is put on the logistics line, the input motor can drive the driving shaft to rotate, the driving shaft drives synchronous pulley to rotate, the transportation synchronous belt starts to operate, the drive tray advances on the logistics line, the limiting block of spacing cylinder can be touch to the in-process that the tray advances and then the stop motion, the jacking cylinder of bottom side stretches out and holds up a supporting bench of tray this moment, the flange cylinder of both sides stretches out, prescribe a limit to the tray position, guide pin lift cylinder withdrawal, the guide pin descends, carry out the secondary location to the tray, in order to ensure that the manipulator can be accurate snatch the work piece.
Furthermore, go up unloading subassembly and include material loading manipulator, unloading manipulator and carousel part, material loading manipulator and unloading manipulator bottom are installed at rack assembly platen upper surface, carousel part bottom is installed on the inside crossbeam of rack assembly, and material loading manipulator and unloading manipulator are located carousel part both sides respectively. The movement track of manipulator has programmability, and when the carousel lasts to rotate, the manipulator can keep manipulator and carousel part static relatively according to the rotation track motion of carousel, and the manipulator also can go up unloading operation under the circumstances that the carousel does not stop like this, the improvement of very big degree work efficiency.
Furthermore, the turntable component comprises a turntable motor, a speed reducer mounting seat, a coupling, a turntable shaft, an anti-loosening bearing nut, a disc spring, a thrust ball bearing, a bearing cushion block, a deep groove ball bearing, a turntable bearing seat, a turntable and a mounting groove, wherein the turntable motor is connected with the speed reducer, a speed reducer output shaft is connected with the turntable shaft through the coupling, the turntable shaft penetrates through the turntable bearing seat, the deep groove ball bearing, the bearing cushion block and the thrust ball bearing are sequentially mounted at two ends of the turntable bearing seat, the disc spring is further mounted at the side edge of the thrust ball bearing at the bottom side, the other side of the disc spring is propped against the anti-loosening bearing nut, the thrust ball bearing at the top side is propped against a positioning shaft shoulder of the turntable shaft, the deep groove ball bearing is contacted with a step inside the turntable shaft, the anti-loosening bearing nut is fixedly, the other end is fastened and connected with the lower side of a cross bar inside the frame assembly, a turntable bearing seat is fastened and connected with the upper side of a cross beam inside the frame assembly, the turntable is connected with the top of a turntable shaft, a mounting groove is mounted on the turntable, and the foreign matter light supplementing component is mounted on the upper surface and the lower surface of the turntable respectively. The turntable shaft axially bears the weight of the turntable during working and radially bears the centrifugal effect generated by rotation, so that a thrust ball bearing and a deep groove ball bearing are selectively arranged at two ends of the bearing mounting seat, the belleville spring can axially play a damping effect during vibration of the machine table, when a workpiece is placed in a mounting groove in the surface of the turntable, the input motor rotates to drive the turntable shaft to rotate, the turntable shaft drives the turntable to rotate, and the workpiece is conveyed to a subsequent processing station.
Furthermore, the visual inspection assembly further comprises a CCD camera component and a camera displacement component, the bottom and the middle of the camera displacement component are respectively fixed on the upper surface of the bottom plate of the frame assembly and the upper surface of the bedplate, and the CCD camera component is installed on the camera displacement component. The camera displacement component can drive the CCD camera component and the turntable to keep synchronous rotation, so that the time for stopping rotation of the workpiece for photographing is saved, and the working efficiency is improved.
Further, the CCD camera part includes CCD camera, camera lens fixed block, camera fixing base, CCD installation riser, riser adjusting device, axle connecting seat and linear guiding axle, CCD camera rear portion and camera fixing base fastening connection, CCD camera front-mounted are inside the camera lens fixed block, camera fixing base, camera lens fixed block and CCD installation riser fastening connection, riser adjusting device is installed to CCD installation riser dorsal part, riser adjusting device opposite side and axle connecting seat fastening connection, the axle connecting seat is installed on linear guiding axle, and the position of axle connecting seat on linear guiding axle is adjustable. The CCD camera component is provided with an upper camera and a lower camera in series on the same linear guide shaft, the upper surface and the lower surface of a workpiece can be detected simultaneously, and the distance between the cameras and the workpiece can be adjusted through a vertical plate adjusting device so as to obtain the optimal shooting distance.
Further, camera displacement part includes CCD connecting seat, ring gear, ring rail, annular slider, gear, servo motor and motor supporting seat, CCD connecting seat one end and ring gear upper surface fastening connect, and the other end is installed on linear guiding axle to lock through the bolt, annular slider is installed to the ring gear bottom, and annular slider installs on ring rail, a set of installation of ring rail is in rack subassembly mesa top and mesa fastening connection, and another group installs on the rack subassembly bottom plate with bottom plate fastening connection, the motor supporting seat has two, installs respectively on rack subassembly mesa and bottom plate, motor supporting seat upper portion and servo motor afterbody fastening connection, install the gear through the key-type connection on the servo motor output shaft, the gear meshes with the rack part of ring gear. When the carousel part rotates, servo motor drives the gear and rotates, gear and ring gear meshing drive the ring gear and rotate on ring rail, the rotational speed through adjusting servo motor can guarantee that ring gear pivoted speed is the same with the carousel, thereby it is static relatively to realize camera and work piece, the camera shoots with a beat of work piece syntony, next beat motor reversal camera gets back to initial position, two new work pieces are changeed two sets of camera belows again, can realize through this kind of working method that the carousel lasts to rotate the camera also can shoot smoothly, very big improvement the work efficiency of equipment.
Further, the NG subassembly is including supporting panel beating, drawer slide rail, charging tray drawer, NG charging tray, spherical mounting panel and the spherical knot of detaining, support panel beating bottom and frame subassembly platen top fastening connection, drawer slide rail one side and support panel beating top side fastening connection, charging tray drawer below side and drawer slide rail opposite side fastening connection, the NG charging tray is placed in charging tray drawer top, and the NG charging tray all is injectd to the stopper in all directions position, the spherical mounting panel bottom and the frame subassembly platen fastening connection of detaining, the spherical end of detaining is installed on the charging tray drawer, detains the end and installs at spherical mounting panel top side of detaining. When the NG workpiece is filled with a material tray, the material tray drawer is pulled, the spherical buckle is opened, the material tray drawer is drawn out along the drawer slide rail, the slide rail is placed into the slide groove after the NG product is emptied, the material tray drawer is pushed, the spherical buckle is buckled again, the NG material tray returns to the initial position again, and the NG workpiece can be received again.
Further, the detection method of the visual detection camera system with the light supplement structure for automatically tracking the foreign matters on the workpiece comprises the following steps:
step 1, the workpiece is driven by the turntable component to continuously rotate, the foreign matter light supplementing component supplements light to the upper surface and the lower surface of the workpiece, and the CCD camera component is driven by the camera displacement component to keep synchronous rotation speed with the workpiece for shooting.
And 2, after photographing and comparison, the foreign matter light supplementing component corresponding to the qualified product stops supplementing light, and the foreign matter light supplementing component corresponding to the unqualified product continues supplementing light to change the color code of the surface reflected light of the unqualified product.
And 3, determining whether the workpiece is qualified or not according to the color code of the reflected light on the surface of the workpiece by a color code sensor arranged on the blanking manipulator, putting the unqualified product into an NG (natural gas) emptying part, and putting the qualified product back into a workpiece tray on the logistics line.
Compared with the prior art, the invention has the following beneficial effects: according to the invention, the NG products are supplemented with light through the foreign matter light supplementing device to change the color code of reflected light of the NG products, so that the NG products can be identified when the manipulator discharges the materials, the accuracy of the system is improved, meanwhile, the turntable does not stop rotating in the detection process by adopting a mode that a CCD camera part and the turntable synchronously rotate, and the overall working efficiency of the equipment is greatly improved.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the principles of the invention and not to limit the invention. In the drawings:
FIG. 1 is a schematic view of the overall structure of the present invention;
FIG. 2 is a top view of the assembly of the logistics line of the present invention;
FIG. 3 is a front view of the assembly of the logistics line of the present invention;
FIG. 4 is a partial cross-sectional view of the turntable assembly of the present invention;
FIG. 5 is an enlarged partial view of the turntable assembly of the present invention;
FIG. 6 is a schematic view of the overall structure of the visual inspection assembly of the present invention;
FIG. 7 is a front view of a CCD camera assembly of the present invention;
FIG. 8 is a top view of the camera displacement component of the present invention;
FIG. 9 is a left side view of the camera displacement component of the present invention;
FIG. 10 is a schematic view of the overall configuration of the NG assembly of the present invention;
FIG. 11 is a bottom view of the NG assembly of the present invention;
in the figure: 1-logistics line assembly, 11-input motor, 12-synchronous belt, 13-synchronous belt pulley, 14-driving shaft, 15-transportation synchronous belt, 16-logistics support frame, 17-jacking cylinder, 18-tray support table, 19-flange cylinder, 110-limiting cylinder, 111-guide pin lifting cylinder, 112-guide pin, 2-loading and unloading assembly, 21-loading manipulator, 22-unloading manipulator, 23-turntable component, 231-turntable motor, 232-speed reducer, 233-speed reducer mounting seat, 234-coupler, 235-turntable shaft, 236-anti-loose bearing nut, 237-butterfly spring, 238-thrust ball bearing, 239-bearing cushion block, 2310-deep groove ball bearing, 2311-turntable bearing block, 238-thrust ball bearing, etc, 2312-a turntable, 2313-a mounting groove, 3-a visual detection component, 31-a CCD camera component, 311-a CCD camera, 312-a lens fixing block, 313-a camera fixing block, 314-a CCD mounting vertical plate, 315-a vertical plate adjusting device, 316-a shaft connecting seat, 317-a linear guide shaft, 32-a foreign matter light supplementing component, 33-a camera displacement component and 331-a CCD connecting seat, 332-gear ring, 333-annular guide rail, 334-annular slide block, 335-gear, 336-servo motor, 337-motor support seat, 4-NG component, 41-support sheet metal, 42-drawer slide rail, 43-tray drawer, 44-NG tray, 45-spherical buckle mounting plate, 46-spherical buckle and 5-frame component.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1-11, the present invention provides the following technical solutions:
as shown in figure 1, the visual detection camera system with the light supplementing structure for automatically tracking the foreign matters on the workpiece and the method thereof comprise a logistics line assembly 1, a feeding and discharging assembly 2, a visual detection assembly 3, an NG assembly 4 and a rack assembly 5, wherein the logistics line assembly 1 is positioned on the front side of the upper surface of the rack assembly 5, the logistics line assembly 1 is fixedly connected with the upper surface of the rack assembly 5, the feeding and discharging assembly 2 is positioned behind the logistics line assembly 1, the bottom of the feeding and discharging assembly 2 is arranged on a cross beam in the rack assembly 5, the middle part and the bottom of the visual detection assembly 3 are both connected with the rack assembly 5, the visual detection position is the upper surface and the lower surface of the workpiece, the NG assembly 4 is positioned on one side of the rear part of the logistics line assembly 1, the bottom of the NG assembly is connected with the top of the rack assembly 5, the NG assembly 4 is used for receiving the defective products, the foreign matter light supplementing component 32 is installed on the feeding and discharging component 2, and the light irradiation position of the foreign matter light supplementing component 32 corresponds to the upper surface and the lower surface of each workpiece. The work piece is got into equipment from logistics line subassembly 1, is got the material by last unloading subassembly 2 and is put visual detection subassembly 3 below and detect, puts NG subassembly 4 by last unloading subassembly 2 with unqualified product after detecting, and qualified product is put back on logistics line subassembly 1. According to the visual detection assembly 3, the foreign matter light supplementing component is used for tracking and supplementing light to the detected unqualified workpiece, and the color code of reflected light of the unqualified workpiece is changed, so that the unqualified product is marked, and the probability of NG misjudgment is reduced. Meanwhile, the camera of the invention synchronously rotates with the turntable 2312 in the detection process, so that the workpiece does not need to be kept static in the detection process, and the production efficiency is greatly improved.
The foreign matter light supplementing component 32 corresponds to each workpiece position on the turntable 2312, 6 foreign matter light supplementing components 32 are respectively installed on the upper and lower sides of the turntable 2312, when a workpiece is placed on the turntable 2312, the upper and lower foreign matter light supplementing components 32 correspondingly irradiate the upper and lower surfaces of the workpiece to ensure that the CCD camera component 31 can shoot clear pictures, when the shot pictures are compared with the template pictures, if the workpiece is qualified, the foreign matter light supplementing component 32 stops supplementing light, when the workpiece reaches the position of the blanking manipulator 22, a color code sensor on the manipulator detects that the color of the reflected light of the workpiece is beyond a set value and belongs to a qualified product, the blanking manipulator 22 places the workpiece on a tray of a material discharging object streamline, when the shot pictures are unqualified compared with the template pictures, the foreign matter is judged to be a foreign matter, the foreign matter light supplementing component 32 continues supplementing light, the light supplementing light irradiates the surface of the workpiece, the color code of the reflected light is changed, and the color, the blanking robot 22 places the workpiece on the NG module 4.
As shown in fig. 2 and 3, the material flow line assembly 1 includes a material taking material flow line, a material transferring flow line and a material discharging flow line, the material taking material flow line includes an input motor 11, a synchronous belt 12, a synchronous pulley 13, a driving shaft 14, a conveying synchronous belt 15, a material flow support frame 16, a jacking cylinder 17, a tray support table 18, a flange cylinder 19, a limiting cylinder 110, a guide pin lifting cylinder 111 and a guide pin 112, the bottom of the input motor 11, the jacking cylinder 17, the material flow support frame 16 and the upper surface of the platen of the rack assembly 5 are fastened, wherein an output wheel of the input motor 11 is driven by the synchronous belt 12 and the synchronous pulley 13 on the driving shaft 14, two ends of the driving shaft 14 are mounted on the material flow support frame 16, two ends of the driving shaft 14 are also mounted with two synchronous pulleys 13, and the two synchronous pulleys 13 are driven by the material flow synchronous belt 12, jacking cylinder 17 top and the fastening connection of tray supporting bench 18, tray supporting bench 18 are located the logistics line support frame inboardly, spacing cylinder 110 is installed on logistics line support frame afterbody horizontal bar, and flange cylinder 19 and guide pin lift cylinder 111 are installed on logistics line support frame both sides baffle, and wherein flange cylinder 19 is horizontal installation, and guide pin lift cylinder 111 is vertical installation, guide pin 112 is installed at guide pin lift cylinder 111 top, the blowing commodity circulation line is the same with getting material logistics line structure, and transit logistics line lacks guide pin lift cylinder 111 and guide pin 112, and other structures are also the same with getting material logistics line. The material taking logistics line is provided with a tray which is being loaded, the transfer logistics line is provided with a tray which is completely loaded before, and the material discharging logistics line is provided with a tray which is being discharged. When the tray is put on the logistics line, input motor 11 can drive driving shaft 14 and rotate, driving shaft 14 drives synchronous pulley 13 and rotates, transportation hold-in range 15 begins the function, it goes ahead on the logistics line to drive the tray, spacing cylinder 110's stopper and then the stop motion can be touch to the in-process that the tray gos forward, the jacking cylinder 17 of bottom side this moment stretches out and props up a supporting bench 18 with the tray, the flange cylinder 19 of both sides stretches out, prescribe a limit to the tray position, guide pin lift cylinder 111 retracts, guide pin 112 descends, carry out the secondary location to the tray, in order to ensure that the manipulator can be accurate snatch the work piece.
As shown in fig. 1, 4 and 5, the loading and unloading assembly 2 includes a loading manipulator 21, an unloading manipulator 22 and a turntable component 23, the bottoms of the loading manipulator 21 and the unloading manipulator 22 are installed on the upper surface of the platen of the rack assembly 5, the bottom of the turntable component 23 is installed on a cross beam inside the rack assembly 5, and the loading manipulator 21 and the unloading manipulator 22 are respectively located on two sides of the turntable component 23. The movement track of the manipulator has programmability, and when the turntable 2312 continuously rotates, the manipulator can keep the manipulator and the turntable part 23 relatively static according to the movement of the rotation track of the turntable 2312, so that the manipulator can also perform feeding and discharging operations under the condition that the turntable 2312 does not stop, and the working efficiency is greatly improved.
As shown in fig. 4 and 5, the turntable assembly 23 includes a turntable motor 231, a reducer 232, a reducer mounting seat 233, a coupling 234, a turntable shaft 235, a locking bearing nut 236, a belleville spring 237, a thrust ball bearing 238, a bearing pad 239, a deep groove ball bearing 2310, a turntable bearing seat 2311, a turntable 2312 and a mounting groove 2313, the input motor 11 is connected with the reducer 232, the reducer 232 output shaft is connected with the turntable shaft 235 through the coupling 234, the turntable shaft 235 passes through the turntable bearing seat 2311, the deep groove ball bearing 2310, the bearing pad 239 and the thrust ball bearing 238 are sequentially mounted at two ends of the turntable bearing seat 2311, the belleville spring 237 is further mounted at the side edge of the thrust 238 at the bottom side, the other side of the belleville spring 237 abuts against the locking bearing nut 236, the thrust 238 at the top side abuts against a positioning shoulder of the turntable shaft 235, the deep groove ball bearing 2310 is in contact with an inner side step of the turntable, the locking bearing nut 236 and the turntable shaft 235 are fastened and connected through threads, one end of the speed reducer mounting seat 233 is connected to the speed reducer 232, the other end of the speed reducer mounting seat is fastened and connected with the lower portion of the cross bar inside the rack assembly 5, the turntable bearing seat 2311 is fastened and connected with the upper side of the cross beam inside the rack assembly 5, the turntable 2312 is connected with the top of the turntable shaft 235, the mounting groove 2313 is mounted on the turntable 2312, and the foreign matter light supplement component 32 is mounted on the upper surface and the lower surface of the turntable 2312 respectively. The turntable shaft 235 axially bears the weight of the turntable 2312 during work and radially bears the centrifugal effect generated by rotation, so that the thrust ball bearing 238 and the deep groove ball bearing 2310 are selectively arranged at the two ends of the bearing mounting seat, the butterfly spring 237 can play a role in damping in the axial direction when the machine vibrates, when a workpiece is placed in the mounting groove 2313 in the surface of the turntable 2312, the input motor 11 rotates to drive the turntable shaft 235 to rotate, the turntable shaft 235 drives the turntable 2312 to rotate, and the workpiece is conveyed to a subsequent processing station.
As shown in fig. 6, the visual inspection unit 3 further includes a CCD camera unit 31 and a camera displacement unit 33, wherein the bottom and middle of the camera displacement unit 33 are fixed to the upper surface of the bottom plate and the upper surface of the table plate of the frame unit 5, respectively, and the CCD camera unit 31 is mounted on the camera displacement unit 33. The camera displacement component can drive the CCD camera component 31 and the turntable 2312 to keep synchronous rotation, so that the time for stopping rotation of the workpiece for photographing is saved, and the working efficiency is improved.
As shown in fig. 7, the CCD camera part 31 includes a CCD camera 311, a lens fixing block 312, a camera fixing seat 313, a CCD mounting vertical plate 314, a vertical plate adjusting device 315, a shaft connecting seat 316 and a linear guide shaft 317, the rear portion of the CCD camera 311 is fastened to the camera fixing seat 313, the front portion of the CCD camera 311 is mounted inside the lens fixing block 312, the camera fixing seat 313, the lens fixing block 312 and the CCD mounting vertical plate 314 are fastened to each other, the vertical plate adjusting device 315 is mounted on the back side of the CCD mounting vertical plate 314, the other side of the vertical plate adjusting device 315 is fastened to the shaft connecting seat 316, the shaft connecting seat 316 is mounted on the linear guide shaft 317, and the position of the shaft connecting seat 316 on the linear guide. The CCD camera part 31 of the present invention has two cameras one above the other on the same linear guide shaft 317 in series, and can simultaneously detect the upper and lower surfaces of the workpiece, and the distance between the cameras and the workpiece can be adjusted by the vertical plate adjusting device 315 to obtain the optimum shooting distance.
As shown in fig. 8 and 9, the camera displacement unit 33 includes a CCD connecting base 331, a gear ring 332, an annular guide rail 333, an annular slider 334, a gear 335, a servo motor 336 and a motor support base 337, wherein one end of the CCD connecting base 331 is fastened to the upper surface of the gear ring 332, the other end is mounted on the linear guide shaft 317 and locked by a bolt, the annular slider 334 is mounted at the bottom of the gear ring 332, the annular slider 334 is mounted on the annular guide rail 333, one set of the annular guide rails 333 is mounted above the table top of the rack assembly 5 and fastened to the table top, the other set is mounted on the bottom plate of the rack assembly 5 and fastened to the bottom plate, two motor support bases 337 are respectively mounted on the table top and the bottom plate of the rack assembly 5, the upper portion of the motor support base 337 is fastened to the rear portion of the servo motor, the pinion gear 335 meshes with the rack portion of the ring gear 332. When the turntable component 23 rotates, the servo motor 336 drives the gear 335 to rotate, the gear 335 and the gear ring 332 are meshed to drive the gear ring 332 to rotate on the annular guide rail 333, the rotating speed of the gear ring 332 can be guaranteed to be the same as that of the turntable 2312 by adjusting the rotating speed of the servo motor 336, so that the camera and a workpiece are relatively static, the camera and the workpiece move synchronously for one beat to take a picture, the next beat motor reverses the camera to return to the initial position, two new workpieces rotate to the lower side of the two groups of cameras, the turntable 2312 can continuously rotate the camera to take a picture smoothly by the working mode, and the working efficiency of the equipment is greatly improved.
As shown in fig. 10 and 11, the NG assembly 4 includes a support metal plate 41, a drawer slide 42, a tray drawer 43, an NG tray 44, a ball buckle 46 mounting plate 45 and a ball buckle 46, the bottom of the support metal plate 41 is fastened to the top of the platen of the rack assembly 5, one side of the drawer slide 42 is fastened to the top side of the support metal plate 41, the lower side of the tray drawer 43 is fastened to the other side of the drawer slide 42, the NG tray 44 is placed above the tray drawer 43, each direction of the NG tray 44 is limited by a limiting block, the bottom of the ball buckle 46 mounting plate 45 is fastened to the platen of the rack assembly 5, the ball end of the ball buckle 46 is mounted on the tray drawer 43, and the buckle end is mounted on the top side of the ball buckle 46 mounting plate 45. When the NG workpiece is filled with a tray, the tray drawer 43 is pulled, the spherical buckle 46 is opened, the tray drawer 43 is drawn out along the drawer slide rail 42, the slide rail is loaded into the chute after the NG product is emptied, the tray drawer 43 is pushed, the spherical buckle 46 is buckled again, the NG tray 44 returns to the initial position again, and the NG workpiece can be received again.
As shown in fig. 1 to 11, a method for detecting a vision inspection camera system with a light supplement structure for automatically tracking foreign objects on a workpiece includes the following steps:
step 1, the workpiece is driven by the turntable component 23 to continuously rotate, the foreign matter light supplementing component 32 supplements light to the upper surface and the lower surface of the workpiece, and the CCD camera component 31 keeps synchronous rotation speed with the workpiece to shoot under the drive of the camera displacement component 33.
And 2, after the photographing comparison, the foreign matter light supplementing part 32 corresponding to the qualified product stops supplementing light, and the foreign matter light supplementing part 32 corresponding to the unqualified product continues supplementing light to change the color code of the surface reflected light of the unqualified product.
And 3, determining whether the workpiece is qualified or not according to the color code of the reflected light on the surface of the workpiece by a color code sensor arranged on the blanking manipulator 22, putting the unqualified product into an NG (natural gas) emptying part, and putting the qualified product back into a workpiece tray on the logistics line.
The working principle of the invention is as follows: the material loading position is carried to the work piece that logistics line subassembly 1 will fill a set, material loading manipulator 21 snatchs the work piece, in putting the mounting groove 2313 on carousel 2312 with the work piece through with carousel 2312 synchronization, foreign matter light filling part carries out the light filling to the upper and lower surface of work piece, CCD camera part keeps synchronous rotational speed with the work piece and shoots, the foreign matter light filling part 32 that qualified product corresponds after will shoot and template photo contrast stops the light filling, the foreign matter light filling part 32 that unqualified product corresponds continues the color code of light filling in order to change unqualified product surface reflection light. The turntable 2312 continues to rotate, the CCD camera part 31 rotates reversely under the driving of the camera displacement part 33 to return to the initial position to continue to inspect subsequent workpieces, the inspected workpieces reach the blanking position, the color mark sensor arranged on the blanking manipulator determines whether the workpieces are qualified or not through reflected light, the qualified workpieces are placed back on the logistics line component 1, and the unqualified components are placed on the NG component 4.
Although the present invention has been described in detail with reference to the foregoing embodiments, it will be apparent to those skilled in the art that changes may be made in the embodiments and/or equivalents thereof without departing from the spirit and scope of the invention. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims (9)

1. Visual detection camera system with automatic tracking work piece foreign matter light filling structure, its characterized in that: the visual inspection camera system comprises a logistics line component (1), a feeding and discharging component (2), a visual inspection component (3), an NG component (4) and a rack component (5), wherein the logistics line component (1) is located on the front side of the upper surface of the rack component (5), the logistics line component (1) is fixedly connected with the upper surface of the rack component (5), the feeding and discharging component (2) is located behind the logistics line component (1), the bottom of the feeding and discharging component (2) is installed on a cross beam inside the rack component (5), the middle part and the bottom of the visual inspection component (3) are connected with the rack component (5), the visual inspection position is the upper surface and the lower surface of a workpiece, the NG component (4) is located on one side of the rear side of the logistics line component (1), the bottom of the NG component is connected with the top of the rack component (5), and the NG component (4) is used for receiving defective products rejected by the, the visual detection assembly (3) comprises a foreign matter light supplementing part (32), the foreign matter light supplementing part (32) is installed on the feeding and discharging assembly (2), and the light irradiation positions of the foreign matter light supplementing part (32) correspond to the upper surface and the lower surface of each workpiece.
2. The vision inspection camera system with the light supplement structure for automatically tracking the foreign matters on the workpiece according to claim 1, wherein: the logistics line assembly (1) comprises a material taking logistics line, a transfer logistics line and a material placing logistics line, the material taking logistics line comprises an input motor (11), a synchronous belt (12), a synchronous belt pulley (13), a driving shaft (14), a conveying synchronous belt (15), a logistics support frame (16), a jacking cylinder (17), a tray support table (18), a flange cylinder (19), a limiting cylinder (110), a guide pin lifting cylinder (111) and a guide pin (112), the bottoms of the input motor (11), the jacking cylinder (17) and the logistics support frame (16) are fixedly connected with the upper surface of a table plate of the rack assembly (5), an output wheel of the input motor (11) is driven by the synchronous belt (12) and the synchronous belt pulley (13) on the driving shaft (14), two ends of the driving shaft (14) are installed on the logistics support frame (16), two synchronous belt pulleys (13) are further installed at two ends of the driving shaft (14), the two synchronous pulleys (13) realize transmission through the logistics synchronous belt (12) and the two synchronous pulleys (13) on the logistics support frame (16), the top of the jacking cylinder (17) is tightly connected with a tray support platform (18), the tray support platform (18) is positioned at the inner side of the logistics support frame (16), the limiting cylinder (110) is arranged on a cross bar at the tail part of the logistics line support frame, the flange cylinder (19) and the guide pin lifting cylinder (111) are arranged on baffle plates at two sides of the logistics line support frame, wherein the flange cylinder (19) is horizontally arranged, the guide pin lifting cylinder (111) is vertically arranged, the guide pin (112) is arranged at the top of the guide pin lifting cylinder (111), the material discharging logistics line is the same as the material taking logistics line in structure, the transfer logistics line is lack of a guide pin lifting cylinder (111) and a guide pin (112), and other structures are also the same as the material taking logistics line.
3. The vision inspection camera system with the light supplement structure for automatically tracking the foreign matters on the workpiece according to claim 1, wherein: go up unloading subassembly (2) and include material loading manipulator (21), unloading manipulator (22) and carousel part (23), install at frame subassembly (5) platen upper surface material loading manipulator (21) and unloading manipulator (22) bottom, install on the inside crossbeam of frame subassembly (5) carousel part (23) bottom, material loading manipulator (21) and unloading manipulator (22) are located carousel part (23) both sides respectively.
4. The vision inspection camera system with the light supplement structure for automatically tracking the foreign matters on the workpiece according to claim 3, wherein: the turntable component (23) comprises a turntable motor (231), a speed reducer (232), a speed reducer mounting seat (233), a coupler (234), a turntable shaft (235), a looseness-proof bearing nut (236), a belleville spring (237), a thrust ball bearing (238), a bearing cushion block (239), a deep groove ball bearing (2310), a turntable bearing seat (2311), a turntable (2312) and a mounting groove (2313), wherein the turntable motor (231) is connected with the speed reducer (232), an output shaft of the speed reducer (232) is connected with the turntable shaft (235) through the coupler (234), the turntable shaft (235) penetrates through the turntable bearing seat (2311), the deep groove ball bearing (2310), the bearing cushion block (239) and the thrust ball bearing (238) are sequentially mounted at two ends of the turntable bearing seat (2311), the belleville spring (237) is further mounted at the side edge of the thrust ball bearing (238) at the bottom side, and the other side of the belleville spring (237) abuts against the looseness, thrust ball bearing (238) top on the top side is on carousel axle (235) location shaft shoulder, deep groove ball bearing (2310) and carousel bearing frame (2311) inboard step contact, locking bearing nut (236) and carousel axle (235) pass through screw thread fastening connection, reduction gear mount pad (233) one end is connected on reduction gear (232), the other end and frame subassembly (5) inside rail downside fastening connection, carousel bearing frame (2311) and frame subassembly (5) inside crossbeam upside fastening connection, carousel (2312) and carousel axle (235) top link to each other, mounting groove (2313) are installed on carousel (2312), foreign matter light filling part (32) are installed respectively in carousel (2312) upper and lower surface.
5. The vision inspection camera system with the light supplement structure for automatically tracking the foreign matters on the workpiece according to claim 4, wherein: the visual inspection assembly (3) further comprises a CCD camera component (31) and a camera displacement component (33), the bottom and the middle of the camera displacement component (33) are respectively fixed on the upper surface of the bottom plate and the upper surface of the bedplate of the frame assembly (5), and the CCD camera component (31) is installed on the camera displacement component (33).
6. The vision inspection camera system with the light supplement structure for automatically tracking the foreign matters on the workpiece according to claim 5, wherein: CCD camera part (31) includes CCD camera (311), camera lens fixed block (312), camera fixing base (313), CCD installation riser (314), riser adjusting device (315), hub connection seat (316) and linear guiding axle (317), CCD camera (311) rear portion and camera fixing base (313) fastening connection, and CCD camera (311) front portion is installed inside camera lens fixed block (312), camera fixing base (313), camera lens fixed block (312) and CCD installation riser (314) fastening connection, riser adjusting device (315) are installed to CCD installation riser (314) dorsal part, riser adjusting device (315) opposite side and hub connection seat (316) fastening connection, hub connection seat (316) are installed on linear guiding axle (317), and hub connection seat (316) position is adjustable on linear guiding axle (317).
7. The vision inspection camera system with the light supplement structure for automatically tracking the foreign matters on the workpiece according to claim 5, wherein: the camera displacement component (33) comprises a CCD connecting seat (331), a gear ring (332), an annular guide rail (333), an annular sliding block (334), a gear (335), a servo motor (336) and a motor supporting seat (337), wherein one end of the CCD connecting seat (331) is fixedly connected with the upper surface of the gear ring (332), the other end of the CCD connecting seat is installed on a linear guide shaft (317) and is locked by a bolt, the annular sliding block (334) is installed at the bottom of the gear ring (332), the annular sliding block (334) is installed on the annular guide rail (333), the annular guide rail (333) is installed above the table top of the rack assembly (5) and is fixedly connected with the table top, the other group is installed on the bottom plate of the rack assembly (5) and is fixedly connected with the bottom plate, the motor supporting seat (337) is provided with two parts and is respectively installed on the table top and the bottom plate of the rack assembly (5, the output shaft of the servo motor (336) is provided with a gear (335) through key connection, and the gear (335) is meshed with the rack part of the gear ring (332).
8. The vision inspection camera system and method with the light supplement structure for automatically tracking the foreign matters on the workpiece according to claim 1, wherein: NG subassembly (4) detain mounting panel (45) and sphere including supporting panel beating (41), drawer slide rail (42), charging tray drawer (43), NG charging tray (44), sphere and detain (46), support panel beating (41) bottom and frame subassembly (5) platen top fastening connection, drawer slide rail (42) one side and support panel beating (41) top side fastening connection, charging tray drawer (43) below side and drawer slide rail (42) opposite side fastening connection, NG charging tray (44) are placed in charging tray drawer (43) top, and NG charging tray (44) are all injectd by the stopper in each side position, sphere detains mounting panel (45) bottom and frame subassembly (5) platen fastening connection, sphere detains (46) spherical end and installs on charging tray drawer (43), detains the end and installs at sphere and detain mounting panel (45) top side.
9. The method for detecting a vision inspection camera system with a light supplement structure for automatically tracking foreign objects on a workpiece according to claim 5, comprising the steps of:
step 1, a workpiece is driven by a turntable component (23) to continuously rotate, a foreign matter light supplementing component (32) supplements light to the upper surface and the lower surface of the workpiece, and a CCD camera component (31) is driven by a camera displacement component (33) to keep synchronous rotation speed with the workpiece for photographing.
And 2, after the photographing contrast, the foreign matter light supplement component (32) corresponding to the qualified product stops light supplement, and the foreign matter light supplement component (32) corresponding to the unqualified product continues light supplement to change the color code of the surface reflected light of the unqualified product.
And 3, determining whether the workpiece is qualified or not according to the color code of the reflected light on the surface of the workpiece by a color code sensor arranged on the blanking manipulator (22), putting the unqualified product into an NG (natural gas) emptying part, and putting the qualified product back into a workpiece tray on the logistics line again.
CN202110056215.5A 2021-01-15 2021-01-15 Visual inspection camera system with automatic tracking workpiece foreign matter light supplementing structure and method Active CN112881408B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110056215.5A CN112881408B (en) 2021-01-15 2021-01-15 Visual inspection camera system with automatic tracking workpiece foreign matter light supplementing structure and method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110056215.5A CN112881408B (en) 2021-01-15 2021-01-15 Visual inspection camera system with automatic tracking workpiece foreign matter light supplementing structure and method

Publications (2)

Publication Number Publication Date
CN112881408A true CN112881408A (en) 2021-06-01
CN112881408B CN112881408B (en) 2022-08-30

Family

ID=76048237

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110056215.5A Active CN112881408B (en) 2021-01-15 2021-01-15 Visual inspection camera system with automatic tracking workpiece foreign matter light supplementing structure and method

Country Status (1)

Country Link
CN (1) CN112881408B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116626318A (en) * 2023-07-26 2023-08-22 珠海华星智造科技有限公司 Tooth nail intelligent detection equipment with automated inspection function

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104132945A (en) * 2014-08-12 2014-11-05 武汉华科喻德科技有限公司 On-line surface quality visual inspection device for bar based on optical fiber conduction
CN105651177A (en) * 2016-03-16 2016-06-08 苏州富强科技有限公司 Measuring system suitable for measuring complex structure
CN206235571U (en) * 2016-11-30 2017-06-09 惠州汉视博自动化设备有限公司 The two-sided visual detection equipment of workpiece
CN106872474A (en) * 2017-03-08 2017-06-20 苏州易瑞得电子科技有限公司 Exploded perspective vision testing machine and its detection method
CN111774323A (en) * 2020-08-10 2020-10-16 昆山明益信智能设备有限公司 CCD machine vision full-size detection equipment
CN211802453U (en) * 2020-01-14 2020-10-30 山东华滋自动化技术股份有限公司 Sheet material removing and detecting equipment

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104132945A (en) * 2014-08-12 2014-11-05 武汉华科喻德科技有限公司 On-line surface quality visual inspection device for bar based on optical fiber conduction
CN105651177A (en) * 2016-03-16 2016-06-08 苏州富强科技有限公司 Measuring system suitable for measuring complex structure
CN206235571U (en) * 2016-11-30 2017-06-09 惠州汉视博自动化设备有限公司 The two-sided visual detection equipment of workpiece
CN106872474A (en) * 2017-03-08 2017-06-20 苏州易瑞得电子科技有限公司 Exploded perspective vision testing machine and its detection method
CN211802453U (en) * 2020-01-14 2020-10-30 山东华滋自动化技术股份有限公司 Sheet material removing and detecting equipment
CN111774323A (en) * 2020-08-10 2020-10-16 昆山明益信智能设备有限公司 CCD machine vision full-size detection equipment

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116626318A (en) * 2023-07-26 2023-08-22 珠海华星智造科技有限公司 Tooth nail intelligent detection equipment with automated inspection function
CN116626318B (en) * 2023-07-26 2023-10-10 珠海华星智造科技有限公司 Tooth nail intelligent detection equipment with automated inspection function

Also Published As

Publication number Publication date
CN112881408B (en) 2022-08-30

Similar Documents

Publication Publication Date Title
CN106596564B (en) Full-automatic vision detection device
CN112881408B (en) Visual inspection camera system with automatic tracking workpiece foreign matter light supplementing structure and method
CN109865679A (en) Vision inspection apparatus
CN114623766A (en) Length and diameter measurer for bearing production and measuring method thereof
CN110077836A (en) Material conveys positioning system
CN115388958B (en) Multifunctional empty bottle quality online detection system and method based on machine vision
CN210401240U (en) Dynamic vision testing device capable of being adjusted at multiple angles
CN116818782A (en) AOI detection equipment for detecting appearance defects of lenses
CN215507844U (en) Defective product detection and collection alarm device
CN112371539A (en) Quality detection device for blade server of data center
CN205289002U (en) Full -automatic measurement sorter
CN116577342B (en) Workpiece vision full inspection machine system
CN220941901U (en) Hardware sorting conveying line
CN212310127U (en) High-speed line medicine box character defect detection equipment
CN219611908U (en) Image acquisition device for bearing ring channel surface detection
CN214398443U (en) Detection platform
CN218424215U (en) Defective product detecting and sorting device
CN219092780U (en) Image acquisition device
CN220920032U (en) Marking device based on visual recognition
CN112729137B (en) Automatic sorting visual particle diameter detection device and use method thereof
CN219675864U (en) AOI detection equipment for detecting appearance defects of lenses
US6237431B1 (en) Apparatus for testing hollow bodies for defects
CN218191110U (en) Model identification weighing system
CN218191088U (en) Bearing retainer automatic check out test set
CN217393026U (en) Gear product automated inspection machine

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant