CN117484171A

CN117484171A - Optical machine assembly method, device, electronic equipment and readable storage medium

Info

Publication number: CN117484171A
Application number: CN202311622829.0A
Authority: CN
Inventors: 董航宇; 王相坤; 朱建刚; 韩欣欣
Original assignee: Goertek Optical Technology Co Ltd
Current assignee: Goertek Optical Technology Co Ltd
Priority date: 2023-11-29
Filing date: 2023-11-29
Publication date: 2024-02-02

Abstract

The application discloses a light machine assembling method, a device, an electronic device and a readable storage medium, which are applied to an assembling control system, wherein the assembling control system is used for controlling the assembling of a light machine to be assembled, the light machine to be assembled comprises a first component, a second component and a third component, and the light machine assembling method comprises the following steps: when the first component and the second component are controlled to be assembled, a first imaging picture of the optical engine to be assembled is obtained; detecting whether the assembly between the first component and the second component is completed or not according to the first imaging picture; after the first component and the second component are detected to be assembled, controlling the third component to be assembled, and acquiring a second imaging picture of the optical machine to be assembled in the third component assembling process; and according to the second imaging picture, adjusting by controlling the third component so as to control the to-be-assembled optical machine to complete assembly. The technical problem that is difficult to compromise packaging efficiency and equipment accuracy has been solved to this application.

Description

Optical machine assembly method, device, electronic equipment and readable storage medium

Technical Field

The present disclosure relates to the field of optical technologies, and in particular, to a method and an apparatus for assembling an optical machine, an electronic device, and a readable storage medium.

Background

Along with the continuous development of technology, the micro-projection technology is also spreading gradually, and meanwhile, the micro-projection technology is also facing higher requirements as an optical machine for providing image elements, and in order to cope with the use demands of users such as convenient moving and miniaturized product design, the micro-optical machine is widely applied.

At present, equipment manufacturers usually finish assembling all parts of the light machine in a manual operation mode, such as a miniature tool positioning technology or a technology of manually operating six shafts to perform assembling positioning, however, because the miniature light machine is small in size, and then in the manual assembling process of all parts of the miniature light machine, operation errors or tool errors are easily introduced, meanwhile, because of the limitation of manual assembling capability, the assembling efficiency of the miniature light machine is limited, and further, the technical defects that the assembling time of the miniature light machine is overlong or the precision of the miniature light machine after the miniature light machine is assembled are easily caused, so that the assembling efficiency and the assembling precision are difficult to be considered when the light machine is assembled currently.

Disclosure of Invention

The main objective of the present application is to provide a method, a device, an electronic device and a readable storage medium for assembling an optical machine, which are intended to solve the technical problem that the prior art is difficult to consider the assembly efficiency and the assembly accuracy.

In order to achieve the above object, the present application provides an optical bench assembling method, applied to an assembling control system, where the assembling control system is used for controlling an assembling optical bench to be assembled, the optical bench to be assembled includes a first component, a second component and a third component, and the optical bench assembling method includes:

when the first component and the second component are controlled to be assembled, a first imaging picture of the optical engine to be assembled is obtained;

detecting whether the assembly between the first component and the second component is completed or not according to the first imaging picture;

after the first component and the second component are detected to be assembled, controlling the third component to be assembled, and acquiring a second imaging picture of the optical machine to be assembled in the third component assembling process;

and according to the second imaging picture, adjusting by controlling the third component so as to control the to-be-assembled optical machine to complete assembly.

To achieve the above object, the present application further provides an optical bench assembling device, applied to an assembling control system, the assembling control system is used for controlling assembling an optical bench to be assembled, the optical bench to be assembled includes a first component, a second component and a third component, and the optical bench assembling device includes:

The first acquisition module is used for acquiring a first imaging picture of the optical engine to be assembled when the first component and the second component are controlled to be assembled;

the detection module is used for detecting whether the assembly between the first component and the second component is finished according to the first imaging picture;

the second acquisition module is used for controlling the third component to be assembled after detecting that the first component and the second component are assembled, and acquiring a second imaging picture of the optical machine to be assembled in the third component assembling process;

and the assembling module is used for controlling the third component to adjust according to the second imaging picture so as to control the optical machine to be assembled to complete the assembly.

The application also provides an electronic device comprising: at least one processor and a memory communicatively coupled to the at least one processor, the memory storing instructions executable by the at least one processor to enable the at least one processor to perform the steps of the optomechanical assembly method as described above.

The present application also provides a computer readable storage medium, on which a program for implementing an optomechanical assembly method is stored, where the program for implementing the optomechanical assembly method, when executed by a processor, implements the steps of the optomechanical assembly method as described above.

The present application also provides a computer program product comprising a computer program which, when executed by a processor, implements the steps of the opto-mechanical assembly method as described above.

The application provides an optical machine assembling method, an optical machine assembling device, electronic equipment and a readable storage medium, which are applied to an assembling control system, wherein the assembling control system is used for controlling an optical machine to be assembled, the optical machine to be assembled comprises a first component, a second component and a third component, namely, a first imaging picture of the optical machine to be assembled is obtained when the first component and the second component are controlled to be assembled; detecting whether the assembly between the first component and the second component is completed or not according to the first imaging picture; after the first component and the second component are detected to be assembled, controlling the third component to be assembled, and acquiring a second imaging picture of the optical machine to be assembled in the third component assembling process; and according to the second imaging picture, adjusting by controlling the third component so as to control the to-be-assembled optical machine to complete assembly.

When the optical machine to be assembled is assembled, the first component and the second component of the optical machine to be assembled are assembled firstly, the first imaging picture in the process of assembling the first component and the second component is obtained, whether the first component and the second component are assembled or not is detected through the first imaging picture, and after the first component and the second component are assembled, the third component is controlled to be assembled through the assembly control system, the second imaging picture of the optical machine to be assembled is obtained in the assembly process of the third component, and finally the optical machine to be assembled is controlled to be assembled through the second imaging picture.

Because the equipment control system can accomplish the equipment and the detection work of waiting to assemble the ray apparatus voluntarily, promptly, compare with the traditional mode that carries out manual assembly and naked eye detection through operating personnel, equipment control system has stronger stability, can avoid because the assembly error and the detection error that the manual limitation brought, and then realized the quick automatic equipment waiting to assemble the ray apparatus under the control of equipment control system to and rely on the objective purpose that detects waiting to assemble the completion of each part of equipment ray apparatus of equipment control system.

Based on this, this application is when carrying out the equipment of waiting to assemble the ray apparatus, carries out the equipment and the detection of waiting to assemble the ray apparatus through equipment control system, can realize the automatic equipment between each part of waiting to assemble the ray apparatus fast to and accomplish the detection whether to accomplish each part equipment with objective angle, thereby control the equipment of waiting to assemble the ray apparatus. And the assembly of all parts of the optical machine to be assembled is completed in a manual operation mode. Therefore, the technical defects that the assembly time of the miniature optical machine is overlong or the precision of the miniature optical machine after assembly is low are easily caused due to the limitation of manual assembly capability, so that the assembly efficiency and the assembly precision of the optical machine assembly are both considered.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the application and together with the description, serve to explain the principles of the application.

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings that are required to be used in the description of the embodiments or the prior art will be briefly described below, and it will be obvious to those skilled in the art that other drawings can be obtained from these drawings without inventive effort.

Fig. 1 is a flow chart of an optical machine assembling method according to an embodiment of the present disclosure;

fig. 2 is a schematic view of a scenario in which the third component assembly is determined by using a pixel gray value and a gray value distribution curve together according to the first embodiment of the present application;

fig. 3 is a schematic view of an assembly control system of an optical bench assembly method according to an embodiment of the disclosure;

fig. 4 is a flow chart of an optical machine assembling method according to a second embodiment of the present disclosure;

fig. 5 is a schematic structural diagram of an optical bench assembly device according to a third embodiment of the present disclosure;

fig. 6 is a schematic structural diagram of an electronic device according to a fourth embodiment of the present application.

The implementation, functional features and advantages of the present application will be further described with reference to the accompanying drawings in conjunction with the embodiments.

Detailed Description

In order to make the above objects, features and advantages of the present invention more comprehensible, the following description of the embodiments accompanied with the accompanying drawings will be given in detail. It will be apparent that the described embodiments are only some, but not all, embodiments of the invention. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.

Example 1

First, it should be understood that the assembly of the micro-optical bench is usually performed by manual operation, taking the AR (Augmented Reality ) optical bench assembly as an example, there are mainly two manual operation modes: 1) Through miniature frock location, adopt the inserted sheet formula through the frock, put into the draw-in groove with each optical components and parts directly, utilize the frock to carry out basic location, however, because the optical engine size is less, above-mentioned assembly mode can appear great frock error and operation error in the equipment process, is difficult to reach the image quality that satisfies the user's demand; 2) The parts of the optical machine are placed on the manual six-axis, and the six-axis is manually operated and the naked eye detection is relied on by an operator to detect whether the optical machine is assembled, but the assembly mode still has larger assembly errors due to manual participation, meanwhile, the manual detection has subjectivity, so that the product assembled by the assembly mode has defects on assembly precision, the assembly efficiency is limited, and in conclusion, the optical machine assembled by the manual participation optical machine assembly mode is difficult to consider the assembly precision and the assembly efficiency, so that a method for considering the optical machine assembly precision and the assembly efficiency is needed.

In a first embodiment of the present application, referring to fig. 1, an optical bench assembling method is provided, where the optical bench assembling method is applied to an assembling control system, and the assembling control system is used for controlling an optical bench to be assembled, where the optical bench to be assembled includes a first component, a second component and a third component, and the optical bench assembling method includes:

step S10, when the first component and the second component are controlled to be assembled, a first imaging picture of the optical machine to be assembled is obtained;

step S20, detecting whether the assembly between the first component and the second component is completed or not according to the first imaging picture;

step S30, after the first component and the second component are detected to be assembled, controlling the third component to be assembled, and acquiring a second imaging picture of the optical machine to be assembled in the process of assembling the third component;

and S40, adjusting by controlling the third component according to the second imaging picture so as to control the optical machine to be assembled to complete the assembly.

In this embodiment, it should be noted that, although fig. 1 shows a logic sequence, in some cases, the steps shown or described may be performed in a sequence different from that of the logic sequence, where the optical machine assembling method is applied to an assembling control system, where the assembling control system is disposed on an assembling control device, where the assembling control device is used to implement the assembling and assembling process detection of an optical machine to be assembled, specifically, an AR device or a VR (Virtual Reality) device, etc., where the optical machine to be assembled is used to characterize an optical machine to be assembled, specifically, a micro optical machine or a middle optical machine, etc., where the first component, the second component, and the third component refer to components of the optical machine to be assembled, specifically, may be an imaging component, a lens, or an illumination component, etc., where in one practical manner, the first component may be an imaging component, the second component may be a lens, and the third component may be an illumination component, and the AA (Active Alignment) of the imaging component and the AA of the lens are performed first, and the AA of the illumination component and the optical machine to be assembled finally.

Additionally, it should be noted that, in the process of assembling the first component and the second component, the optical engine to be assembled may form a first imaging frame through the first component or the second component, where the first component or the second component may be an imaging piece, and the first imaging frame formed based on the imaging piece may be used to evaluate whether the assembly between the components is completed, that is, whether the relative positions of the first component and the second component can meet the production requirement, where the specific manner of the detection may be that the pixels and the resolution of the frame are detected by the vision system, so as to determine the sharpness of the first imaging frame, and determine that the assembly of the first component and the second component is completed after the sharpness meets the requirement, for example, in one possible embodiment, it is assumed that the preset resolution threshold of the vision system is a, the resolution of the first imaging frame is B, and if B > a, and then the assembly of the first component and the second component is completed.

Additionally, it should be noted that, after the assembly of the first component and the second component is completed, the assembly of the optical machine to be assembled may be completed after the assembly of the third component is controlled, where the assembly of the third component includes the assembly of the third component and the first component, and the assembly of the third component and the assembly of the second component, and the second imaging frame is used to determine whether the assembly of the third component is completed, for example, in one embodiment, if the assembly of the third component is detected, that is, the assembly of the first component, the second component, and the third component is completed, and if the assembly of the first component and the second component is determined during the assembly of the third component, or if the assembly of the third component is not completed, the assembly of the optical machine to be assembled may be determined by the first imaging frame and the second imaging frame, or if the assembly of the third component is not completed, the assembly of the six axes of the corresponding components may be controlled by the control command issued by the assembly control system, and after the adjustment, whether the assembly of the components is continuously detected.

As an example, steps S10 to S30 include: controlling the assembly between the imaging component and the lens, and acquiring a first imaging picture imaged by the imaging component when the imaging component and the lens are assembled through a vision module of an assembly control system, wherein the vision module can be a vision subsystem in the assembly control system; if the resolution of the first imaging picture is detected to be larger than a first preset resolution threshold, determining that the assembly between the first component and the second component is completed, and if the resolution of the first imaging picture is detected to be smaller than or equal to the first preset resolution threshold, determining that the assembly between the first component and the second component is not completed; after the first component and the second component are detected to be assembled, controlling an imaging component to be assembled with an illumination component through an assembly control system, and acquiring a second imaging picture imaged by the imaging component through the vision module; detecting whether the resolution of the second imaging picture is larger than a second preset resolution threshold, if the resolution of the second imaging picture is larger than the second preset resolution threshold, determining that assembly adjustment is not needed between the imaging component and the illumination component, further determining that the assembly of the optical machine to be assembled is completed, and if the resolution of the second imaging picture is smaller than or equal to the second preset resolution threshold, determining that the assembly between the imaging component and the illumination component is not completed, further controlling the assembly adjustment between the imaging component and the illumination component, and further controlling the assembly of the optical machine to be assembled.

In the assembly process of the optical machine to be assembled, firstly, the imaging component and the lens are controlled by the assembly control system, whether the first imaging picture generated by the imaging component in the assembly process of the imaging component and the lens is assembled or not is detected, after the assembly of the imaging component and the lens is determined, the imaging component and the illumination component are controlled by the assembly control system to be assembled, whether the second imaging picture generated by the imaging component in the assembly process of the imaging component and the illumination component is assembled or not is detected, after the assembly of the imaging component and the illumination component is detected, the assembly of the optical machine to be assembled is controlled by the assembly control system, namely, the imaging component and the lens are sequentially assembled by the assembly control system and the assembly of the imaging component and the illumination component, the automatic assembly of the optical machine to be assembled can be realized by the assembly control system, and meanwhile, whether the assembly of each component of the optical machine to be assembled is finished depends on the assembly control system to be judged in the assembly process, so that the assembly of the imaging picture is finished, the assembly control system is finished, the assembly of the optical machine to be assembled is easy to be assembled automatically, the optical machine to be assembled is detected, the defect that the assembly is not is realized, and the assembly of the optical machine to be assembled is high precision is overcome, and the assembly precision is limited due to the fact that the assembly is finished, and the miniature optical machine is assembled.

In an embodiment, when the assembly control system detects that the assembly of the imaging component and the lens is completed or the assembly of the imaging component and the illumination component is not completed, the assembly control system generates a control instruction to control six axes of the corresponding component to perform self-adaptive adjustment on the relative positions until the imaging component and the lens are adjusted and the imaging component and the illumination component are assembled, and it is understood that after the assembly of the imaging component and the lens and the assembly of the imaging component and the illumination component and the assembly of the imaging component and the assembly of the illumination component, the relative positions of the illumination component and the lens can meet the production tolerance requirement, and then after the assembly of all components of the optical machine to be assembled is completed, the assembly of the optical machine to be assembled is determined, wherein the six axes can be an X axis, a Y axis, a Z axis, a Tip axis, a tin axis and an R axis respectively.

Wherein, according to the first imaging picture, the step of detecting whether the assembly between the first component and the second component is completed includes:

step A10, determining imaging quality pixel points on the first imaging picture;

and step A20, determining whether the assembly between the first component and the second component is finished according to the first pixel gray value of the imaging quality pixel point.

In this embodiment, it should be noted that, when determining whether the assembly of the first component and the second component is completed, since the overall definition of the frame is difficult to reflect the quality condition of the local part of the frame, for example, the first imaging frame may satisfy the production requirement on the overall resolution, but there is a color stripe around the frame, that is, in this case, if it is determined that the assembly of the first component and the second component is completed, the finally assembled optical machine to be assembled still cannot satisfy the user requirement, further, when determining whether the assembly of the first component and the second component is completed, the pixel gray value is introduced, the imaging quality determination is accurately performed on the local area of the frame through the pixel gray value, that is, the assembly control system sets the preset pixel gray value threshold in advance, and the determination of whether the assembly of the first component and the second component is completed through the magnitude relation between the preset pixel gray value threshold and the pixel gray value, where the imaging quality pixel points are used for characterizing the imaging quality of the determined frame, that one or more imaging quality pixel points, in particular, may be one or more imaging quality pixel points, if there are a plurality of preset pixel points, and the first pixel value of the preset pixel value of the image quality pixel values of the image quality pixel points exceeds the first component gray value, which is not completed.

As an example, steps a10 to a20 include: extracting imaging quality pixel points in the first imaging picture according to a preset extraction rule, wherein the position of the pixel point waiting to be extracted in the first imaging picture is set in the preset extraction rule; if the first pixel gray value of the imaging quality pixel point is detected to be larger than a preset pixel gray value threshold, determining that the imaging component and the lens are not assembled, and if the first pixel gray value of the imaging quality pixel point is detected to be smaller than or equal to the preset pixel gray value threshold, determining that the imaging component and the lens are assembled. Because the pixel gray value can feed back the imaging quality of the first imaging picture from the pixel level, whether the assembly between the imaging component and the lens is completed can be accurately judged through the size relation between the first pixel gray value of the imaging quality pixel point in the first imaging picture and the preset pixel gray value threshold, and therefore, a foundation is laid for considering the assembly efficiency and the assembly accuracy in the assembly process of the optical machine to be assembled.

Wherein the step of determining whether the assembly between the first component and the second component is completed according to the first pixel gray value of the imaging quality pixel point comprises the following steps:

Step B10, determining whether the imaging quality of the first imaging picture meets a first preset imaging condition according to a first pixel gray value of the imaging quality pixel point;

step B20, if yes, determining that the assembly between the first component and the second component is completed;

step B30, if not, acquiring a third imaging picture of the optical engine to be assembled after adjusting the first component and/or the second component;

step B40, taking the third imaging picture as the first imaging picture, and returning to the execution step: and determining whether the imaging quality of the first imaging picture meets a first preset imaging condition according to the first pixel gray value of the imaging quality pixel point.

In this embodiment, it should be noted that, whether the lens and the imaging component are assembled is determined by the first pixel gray value of the single imaging quality pixel point or the imaging quality pixel point of the single area, so that it is difficult to ensure whether the imaging quality requirement is met by the whole, so that the imaging quality of the first imaging picture is represented by the first pixel gray value as a whole, and whether the first component and the second component are assembled is determined by the meeting condition of the imaging quality and the first preset imaging condition, where the imaging quality of the first imaging picture can be represented by the pixel gray average value of a plurality of areas, for example, in one possible embodiment, it is assumed that the plurality of areas include the upper left corner area, the lower left corner area, the upper right corner area and the lower right corner area altogether, taking all pixel points in the area as imaging quality pixel points, averaging first pixel gray values of all imaging quality pixel points, wherein the first preset imaging condition can be that all areas have no color bands, namely, the pixel gray average value of the area is smaller than a certain preset pixel gray average value threshold value, when the pixel gray average value of the upper left corner area, the lower left corner area, the upper right corner area and the lower right corner area is detected to be smaller than the preset pixel gray average value threshold value, judging that the imaging quality of a first imaging picture meets the first preset imaging condition, after the imaging quality of the first imaging picture does not meet the first preset imaging condition, carrying out angle adjustment of the first component and/or the second component through six axes corresponding to the first component and/or the second component, and determines whether the first member and the second member satisfy a first preset imaging condition depending on an imaging screen (third imaging screen) imaged by the imaging member after each adjustment.

As an example, steps B10 to B40 include: taking all pixel points of an upper left corner area, an upper right corner area, a lower left corner area and a lower right corner area of the first imaging picture as imaging quality pixel points, respectively calculating pixel gray average values of the upper left corner area, the upper right corner area, the lower left corner area and the lower right corner area based on first pixel gray values of the imaging quality pixel points, and determining whether the imaging quality of the first imaging picture meets a first preset imaging condition according to the pixel gray average values of the upper left corner area, the upper right corner area, the lower left corner area and the lower right corner area; when the pixel gray average values of the upper left corner area, the upper right corner area, the lower left corner area and the lower right corner area are all larger than the first preset imaging condition, determining that the imaging quality of the first imaging picture does not meet the first preset imaging condition, adjusting the first component and/or the second component, and acquiring a third imaging picture of the optical machine to be assembled through the vision module after the first component and/or the second component are adjusted; taking the third imaging picture as the first imaging picture, and returning to the executing step: and determining whether the imaging quality of the first imaging picture meets a first preset imaging condition according to the first pixel gray value of the imaging quality pixel point.

The step of controlling the light machine to be assembled to be completed by controlling the third component to adjust according to the second imaging picture comprises the following steps:

step C10, determining an imaging quality pixel area on the second imaging picture;

step C20, detecting whether the third component is assembled according to a second pixel gray value of the imaging quality pixel region;

step C30, if yes, determining that the optical engine to be assembled is completed;

and step C40, if not, iteratively adjusting the assembly position of the third component according to the imaging uniformity degree of the second imaging picture until the completion of the assembly of the third component is detected.

In this embodiment, it should be noted that, after the first component and the second component are assembled, the assembly of the optical engine to be assembled is controlled by completing the assembly of the third component, where in the process of assembling the third component mainly involves the influence on the uniformity and the imaging definition of the imaging frame, and further, the determination of the imaging uniformity degree of the second imaging frame is completed through the second pixel gray value of the imaging quality pixel area, where the imaging uniformity degree is used to characterize the uniformity of imaging, and specifically may be determined through the pixel brightness values of different imaging areas, the imaging quality pixel area is used to characterize the pixel point area of the imaging quality, specifically may be four corners of the second imaging frame, the second preset imaging condition may be that the pixel gray difference value of the four corner area of the second imaging frame is minimum, that is, when the pixel gray difference value of the four corner area of the second imaging frame is minimum, the third component assembly is determined, and when the pixel gray difference value of the four corner area of the second imaging frame is not minimum, the second imaging uniformity degree is determined through the four corner area of the second imaging frame (imaging quality pixel area), and the second imaging quality pixel area is adjusted.

As an example, steps C10 to C30 include: extracting an imaging quality pixel region from the second imaging picture; detecting whether the third component is assembled according to the second pixel gray value of the imaging quality pixel region, wherein the detection mode can be specifically a mode of detecting the magnitude relation between the second pixel gray value and a preset second preset pixel gray value threshold, for example, if the second pixel gray value is greater than the preset second preset pixel gray value, the third component is determined to be assembled, and if the second pixel gray value is less than or equal to the preset second preset pixel gray value, the third component is determined to be assembled incompletely; if the third component is detected to be assembled, determining that the optical machine to be assembled is assembled; and if the third component is detected to be not assembled, iteratively adjusting the assembly position of the third component according to the imaging uniformity of the second imaging picture until the third component is detected to be assembled.

The step of iteratively adjusting the assembly position of the third component according to the imaging uniformity of the second imaging picture until the completion of the assembly of the third component is detected includes:

Step D10, determining whether the imaging uniformity degree of the second imaging picture meets a second preset imaging condition according to a second pixel gray value of the imaging quality pixel region;

step D20, if yes, determining that the optical machine to be assembled is completed;

step D30, if not, acquiring a fourth imaging picture of the optical engine to be assembled after adjusting the third component;

step D40, taking the fourth imaging frame as the second imaging frame, and returning to the execution step: and determining whether the imaging uniformity degree of the second imaging picture meets a second preset imaging condition according to the second pixel gray value of the imaging quality pixel region.

As an example, steps D10 to D40 include: determining pixel gray level differences of four corner areas of the second imaging picture according to second pixel gray level values of the imaging quality pixel areas, determining that second preset imaging conditions are met when the pixel gray level differences are minimum, and determining that the second preset imaging conditions are not met when the pixel gray level differences are not minimum; if the second preset imaging condition is determined to be met, adjusting the assembly position between the illumination component and the imaging component, and acquiring a fourth imaging picture generated by the imaging component after adjustment; taking the fourth imaging picture as the second imaging picture, and returning to the executing step: and determining whether the imaging uniformity degree of the second imaging picture meets a second preset imaging condition according to the second pixel gray value of the imaging quality pixel region.

Wherein the step of detecting whether the third component is assembled according to the second pixel gray value of the imaging quality pixel region comprises the following steps:

step E10, detecting whether the pixel gray difference value corresponding to the second imaging picture is the minimum gray difference value according to the second pixel gray value of the imaging quality pixel region;

e20, if yes, determining that the third component is assembled when the gray value distribution curve constructed by the gray values of the second pixels meets a third preset imaging condition;

and E30, if not, determining that the third component is not assembled.

In this embodiment, it should be noted that, whether the third component is assembled is determined by the pixel gray difference value and the minimum gray difference value, and a defect exists to a certain extent, for example, when the pixel gray difference value is the minimum gray difference value, the gray values of pixels at different positions of the second imaging frame are uneven, and further, in order to further avoid the uniformity problem in the process of assembling the third component, a gray value distribution curve is introduced to further perform frame pixel uniformity determination, where the gray value distribution curve is used to characterize the distribution situation of gray values of different pixels of the frame, for example, in an implementation manner, it is assumed that the gray value distribution curve is an energy gaussian curve, if the energy gaussian curve is at a center completely symmetrical position, it is determined that the second imaging frame is uniformly imaged, and in this way, the third preset imaging condition is that the curve is completely symmetrical.

In one embodiment, referring to fig. 2, fig. 2 is a schematic view showing a situation that the assembly of the third component is completed by jointly determining the pixel gray value and the gray value distribution curve, wherein the assembly of the illumination component and the imaging component (third component) is completed by calculating the pixel gray difference values of the four corner areas a, b, c and d and adjusting the assembly position between the illumination component and the imaging component according to the pixel gray difference values.

In one embodiment, referring to fig. 3, fig. 3 is a schematic view illustrating a scenario of an assembled control system, where (1) represents a first optomechanical product and (2) represents a second optomechanical product.

As an example, steps E10 to E30 include: detecting whether a pixel gray level difference value corresponding to the second imaging picture is a minimum gray level difference value according to a second pixel gray level value of the imaging quality pixel region; when detecting that the pixel gray level difference value corresponding to the second imaging picture is the minimum gray level difference value, acquiring a gray level value distribution curve constructed by the second pixel gray level value, detecting whether the gray level value distribution curve is completely symmetrical, and if the gray level value distribution curve is detected to be completely symmetrical, determining that the illumination component and the imaging component are assembled; and when detecting that the pixel gray level difference value corresponding to the second imaging picture is not the minimum gray level difference value, determining that the third component is not assembled.

The embodiment of the application provides an optical machine assembling method which is applied to an assembling control system, wherein the assembling control system is used for controlling an optical machine to be assembled, the optical machine to be assembled comprises a first component, a second component and a third component, namely, a first imaging picture of the optical machine to be assembled is obtained when the first component and the second component are controlled to be assembled; detecting whether the assembly between the first component and the second component is completed or not according to the first imaging picture; after the first component and the second component are detected to be assembled, controlling the third component to be assembled, and acquiring a second imaging picture of the optical machine to be assembled in the third component assembling process; and according to the second imaging picture, adjusting by controlling the third component so as to control the to-be-assembled optical machine to complete assembly.

When the optical machine to be assembled is assembled, the first component and the second component of the optical machine to be assembled are assembled first, the first imaging picture in the process of assembling the first component and the second component is obtained, whether the first component and the second component are assembled is detected through the first imaging picture, and after the first component and the second component are assembled, the third component is controlled to be assembled through the assembly control system, the second imaging picture of the optical machine to be assembled is obtained in the assembly process of the third component, and finally the optical machine to be assembled is controlled to be assembled through the second imaging picture.

Based on this, when the light machine to be assembled is assembled, the assembly control system is used for assembling and detecting the light machine to be assembled, so that automatic assembly among all parts of the light machine to be assembled can be rapidly realized, and whether the assembly of all the parts is completed or not can be detected in an objective angle, and the assembly of the light machine to be assembled is controlled to be completed. And the assembly of all parts of the optical machine to be assembled is completed in a manual operation mode. Therefore, the technical defects that the assembly time of the miniature optical machine is overlong or the precision of the miniature optical machine after assembly is low are easily caused due to the limitation of manual assembly capability, so that the assembly efficiency and the assembly precision of the optical machine assembly are both considered.

Example two

Further, referring to fig. 4, in another embodiment of the present application, the same or similar content as that of the first embodiment may be referred to the description above, and will not be repeated. On the basis, after the step of iteratively adjusting the assembly position of the third component according to the imaging uniformity of the second imaging picture until the completion of the assembly of the third component is detected, the optomechanical assembly method further comprises:

step F10, obtaining a fifth imaging picture of the optical engine to be assembled;

step F20, detecting whether the degree of change between the fifth imaging frame and the imaging process frame is smaller than a fourth preset imaging condition, wherein the imaging process frame comprises the first imaging frame and/or the second imaging frame;

step F30, if yes, determining that the optical engine to be assembled is completed;

and F40, if not, carrying out iterative adjustment on the optical machine to be assembled until the optical machine to be assembled is determined to be assembled.

In this embodiment, it should be noted that, after the first component, the second component and the third component are all assembled, the optical engine to be assembled may still be affected by other factors, so that the use requirement cannot be met, further after it is determined that the third component is assembled, whether an assembly error is introduced in the assembly process of different stages is determined by comparing the imaging picture in the assembly process with the change condition of the imaging picture after the assembly of the third component, so that the use requirement cannot be met by the optical engine to be assembled, where the imaging picture is used for characterizing the imaging picture in the assembly process, specifically, the imaging picture after the assembly of the first component and the second component, that is, the first imaging picture, or the imaging picture after the assembly of the third component, that is, the second imaging picture, and the fourth preset imaging condition is used for characterizing that the change degree of the imaging picture is smaller than the preset change degree threshold.

As an example, steps F10 to F40 include: acquiring a fifth imaging picture of the optical engine to be assembled; detecting whether the degree of change between the fifth imaging picture and an imaging process picture is smaller than a fourth preset imaging condition, wherein the imaging process picture comprises the first imaging picture and/or the second imaging picture; if the change degree between the fifth imaging picture and the imaging process picture is detected to be smaller than a preset change degree threshold value, determining that the optical machine to be assembled is completed; and if the change degree between the fifth imaging picture and the imaging process picture is detected to be greater than or equal to the preset change degree threshold, iteratively adjusting the components of the optical machine to be assembled until the optical machine to be assembled is determined to be completed.

The embodiment of the application provides a method for adjusting an optical machine to be assembled, namely, a fifth imaging picture of the optical machine to be assembled is obtained; detecting whether the degree of change between the fifth imaging picture and an imaging process picture is smaller than a fourth preset imaging condition, wherein the imaging process picture comprises the first imaging picture and/or the second imaging picture; if yes, determining that the optical engine to be assembled is completed; and if not, carrying out iterative adjustment on the optical machine to be assembled until the optical machine to be assembled is determined to be assembled. When the optical machine to be assembled is adjusted, the fifth imaging picture after the third component is assembled through the optical machine to be assembled is compared with the picture change degree of the imaging process picture, so that whether the optical machine to be assembled has imaging picture quality change mutation in the assembling process is determined, and when the imaging picture quality mutation occurs, the relative positions of all components of the optical machine to be assembled are adjusted through fine adjustment, so that the optical machine to be assembled obtained by assembly is ensured to meet the use requirement of a user, and the assembling accuracy of the optical machine assembly is further improved.

Example III

The embodiment of the application also provides an optical machine assembling device, which is applied to an assembling control system, wherein the assembling control system is used for controlling the assembling of an optical machine to be assembled, the optical machine to be assembled comprises a first component, a second component and a third component, and referring to fig. 5, the optical machine assembling device comprises:

a first obtaining module 101, configured to obtain a first imaging frame of the optical engine to be assembled when controlling the first component and the second component to be assembled;

a detecting module 102, configured to detect whether the assembly between the first component and the second component is completed according to the first imaging frame;

a second obtaining module 103, configured to control the third component to be assembled after detecting that the first component and the second component are assembled, and obtain a second imaging frame of the optical engine to be assembled in the third component assembling process;

and the assembling module 104 is configured to control the optical machine to be assembled to complete assembly by controlling the third component to perform adjustment according to the second imaging frame.

Optionally, the detection module 102 is further configured to:

determining imaging quality pixel points on the first imaging picture;

And determining whether the assembly between the first component and the second component is finished or not according to the first pixel gray value of the imaging quality pixel point.

Optionally, the detection module 102 is further configured to:

determining whether the imaging quality of the first imaging picture meets a first preset imaging condition according to a first pixel gray value of the imaging quality pixel point;

if yes, determining that the assembly between the first component and the second component is completed;

if not, after the first component and/or the second component are adjusted, a third imaging picture of the optical engine to be assembled is obtained;

taking the third imaging picture as the first imaging picture, and returning to the executing step: and determining whether the imaging quality of the first imaging picture meets a first preset imaging condition according to the first pixel gray value of the imaging quality pixel point.

Optionally, the assembly module 104 is further configured to:

determining an imaging quality pixel region at the second imaging picture;

detecting whether the third component is assembled according to a second pixel gray value of the imaging quality pixel region;

if yes, determining that the optical engine to be assembled is completed;

And if not, iteratively adjusting the assembly position of the third component according to the imaging uniformity of the second imaging picture until the third component is detected to be assembled.

Optionally, the assembly module 104 is further configured to:

determining whether the imaging uniformity degree of the second imaging picture meets a second preset imaging condition according to a second pixel gray value of the imaging quality pixel region;

if yes, determining that the optical engine to be assembled is completed;

if not, after the third component is adjusted, a fourth imaging picture of the optical engine to be assembled is obtained;

taking the fourth imaging picture as the second imaging picture, and returning to the executing step: and determining whether the imaging uniformity degree of the second imaging picture meets a second preset imaging condition according to the second pixel gray value of the imaging quality pixel region.

Optionally, the assembly module 104 is further configured to:

detecting whether a pixel gray level difference value corresponding to the second imaging picture is a minimum gray level difference value according to a second pixel gray level value of the imaging quality pixel region;

if yes, determining that the third component is assembled when the gray value distribution curve constructed by the gray values of the second pixels meets a third preset imaging condition;

If not, determining that the third component is not assembled.

Optionally, the optical bench assembling device is further configured to:

acquiring a fifth imaging picture of the optical engine to be assembled;

detecting whether the degree of change between the fifth imaging picture and an imaging process picture is smaller than a fourth preset imaging condition, wherein the imaging process picture comprises the first imaging picture and/or the second imaging picture;

if yes, determining that the optical engine to be assembled is completed;

and if not, carrying out iterative adjustment on the optical machine to be assembled until the optical machine to be assembled is determined to be assembled.

The optical machine assembly device provided by the invention adopts the optical machine assembly method in the embodiment, so that the technical problem that the assembly efficiency and the assembly accuracy are difficult to be simultaneously achieved is solved. Compared with the prior art, the optical machine assembling device provided by the embodiment of the invention has the same beneficial effects as the optical machine assembling method provided by the embodiment, and other technical features in the optical machine assembling device are the same as the features disclosed by the method of the embodiment, and are not repeated herein.

Example IV

The embodiment of the invention provides electronic equipment, which comprises: at least one processor; and a memory communicatively coupled to the at least one processor; the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor, so that the at least one processor can execute the optical bench assembly method in the first embodiment.

Referring now to fig. 6, a schematic diagram of an electronic device suitable for use in implementing embodiments of the present disclosure is shown. The electronic devices in the embodiments of the present disclosure may include, but are not limited to, mobile terminals such as mobile phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), in-vehicle terminals (e.g., in-vehicle navigation terminals), and the like, and stationary terminals such as digital TVs, desktop computers, and the like. The electronic device shown in fig. 6 is merely an example and should not be construed to limit the functionality and scope of use of the disclosed embodiments.

As shown in fig. 6, the electronic device may include a processing apparatus 1001 (e.g., a central processing unit, a graphics processor, etc.), which may perform various appropriate actions and processes according to a program stored in a Read Only Memory (ROM) 1002 or a program loaded from a storage apparatus 1003 into a Random Access Memory (RAM) 1004. In the RAM1004, various programs and data required for the operation of the electronic device are also stored. The processing device 1001, the ROM1002, and the RAM1004 are connected to each other by a bus 1005. An input/output (I/O) interface 1006 is also connected to the bus.

In general, the following systems may be connected to the I/O interface 1006: input devices 1007 including, for example, a touch screen, touchpad, keyboard, mouse, image sensor, microphone, accelerometer, gyroscope, and the like; an output device 1008 including, for example, a Liquid Crystal Display (LCD), a speaker, a vibrator, and the like; storage device 1003 including, for example, a magnetic tape, a hard disk, and the like; and communication means 1009. The communication means may allow the electronic device to communicate with other devices wirelessly or by wire to exchange data. While electronic devices having various systems are shown in the figures, it should be understood that not all of the illustrated systems are required to be implemented or provided. More or fewer systems may alternatively be implemented or provided.

In particular, according to embodiments of the present disclosure, the processes described above with reference to flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program embodied on a computer readable medium, the computer program comprising program code for performing the method shown in the flowcharts. In such an embodiment, the computer program may be downloaded and installed from a network via the communication device 1009, or installed from the storage device 1003, or installed from the ROM 1002. The above-described functions defined in the method of the embodiment of the present disclosure are performed when the computer program is executed by the processing device 1001.

The electronic equipment provided by the invention adopts the optical machine assembly method in the embodiment, so that the technical problem that the assembly efficiency and the assembly accuracy are difficult to be simultaneously achieved is solved. Compared with the prior art, the electronic device provided by the embodiment of the invention has the same beneficial effects as the optical machine assembly method provided by the embodiment, and other technical features in the electronic device are the same as the features disclosed by the embodiment method, and are not repeated herein.

It should be understood that portions of the present disclosure may be implemented in hardware, software, firmware, or a combination thereof. In the description of the above embodiments, particular features, structures, materials, or characteristics may be combined in any suitable manner in any one or more embodiments or examples.

The foregoing is merely illustrative of the present invention, and the present invention is not limited thereto, and any person skilled in the art will readily recognize that variations or substitutions are within the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.

Example five

The present embodiment provides a computer-readable storage medium having computer-readable program instructions stored thereon for performing the optical bench assembly method of the above embodiments.

The computer readable storage medium according to the embodiments of the present invention may be, for example, a usb disk, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, or device, or a combination of any of the foregoing. More specific examples of the computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In this embodiment, a computer-readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, or device. Program code embodied on a computer readable storage medium may be transmitted using any appropriate medium, including but not limited to: electrical wires, fiber optic cables, RF (radio frequency), and the like, or any suitable combination of the foregoing.

The above-described computer-readable storage medium may be contained in an electronic device; or may exist alone without being assembled into an electronic device.

The computer-readable storage medium carries one or more programs that, when executed by an electronic device, cause the electronic device to: when the first component and the second component are controlled to be assembled, a first imaging picture of the optical engine to be assembled is obtained; detecting whether the assembly between the first component and the second component is completed or not according to the first imaging picture; after the first component and the second component are detected to be assembled, controlling the third component to be assembled, and acquiring a second imaging picture of the optical machine to be assembled in the third component assembling process; and according to the second imaging picture, adjusting by controlling the third component so as to control the to-be-assembled optical machine to complete assembly.

Computer program code for carrying out operations of the present disclosure may be written in one or more programming languages, including an object oriented programming language such as Java, smalltalk, C ++ and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computer (for example, through the Internet using an Internet service provider).

The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.

The modules described in the embodiments of the present disclosure may be implemented in software or hardware. Wherein the name of the module does not constitute a limitation of the unit itself in some cases.

The computer readable storage medium provided by the invention stores the computer readable program instructions for executing the optical machine assembly method, and solves the technical problem that the assembly efficiency and the assembly accuracy are difficult to be simultaneously considered. Compared with the prior art, the beneficial effects of the computer readable storage medium provided by the embodiment of the invention are the same as those of the optical machine assembly method provided by the above embodiment, and are not described herein.

Example six

The application provides a computer program product which solves the technical problem that the assembly efficiency and the assembly accuracy are difficult to be considered. Compared with the prior art, the beneficial effects of the computer program product provided by the embodiment of the present invention are the same as those of the optical machine assembly method provided by the above embodiment, and are not described herein.

The foregoing description is only of the preferred embodiments of the present application and is not intended to limit the scope of the claims, and all equivalent structures or equivalent processes using the descriptions and drawings of the present application, or direct or indirect application in other related technical fields are included in the scope of the claims.

Claims

1. An optical machine assembling method, characterized by being applied to an assembling control system, wherein the assembling control system is used for controlling an optical machine to be assembled, and the optical machine to be assembled comprises a first component, a second component and a third component, and the optical machine assembling method comprises the following steps:

2. The method of assembling a light engine of claim 1, wherein said step of detecting whether assembly between said first component and said second component is complete based on said first imaging frame comprises:

determining imaging quality pixel points on the first imaging picture;

3. The method of opto-mechanical assembly of claim 2 wherein said step of determining whether assembly between said first component and said second component is complete based on a first pixel gray value of said imaging quality pixel comprises:

4. The method of assembling an optical bench according to claim 1, wherein the step of controlling the completion of assembling the optical bench to be assembled by controlling the third member according to the second imaging frame comprises:

Determining an imaging quality pixel region at the second imaging picture;

if yes, determining that the optical engine to be assembled is completed;

5. The method of assembling the optical engine of claim 4, wherein the step of iteratively adjusting the assembly position of the third component until the completion of the assembly of the third component is detected according to the degree of uniformity of the imaging of the second imaging frame comprises:

if yes, determining that the optical engine to be assembled is completed;

6. The method of opto-mechanical assembly of claim 4 wherein said step of detecting whether said third component is assembled based on said second pixel gray level of said image quality pixel area comprises:

if not, determining that the third component is not assembled.

7. The method of assembling a light engine as recited in claim 4, wherein after said step of iteratively adjusting an assembly position of said third component in accordance with said degree of uniformity of imaging of said second imaged frame until completion of assembly of said third component is detected, said method of assembling a light engine further comprises:

acquiring a fifth imaging picture of the optical engine to be assembled;

If yes, determining that the optical engine to be assembled is completed;

8. An optical machine assembling device, characterized in that it is applied to an assembling control system for controlling the assembling of an optical machine to be assembled, the optical machine to be assembled comprising a first component, a second component and a third component, the optical machine assembling device comprising:

9. An electronic device, the electronic device comprising:

at least one processor;

a memory communicatively coupled to the at least one processor;

the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the steps of the opto-mechanical assembly method of any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that the computer-readable storage medium has stored thereon a program for realizing an optomechanical assembly method, the program for realizing an optomechanical assembly method being executed by a processor to realize the steps of the optomechanical assembly method according to any one of claims 1 to 7.