WO2021042638A1

WO2021042638A1 - Method and apparatus for extracting test target image of projector xpr-tilt glass, and electronic device

Info

Publication number: WO2021042638A1
Application number: PCT/CN2019/129219
Authority: WO
Inventors: 赵团伟
Original assignee: 歌尔股份有限公司
Priority date: 2019-09-03
Filing date: 2019-12-27
Publication date: 2021-03-11
Also published as: CN110717920A; CN110717920B

Abstract

A method and apparatus for extracting a test target image of projector XPR-tilt glass, and an electronic device, the method comprising: preprocessing a sample image captured by an industrial camera, and acquiring a communication area in the preprocessed sample image as well as centers of gravity of the communication area (S2100); selecting from among the centers of gravity of the communication area multiple centers of gravity which comply with a preset positional relationship, and determining a starting position of a target image according to position information of the multiple centers of gravity (S2200); obtaining the contour size of the target image according to size information of a standard XPR-tilt glass unit image and size information of the multiple centers of gravity (S2300); and obtaining the target image according to the starting position of the target image and the contour size of the target image (S2400).

Description

Method, device and electronic equipment for extracting test target image of projector galvanometer

Technical field

The present invention relates to the technical field of image processing, and more specifically, to a method for extracting a test target image of a projector galvanometer, a device for extracting a test target image of a projector galvanometer, an electronic device, and a computer readable Storage medium.

Background technique

As a screenless TV, projectors have entered the lives of ordinary families. With the continuous improvement and development of Internet speeds, people continue to put forward new requirements for the clarity of the TV screen, 720p, 1080p, 4K, these have become the new choice for TV. standard. With the increase in TV picture definition, the cost of projector hardware has doubled, so the galvanometer (XPR-tilt glass) technology came into being. You can use the hardware configuration of the XPR-tilt glass+1080p projector to output 4K image quality .

For this type of DLP (Digital Light Processing, digital light processing technology) projector, the vibration of its galvanometer needs to be tested when it leaves the factory. At present, the vibration of the galvanometer of the DLP projector is judged by the human eye, which is highly subjective, low in accuracy, and easy to cause fatigue and low efficiency.

In order to realize the automatic test of the vibration of the DLP projector, an industrial camera can be used to capture the image when the galvanometer is vibrating, extract a target image containing a group of unit vibration images from the image, and then extract a unit vibration image from the target image to determine The vibration of the galvanometer. One difficulty of this automatic test is to extract the test target image of the projector galvanometer from the image taken by the industrial camera.

Summary of the invention

An object of the present invention is to provide a new technical solution for extracting the target image in the vibration test of the projector.

According to the first aspect of the present invention, there is provided a method for extracting a test target image of a projector galvanometer, which includes:

Preprocessing the sampled image taken by the industrial camera to obtain the connected area and the center of gravity of the connected area in the sampled image after the preprocessing;

Selecting multiple centers of gravity that conform to a preset position relationship from the centers of gravity of the connected regions, and determining the starting position of the target image according to the position information of the multiple centers of gravity;

Obtaining the outline size of the target image according to the size information of the standard galvanometer unit image and the size information of the multiple centers of gravity;

The target image is obtained according to the starting position of the target image and the outline size of the target image.

Optionally, the step of selecting multiple centers of gravity that conform to a preset positional relationship from the centers of gravity of the connected regions includes:

Preliminarily selecting four centers of gravity from the centers of gravity of the connected regions, and obtaining the centers of gravity of a quadrilateral with the four centers of gravity as vertices as the centers of the four centers of gravity;

In a case where the distance difference between the four centers of gravity and the center is less than a preset threshold, use the four centers of gravity as the plurality of centers of gravity that conform to the preset positional relationship;

The step of determining the starting position of the target image according to the position information of the multiple centers of gravity includes:

The center of the four centers of gravity is used as the starting position of the target image.

Optionally, the step of obtaining the outline size of the target image according to the size information of the standard galvanometer unit image and the size information of the multiple centers of gravity includes:

Obtaining a scale factor for size conversion according to the reference size in the standard galvanometer unit diagram and the corresponding sizes determined by the multiple centers of gravity;

According to the outline size in the standard galvanometer unit and the scale factor, the outline size of the target image is obtained.

Optionally, the step of initially selecting four centers of gravity from the centers of gravity of the connected regions includes:

First, a center of gravity is initially selected from the centers of gravity of the connected regions, and then three other centers of gravity are selected within a preset distance range from the selected center of gravity to obtain the four centers of gravity.

Optionally, the reference size is the distance from a certain vertex of the standard galvanometer unit to the center of gravity of the nearest subunit, and the corresponding size is from a certain center of gravity of the plurality of centers of gravity to the plurality of centers of gravity. The distance from the center of the center of gravity, where the centers of the plurality of centers of gravity are the center of gravity of a polygon with the plurality of centers of gravity as vertices.

Optionally, the step of acquiring the connected region and the center of gravity of the connected region in the sampled image after preprocessing includes:

Obtaining the connected region according to the pixel value of each pixel in the sampled image after the preprocessing and the neighboring relationship between pixels;

According to the pixel distribution of the connected area, the center of gravity of the connected area is obtained.

Optionally, the step of preprocessing the sampled image taken by the industrial camera includes:

Crop the sampled image;

The cropped sampled image is processed into a binarized image based on a preset monochrome channel, and the binarized image is denoised to obtain a preprocessed sampled image.

According to the second aspect of the present invention, there is also provided a device for extracting a test target image of a projector galvanometer, including:

The image acquisition module is used to preprocess the sampled image taken by the industrial camera, and acquire the connected area and the center of gravity of the connected area in the preprocessed sampled image;

A starting position acquiring module, configured to select multiple centers of gravity that conform to a preset position relationship from the centers of gravity of the connected regions, and determine the starting position of the target image according to the position information of the multiple centers of gravity;

An outline size obtaining module, configured to obtain the outline size of the target image according to the size information of the standard galvanometer unit image and the size information of the multiple centers of gravity;

The target image acquisition module is configured to obtain the target image according to the starting position of the target image and the outline size of the target image.

According to a third aspect of the present invention, there is also provided an electronic device, including: a memory and a processor, the memory is used to store instructions, and the instructions are used to control the processor to operate to perform the first step according to the present invention. The method described in the aspect.

According to the fourth aspect of the present invention, there is also provided a computer-readable storage medium on which a computer program is stored, and the computer program, when executed by a processor, implements the method according to the first aspect of the present invention.

The method for extracting the target image in the galvanometer measurement of the projector provided by the embodiment of the present invention realizes the automatic extraction of the image of the test unit and improves the accuracy of the extraction work.

Through the following detailed description of exemplary embodiments of the present invention with reference to the accompanying drawings, other features and advantages of the present invention will become clear.

Description of the drawings

The drawings incorporated in the specification and constituting a part of the specification illustrate the embodiments of the present invention, and together with the description are used to explain the principle of the present invention.

FIG. 1 is a block diagram of the hardware configuration of an electronic device that can be used to implement a method for extracting a target image in a galvanometer test of a projector according to any embodiment of the present invention.

Fig. 2 is a processing flowchart of a method for extracting a target image in a galvanometer test of a projector according to an embodiment of the present invention.

Fig. 3 shows a schematic diagram of an image projected by a projector.

Figure 4 is a schematic diagram of sampled graphics cropping in this example.

Fig. 5 is a schematic diagram of the binarized image in this example.

Figure 6 is a schematic diagram of determining the starting position of the target image in this example.

Fig. 7 is a schematic diagram of a standard galvanometer unit diagram in this example.

Fig. 8 is a schematic diagram of the reference edge in this example.

Fig. 9 is a schematic diagram of the target map obtained in this example.

Fig. 10 is a schematic diagram of a device for extracting a target image in a galvanometer test of a projector according to an embodiment of the present invention.

Fig. 11 is a schematic diagram of an electronic device according to an embodiment of the present invention.

detailed description

Various exemplary embodiments of the present invention will now be described in detail with reference to the accompanying drawings. It should be noted that unless specifically stated otherwise, the relative arrangement of components and steps, numerical expressions and numerical values set forth in these embodiments do not limit the scope of the present invention.

The following description of at least one exemplary embodiment is actually only illustrative, and in no way serves as any limitation to the present invention and its application or use.

The techniques, methods, and equipment known to those of ordinary skill in the relevant fields may not be discussed in detail, but where appropriate, the techniques, methods, and equipment should be regarded as part of the specification.

In all examples shown and discussed herein, any specific value should be interpreted as merely exemplary, rather than as a limitation. Therefore, other examples of the exemplary embodiment may have different values.

It should be noted that similar reference numerals and letters indicate similar items in the following drawings, and therefore, once an item is defined in one drawing, it does not need to be further discussed in subsequent drawings.

FIG. 1 is a block diagram of the hardware configuration of an electronic device that can be used to implement a method for extracting a test target image of a projector galvanometer according to any embodiment of the present invention.

The electronic device 1000 may be an electronic device such as a mobile phone, a portable computer, a tablet computer, and a palmtop computer.

The electronic device 1000 may include a processor 1100, a memory 1200, an interface device 1300, a communication device 1400, a display device 1500, an input device 1600, a speaker 1700, a microphone 1800, and so on. Wherein, the processor 1100 may be a central processing unit (CPU), a microprocessor MCU, or the like. The memory 1200 includes, for example, ROM (Read Only Memory), RAM (Random Access Memory), nonvolatile memory such as a hard disk, and the like. The interface device 1300 includes, for example, a USB interface, a headphone interface, and the like. The communication device 1400 can perform wired or wireless communication, for example. The display device 1500 is, for example, a liquid crystal display, a touch display, or the like. The input device 1600 may include, for example, a touch screen, a keyboard, and the like. The user can input/output voice information through the speaker 1700 and the microphone 1800.

Although multiple devices are shown for the electronic device 1000 in FIG. 1, the present invention may only involve some of the devices. For example, the electronic device 1000 only involves the memory 1200 and the processor 1100.

In the embodiment of the present invention, the memory 1200 of the electronic device 1000 is used to store instructions, and the instructions are used to control the processor 1100 to execute the method for extracting the test target image of the projector galvanometer provided by the embodiment of the present invention.

In the above description, technical personnel can design instructions according to the disclosed scheme of the present invention. How the instruction controls the processor to operate is well known in the art, so it will not be described in detail here.

Fig. 2 is a processing flowchart of a method for extracting a test target image of a projector galvanometer according to an embodiment of the present invention. The method for extracting the test target image of the projector galvanometer is implemented by electronic equipment.

According to FIG. 2, the method for extracting the test target image of the projector galvanometer may include the following steps S2100-S2400.

Step S2100: Preprocess the sampled image taken by the industrial camera, and obtain the connected area and the center of gravity of the connected area in the preprocessed sampled image.

Fig. 3 shows a schematic diagram of an image projected by a projector.

According to Figure 3, the projector projects an image on the projection screen ABCD, the projected image area is A1B1C1D1, and the projector lens is parallel to the plane where the projection screen is located.

The industrial camera is installed in the fixture and used to shoot the projected image projected by the projector onto the projection screen. The optical axis of the optical components of the industrial camera is perpendicular to the plane where the projection screen is located.

The electronic equipment is used to control the industrial camera to take pictures and obtain the projected images collected by the industrial camera for processing. The electronic device is also used to control the galvanometer of the projector to turn on the fixed vibration mode.

An industrial camera is used to shoot the image projected by the projector to obtain a sampled image.

In an embodiment of the present invention, preprocessing the sampled images taken by the industrial camera includes the following steps S2110-S2120:

In step S2110, the sampled image is cropped.

For example, if the short side of the original sampled image is the length of the side, the center of the original sampled image is cropped, and the cropping result is a square. Through cropping, the amount of subsequent image processing operations can be reduced without affecting the final result, and the processing speed can be improved.

Step S2120: Process the cropped sampled image into a binarized image based on the preset monochrome channel, and denoise the binarized image to obtain a preprocessed sampled image.

During the binarization process, based on the brightness value of the preset monochrome channel, the gray value of the pixel whose brightness value of the preset monochrome channel exceeds the preset brightness threshold can be set to 255, and the preset brightness value can be set to 255. The gray value of the pixel whose brightness value of the monochrome channel does not exceed the preset brightness threshold is set to 0 to obtain a binary image.

When denoising, you can remove pixels whose brightness value of the preset monochrome channel exceeds the preset brightness threshold. The brightness value of the red channel exceeds the preset red brightness threshold, and the brightness value of the green channel exceeds the preset green brightness threshold. The pixel whose brightness value of the blue channel exceeds the preset blue brightness threshold. This can eliminate the interference of white pixels. It is also possible to count the number of pixels with a gray value of 255 in each connected area when obtaining connected areas later, and filter out the number of pixels with a gray value of 255 that exceeds the preset number of connected areas to avoid the influence of noise .

After preprocessing the sampled image taken by the industrial camera, the connected area and the center of gravity of the connected area in the preprocessed sampled image are obtained.

In this embodiment, the connected regions in the sampled image correspond to the sub-units in the unit vibration image. In the binarized image, the connected area is formed by pixels with a gray value of 255.

In this embodiment, acquiring the connected regions in the sampled image includes:

According to the pixel value of each pixel in the sampled image after preprocessing and the neighboring relationship between the pixels, the connected area is obtained.

For example, a group of pixels with gray values of 255 and adjacent to each other is selected from the sampled image, and the set of these pixels constitutes a connected area.

In this embodiment, obtaining the center of gravity of the connected region includes:

For example, first obtain the center position coordinates of each pixel in the connected area, and then calculate the average value of the center position coordinates of all pixels in the connected area, and the average value is the center of gravity coordinates of the connected area.

Step S2200: Select multiple centers of gravity that conform to a preset position relationship from the centers of gravity of the connected regions, and determine the starting position of the target image according to the position information of the multiple centers of gravity.

In one example, the number of selected centers of gravity is four. The step of selecting multiple centers of gravity conforming to the preset position relationship from the centers of gravity of the connected regions includes the following steps S2210-S2220:

Step S2210: Preliminarily select four centers of gravity from the centers of gravity of the connected regions, and obtain the centers of gravity of a quadrilateral with the four centers of gravity as vertices as the centers of the four centers of gravity.

When initially selecting four centers of gravity, you can first select a center of gravity from the center of gravity of the connected area, and then select the other three centers of gravity within the preset distance range of the center of gravity to obtain four centers of gravity.

A quadrilateral can be obtained by taking the four initially selected centers of gravity as vertices. Calculate the center of gravity of the quadrilateral, which is the center of the four centers of gravity.

It is easy to understand that the selected four centers of gravity need not be collinear.

It is easy to understand that the center coordinates of the four centers of gravity are equal to the average of the coordinates of the four centers of gravity.

In step S2220, in the case where the distance difference between the four centers of gravity to the center is less than a preset threshold, the four centers of gravity are used as multiple centers of gravity that conform to the preset positional relationship.

Obtain the distances from each of the four centers of gravity to the center, and the difference between the maximum value and the minimum value of these distances is less than the preset threshold, that is, the difference between the four centers of gravity to the center is less than the preset threshold.

Correspondingly, the step of determining the starting position of the target image according to the position information of the multiple centers of gravity includes: taking the centers of the four centers of gravity as the starting position of the target image.

The center of the four centers of gravity corresponds to a vertex of the target graph, and can be used as the starting position for determining the target graph.

It should be noted that the number of centers of gravity selected in the above example is four. When the number of centers of gravity is other numbers, such as three, five, etc., those skilled in the art can also obtain the starting position of the target image according to the matching relationship between the arrangement of these centers of gravity and the target image.

In step S2300, the outline size of the target image is obtained according to the size information of the standard galvanometer unit image and the size information of multiple centers of gravity.

The standard galvanometer unit graph reflects the ideal vibration situation, which includes a group of unit vibration images, and the size information in the graph is known. Among them, a group of unit vibration images includes multiple subunits.

In an example, the step of obtaining the outline size of the target image according to the size information of the standard galvanometer unit image and the size information of multiple centers of gravity includes the following steps S2310-2320:

Step S2310, according to the reference size in the standard galvanometer unit diagram and the corresponding sizes determined by multiple centers of gravity, a scale factor for size conversion is obtained.

For example, the reference size is the distance from a vertex of the standard galvanometer unit to the center of gravity of the nearest subunit, and the corresponding size is the distance from a certain center of gravity to the center of multiple centers of gravity. It is the center of gravity of a polygon with multiple centers of gravity as vertices. According to the ratio of the reference size to the corresponding size, the scale factor used for size conversion can be determined

In step S2320, the contour size of the target image is obtained according to the contour size and the scale factor in the standard galvanometer unit.

For example, multiply the ratio of the reference size and the corresponding size with the outline size of the standard galvanometer unit, and the product obtained is the outline size of the icon diagram of the standard galvanometer unit.

In step S2400, the target image is obtained according to the starting position of the target image and the outline size of the target image.

For example, from the preprocessed sampled image, take the above-mentioned starting position as a starting point and perform cropping according to the above-mentioned outline size, and the obtained image is the target image.

After the target image is extracted, the sub-unit images can be extracted based on the target image, the tilt angle difference of each sub-unit image before and after the vibration of the galvanometer is calculated, and the working state of the galvanometer is determined according to the tilt angle difference.

The method for extracting the target image in the galvanometer measurement of the projector provided by the embodiment of the present invention realizes the automatic extraction of the target image and improves the accuracy of the extraction work.

The following provides a specific example of the implementation of the method for extracting the target image in the galvanometer measurement.

As shown in Figure 4, the left side of Figure 4 is a sampled image obtained by shooting a projected image with an industrial camera. The sampled image is cropped to obtain a square with the short side of the sampled image as the side length and the center of the sampled image as the center, as shown on the right side of FIG. 4.

Based on the brightness value of the green channel, set the gray value of the pixel whose brightness value of the green channel exceeds the preset brightness threshold to 255, and set the gray value of the pixel whose brightness value does not exceed the preset brightness threshold. 0, and remove the pixels whose brightness value of the red channel exceeds the preset red brightness threshold and the brightness value of the blue channel exceeds the preset blue brightness threshold from the pixels whose brightness value of the green channel exceeds the preset brightness threshold to eliminate white Pixel interference. Obtain the binarized image as shown in FIG. 5 (in FIG. 5, a part of the binarized image is selected for magnified display).

On the basis of the binarized image shown in FIG. 5, pixels with a gray value of 255 and adjacent relationships are selected to form connected areas, and multiple white connected areas shown in FIG. 5 are obtained. For each white connected area, calculate the average value of the coordinates of all pixels in the connected area to obtain the barycentric coordinates of the connected area. The center of gravity of the connected region thus obtained is shown as point A, point B, point C... in Figure 5.

Based on the obtained center of gravity of the connected region, four centers of gravity that meet the preset location conditions are selected. Take the upper left corner of the binarized image in Fig. 5 as the far point to establish a coordinate system, and initially select a center of gravity in the order of the distance from the origin to the farthest point, for example, the center of gravity A is selected. Based on the position of point A, the other three centers of gravity are selected from the preset distance range of point A, for example, the centers of gravity B, C, and D are selected, and the four centers of gravity are initially selected. Through the preset distance range, the center of gravity that is far away from A can be excluded, such as the center of gravity E, F, and G, thereby reducing the amount of calculation.

Verify that the initially selected centers of gravity A, B, C, and D meet the preset positional relationship. Calculate the average value of the coordinates of the center of gravity A, B, C, and D. The average value is the center coordinates of the center of gravity A, B, C, and D. From this, the center of the center of gravity A, B, C, and D is obtained as point O in Figure 6 Shown. Obtain the lengths of OA, OB, OC, and OD. Assuming that the largest value of the above-mentioned length is OA, and the smallest is OD, calculate the difference between OA and OD, and record it as diff=OA-OD. If diff<5 (pixels), it is considered that the center of gravity A, B, C, and D meet the preset positional relationship, and subsequent calculations can be performed. If diff ≥ 5 (pixels), the center of gravity A, B, C, and D do not meet the preset positional relationship. In this case, discard the points A, B, C, and D selected in this round, and follow the distance to the far point. Continue to select a center of gravity in the order of near to far, for example, select center of gravity E, and continue to select and verify in the above-mentioned manner.

When the center of gravity A, B, C, and D meet the preset positional relationship, the center of gravity O of A, B, C, and D is taken as the starting position of the target map.

Figure 7 shows a diagram of the standard galvanometer unit used in this example. It can be seen that the standard galvanometer unit includes four sub-units represented by black areas, and the size information in the figure is known, for example, the side length of the standard galvanometer unit is 32 pixels.

Figure 8 shows the reference edge O'A' in the standard galvanometer unit diagram in this example. Among them, O'is a vertex in the standard galvanometer unit graph, and A'is the center of gravity of the subunit closest to the vertex. It is easy to understand, the length of O'A' is

Correspondingly, the corresponding edge in the binarized image is OA. The length of OA can be measured from the binarized image. From this, the scale factor C=OA/O'A' for size conversion can be calculated.

According to the scale factor C and the contour size 32 of the standard galvanometer unit graph, the contour size w=32*C of the target graph can be calculated.

The binarized image is cropped according to the starting position O of the target image and the outline size w of the target image to obtain the target image, which is the area within the dashed box in FIG. 9.

Fig. 10 is a block diagram of a device for extracting a target image in a galvanometer measurement of a projector according to an embodiment of the present invention.

As shown in FIG. 10, the device 100 for extracting the target image of the projector galvanometer test includes an image acquisition module 101, a starting position acquisition module 102, an outline size acquisition module 103 and a target image acquisition module 104.

The image acquisition module 101 is used to preprocess the sampled image taken by the industrial camera, and acquire the connected area and the center of gravity of the connected area in the preprocessed sampled image.

The starting position acquiring module 102 is configured to select multiple centers of gravity that conform to a preset position relationship from the centers of gravity of the connected regions, and determine the starting position of the target image according to the position information of the multiple centers of gravity;

The outline size obtaining module 103 is configured to obtain the outline size of the target image according to the size information of the standard galvanometer unit image and the size information of multiple centers of gravity;

The target image acquisition module 104 is configured to obtain the target image according to the starting position of the target image and the outline size of the target image.

In one embodiment, when the starting position acquisition module 102 executes the step of selecting multiple centers of gravity that conform to the preset position relationship from the centers of gravity of the connected regions, it is also used to: initially select four centers of gravity from the centers of gravity of the connected regions, Obtain the center of gravity of the quadrilateral with the four centers of gravity as the vertices, as the centers of the four centers of gravity; when the distance difference between the four centers of gravity to the center is less than the preset threshold, the four centers of gravity are regarded as multiples that conform to the preset position relationship Center of gravity. The starting position acquiring module 102 is also used to use the centers of the four centers of gravity as the starting position of the target image when performing the step of determining the starting position of the target image by the position information of the multiple centers of gravity.

In one embodiment, the contour size obtaining module 103 is also used to: according to the standard galvanometer unit diagram size information and multiple center of gravity size information to obtain the contour size of the target image The reference size and the corresponding sizes determined by the multiple centers of gravity are used to obtain the scale factor for size conversion; the outline size of the target image is obtained according to the outline size and the scale factor in the standard galvanometer unit.

In one embodiment, when the starting position acquisition module 102 performs the four steps of preliminarily selecting the center of gravity from the center of gravity of the connected area, it is also used to: first select a center of gravity from the center of gravity of the connected area, and then start from the preset of the center of gravity. Choose the other three centers of gravity within the distance range to get four centers of gravity.

In one embodiment, the reference size is the distance from a vertex of the standard galvanometer unit graph to the center of gravity of the nearest subunit, and the corresponding size is the distance from a center of gravity to the center of the multiple centers of gravity. The center of each center of gravity is the center of gravity of a polygon with multiple centers of gravity as vertices.

In one embodiment, when the image acquisition module 101 executes the step of acquiring the connected region and the center of gravity of the connected region in the preprocessed sampled image, it is also used to: according to the pixel value of each pixel in the preprocessed sampled image The connected area is obtained by the adjacent relationship between the pixel and the pixel; and the center of gravity of the connected area is obtained according to the pixel distribution of the connected area.

In one embodiment, when the image acquisition module 101 performs the step of preprocessing the sampled image taken by the industrial camera, it is also used to: crop the sampled image; process the cropped sampled image based on the preset monochrome channel It is a binarized image, and the binarized image is denoised to obtain a preprocessed sampled image.

In one embodiment, the electronic device may include the device 100 for extracting the target image in the galvanometer measurement of the projector according to any embodiment of the present invention, which is used to implement the method for extracting the target image in the galvanometer measurement of the projector according to any embodiment of the present invention. .

In another embodiment, the electronic device 110 shown in FIG. 11 may include a processor 112 and a memory 111. The memory 111 is used for storing executable instructions, and the processor 120 is used for operating the electronic device 110 according to the control of the instructions to execute the method for extracting the target image in the galvanometer measurement of the projector according to any embodiment of the present invention.

In this embodiment, a computer-readable storage medium is also provided, on which a computer program is stored. When the computer program is executed by the processor, the method for extracting the target image in the galvanometer measurement of the projector as in any embodiment of the present invention is realized. .

The present invention may be a system, a method and/or a computer program product. The computer program product may include a computer-readable storage medium loaded with computer-readable program instructions for enabling a processor to implement various aspects of the present invention.

The computer-readable storage medium may be a tangible device that can hold and store instructions used by the instruction execution device. The computer-readable storage medium may be, for example, but not limited to, an electrical storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing. More specific examples (non-exhaustive list) of computer-readable storage media include: portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM) Or flash memory), static random access memory (SRAM), portable compact disk read-only memory (CD-ROM), digital versatile disk (DVD), memory stick, floppy disk, mechanical encoding device, such as a printer with instructions stored thereon The protruding structure in the hole card or the groove, and any suitable combination of the above. The computer-readable storage medium used here is not interpreted as the instantaneous signal itself, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through waveguides or other transmission media (for example, light pulses through fiber optic cables), or through wires Transmission of electrical signals.

The computer-readable program instructions described herein can be downloaded from a computer-readable storage medium to various computing/processing devices, or downloaded to an external computer or external storage device via a network, such as the Internet, a local area network, a wide area network, and/or a wireless network. The network may include copper transmission cables, optical fiber transmission, wireless transmission, routers, firewalls, switches, gateway computers, and/or edge servers. The network adapter card or network interface in each computing/processing device receives computer-readable program instructions from the network, and forwards the computer-readable program instructions for storage in the computer-readable storage medium in each computing/processing device .

The computer program instructions used to perform the operations of the present invention may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-related instructions, microcode, firmware instructions, status setting data, or in one or more programming languages. Source code or object code written in any combination. Programming languages include object-oriented programming languages-such as Smalltalk, C++, etc., and conventional procedural programming languages-such as "C" language or similar programming languages. Computer-readable program instructions can be executed entirely on the user's computer, partly on the user's computer, executed as a stand-alone software package, partly on the user's computer and partly executed on a remote computer, or entirely on the remote computer or server carried out. In the case of a remote computer, the remote computer can be connected to the user's computer through any kind of network-including a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computer (for example, using an Internet service provider to connect to the user's computer) connection). In some embodiments, an electronic circuit, such as a programmable logic circuit, a field programmable gate array (FPGA), or a programmable logic array (PLA), can be customized by using the status information of the computer-readable program instructions. The computer-readable program instructions are executed to implement various aspects of the present invention.

Here, various aspects of the present invention are described with reference to flowcharts and/or block diagrams of methods, devices (systems) and computer program products according to embodiments of the present invention. It should be understood that each block of the flowcharts and/or block diagrams, and combinations of blocks in the flowcharts and/or block diagrams, can be implemented by computer-readable program instructions.

These computer-readable program instructions can be provided to the processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, thereby producing a machine that makes these instructions when executed by the processor of the computer or other programmable data processing device , A device that implements the functions/actions specified in one or more blocks in the flowcharts and/or block diagrams is produced. It is also possible to store these computer-readable program instructions in a computer-readable storage medium. These instructions make computers, programmable data processing apparatuses, and/or other devices work in a specific manner. Thus, the computer-readable medium storing the instructions includes An article of manufacture, which includes instructions for implementing various aspects of the functions/actions specified in one or more blocks in the flowcharts and/or block diagrams.

It is also possible to load computer-readable program instructions on a computer, other programmable data processing device, or other equipment, so that a series of operation steps are executed on the computer, other programmable data processing device, or other equipment to produce a computer-implemented process , So that the instructions executed on the computer, other programmable data processing apparatus, or other equipment realize the functions/actions specified in one or more blocks in the flowcharts and/or block diagrams.

The flowcharts and block diagrams in the accompanying drawings show the possible implementation architecture, functions, and operations of the system, method, and computer program product according to multiple embodiments of the present invention. In this regard, each block in the flowchart or block diagram can represent a module, program segment, or part of an instruction, and the module, program segment, or part of an instruction contains one or more executables for implementing the specified logical functions. instruction. In some alternative implementations, the functions marked in the block may also occur in a different order than the order marked in the drawings. For example, two consecutive blocks can actually be executed in parallel, or they can sometimes be executed in the reverse order, depending on the functions involved. It should also be noted that each block in the block diagram and/or flowchart, and the combination of the blocks in the block diagram and/or flowchart, can be implemented by a dedicated hardware-based system that performs the specified functions or actions Or it can be realized by a combination of dedicated hardware and computer instructions. It is well known to those skilled in the art that implementation through hardware, implementation through software, and implementation through a combination of software and hardware are all equivalent.

The embodiments of the present invention have been described above, and the above description is exemplary, not exhaustive, and is not limited to the disclosed embodiments. Without departing from the scope and spirit of the described embodiments, many modifications and changes are obvious to those of ordinary skill in the art. The choice of terms used herein is intended to best explain the principles, practical applications, or technical improvements in the market of the various embodiments, or to enable other ordinary skilled in the art to understand the various embodiments disclosed herein. The scope of the invention is defined by the appended claims.

Claims

A method for extracting a test target image of a projector galvanometer, including:

Preprocessing the sampled image taken by the industrial camera to obtain the connected area and the center of gravity of the connected area in the sampled image after the preprocessing;

Selecting multiple centers of gravity that conform to a preset position relationship from the centers of gravity of the connected regions, and determining the starting position of the target image according to the position information of the multiple centers of gravity;

Obtaining the outline size of the target image according to the size information of the standard galvanometer unit image and the size information of the multiple centers of gravity;

The target image is obtained according to the starting position of the target image and the outline size of the target image.
The method according to claim 1, wherein the step of selecting a plurality of centers of gravity conforming to a preset positional relationship from the centers of gravity of the connected regions comprises:

Preliminarily selecting four centers of gravity from the centers of gravity of the connected regions, and obtaining the centers of gravity of a quadrilateral with the four centers of gravity as vertices as the centers of the four centers of gravity;

In a case where the distance difference between the four centers of gravity and the center is less than a preset threshold, use the four centers of gravity as the plurality of centers of gravity that conform to the preset positional relationship;

The step of determining the starting position of the target image according to the position information of the multiple centers of gravity includes:

The center of the four centers of gravity is used as the starting position of the target image.
The method according to claim 1, wherein the step of obtaining the outline size of the target image according to the size information of the standard galvanometer unit image and the size information of the multiple centers of gravity comprises:

Obtaining a scale factor for size conversion according to the reference size in the standard galvanometer unit diagram and the corresponding sizes determined by the multiple centers of gravity;

According to the outline size in the standard galvanometer unit and the scale factor, the outline size of the target image is obtained.
The method according to claim 2, wherein the step of preliminarily selecting four centers of gravity from the centers of gravity of the connected regions comprises:

First, a center of gravity is initially selected from the centers of gravity of the connected regions, and then three other centers of gravity are selected from the preset distance range of the selected center of gravity to obtain the four centers of gravity.
The method according to claim 3, wherein the reference size is the distance from a vertex of the standard galvanometer unit graph to the center of gravity of the nearest subunit, and the corresponding size is a certain center of gravity among the multiple centers of gravity. The distance from one center of gravity to the centers of the plurality of centers of gravity, wherein the centers of the plurality of centers of gravity are the centers of gravity of a polygon with the plurality of centers of gravity as vertices.
The method according to claim 1, wherein the step of acquiring the connected region and the center of gravity of the connected region in the sampled image after preprocessing comprises:

Obtaining the connected region according to the pixel value of each pixel in the sampled image after the preprocessing and the neighboring relationship between pixels;

According to the pixel distribution of the connected area, the center of gravity of the connected area is obtained.
The method according to claim 1, wherein the step of preprocessing the sampled images taken by the industrial camera comprises:

Crop the sampled image;

The cropped sampled image is processed into a binarized image based on a preset monochrome channel, and the binarized image is denoised to obtain a preprocessed sampled image.
A device for extracting a test target image of a projector galvanometer, comprising:

The image acquisition module is used to preprocess the sampled image taken by the industrial camera, and acquire the connected area and the center of gravity of the connected area in the preprocessed sampled image;

A starting position acquiring module, configured to select multiple centers of gravity that conform to a preset position relationship from the centers of gravity of the connected regions, and determine the starting position of the target image according to the position information of the multiple centers of gravity;

An outline size obtaining module, configured to obtain the outline size of the target image according to the size information of the standard galvanometer unit image and the size information of the multiple centers of gravity;

The target image acquisition module is configured to obtain the target image according to the starting position of the target image and the outline size of the target image.
An electronic device comprising: a memory and a processor, the memory is used to store instructions, and the instructions are used to control the processor to operate to execute the method according to any one of claims 1-7.
A computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the method according to any one of claims 1-7.