CN116823986A - Spray image processing system and method based on scanning camera, electronic equipment and storage medium - Google Patents

Abstract

The application discloses a spray image processing system, a method, electronic equipment and a storage medium based on a scanning camera. These features may include shapes, logos, patterns, etc. of the article. After the algorithm processing, image data for spray painting is generated. The specific technical scheme comprises the steps of image preprocessing, feature extraction, feature matching, calibration conversion, image rendering and the like. In an embodiment, image preprocessing includes image correction, denoising, enhancement and smoothing, and image stitching. The feature extraction method comprises edge detection, key point detection, contour extraction and the like. The feature matching method determines the position and angle of the item in the image by matching with features in a known template or database. And (3) calculating the coordinate and angle data of the object based on the feature matching result by calibration conversion. And the image rendering superimposes the calibrated and converted data with the spray pattern to generate the spray pattern image data which is accurately matched. In addition, the application also relates to a random coin spray image processing device which comprises a scanning shooting unit, a light supplementing unit and an image processing unit. Finally, the application provides an electronic device, a readable storage medium for implementing the above image processing method.

Description

Spray image processing system and method based on scanning camera, electronic equipment and storage medium

Technical Field

The application relates to the technical field of hardware ornament spray painting, in particular to a spray painting image processing system and method based on a scanning camera, electronic equipment and a storage medium.

Background

Conventional inkjet printing techniques typically require manual operations, which result in low production efficiency, difficult quality assurance, and difficulties in handling complex patterns and inkjet printing in specific areas. Therefore, there is a need for a more efficient, accurate and automated inkjet image processing method to meet the needs of specific area inkjet printing.

With the development of computer vision and image processing technology, mobile cameras and algorithms have potential for wide application in the field of image recognition and processing. However, in applications where specific area painting is performed for, for example, coins, some challenges remain. First, the location and distribution of coins is typically random, and thus an accurate positioning method is required to determine the exact location of the coins. Second, there may be multiple feature areas on the coin that require efficient algorithms to extract and identify these features. Finally, generating image data for inkjet printing requires efficient processing and optimization to ensure definition and accuracy of the pattern.

In the prior art, no document is disclosed on how to accurately collect and identify a specific area on a hardware ornament to provide accurate image data for spray painting, and how to generate a high-quality spray painting image to ensure definition and detail display of a spray painting effect.

Disclosure of Invention

In order to overcome the challenges, to accurately collect and identify a specific area on a hardware ornament, provide accurate image data for spray painting, generate high-quality spray painting images, ensure definition and detail presentation of spray painting effects, and improve artistic and commercial values of spray painting of the hardware ornament, the application provides a spray painting image processing system, a spray painting image processing method, electronic equipment and a storage medium based on a scanning camera.

According to the application, the movable camera is used for shooting the hardware ornaments which are fixed on the tool and are randomly distributed, and the images on the hardware ornaments are captured; and then, performing image processing by using an advanced algorithm to extract and identify the characteristics of the hardware ornament. The characteristics can be the shape, the sign, the pattern and the like of the hardware ornament, and the image data for spray painting is generated after the algorithm processing. The specific technical scheme comprises the following aspects:

in a first aspect, the present application provides a method for processing an image of a hardware ornament at a random position, the method comprising: image preprocessing, namely preprocessing the acquired hardware ornament image to obtain a complete large image of all article information; extracting features, namely extracting features of the hardware ornament image by using a feature recognition algorithm; matching the extracted hardware ornament features with features in a known template or database; and (3) calibrating and converting, and calculating coordinate and angle data of the hardware ornament based on the feature matching result. The coordinate data represents the position of the hardware ornament in the image, and the angle data represents the rotation angle of the hardware ornament relative to the reference coordinate system; and (3) image rendering, namely outputting the recognized hardware ornament coordinates and angle data for subsequent image generation and spray painting.

In some embodiments, the image preprocessing includes: image correction, image denoising, enhancement and smoothing, and image stitching.

In some embodiments, the feature extraction method includes: edge detection, SIFT/SURF key point detection and contour extraction, so that information such as the shape, texture, edge and the like of all hardware ornaments is obtained to generate a characteristic image.

In some embodiments, the feature matching method includes first identifying the hardware ornament feature at the center as a material template, and then matching the remaining extracted hardware ornament features with features in the material template. The positions and angles of all coins in the image are determined by using a neighbor matching, feature descriptor matching algorithm.

In some embodiments, the feature calibration conversion is based on feature matching results, and coordinates and angle data of the hardware ornament are calculated. The coordinate data represents the position of the hardware ornament in the image, and the angle data represents the rotation angle of the hardware ornament relative to the reference coordinate system.

In some embodiments, the image rendering is to superimpose the coordinate and angle data of the hardware ornament converted by calibration and the spray pattern, and output a TIFF file which exactly matches all the spray patterns of the hardware ornament.

In a second aspect, an embodiment of the present application provides a random hardware ornament spray image processing apparatus, including: the shooting unit is used for shooting hardware ornament images fixed at random distribution positions on the clamp; the light supplementing unit is used for providing a uniform and stable light source so as to ensure the brightness and contrast of the hardware ornament image; the scanning unit is used for moving the shooting unit and the light supplementing unit to carry out scanning shooting; the image processing unit is responsible for processing and analyzing the hardware ornament image acquired by the camera and generating image data for spray painting.

Specifically, the above-mentioned shooting unit includes: camera, camera lens, high gentle power cord, high gentle net twine, camera power adapter and mount. The lens is connected to the camera and then fixed on the fixing frame, and the camera power adapter supplies power to the camera through the high-flexibility power line. And the camera shoots an image of the hardware ornament on the jig and transmits the image to the image processing unit through the high-flexibility network cable. The number of photographing units may be increased according to actual use requirements, but is at least 1 or more.

Specifically, the light supplementing unit includes: the camera comprises a light source, a light source controller and a light source extension line, wherein the light source is fixed on a fixing frame under the camera, the light source controller is powered by the light source extension line, and the light source emits a light source coaxial with the camera, so that the camera can shoot a clear picture and the light source is sufficient. The number of the light supplementing units corresponds to that of the shooting units.

Specifically, the scanning unit includes: guide rail, motor, hold-in range, tool, the mount links to each other with the hold-in range, and the motor rotates and drives the hold-in range, makes shooting unit and the light filling unit on the mount realize the removal of XY axle along the guide rail.

In some embodiments, the following three capturing methods are used for capturing the random hardware ornament spray image processing device:

1) The single camera scans and shoots, the shooting unit and the light supplementing unit are only one set, and the scanning unit drives the shooting unit and the light supplementing unit to perform X-axis and Y-axis bidirectional movement to scan and shoot the whole jig.

2) When the scanning unit is provided with at least 2 sets of light supplementing units, the scanning unit drives the scanning unit and the light supplementing unit to carry out X-axis transverse scanning to shoot the whole jig when the image shot at a single time can cover the short side of the jig, namely the Y direction.

3) The fixed shooting of many cameras, shooting unit and light filling unit are installed more than 2 sets at scanning unit, and its image of single shooting can cover whole tool surface, and scanning unit is fixed shooting unit and light filling unit carry out single shooting at the tool center.

Specifically, the image processing unit performs preprocessing, feature extraction, feature matching, calibration conversion and image rendering on the collected hardware ornament image according to an image processing method, finally generates spray painted image data, and transmits the spray painted image data to a spray painting device for spray painting operation.

Specifically, the inkjet device may be one or more inkjet devices of a UV inkjet printer, a laser printer, an inkjet printer, and a digital screen printer.

In a third aspect, embodiments of the present application relate to an electronic device including a memory and a processor. The memory is in parallel with the processor for storing computer program code. The image processing apparatus is caused to execute the image processing method described in the above-described application, i.e., the first aspect of the application, in the course of execution of the computer code by the processor.

In a fourth aspect, the application provides a readable storage medium comprising computer software code. The computer software code, when run in an image processing apparatus, enables the image processing apparatus to implement the image processing method described in the above-described application, i.e. the first aspect of the application.

The application adopts the technology, so that compared with the prior art, the application has the positive effects that:

according to the application, the movable camera is used for shooting the articles which are randomly distributed and fixed on the tool, and an advanced algorithm is utilized for image processing, so that the characteristics of the articles are extracted and identified. These features may include shapes, logos, patterns, etc. of the article. After the algorithm processing, image data for spray painting is generated. The specific technical scheme comprises the steps of image preprocessing, feature extraction, feature matching, calibration conversion, image rendering and the like. In an embodiment, image preprocessing includes image correction, denoising, enhancement and smoothing, and image stitching. The feature extraction method comprises edge detection, key point detection, contour extraction and the like. The feature matching method determines the position and angle of the item in the image by matching with features in a known template or database. And (3) calculating the coordinate and angle data of the object based on the feature matching result by calibration conversion. And the image rendering superimposes the calibrated and converted data with the spray pattern to generate the spray pattern image data which is accurately matched. In addition, the application also relates to a random coin spray image processing device which comprises a scanning shooting unit, a light supplementing unit and an image processing unit. Finally, the application provides an electronic device, a readable storage medium for implementing the above image processing method. Particular advantages include at least the following:

(1) According to the application, a hardware ornament feature recognition technology based on a movable camera and an algorithm is provided, so that specific areas on the hardware ornament are accurately collected and recognized, and accurate image data is provided for spray painting;

(2) According to the application, high-quality spray painting images are generated through algorithm processing and optimization, so that definition and detail display of a spray painting effect are ensured, and artistic and commercial values of spray painting of hardware ornaments are improved;

(3) According to the application, the automatic hardware ornament image acquisition and processing based on the scanning camera greatly improves the production efficiency and consistency, reduces the manual operation and errors and reduces the production cost.

(4) In the application, the accuracy and stability of the hardware ornament feature recognition algorithm can adapt to different hardware ornament shapes and materials, has wide applicability and expandability, and meets the requirements of different clients

Drawings

Fig. 1 is a schematic diagram of a spray image processing system of a scanning camera according to the present application.

Fig. 2 is a schematic diagram of a scanning unit according to the present application.

Fig. 3 is a schematic structural diagram of a light supplementing unit according to the present application.

Fig. 4 is a schematic diagram of an image processing apparatus according to the present application.

Fig. 5 is a schematic diagram of an image processing flow provided by the present application.

Fig. 6 is a schematic diagram of an original image captured by scanning according to the present application.

Fig. 7 is a schematic diagram of feature recognition according to the present application.

Fig. 8 is a schematic diagram of calibration conversion provided by the present application.

Fig. 9 is a spray painting data file obtained after image rendering according to the present application.

Fig. 10 is a schematic structural diagram of an electronic device according to the present application.

Detailed Description

Detailed description of the embodiments and operational steps of the present application further include camera setup and adjustment, algorithm operating parameters, and the like.

The technical solution of the present application will be clearly and completely described below with reference to the accompanying drawings and detailed description, but it will be understood by those skilled in the art that the examples described below are some, but not all, examples of the present application, and are intended to be illustrative of the present application only and should not be construed as limiting the scope of the present application. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to be within the scope of the application. The specific conditions are not noted in the examples and are carried out according to conventional conditions or conditions recommended by the manufacturer. The reagents or apparatus used were conventional products commercially available without the manufacturer's attention.

In the description of the present application, it should be noted that the directions or positional relationships indicated by the terms "center", "upper", "lower", "left", "right", "vertical", "horizontal", "inner", "outer", etc. are based on the directions or positional relationships shown in the drawings, are merely for convenience of describing the present application and simplifying the description, and do not indicate or imply that the devices or elements referred to must have a specific orientation, be configured and operated in a specific orientation, and thus should not be construed as limiting the present application. Furthermore, the terms "first," "second," and "third" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance.

In the description of the present application, it should be noted that, unless explicitly specified and limited otherwise, the terms "mounted," "fixed," "connected" and "connected" are to be construed broadly, and may be, for example, fixedly connected, detachably connected, or integrally connected; can be mechanically or electrically connected; can be directly connected or indirectly connected through an intermediate medium, and can be communication between two elements. The specific meaning of the above terms in the present application will be understood in specific cases by those of ordinary skill in the art.

The spray painting image processing method based on the scanning camera provided by the embodiment of the application can be applied to electronic equipment such as a spray painting device, scanning equipment and the like for spray painting the surface of the hardware ornament.

The spray image processing method based on the scanning camera provided by the embodiment of the application can be applied to a spray drawing system shown in fig. 1. As shown in fig. 1, the spray painting system may include an image processing device 11 and a spray painting device 21

The image processing device 11 scans the photographed object data and converts the photographed object data into a file readable by the inkjet device in combination with the pattern processing of the region inkjet. For example, the spraying requirements of the specified area spraying on the coin, the spraying requirements of the specified area spraying on the ear nail, and the like, which need the spraying pattern to be matched with the characteristics of the object.

The inkjet printing apparatus 21 performs an inkjet printing operation on a data file acquired and processed by the image processing apparatus 11.

The following describes in detail the process flow, method and apparatus of the present application for processing the spray image based on the scanning camera by spraying the pattern matching with the texture of the coin itself on the specific area of the coin surface.

In some embodiments, as shown in fig. 2 and 3, the photographing unit includes: the camera comprises a camera 5, a lens 6, a high-flexibility power line 5-1, a high-flexibility net line 5-3, a camera power adapter 5-2 and a fixing frame 4. The scanning unit includes: the camera power adapter comprises a guide rail 2, a motor 1, a synchronous belt 3 and a jig 8, wherein a lens 6 is connected to a camera 5 and then fixed on a fixing frame 4, and a camera power adapter 5-2 supplies power to the camera 5 through a high-flexibility power line 5-1. The fixing frame 4 is connected with the synchronous belt 3, the motor 1 rotates to drive the synchronous belt 3, so that the camera 5 on the fixing frame 4 and the camera 5 along the guide rail 2 can move along the XY axis, and the camera 4 can shoot images on all the jigs 8 and transmit the images to the image processing unit through the high-flexibility net twine 5-3.

In some embodiments, the light supplementing unit as shown in fig. 2 and 3 includes: the camera comprises a light source 7, a light source controller 7-2 and a light source extension line 7-1, wherein the light source 7 is fixed on a fixed frame 4 under a camera 5, the light source controller 7-2 is powered by the light source extension line 7-1, and the light source 7 emits a light source coaxial with the camera 5, so that the camera 5 can shoot a clear picture and the light source is sufficient.

Further, the camera 5 is fixed on the fixing frame 4, and can be adjusted slightly up and down, left and right, so that the camera lens 6 and the light source 7 are kept coaxial to ensure the brightness and contrast of the coin image.

In some embodiments, when a single-camera scanning shooting mode is adopted, the coin array is arranged on the jig, the motor 1 drives the synchronous belt 3 to enable the camera to move along the X axis and the Y axis, and in a flying shooting state, static coins are shot to acquire all coin image information, and the current frame image information is transmitted to the image processing unit.

In some embodiments, when the multi-camera transverse scanning shooting mode is adopted, the coin array is arranged on the jig, the motor 1 drives the synchronous belt 3 to enable the multi-camera to move along the X axis, and in a flying shooting state, static coins are shot to acquire all coin image information, and the current frame image information is transmitted to the image processing unit.

In some embodiments, when the multi-camera fixed shooting mode is adopted, the coin array is arranged on the jig, the motor 1 drives the synchronous belt 3 to enable the shooting unit formed by the multiple cameras to be positioned in the center of the jig, and in a fixed state, the static coins are shot once to acquire all coin image information, and the image information is transmitted to the image processing unit.

In some embodiments, as shown in fig. 1, the inkjet printing unit uses inkjet printing software according to the image data generated by the image processing unit, and the inkjet printing device is used to inkjet print the image on a specific area of the coin, so as to ensure inkjet printing efficiency and effect.

In some embodiments, as shown in fig. 4, the image processing apparatus 11 includes: a photographing unit 12 for photographing an original image 16 of coins fixed at randomly distributed positions on the jigs; a light supplementing unit 13 for providing a uniform and stable light source to ensure brightness and contrast of the coin image; a scanning unit 14 for scanning the moving photographing unit 12 and the light supplementing unit 13; the image processing unit 15 is responsible for processing and analyzing the original coin image 16 collected by the camera to generate spray drawing data 17 for spray drawing.

In some embodiments, as shown in fig. 4, the image processing unit performs preprocessing, feature extraction, feature matching, calibration conversion, and image rendering on the collected coin image, and finally generates image data of the spray painting and transmits the image data to the spray painting device, and the specific flow is as follows:

s201, after the image processing unit receives all current coin images transmitted by the camera, the image preprocessing according to the preprocessing algorithm comprises the following steps: image correction, image denoising, enhancement and smoothing, and image stitching, and converging a plurality of image information to obtain clear and complete coin image information, as shown in fig. 6.

S202, after preprocessing an image, carrying out feature extraction according to a feature extraction algorithm, wherein the feature extraction method comprises the following steps: edge detection, SIFT/SURF key point detection, contour extraction, thereby obtaining information such as shape, texture, edge and the like of all coins to generate a characteristic image, as shown in fig. 7.

S203, matching the characteristic information generated in the previous step with the extracted coin characteristic and the characteristic in the material template by a characteristic matching method. Based on the feature matching result, the position and angle of the coin in the image are determined by using a neighbor matching, feature descriptor matching algorithm, the coordinate data represents the position of the coin in the image, and the angle data represents the rotation angle of the coin with respect to the reference coordinate system, as shown in fig. 8.

S204, outputting the coin coordinates and the angle data converted by calibration, performing graphic rendering, finally generating an image file for spray painting, and transmitting the image file to a spray painting device for spray painting operation as shown in FIG. 9.

The present application provides hardware of an electronic device for realizing the functions of the above-mentioned image processing unit, as shown in fig. 10, the electronic device includes: processor 301, communication interface 302, memory 303, bus 304.

A processor 301, the processor 301 is a device capable of implementing or executing various exemplary logic blocks, modules and circuits. It may be implemented as a central processing unit, general purpose processor, digital signal processor, application specific integrated circuit, field programmable gate array or other programmable logic device, transistor logic device, hardware components, or any combination thereof. The processor 301 is capable of executing the functions in combination with the various exemplary logical blocks, units and circuits described in this disclosure.

A communication interface 302 for connecting with other devices via a communication network. The communication network may be a wired local area network, a wireless access network, a wireless local network, etc.

Memory 303 is a static storage device capable of storing read-only information or other types of static information and instructions. It may also be a dynamic memory device capable of storing random access information and instructions, or other devices capable of storing information and instructions. Furthermore, memory 303 may also be an electrically erasable programmable read-only memory, a magnetic disk storage medium, or other magnetic storage device, or even other medium capable of carrying or storing program code in the form of instructions or data structures and that can be accessed by a computer. Memory 303 may be separate from processor 301 and may be coupled to the processor via bus 304 for storing instructions or program code. The image processing method provided by the present application can be implemented when the processor 303 invokes and executes instructions or program codes stored in the memory 304. Furthermore, the memory 303 may also be integrated with the processor 301 as another possible implementation.

Bus 304 may be an extended industrial control bus or the like.

Embodiments of the present application also provide a computer readable storage medium capable of storing all or part of the flow associated with the above-described method embodiments. These flows may be accomplished by computer instructions to instruct the associated hardware. In execution, the program in the storage medium includes a flow corresponding to the above-described method embodiment. The computer readable storage medium may be a memory or part of the foregoing embodiments. The computer readable storage medium may also be used as an external storage device of the electronic device, for example, a hard disk or a smart memory card plugged into the electronic device.

The foregoing is merely illustrative of the preferred embodiments of the present application and is not intended to limit the embodiments and scope of the present application, and it should be appreciated by those skilled in the art that equivalent substitutions and obvious variations may be made using the description and illustrations of the present application, and are intended to be included in the scope of the present application.

Claims (14)

1. A scanning camera-based spray image processing system, comprising:

the shooting unit is used for shooting hardware ornament images fixed at random distribution positions on the clamp;

a light supplementing unit for providing a uniform and stable light source to ensure brightness and contrast of the coin image;

the scanning unit is used for scanning shooting and fixed shooting by the mobile shooting unit and the light supplementing unit;

the image processing unit is responsible for processing and analyzing the hardware ornament image acquired by the camera and generating image data for spray painting.

2. The scan camera-based spray image processing system of claim 1, wherein the capture unit comprises: camera, camera lens, high gentle power cord, high gentle net twine, camera power adapter and mount.

The camera power adapter supplies power to the camera through the high-flexibility power line.

3. The scanning-camera-based spray image processing system according to claim 1 or 2, wherein the light supplementing unit emits a light source coaxial with the camera for ensuring that the picture taken by the camera is clear and the light source is sufficient.

4. The scan camera-based spray image processing system of claim 1, wherein the scanning unit comprises: the device comprises a guide rail, a motor, a synchronous belt and a jig;

the fixing frame is connected with the synchronous belt, and the motor rotates to drive the synchronous belt to move, so that the shooting unit and the light supplementing unit can move along the guide rail along the XY axis.

5. The scanning camera-based spray image processing system of claim 1, wherein the scanning unit movable shooting unit and the light supplementing unit perform single-camera scanning shooting, multi-camera sweeping shooting and multi-camera fixed shooting.

The number of the shooting units can be increased according to the requirement, but the number of the shooting units is at least 1 when the shooting units are applied to single-camera scanning shooting, and the number of the shooting units is at least 2 when the shooting units are applied to multi-camera sweeping shooting and multi-camera fixed shooting.

6. The spray painting image processing method based on the scanning camera is characterized by being used for realizing the functions of the image processing unit, and the image processing unit processes the collected hardware ornament image according to the image processing method and finally generates a data file for spray painting.

7. The scan camera-based spray image processing method according to claim 6, wherein the image processing method comprises the steps of:

s1, preprocessing an image, namely preprocessing the acquired hardware ornament image to obtain a complete large image of all article information;

s2, extracting features, namely extracting features of the hardware ornament image by using a feature recognition algorithm;

s3, calibrating and converting, and calculating coordinate and angle data of the hardware ornament based on the feature matching result;

and S4, image rendering, namely outputting the recognized hardware ornament coordinates and angle data for subsequent image generation and spray painting.

8. The scan camera-based spray image processing method of claim 7, wherein the image preprocessing comprises: image correction, image denoising, enhancement and smoothing, and image stitching.

9. The scan camera-based spray image processing method according to claim 7, wherein the symptom extraction method comprises: edge detection, SIFT/SURF key point detection and contour extraction, so that information such as the shape, texture, edge and the like of all hardware ornaments is obtained to generate a characteristic image.

10. The method for processing the spray image based on the scanning camera according to claim 7, wherein the feature matching method is characterized in that firstly, hardware ornament features at a central position are identified as a material template, and then the other extracted hardware ornament features are matched with features in the material template; the positions and angles of all coins in the image are determined by using a neighbor matching, feature descriptor matching algorithm.

11. The scan camera based spray image processing method according to claim 7, wherein the calibration transformation is based on feature matching results, and coordinates and angle data of the hardware ornament are calculated.

12. The scan camera-based spray pattern image processing method of claim 7, wherein the image rendering is to superimpose the coordinate and angle data of the hardware ornament converted by calibration and the spray pattern, and output TIFF files accurately matching all the spray patterns of the hardware ornament.

13. An optoelectronic device, comprising: a processor and a memory for storing a computer program, the processor being adapted to run the program in the memory for implementing the image processing method of any of claims 6 to 12.

14. A computer-readable storage medium, the computer-readable storage medium comprising: computer software program which, when run in an image processing apparatus, causes the image processing unit to implement the image processing method of any of claims 6 to 12.