CN116862890A - Method, device, equipment and medium for determining assembly line of vehicle door - Google Patents

Method, device, equipment and medium for determining assembly line of vehicle door Download PDF

Info

Publication number
CN116862890A
CN116862890A CN202310911120.6A CN202310911120A CN116862890A CN 116862890 A CN116862890 A CN 116862890A CN 202310911120 A CN202310911120 A CN 202310911120A CN 116862890 A CN116862890 A CN 116862890A
Authority
CN
China
Prior art keywords
door
target
color information
determining
color
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202310911120.6A
Other languages
Chinese (zh)
Inventor
邢春上
张天奇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Faw Nanjing Technology Development Co ltd
FAW Group Corp
Original Assignee
Faw Nanjing Technology Development Co ltd
FAW Group Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Faw Nanjing Technology Development Co ltd, FAW Group Corp filed Critical Faw Nanjing Technology Development Co ltd
Priority to CN202310911120.6A priority Critical patent/CN116862890A/en
Publication of CN116862890A publication Critical patent/CN116862890A/en
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/0002—Inspection of images, e.g. flaw detection
    • G06T7/0004—Industrial image inspection
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/0464—Convolutional networks [CNN, ConvNet]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/90—Determination of colour characteristics
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/764—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using classification, e.g. of video objects
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/82—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using neural networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10024—Color image
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20081—Training; Learning
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20084—Artificial neural networks [ANN]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30108—Industrial image inspection
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
    • Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
    • Y02P90/30—Computing systems specially adapted for manufacturing

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Evolutionary Computation (AREA)
  • General Health & Medical Sciences (AREA)
  • Software Systems (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Health & Medical Sciences (AREA)
  • Artificial Intelligence (AREA)
  • Computing Systems (AREA)
  • Medical Informatics (AREA)
  • Databases & Information Systems (AREA)
  • Multimedia (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Biomedical Technology (AREA)
  • Biophysics (AREA)
  • Computational Linguistics (AREA)
  • Data Mining & Analysis (AREA)
  • Molecular Biology (AREA)
  • General Engineering & Computer Science (AREA)
  • Mathematical Physics (AREA)
  • Quality & Reliability (AREA)
  • Automobile Manufacture Line, Endless Track Vehicle, Trailer (AREA)

Abstract

The invention discloses a method, a device, equipment and a medium for determining a production line of a vehicle door, and relates to the technical field of vehicle assembly. Comprising the following steps: acquiring a door image of a target door; determining a frame area and a door guard board area of a target car door from a car door image, and determining color information of the frame area and color information of the door guard board area; if the color information of the door guard plate area is different from the preset color information, determining a target assembly line of the target vehicle door according to the color information of the vehicle frame area and the color information of the door guard plate area, wherein the target assembly line is used for processing the target vehicle door. According to the method and the device, the target assembly line is determined according to the color information of the frame area and the door area determined in the door image, and compared with the mode of manually identifying the color of the door guard board and manually adjusting the door in the prior art, the method and the device improve the misloading detection efficiency of the door guard board, the door processing efficiency and the assembly accuracy of the door guard board.

Description

Method, device, equipment and medium for determining assembly line of vehicle door
Technical Field
The invention relates to the technical field of vehicle assembly, in particular to a method, a device, equipment and a medium for determining a production line of a vehicle door.
Background
Along with the rapid development of the automobile industry, the types of automobile models are continuously increased, and the colors of the interior door guard plates are also more abundant.
In the current automobile main engine factory assembly workshop, still rely on a large amount of personnel to carry out manual detection debugging to the interior trim door backplate that installs, door detection and debugging's efficiency is lower.
Disclosure of Invention
The invention provides a method, a device, equipment and a medium for determining a production line of a vehicle door, which are used for improving the misloading detection efficiency, the vehicle door processing efficiency and the equipment accuracy of the door guard board.
In a first aspect, the present invention provides a method for determining a vehicle door in a production line, including:
acquiring a door image of a target door;
determining a frame area and a door guard board area of a target car door from a car door image, and determining color information of the frame area and color information of the door guard board area;
if the color information of the door guard plate area is different from the preset color information, determining a target assembly line of the target vehicle door according to the color information of the vehicle frame area and the color information of the door guard plate area, wherein the target assembly line is used for processing the target vehicle door.
In a second aspect, the present invention also provides a vehicle door assembly line determining apparatus, including:
the image acquisition module is used for acquiring a door image of the target door;
the color information determining module is used for determining a frame area and a door guard board area of the target car door from the car door image and determining color information of the frame area and color information of the door guard board area;
the assembly line determining module is used for determining a target assembly line of the target car door according to the color information of the car frame area and the color information of the door guard plate area if the color information of the door guard plate area is different from the preset color information, and the target assembly line is used for processing the target car door.
In a third aspect, an embodiment of the present invention further provides an electronic device, including:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein the method comprises the steps of
The memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of pipelining a vehicle door provided by any one of the embodiments of the present invention.
In a fourth aspect, embodiments of the present invention further provide a computer readable storage medium storing computer instructions for causing a processor to execute the method for determining a pipeline of a vehicle door according to any one of the embodiments of the present invention.
According to the embodiment of the invention, the door image of the target door is acquired; determining a frame area and a door guard board area of a target car door from a car door image, and determining color information of the frame area and color information of the door guard board area; if the color information of the door guard plate area is different from the preset color information, determining a target assembly line of the target vehicle door according to the color information of the vehicle frame area and the color information of the door guard plate area, wherein the target assembly line is used for processing the target vehicle door. According to the technical scheme provided by the embodiment of the invention, the color information of the frame area and the door area can be determined from the door image, and compared with the mode of manually identifying the color of the door guard plate in the prior art, the color identification efficiency of the door guard plate is improved; whether the door guard board is in a wrong-missing state or not is detected according to the identified color of the door guard board, and the wrong-missing state detection efficiency of the door guard board is improved; according to the color information of the frame area and the color information of the door guard board area, a target assembly line is determined, so that the correct door guard board is assembled for the vehicle door through the target assembly line, and compared with the mode of manually processing the vehicle door with the door guard board assembled in a missed manner in the prior art, the processing efficiency of the vehicle door and the assembling accuracy of the door guard board of the vehicle door are improved.
It should be understood that the description in this section is not intended to identify key or critical features of the embodiments of the invention or to delineate the scope of the invention. Other features of the present invention will become apparent from the description that follows.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required for the description of the embodiments will be briefly described below, and it is apparent that the drawings in the following description are only some embodiments of the present invention, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a flow chart of a method for determining a vehicle door assembly line according to a first embodiment of the present invention;
FIG. 2 is a flow chart of a method for determining a vehicle door assembly line according to a second embodiment of the present invention;
FIG. 3 is a flow chart of a method of determining a vehicle door assembly line according to a third embodiment of the invention;
fig. 4 is a schematic structural view of a line determining apparatus for a vehicle door according to a fourth embodiment of the present invention;
fig. 5 is a schematic structural view of an electronic device implementing a method for determining a flow line of a vehicle door according to an embodiment of the present invention.
Detailed Description
In order that those skilled in the art will better understand the present invention, a technical solution in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in which it is apparent that the described embodiments are only some embodiments of the present invention, not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the present invention without making any inventive effort, shall fall within the scope of the present invention.
It should be noted that the terms "first" and "second" and the like in the description and the claims of the present invention and the above drawings are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate such that the embodiments of the invention described herein may be implemented in sequences other than those illustrated or otherwise described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
In the technical scheme of the embodiment of the invention, the acquisition, storage, application and the like of the related vehicle door images and the like all accord with the regulations of related laws and regulations, and the prior art is not violated.
Example 1
Fig. 1 is a flowchart of a vehicle door pipelining method according to an embodiment of the present invention, where the method may be performed by a vehicle door pipelining apparatus, and the vehicle door pipelining apparatus may be implemented in hardware and/or software, and specifically configured in an electronic device, such as a server.
Referring to the method for determining the assembly line of the vehicle door shown in fig. 1, the method comprises the following steps:
s101, acquiring a door image of a target door.
In this embodiment, the target door may be a door of a target line to be determined. The door image may be an image of the target door. In one embodiment, a door image of a target door may be acquired by capturing a target door with an industrial camera. In another embodiment, the door video of the target door may be recorded by an industrial camera, and the door image of the target door may be captured from the door video.
S102, determining a frame area and a door guard board area of a target vehicle door from a vehicle door image, and determining color information of the frame area and color information of the door guard board area.
In this embodiment, the frame area may be an area where the frame of the target door is located in the door image. The door guard area may be an area where the door guard is located in the door guard image. The color information is information for characterizing the color. In an alternative embodiment, the color information may be represented in the form of color levels, where each color level characterizes a different color, and the association between the color level and the corresponding color may be set by the technician autonomously. In another alternative embodiment, the color information may be represented in the form of pixel values having the same number of dimensions as the number of color channels of the door image; for example, if the door image is a three-dimensional color image, i.e., the number of color channels of the door image is 3, the color information may be in the form of (a, B, C), where a represents the pixel value of the first color channel, B represents the pixel value of the second color channel, and C represents the pixel value of the third color channel.
Specifically, a neural network model is adopted to detect a target of a vehicle door image, a frame area and a door guard board area of the target vehicle door are determined from the vehicle door image, and color information of the frame area and color information of the door guard board area are determined by adopting a certain algorithm. In a specific embodiment, a YOLOv5 Network model using a ResNet (Residual Network) as a backbone Network is used for performing target detection on a vehicle door image, so that the calculation amount required for performing target detection on the vehicle door image is reduced, and the recognition efficiency of a vehicle frame area and a door guard plate area is improved.
Optionally, determining color information of the frame area includes: obtaining pixel values of all pixel points in the frame area; counting the number of pixel points with the same pixel value; and determining color information of the frame area according to the number of pixel points of each pixel value.
Specifically, for each color channel of the frame region, obtaining a pixel value of each pixel point in the frame region in the color channel; counting the number of pixel points with the same pixel value in the color channel; determining the number ratio between the number of pixel points of each pixel value in the color channel and the number of all pixel points in the frame area; determining a difference between the number ratio of the pixel value with the largest number ratio and the number ratio of the pixel value with the second largest number ratio in the color channel; if the difference is smaller than the preset difference, taking the pixel value with the largest quantity ratio and the pixel value with the second largest quantity ratio as the color information of the frame area in the color channel; if the difference is greater than or equal to the preset difference, the pixel value with the largest numerical ratio in the color channel is used as the color information of the frame area in the color channel. Wherein the second largest pixel value of the number ratio may be a pixel value of which the number ratio is only smaller than the largest number ratio. The preset difference value can be set by the technician according to the actual requirement or practical experience.
It can be understood that by adopting the above technical scheme, the ratio of the number of the pixels of each pixel value in the frame area can be determined according to the number of the pixels of each pixel value, so as to determine that the color of the frame area is a single color or a spliced color; the color information of the frame area is further determined according to the number of the pixel points of each pixel value, the defect that only a single color can be identified in the prior art is overcome, and the accuracy of the color information of the frame area is improved.
Optionally, determining color information of the door guard plate area includes: for each color channel of the door guard plate area, determining the average value of pixel values of all pixel points in the color channel; and taking the pixel value average value as color information of the door guard plate image in the color channel.
And S103, if the color information of the door guard plate area is different from the preset color information, determining a target assembly line of the target vehicle door according to the color information of the vehicle frame area and the color information of the door guard plate area, wherein the target assembly line is used for processing the target vehicle door.
In this embodiment, the preset color information may be set by a technician according to actual requirements or practical experience, which is not limited in the present invention. The target pipeline is the pipeline for processing the target vehicle door.
Specifically, if the color information of the door guard plate area is different from the preset color information, a certain algorithm is adopted, and a target assembly line of the target vehicle door is determined according to the color information of the vehicle frame area and the color information of the door guard plate area so as to transfer the target vehicle door to the target assembly line for processing.
In an alternative embodiment, the target vehicle door moves on the pipeline in which the target vehicle door is located, and the vehicle door image is an image of the target vehicle on the pipeline in which the target vehicle is located; if the color information of the door guard plate area is the same as the preset color information, taking the assembly line where the target vehicle door is located as the target assembly line of the target vehicle door, namely, keeping the target vehicle door on the assembly line where the target vehicle door is located, and not transferring the assembly line to other assembly lines.
The method comprises the steps of obtaining a door image of a target door; determining a frame area and a door guard board area of a target car door from a car door image, and determining color information of the frame area and color information of the door guard board area; if the color information of the door guard plate area is different from the preset color information, determining a target assembly line of the target vehicle door according to the color information of the vehicle frame area and the color information of the door guard plate area, wherein the target assembly line is used for processing the target vehicle door. According to the technical scheme provided by the embodiment of the invention, the color information of the frame area and the door area can be determined from the door image, and compared with the mode of manually identifying the color of the door guard plate in the prior art, the color identification efficiency of the door guard plate is improved; whether the door guard board is in a wrong-missing state or not is detected according to the identified color of the door guard board, and the wrong-missing state detection efficiency of the door guard board is improved; according to the color information of the frame area and the color information of the door guard board area, a target assembly line is determined, so that the correct door guard board is assembled for the vehicle door through the target assembly line, and compared with the mode of manually processing the vehicle door with the door guard board assembled in a missed manner in the prior art, the processing efficiency of the vehicle door and the assembling accuracy of the door guard board of the vehicle door are improved.
Example two
Fig. 2 is a flowchart of a method for determining a vehicle door assembly line according to a second embodiment of the present invention, where the determining operation of a target assembly line is optimized and improved based on the technical solution of the foregoing embodiment.
Further, the target assembly line for determining the target vehicle door is thinned according to the color information of the vehicle frame area and the color information of the door guard board area, and if the color information of the vehicle frame area is the same as the color information of the door guard board area, the door guard board installation assembly line is determined to be the target assembly line for the target vehicle door; if the color information of the frame area is different from the color information of the door guard board area, determining a target color difference between the color information of the frame area and the color information of the door guard board area; and determining a target assembly line of the target vehicle door according to a comparison result between the target color difference and the preset color difference so as to perfect the determining operation of the target assembly line.
In the embodiments of the present invention, the details are not described, and reference may be made to the description of the foregoing embodiments.
Referring to the method for determining the assembly line of the vehicle door shown in fig. 2, the method comprises the following steps:
s201, acquiring a door image of a target door.
S202, determining a frame area and a door guard board area of a target vehicle door from a vehicle door image, and determining color information of the frame area and color information of the door guard board area.
And S203, if the color information of the door guard plate area is different from the preset color information and the color information of the vehicle frame area is the same as the color information of the door guard plate area, determining the door guard plate installation assembly line as a target assembly line of the target vehicle door.
In this embodiment, the door guard mounting line may be a line for mounting a door guard for a target vehicle door. Specifically, the same color information of the frame area and the door guard board area can be used for representing that the door guard board is neglected to be installed on the target vehicle door, and then the door guard board installation assembly line is determined to be the target assembly line of the target vehicle door.
S204, if the color information of the door guard board area is different from the preset color information, and the color information of the vehicle frame area is different from the color information of the door guard board area, determining the target color difference between the color information of the vehicle frame area and the color information of the door guard board area.
In this embodiment, the target color difference is the difference between the color information of the frame area and the color information of the door shield area. In an alternative embodiment, the color information is represented in the form of a color level, and the target color difference may be a level difference between the color level of the frame area and the color level of the door trim area. In another alternative embodiment, the color information is represented in the form of pixel values, and the target color difference may be a difference between the pixel values of the frame area and the gate area.
S205, determining a target assembly line of the target vehicle door according to a comparison result between the target color difference and the preset color difference.
In this embodiment, the preset color difference may be set by a technician according to the actual requirement or practical experience, which is not limited in the present invention.
Optionally, determining the target assembly line of the target vehicle door according to a comparison result between the color difference value and the preset color difference value includes: if the target color difference is smaller than or equal to the preset color difference, determining a door guard plate paint spraying assembly line as a target assembly line of a target vehicle door; if the target color difference is larger than the preset color difference, determining the door guard plate disassembly assembly line as a target assembly line of the target vehicle door.
The door guard plate paint spraying assembly line can be an assembly line for spraying paint on the door guard plate on the target car door. The door guard plate disassembly assembly line can be an assembly line for disassembling a door guard plate on a target vehicle door.
It can be appreciated that by adopting the technical scheme, different target assembly lines can be determined for the target vehicle door according to the size relation between the target color difference and the preset color difference so as to determine the paint spraying operation or the dismounting operation of the door guard plate in the target vehicle door, and compared with the technical scheme of only dismounting and reloading the mistakenly-mounted door guard plate in the prior art, the flexibility of processing the target vehicle door is improved.
In the embodiment of the invention, if the color information of the door guard plate area is the same as the color information of the door guard plate area under the condition that the color information of the door guard plate area is different from the preset color information, determining the door guard plate installation assembly line as a target assembly line of a target vehicle door; if the color information of the frame area is different from the color information of the door guard board area, determining a target color difference between the color information of the frame area and the color information of the door guard board area; and determining a target assembly line of the target vehicle door according to a comparison result between the target color difference and the preset color difference. According to the technical scheme, different target pipelines are determined for the target vehicle door according to the comparison result between the color information of the vehicle frame area and the color information of the door guard plate area and the comparison result between the target color difference and the preset color difference, so that the flexibility of determining the target pipelines is improved; and the target assembly line is determined for the target car door according to the color information and the color difference, compared with the technical scheme that the car door guard board is manually detected and the car door is processed in the prior art, the detection efficiency of the car door guard board and the processing efficiency of the car door are improved.
Example III
Fig. 3 is a flowchart of a method for determining a vehicle door assembly line according to a third embodiment of the present invention, where the determining operation of the vehicle door image is optimized and improved based on the technical solution of the foregoing embodiment.
Further, the ' acquiring the door image of the target door ' is thinned to ' acquiring the original image of the target door, and the environmental illumination intensity of a door guard plate detection assembly line is determined; and carrying out color correction on the original image according to the ambient illumination intensity to obtain a vehicle door image so as to perfect the acquisition operation of the vehicle door image.
In the embodiments of the present invention, the details are not described, and reference may be made to the description of the foregoing embodiments.
Referring to the method for determining the assembly line of the vehicle door shown in fig. 3, the method comprises the following steps:
s301, acquiring an original image of a target vehicle door, and determining the ambient illumination intensity of a door guard plate detection assembly line.
In this example, the original image may be an RGB format image that is directly captured of the target door. The door guard detection assembly line may be an assembly line that performs door guard detection on a target vehicle door. The target car door is located on the door guard plate detection assembly line, namely the original image is an image of the target car door located on the door guard plate detection assembly line. The ambient illumination intensity is the illumination intensity in the environment where the door guard plate detection assembly line is located.
S302, performing color correction on the original image according to the ambient illumination intensity to obtain a vehicle door image.
Specifically, a certain algorithm is adopted to correct the original image, and a door image is obtained.
Optionally, performing color correction on the original image according to the ambient illumination intensity to obtain a vehicle door image, including: converting the color format of the original image into an HSL (Hue-Saturation-brightness) format; correcting the color component of the L channel in the original image after format conversion according to the ambient illumination intensity; and determining the vehicle door image according to the H-channel color component, the S-channel color component and the corrected L-channel color component in the original image after format conversion.
The color component may be a pixel value of the pixel point in the corresponding channel; the L channel color component is the pixel value of the pixel point in the L channel; the color component of the H channel is the pixel value of the pixel point in the H channel; the S-channel color component is the pixel value of the pixel point in the S-channel.
Specifically, a certain algorithm is adopted to convert an original image in an RGB format into an original image in an HSL format; correcting pixel values of all pixel points in an L-color channel of the original image in the HSL format according to the ambient illumination intensity to obtain a corrected L-channel color component; an image composed of the H-channel color component, the S-channel color component, and the corrected L-channel color component is determined as a door image.
It can be appreciated that by adopting the technical scheme, the L-channel color component representing the image brightness in the original image is corrected according to the ambient illumination intensity to obtain the vehicle door image, so that the influence of the ambient illumination on the color brightness in the image can be reduced, the color accuracy of the vehicle door image is improved, and the accuracy of the color information of the vehicle frame region and the color information of the door guard plate region is further improved.
Optionally, correcting the L-channel color component in the format-converted original image according to the ambient illumination intensity includes: determining the ratio of the illumination intensity between the ambient illumination intensity and the preset illumination intensity; and determining the corrected L-channel color component according to the illumination intensity ratio and the L-channel color component in the original image after format conversion.
The preset illumination intensity can be set by a technician according to actual requirements or practical experience. Specifically, the ratio between the L-channel color component and the illumination intensity ratio in the format-converted original image is determined as the corrected L-channel color component.
It can be understood that by adopting the above technical scheme, if the ambient illumination intensity is greater than the preset illumination intensity, the L-channel color component is corrected according to the illumination intensity ratio, so that the L-channel color component can be increased; if the ambient illumination intensity is smaller than the preset illumination intensity, correcting the color component of the L channel according to the illumination intensity ratio, so that the color component of the L channel can be reduced; and correcting the L-channel color component according to the illumination intensity ratio to reduce the influence of ambient illumination on the L-channel color component, thereby acquiring an accurate L-channel color component and further acquiring a door image with accurate color.
S303, determining a frame area and a door guard board area of the target vehicle door from the vehicle door image, and determining color information of the frame area and color information of the door guard board area.
S304, if the color information of the door guard plate area is different from the preset color information, determining a target assembly line of the target vehicle door according to the color information of the vehicle frame area and the color information of the door guard plate area, wherein the target assembly line is used for processing the target vehicle door.
According to the embodiment of the invention, an original image of a target car door is obtained, and the environmental illumination intensity of a door guard plate detection assembly line is determined; and carrying out color correction on the original image according to the ambient illumination intensity to obtain a vehicle door image. According to the technical scheme provided by the embodiment of the invention, the influence of ambient light on the brightness of the image can be reduced, so that the accurate image color is obtained, the color accuracy of the door image is improved, and the accuracy of the color information of the frame area and the color information of the door guard plate area determined from the door image is further improved.
Example IV
Fig. 4 is a schematic structural diagram of a vehicle door assembly line determining device according to a fourth embodiment of the present invention. The method and the device can be applied to the situation that the assembly line of the vehicle door is determined, the device can execute the assembly line determining method of the vehicle door, the assembly line determining device of the vehicle door can be realized in a hardware and/or software mode, and the device can be configured in electronic equipment, such as a server.
Referring to the in-line determination apparatus of the vehicle door shown in fig. 4, it includes an image acquisition module 401, a color information determination module 402, and an in-line determination module 403, wherein,
an image acquisition module 401 for acquiring a door image of a target door;
a color information determining module 402, configured to determine a frame area and a door guard area of a target door from a door image, and determine color information of the frame image and color information of the door guard area;
the assembly line determining module 403 is configured to determine, if the color information of the door guard board area is different from the preset color information, a target assembly line of the target vehicle door according to the color information of the frame area and the color information of the door guard board area, where the target assembly line is used for processing the target vehicle door.
According to the embodiment of the invention, the image acquisition module is used for acquiring the door image of the target door; the color information determining module determines a frame area and a door guard board area of the target car door from the car door image, and determines color information of the frame image and color information of the door guard board area; and the assembly line determining module is used for determining a target assembly line of the target car door according to the color information of the car frame area and the color information of the door guard plate area if the color information of the door guard plate area is different from the preset color information, and the target assembly line is used for processing the target car door. According to the technical scheme provided by the embodiment of the invention, the color information of the frame area and the door area can be determined from the door image, and compared with the mode of manually identifying the color of the door guard plate in the prior art, the color identification efficiency of the door guard plate is improved; whether the door guard board is in a wrong-missing state or not is detected according to the identified color of the door guard board, and the wrong-missing state detection efficiency of the door guard board is improved; according to the color information of the frame area and the color information of the door guard board area, a target assembly line is determined, so that the correct door guard board is assembled for the vehicle door through the target assembly line, and compared with the mode of manually processing the vehicle door with the door guard board assembled in a missed manner in the prior art, the processing efficiency of the vehicle door and the assembling accuracy of the door guard board of the vehicle door are improved.
Optionally, the pipeline determination module 403 includes:
the first assembly line determining unit is used for determining the door guard plate installation assembly line as a target assembly line of the target vehicle door if the color information of the vehicle frame area is the same as the color information of the door guard plate area;
a color difference determining unit configured to determine a target color difference between color information of the frame region and color information of the door shield region if the color information of the frame region is different from the color information of the door shield region;
and the second assembly line determining unit is used for determining a target assembly line of the target vehicle door according to a comparison result between the target color difference and the preset color difference.
Optionally, the second pipeline determining unit is specifically configured to:
if the target color difference is smaller than or equal to the preset color difference, determining a door guard plate paint spraying assembly line as a target assembly line of a target vehicle door;
if the target color difference is larger than the preset color difference, determining the door guard plate disassembly assembly line as a target assembly line of the target vehicle door.
Optionally, the image acquisition module 401 includes:
the illumination intensity determining unit is used for acquiring an original image of the target vehicle door and determining the ambient illumination intensity of the door guard plate detection assembly line;
the image acquisition unit is used for carrying out color correction on the original image according to the ambient illumination intensity to obtain a vehicle door image.
Optionally, the image acquisition unit includes:
a format conversion subunit, configured to convert a color format of an original image into an HSL format;
the color correction subunit is used for correcting the color component of the L channel in the original image after format conversion according to the ambient illumination intensity;
an image acquisition subunit, configured to determine a door image according to the H-channel color component, the S-channel color component, and the corrected L-channel color component in the format-converted original image.
Optionally, the color correction subunit is specifically configured to:
determining the ratio of the illumination intensity between the ambient illumination intensity and the preset illumination intensity;
and determining the corrected L-channel color component according to the illumination intensity ratio and the L-channel color component in the original image after format conversion.
Optionally, the color information determining module 402 includes:
the pixel acquisition unit is used for acquiring pixel values of all pixel points in the frame area;
the quantity counting unit is used for counting the quantity of the pixel points with the same pixel value;
and the color information determining unit is used for determining the color information of the vehicle frame area according to the number of the pixel points of each pixel value.
The assembly line determining device for the vehicle door provided by the embodiment of the invention can execute the assembly line determining method for the vehicle door provided by any embodiment of the invention, and has the corresponding functional modules and beneficial effects of executing the assembly line determining method for the vehicle door.
Example five
Fig. 5 shows a schematic diagram of an electronic device 500 that may be used to implement an embodiment of the invention. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. Electronic equipment may also represent various forms of mobile devices, such as personal digital processing, cellular telephones, smartphones, wearable devices (e.g., helmets, glasses, watches, etc.), and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be exemplary only, and are not meant to limit implementations of the inventions described and/or claimed herein.
As shown in fig. 5, the electronic device 500 includes at least one processor 501, and a memory communicatively connected to the at least one processor 501, such as a Read Only Memory (ROM) 502, a Random Access Memory (RAM) 503, etc., where the memory stores computer programs executable by the at least one processor, and the processor 501 may perform various suitable actions and processes according to the computer programs stored in the Read Only Memory (ROM) 502 or the computer programs loaded from the storage unit 508 into the Random Access Memory (RAM) 503. In the RAM 503, various programs and data required for the operation of the electronic device 500 may also be stored. The processor 501, ROM 502, and RAM 503 are connected to each other by a bus 504. An input/output (I/O) interface 505 is also connected to bus 504.
A number of components in electronic device 500 are connected to I/O interface 505, including: an input unit 506 such as a keyboard, a mouse, etc.; an output unit 507 such as various types of displays, speakers, and the like; a storage unit 508 such as a magnetic disk, an optical disk, or the like; and a communication unit 509 such as a network card, modem, wireless communication transceiver, etc. The communication unit 509 allows the electronic device 500 to exchange information/data with other devices via a computer network such as the internet and/or various telecommunication networks.
The processor 501 may be a variety of general and/or special purpose processing components having processing and computing capabilities. Some examples of processor 501 include, but are not limited to, a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), various specialized Artificial Intelligence (AI) computing chips, various processors running machine learning model algorithms, digital Signal Processors (DSPs), and any suitable processor, controller, microcontroller, etc. The processor 501 performs the various methods and processes described above, such as a pipelining method of the vehicle door.
In some embodiments, the pipelining method of the vehicle door may be implemented as a computer program tangibly embodied on a computer-readable storage medium, such as storage unit 508. In some embodiments, part or all of the computer program may be loaded and/or installed onto the electronic device 500 via the ROM 502 and/or the communication unit 509. When the computer program is loaded into RAM 503 and executed by processor 501, one or more steps of the pipelining method of the vehicle door described above may be performed. Alternatively, in other embodiments, processor 501 may be configured to perform the pipelining method of the vehicle door in any other suitable manner (e.g., by means of firmware).
Various implementations of the systems and techniques described here above can be implemented in digital electronic circuitry, integrated circuit systems, field Programmable Gate Arrays (FPGAs), application Specific Integrated Circuits (ASICs), application Specific Standard Products (ASSPs), systems On Chip (SOCs), complex Programmable Logic Devices (CPLDs), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs, the one or more computer programs may be executed and/or interpreted on a programmable system including at least one programmable processor, which may be a special purpose or general-purpose programmable processor, that may receive data and instructions from, and transmit data and instructions to, a storage system, at least one input device, and at least one output device.
A computer program for carrying out methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus, such that the computer programs, when executed by the processor, cause the functions/acts specified in the flowchart and/or block diagram block or blocks to be implemented. The computer program may execute entirely on the machine, partly on the machine, as a stand-alone software package, partly on the machine and partly on a remote machine or entirely on the remote machine or server.
In the context of the present invention, a computer-readable storage medium may be a tangible medium that can contain, or store a computer program for use by or in connection with an instruction execution system, apparatus, or device. The computer readable storage medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. Alternatively, the computer readable storage medium may be a machine readable signal medium. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
To provide for interaction with a user, the systems and techniques described here can be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and a pointing device (e.g., a mouse or a trackball) through which a user can provide input to the electronic device. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic input, speech input, or tactile input.
The systems and techniques described here can be implemented in a computing system that includes a background component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such background, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), wide Area Networks (WANs), blockchain networks, and the internet.
The computing system may include clients and servers. The client and server are typically remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. The server can be a cloud server, also called a cloud computing server or a cloud host, and is a host product in a cloud computing service system, so that the defects of high management difficulty and weak service expansibility in the traditional physical host and VPS (Virtual Private Server ) service are overcome.
It should be appreciated that various forms of the flows shown above may be used to reorder, add, or delete steps. For example, the steps described in the present invention may be performed in parallel, sequentially, or in a different order, so long as the desired results of the technical solution of the present invention are achieved, and the present invention is not limited herein.
The above embodiments do not limit the scope of the present invention. It will be apparent to those skilled in the art that various modifications, combinations, sub-combinations and alternatives are possible, depending on design requirements and other factors. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present invention should be included in the scope of the present invention.

Claims (10)

1. A method of pipelining a vehicle door, the method comprising:
acquiring a door image of a target door;
determining a frame area and a door guard board area of the target vehicle door from the vehicle door image, and determining color information of the frame area and color information of the door guard board area;
if the color information of the door guard plate area is different from the preset color information, determining a target assembly line of the target car door according to the color information of the car frame area and the color information of the door guard plate area, wherein the target assembly line is used for processing the target car door.
2. The method of claim 1, wherein the determining the target pipeline for the target door based on the color information for the frame area and the color information for the door trim area comprises:
if the color information of the frame area is the same as the color information of the door guard board area, determining a door guard board installation assembly line as a target assembly line of a target vehicle door;
if the color information of the frame area is different from the color information of the door guard board area, determining a target color difference between the color information of the frame area and the color information of the door guard board area;
and determining a target assembly line of the target vehicle door according to a comparison result between the target color difference and a preset color difference.
3. The method of claim 2, wherein the determining the target pipeline for the target door based on the comparison between the color difference and a preset color difference comprises:
if the target color difference is smaller than or equal to the preset color difference, determining a door guard plate paint spraying assembly line as a target assembly line of the target vehicle door;
if the target color difference is larger than the preset color difference, determining a door guard plate disassembly assembly line as a target assembly line of the target vehicle door.
4. The method of claim 1, wherein the acquiring a door image of the target door comprises:
acquiring an original image of a door guard board of the target car door, and determining the ambient illumination intensity of a door guard board detection assembly line;
and carrying out color correction on the original image according to the ambient illumination intensity to obtain a vehicle door image.
5. The method of claim 4, wherein performing color correction on the original image according to the ambient light intensity to obtain a door image comprises:
converting the color format of the original image into an HSL format;
correcting the color component of the L channel in the original image after format conversion according to the ambient illumination intensity;
and determining the vehicle door image according to the H-channel color component, the S-channel color component and the corrected L-channel color component in the original image after format conversion.
6. The method of claim 5, wherein correcting the L-channel color component in the format-converted original image based on the ambient illumination intensity comprises:
determining the illumination intensity ratio between the ambient illumination intensity and a preset illumination intensity;
and determining the corrected L-channel color component according to the illumination intensity ratio and the L-channel color component in the original image after format conversion.
7. The method of claim 1, wherein the determining color information of the bezel area comprises:
acquiring pixel values of all pixel points in the frame area;
counting the number of pixel points with the same pixel value;
and determining the color information of the frame area according to the number of the pixel points of each pixel value.
8. An in-line determination apparatus for a vehicle door, the apparatus comprising:
the image acquisition module is used for acquiring a door image of the target door;
a color information determining module, configured to determine a frame area and a door guard board area of the target vehicle door from the vehicle door image, and determine color information of the frame image and color information of the door guard board area;
the assembly line determining module is used for determining a target assembly line of the target car door according to the color information of the car frame area and the color information of the door guard plate area if the color information of the door guard plate area is different from the preset color information, and the target assembly line is used for processing the target car door.
9. An electronic device, the electronic device comprising:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein,,
the memory stores a computer program executable by the at least one processor to enable the at least one processor to perform the pipelining method of the vehicle door of any one of claims 1-7.
10. A computer readable storage medium storing computer instructions for causing a processor to perform the method of pipelining a vehicle door of any one of claims 1-7 when executed.
CN202310911120.6A 2023-07-24 2023-07-24 Method, device, equipment and medium for determining assembly line of vehicle door Pending CN116862890A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202310911120.6A CN116862890A (en) 2023-07-24 2023-07-24 Method, device, equipment and medium for determining assembly line of vehicle door

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202310911120.6A CN116862890A (en) 2023-07-24 2023-07-24 Method, device, equipment and medium for determining assembly line of vehicle door

Publications (1)

Publication Number Publication Date
CN116862890A true CN116862890A (en) 2023-10-10

Family

ID=88223310

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202310911120.6A Pending CN116862890A (en) 2023-07-24 2023-07-24 Method, device, equipment and medium for determining assembly line of vehicle door

Country Status (1)

Country Link
CN (1) CN116862890A (en)

Similar Documents

Publication Publication Date Title
CN112581463B (en) Image defect detection method and device, electronic equipment, storage medium and product
CN111583223B (en) Defect detection method, defect detection device, computer equipment and computer readable storage medium
CN111355941B (en) Image color real-time correction method, device and system
US20200175673A1 (en) Method and device for detecting defect of meal box, server, and storage medium
CN110602488B (en) Day and night type camera device switching abnormity detection method and device and camera device
CN111833303A (en) Product detection method and device, electronic equipment and storage medium
CN113436100B (en) Method, apparatus, device, medium, and article for repairing video
US10832399B2 (en) Detection for abnormal connectivity on a product
CN113177451A (en) Training method and device of image processing model, electronic equipment and storage medium
CN112730251B (en) Device and method for detecting screen color defects
CN115205291B (en) Circuit board detection method, device, equipment and medium
CN112312001A (en) Image detection method, device, equipment and computer storage medium
CN114782286A (en) Defect repairing method, optical repairing device, electronic device and storage medium
CN112070762A (en) Mura defect detection method and device for liquid crystal panel, storage medium and terminal
CN116310903A (en) Method and device for identifying fault type of photovoltaic module and electronic equipment
CN116862890A (en) Method, device, equipment and medium for determining assembly line of vehicle door
CN116668843A (en) Shooting state switching method and device, electronic equipment and storage medium
CN113628192B (en) Image blur detection method, apparatus, device, storage medium, and program product
CN115861801A (en) Pointer instrument identification method and system, electronic equipment and readable storage medium
CN115205163A (en) Method, device and equipment for processing identification image and storage medium
CN112529928A (en) Part assembly detection method, computer device and storage medium
CN114092874B (en) Training method of target detection model, target detection method and related equipment thereof
WO2024026990A1 (en) Automatic iterative training method, system and device for recognition model, and storage medium
CN116952166B (en) Method, device, equipment and medium for detecting parts of automobile door handle assembly
CN118071839A (en) Inspection method, inspection device, inspection equipment and inspection medium for substation equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination