CN107085344A - The intelligent apparatus and method of backlight in a kind of full-automatic setting imaging system - Google Patents

The intelligent apparatus and method of backlight in a kind of full-automatic setting imaging system Download PDF

Info

Publication number
CN107085344A
CN107085344A CN201710357201.0A CN201710357201A CN107085344A CN 107085344 A CN107085344 A CN 107085344A CN 201710357201 A CN201710357201 A CN 201710357201A CN 107085344 A CN107085344 A CN 107085344A
Authority
CN
China
Prior art keywords
mrow
backlight
light emitting
module
msub
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201710357201.0A
Other languages
Chinese (zh)
Other versions
CN107085344B (en
Inventor
胡凯
翁理国
夏旻
胡伟
李渝
蒋星宇
杨颖�
苏洋
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Jiangsu Austin Photoelectric Technology Co ltd
Original Assignee
Nanjing University of Information Science and Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nanjing University of Information Science and Technology filed Critical Nanjing University of Information Science and Technology
Priority to CN201710357201.0A priority Critical patent/CN107085344B/en
Publication of CN107085344A publication Critical patent/CN107085344A/en
Application granted granted Critical
Publication of CN107085344B publication Critical patent/CN107085344B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B15/00—Special procedures for taking photographs; Apparatus therefor
    • G03B15/02—Illuminating scene
    • G03B15/03—Combinations of cameras with lighting apparatus; Flash units
    • G03B15/05—Combinations of cameras with electronic flash apparatus; Electronic flash units
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/20—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
    • G09G3/22—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters using controlled light sources
    • G09G3/30—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters using controlled light sources using electroluminescent panels
    • G09G3/32—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters using controlled light sources using electroluminescent panels semiconductive, e.g. using light-emitting diodes [LED]

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Hardware Design (AREA)
  • Theoretical Computer Science (AREA)
  • Studio Devices (AREA)

Abstract

The invention discloses a kind of intelligent apparatus of backlight in full-automatic setting imaging system and method, the device, control panel is connected with computer control, and the image information of collection and analysis camera controls the working condition of light emitting array；After operational order of the master controller module for receiving computer, sub-controller is issued instructions to so that sub-controller drive module drives the operation of each light emitting array.1. initialization that the method comprising the steps of；Step 2. judges the imaging of backlight area；Step 3. matches image and light emitting array；Step 4. computer sends information to master controller module；Step 5. gathers image；Step 6. is calculated, and step 7. is adjusted, and step 8. terminates.The present invention calculates regional luminance information automatically, then drives the light emitting diode in single region, changes brightness so that in face of the completely the same image of a colourity, shows the consistent correct effect of the brightness of regional.

Description

Intelligent device and method for automatically setting backlight in imaging system
Technical Field
The invention relates to an intelligent device and method for automatically setting backlight in an imaging system, and belongs to the technical field of auxiliary equipment when the imaging system is used.
Background
An imaging system formed by a camera and a backlight is a main device used for shooting images of products such as liquid crystal screens and the like which can transmit and then realizing nondestructive analysis on the products, and provides a good nondestructive testing means, so that people can rapidly analyze the quality of the products.
At present, a backlight plate is composed of a plurality of light emitting diodes driven by a controller and a panel with an acrylic surface, and the backlight plate cannot respectively control the brightness of a certain area. Due to the distortion of the lens of the camera, the inconsistency between the lens and the sensing array in the camera and other reasons, when the camera images, even facing an image with completely consistent chromaticity, the camera can also present the error effect of inconsistent brightness of each area, and the effect has serious influence on the next processing.
If one device can automatically adjust the backlight in the imaging system, the correct effect of consistent brightness of each area can be presented when facing an image with completely consistent chromaticity, so that the imaging system can be provided with a correct initial value, and meanwhile, the device can also be self-checked, analyze error sources and automatically report errors. It can have good influence on the next processing, thereby promoting the application of the image detection product.
After extensive research and study, the existing papers and patents have no such products.
Disclosure of Invention
In order to solve the existing problems, the invention discloses an intelligent device and a method for automatically setting backlight in an imaging system, and the specific technical scheme is as follows:
an intelligent device for automatically setting backlight in an imaging system comprises a power supply, a light-emitting module, a sound-producing module, a master controller module, a sub-controller driving module, a light-emitting array, a camera and a computer,
the power supply, the light-emitting module, the sound-producing module, the master controller module and the sub-controller driving module are integrated in one control panel, and the control panel is connected with a computer for controlling, collecting and analyzing image information of the camera and controlling the working state of the light-emitting array;
the power supply supplies power to the light-emitting module, the sound-producing module, the master controller module, the sub-controller driving module, the light-emitting array, the camera and the computer;
the light emitting module is used for displaying the working state of the light emitting array;
the pronunciation module is used for giving out an alarm when the light-emitting array works abnormally;
the main controller module is used for receiving an operation instruction of a computer and then sending an instruction to the sub-controller driving modules, so that the sub-controller driving modules drive the operation of each light-emitting array, and the main controller module also drives the work of the sound-producing module and the light-emitting module;
the sub-controller driving module is used for receiving an instruction of the main controller module and controlling the work of each light-emitting array;
the light emitting array is used for forming a light emitting part of the backlight and forming a main body of the backlight;
the camera is used for shooting an object to be detected under the operation of a computer;
the computer is used for obtaining the shooting result of the camera, analyzing and storing the pictures shot by the camera, driving the master controller module to change the work of each light-emitting array in the backlight, recording the parameters for direct use of the same batch of products next time, analyzing various states, analyzing possible error conditions and giving an alarm.
The power supply selects a 220V alternating current power supply and is converted into two 5V module power supplies, wherein one module power supply is used for supplying power to the light-emitting module, the sound-producing module, the master controller module and the branch controller driving module, and the other module power supply is used for driving the light-emitting array.
The power supply is provided with a button, the button is used for controlling the power supply to be turned on and turned off, and the button is a touch self-locking microswitch.
The main controller adopts an STM32F107 chip, and the sub-controllers adopt an STM32F103 chip.
The light emitting array is a 5mm high-brightness white light emitting diode of Risym to form a 4 x 3 light emitting matrix, and the sound producing module is a buzzer.
The camera is an industrial camera with 1070 ten thousand pixels of large constant water star MER-1070-10GM/C type, and the computer is a Dell T5810 type graphic workstation.
An intelligent method for automatically setting backlight in an imaging system comprises the following operation steps:
step 1, initialization: the computer sends information to the driving master controller module to change the state of each light emitting array in the backlight into the brightest value, and the target average brightness ratio under the normal working state is setLet the tolerable scale error range Gert be the ideal brightnessSetting the initial correction ratio of the light emitting arrayThe method (1) above;wherein i represents the ith correction iteration and sets the maximum correction iteration frequency imax;
step 2, judging the imaging of the backlight area: under the condition that an object to be detected does not exist and only backlight exists, a computer drives a camera to collect an image, an image of a target area to be detected in the image is searched after the image is obtained, namely the image of a backlight area, the backlight is composed of a plurality of light emitting arrays and is generally designed into a rectangle, if a matrix cannot be detected under the condition that all the light emitting arrays are set to be the brightest value in the step 1, the backlight hardware is abnormal or the camera has a problem, the inspection is stopped, a light emitting module and a sound emitting module are driven to perform alarm work, and the step 8 is carried out;
step 3, matching the image and the light emitting array: after obtaining a correct backlight imaging image, obtaining a backlight area long pixel value HimWide pixel value WimThen, the light emitting arrays are matched with the actual light emitting arrays one by one,
the principle is that, since mm light emitting arrays are arranged in the long direction and nn light emitting arrays are arranged in the wide direction under the known real backlight, the pixel length H of the display area of each light emitting array on the image is knownmaPixel width Wma，
Namely:
Hma＝Him/mm
Wma＝Wim/nn
thus, the whole backlight area is divided into a plurality of individual areas in the image display area, i.e., Im (m, n), where m represents the m-th array in the longitudinal direction, m is 1, …, mm, n represents the n-th array in the width direction, n is 1, …, nn,
then, according to the arrangement sequence of the light emitting arrays during circuit design, each image area Im (m, n) is paired with the light emitting array LED (m, n);
step 4, the computer sends information to the master controller module to drive the master controller module to change the display of each light-emitting array LED (m, n) in the backlight, namely the target brightness is
Step 5, collecting images, and analyzing the average brightness of each image area Im (m, n)Variance of brightness S(m，n)Average brightness G of the entire imageavgNamely:
wherein,representative are pixel values of the ith pixel in the longitudinal direction and the jth pixel in the width direction in the mth array in the longitudinal direction and the nth array in the width direction,
step 6. luminance variance S of each image area Im (m, n)(m，n)Calculating their average value SavgAnd the variance SS, and the variance of the measured values,
since the light emitting array of the backlight is used, aging and individual led damage may occur, resulting in non-light emission, S is used hereavgAnd SS, using a threshold value method to quickly analyze whether the problem of the type occurs,
if present
Savg≥T(Savg)
It means that there are many areas of the whole backlight with serious uneven lighting, and the whole backlight needs to be replaced, and the process goes to step 8,
if present
SS≥T(SS)
It is indicated that there is a serious difference in the individual areas of the backlight from the other areas, and the light emitting arrays of the areas need to be repaired, step 8,
if one of the two problems exists, stopping checking, driving the light emitting module and the sound emitting module to alarm, and if the other problem does not exist, entering the step 7 to carry out the next step;
and 7, adjusting: the degree to which the average luminance of each image area differs from the average luminance of the entire image is calculated,
distinguishing whether each image area Im (m, n) meets an error range, namely whether | D (m, n) | is within Gert, if yes, then no adjustment is needed; if not, it needs to be adjusted, namely:
if D (m, n) ≠ 0 exists, it indicates that the system requires further modification,
at this time, if there are:
i≥imax
the device is corrected by imax and still cannot work normally, the system is in problem, if the system is not reached, the step 4 is entered,
if all ofThen, the system is normal without adjustment at the beginning, and can output the normal output, which is also used as the standard when the whole intelligent device leaves the factory, and the process goes to step 8,
if all D (m, n) ═ 0, it indicates that the system has been adjusted to output normally, and this is also used as a standard for the normal operation of the whole intelligent device, and the process goes to step 8;
and 8, ending:
saving correction valuesAnalyzing the system state, stopping checking, driving the light emitting module and the sound emitting module to alarm, and outputting one of the following information:
(1) normal delivery;
(2) working normally after correction;
(3) error type:
● there is serious uneven lighting in many areas of the whole backlight, and the whole backlight needs to be replaced;
● there is a severe distinction between the regions of the backlight and other regions, displaying the region's number, alerting the need for repair of the light emitting array in that region,
● the device still does not work properly, with imax correction, indicating that there is a problem with the system,
● fail to detect the backlight area, it indicates that the backlight hardware as a whole is abnormal or that the camera is in problem.
The invention has the beneficial effects that:
the invention provides an intelligent device for automatically setting backlight in an imaging system based on the existing electronic technology and machine vision technology, which can automatically calculate regional brightness information, then drive a light emitting diode of a single region to change the brightness, so that the correct effect of consistent brightness of each region is presented facing an image with completely consistent chromaticity. Meanwhile, the system can also be self-checked, analyze error sources and automatically report errors. The device is objective, saves the energy of operators, reduces the labor force, reduces the cost and also improves the accuracy of the next image processing.
The method of the invention divides the image area corresponding to each light-emitting array, automatically calculates the area brightness, then drives the light-emitting diode of a single area, changes the brightness, and presents the correct effect of consistent brightness of each area when facing an image with completely consistent chromaticity. Meanwhile, various states of the intelligent device can be analyzed, and possible error conditions can be analyzed and an alarm can be given.
Drawings
FIG. 1 is a schematic view of the connection state structure of the device of the present invention;
FIG. 2 is a schematic diagram of the circuit control relationship of the apparatus of the present invention;
FIG. 3 is a schematic flow chart of the process of the present invention.
Detailed Description
The invention is further elucidated with reference to the drawings and the detailed description. It should be understood that the following detailed description is illustrative of the invention only and is not intended to limit the scope of the invention.
Fig. 1 is a schematic view of a connection state structure of the device of the present invention, and it can be seen from the attached drawings that when the device of the present invention is in use, an object to be detected is placed in a backlight area on a placement platform, a camera is connected with a computer, and the computer controls a light emitting array of the backlight area through a control panel.
FIG. 2 is a schematic diagram of the circuit control relationship of the apparatus of the present invention; as can be seen by combining the attached drawings, the intelligent device for automatically setting the backlight in the imaging system comprises a power supply, a light-emitting module, a sound-producing module, a master controller module, a sub-controller driving module, a light-emitting array, a camera and a computer,
the power supply, the light-emitting module, the sound generation module, the master controller module and the sub-controller driving module are integrated in one control panel, and the control panel is connected with a computer for controlling, collecting and analyzing image information of the camera and controlling the working state of the light-emitting array;
the power supply supplies power to the light-emitting module, the sound-producing module, the master controller module, the sub-controller driving module, the light-emitting array, the camera and the computer;
the light emitting module is used for displaying the working state of the light emitting array;
the pronunciation module is used for giving out an alarm when the light-emitting array works abnormally;
the main controller module is used for receiving an operation instruction of a computer and then sending an instruction to the sub-controller driving modules, so that the sub-controller driving modules drive the operation of each light-emitting array, and the main controller module also drives the work of the sound-producing module and the light-emitting module;
the sub-controller driving module is used for receiving an instruction of the main controller module and controlling the work of each light-emitting array;
the light emitting array is used for forming a light emitting part of the backlight and forming a main body of the backlight;
the camera is used for shooting an object to be detected under the operation of a computer;
the computer is used for obtaining the shooting result of the camera, analyzing and storing the pictures shot by the camera, driving the master controller module to change the work of each light-emitting array in the backlight, recording the parameters for direct use of the same batch of products next time, analyzing various states, analyzing possible error conditions and giving an alarm. .
The power supply selects a 220V alternating current power supply and is converted into two 5V module power supplies, wherein one module power supply is used for supplying power to the light-emitting module, the sound-producing module, the master controller module and the branch controller driving module, and the other module power supply is used for driving the light-emitting array.
The power supply is provided with a button, the button is used for controlling the power supply to be turned on and turned off, and the button is a touch self-locking microswitch.
The main controller adopts an STM32F107 chip, and the sub-controllers adopt an STM32F103 chip.
The light emitting array is a 5mm high-brightness white light emitting diode of Risym to form a 4 x 3 light emitting matrix, and the sound producing module is a buzzer.
The camera is an industrial camera with 1070 ten thousand pixels of large constant water star MER-1070-10GM/C type, and the computer is a Dell T5810 type graphic workstation.
Fig. 3 is a schematic program flow diagram of the method of the present invention, and it can be seen from the attached drawings that an intelligent method for automatically setting the backlight in the imaging system includes the following operation steps:
step 1, initialization: the computer sends information to the driving master controller module to change the state of each light-emitting array in the backlight to the brightest value and set the brightnessTarget average brightness ratio under normal operating conditionLet the tolerable scale error range Gert be the ideal brightnessSetting the initial correction ratio of the light emitting arrayIn (1)Wherein i represents the ith correction iteration and sets the maximum correction iteration frequency imax;
step 2, judging the imaging of the backlight area: under the condition that an object to be detected does not exist and only backlight exists, a computer drives a camera to collect an image, an image of a target area to be detected in the image is searched after the image is obtained, namely the image of a backlight area, the backlight is composed of a plurality of light emitting arrays and is generally designed into a rectangle, if a matrix cannot be detected under the condition that all the light emitting arrays are set to be the brightest value in the step 1, the backlight hardware is abnormal or the camera has a problem, the inspection is stopped, a light emitting module and a sound emitting module are driven to perform alarm work, and the step 8 is carried out;
step 3, matching the image and the light emitting array: after obtaining a correct backlight imaging image, obtaining a backlight area long pixel value HimWide pixel value WimThen, the light emitting arrays are matched with the actual light emitting arrays one by one,
the principle is that, since mm light emitting arrays are arranged in the long direction and nn light emitting arrays are arranged in the wide direction under the known real backlight, the pixel length H of the display area of each light emitting array on the image is knownmaPixel width Wma，
Namely:
Hma＝Him/mm
Wma＝Wim/nn
thus, the whole backlight area is divided into a plurality of individual areas in the image display area, i.e., Im (m, n), where m represents the m-th array in the longitudinal direction, m is 1, …, mm, n represents the n-th array in the width direction, n is 1, …, nn,
then, according to the arrangement sequence of the light emitting arrays during circuit design, each image area Im (m, n) is paired with the light emitting array LED (m, n);
step 4, the computer sends information to the master controller module to drive the master controller module to change the display of each light-emitting array LED (m, n) in the backlight, namely the target brightness is
Step 5, collecting images, and analyzing the average brightness of each image area Im (m, n)Variance of brightness S(m，n)Average brightness G of the entire imageavgNamely:
wherein,representative are pixel values of the ith pixel in the longitudinal direction and the jth pixel in the width direction in the mth array in the longitudinal direction and the nth array in the width direction,
step 6. luminance variance S of each image area Im (m, n)(m，n)Calculating their average value SavgAnd the variance SS, and the variance of the measured values,
since the light emitting array of the backlight is used, aging and individual led damage may occur, resulting in non-light emission, S is used hereavgAnd SS, using a threshold value method to quickly analyze whether the problem of the type occurs,
if present
Savg≥T(Savg)
It means that there are many areas of the whole backlight with serious uneven lighting, and the whole backlight needs to be replaced, and the process goes to step 8,
if present
SS≥T(SS)
It is indicated that there is a serious difference in the individual areas of the backlight from the other areas, and the light emitting arrays of the areas need to be repaired, step 8,
if one of the two problems exists, stopping checking, driving the light emitting module and the sound emitting module to alarm, and if the other problem does not exist, entering the step 7 to carry out the next step;
and 7, adjusting: the degree to which the average luminance of each image area differs from the average luminance of the entire image is calculated,
distinguishing whether each image area Im (m, n) meets an error range, namely whether | D (m, n) | is within Gert, if yes, then no adjustment is needed; if not, it needs to be adjusted, namely:
if D (m, n) ≠ 0 exists, it indicates that the system requires further modification,
at this time, if there are:
i≥imax
the device is corrected by imax and still cannot work normally, the system is in problem, if the system is not reached, the step 4 is entered,
if all ofThen, the system is normal without adjustment at the beginning, and can output the normal output, which is also used as the standard when the whole intelligent device leaves the factory, and the process goes to step 8,
if all D (m, n) ═ 0, it indicates that the system has been adjusted to output normally, and this is also used as a standard for the normal operation of the whole intelligent device, and the process goes to step 8;
and 8, ending:
saving correction valuesAnalyzing the system state, stopping checking, driving the light emitting module and the sound emitting module to alarmAnd outputs one of the following information:
(1) normal delivery;
(2) working normally after correction;
(3) error type:
● there is serious uneven lighting in many areas of the whole backlight, and the whole backlight needs to be replaced;
● there is a severe distinction between the regions of the backlight and other regions, displaying the region's number, alerting the need for repair of the light emitting array in that region,
● the device still does not work properly, with imax correction, indicating that there is a problem with the system,
if the backlight area cannot be detected, it indicates that the backlight hardware is abnormal as a whole or the camera has a problem.
The technical means disclosed by the scheme of the invention are not limited to the technical means disclosed by the technical means, and the technical scheme also comprises the technical scheme formed by any combination of the technical characteristics.
In light of the foregoing description of the preferred embodiment of the present invention, many modifications and variations will be apparent to those skilled in the art without departing from the spirit and scope of the invention. The technical scope of the present invention is not limited to the content of the specification, and must be determined according to the scope of the claims.

Claims (7)

1. An intelligent device for automatically setting backlight in an imaging system is characterized by comprising a power supply, a light-emitting module, a sound-producing module, a master controller module, a sub-controller driving module, a light-emitting array, a camera and a computer,
the power supply, the light-emitting module, the sound-producing module, the master controller module and the sub-controller driving module are integrated in one control panel, and the control panel is connected with a computer for controlling, collecting and analyzing image information of the camera and controlling the working state of the light-emitting array;
the power supply supplies power to the light-emitting module, the sound-producing module, the master controller module, the sub-controller driving module, the light-emitting array, the camera and the computer;
the light emitting module is used for displaying the working state of the light emitting array;
the pronunciation module is used for giving out an alarm when the light-emitting array works abnormally;
the main controller module is used for receiving an operation instruction of a computer and then sending an instruction to the sub-controller driving modules, so that the sub-controller driving modules drive the operation of each light-emitting array, and the main controller module also drives the work of the sound-producing module and the light-emitting module;
the sub-controller driving module is used for receiving an instruction of the main controller module and controlling the work of each light-emitting array;
the light emitting array is used for forming a light emitting part of the backlight and forming a main body of the backlight;
the camera is used for shooting an object to be detected under the operation of a computer;
the computer is used for obtaining the shooting result of the camera, analyzing and storing the pictures shot by the camera, driving the master controller module to change the work of each light-emitting array in the backlight, recording the parameters for direct use of the same batch of products next time, analyzing various states, analyzing possible error conditions and giving an alarm.
2. The intelligent device for automatically setting the backlight in the imaging system according to claim 1, wherein the power supply is a 220V ac power supply and is converted into two 5V modular power supplies, one of which is supplied to the light emitting module, the sound emitting module, the main controller module and the sub-controller driving module, and the other is used for driving the light emitting array.
3. The intelligent device for setting the backlight of the imaging system in a full-automatic way as claimed in claim 2, wherein the power supply is provided with a button, the button is used for controlling the power supply to be turned on and off, and the button is a micro switch with a touch self-locking function.
4. The intelligent device for automatically setting the backlight in the imaging system according to claim 3, wherein the main controller uses an STM32F107 chip, and the sub-controllers use an STM32F103 chip.
5. The intelligent device for setting the backlight in the imaging system according to claim 4, wherein the light emitting array is Risym's 5mm high brightness white light LED to form a 4 x 3 light emitting matrix, and the sound generating module is buzzer.
6. The intelligent device for automatically setting the backlight in the imaging system as claimed in claim 5, wherein the camera is an industrial camera with 1070-10GM/C model 1070 ten thousand pixels and the computer is a graphics workstation with Dell T5810 model.
7. An intelligent method for automatically setting backlight in an imaging system is characterized by comprising the following operation steps:
step 1, initialization: the computer sends information to the driving master controller module to change the state of each light emitting array in the backlight into the brightest value, and the target average brightness ratio under the normal working state is setLet the tolerable scale error range Gert be the ideal brightnessSetting the initial correction ratio of the light emitting arrayIn (1)Wherein i represents the ith repairPerforming positive iteration, and setting the maximum correction iteration time imax;
step 2, judging the imaging of the backlight area: under the condition that an object to be detected does not exist and only backlight exists, a computer drives a camera to collect an image, an image of a target area to be detected in the image is searched after the image is obtained, namely the image of a backlight area, the backlight is composed of a plurality of light emitting arrays and is generally designed into a rectangle, if a matrix cannot be detected under the condition that all the light emitting arrays are set to be the brightest value in the step 1, the backlight hardware is abnormal or the camera has a problem, the inspection is stopped, a light emitting module and a sound emitting module are driven to perform alarm work, and the step 8 is carried out;
step 3, matching the image and the light emitting array: after obtaining a correct backlight imaging image, obtaining a backlight area long pixel value HimWide pixel value WimThen, the light emitting arrays are matched with the actual light emitting arrays one by one,
the principle is that, since mm light emitting arrays are arranged in the long direction and nn light emitting arrays are arranged in the wide direction under the known real backlight, the pixel length H of the display area of each light emitting array on the image is knownmaPixel width Wma，
Namely:
Hma＝Him/mm
Wma＝Wim/nn
thus, the whole backlight area is divided into a plurality of individual areas in the image display area, i.e., Im (m, n), where m represents the m-th array in the longitudinal direction, m is 1, …, mm, n represents the n-th array in the width direction, n is 1, …, nn,
then, according to the arrangement sequence of the light emitting arrays during circuit design, each image area Im (m, n) is paired with the light emitting array LED (m, n);
step 4, the computer sends information to the master controller module to drive the master controller module to change the display of each light-emitting array LED (m, n) in the backlight, namely the target brightness is
Step 5, collecting images, and analyzing the average brightness of each image area Im (m, n)Variance of brightness S(m，n)Average brightness G of the entire imageavgNamely:
<mrow> <msubsup> <mi>G</mi> <mrow> <mi>a</mi> <mi>v</mi> <mi>g</mi> </mrow> <mrow> <mo>(</mo> <mrow> <mi>m</mi> <mo>,</mo> <mi>n</mi> </mrow> <mo>)</mo> </mrow> </msubsup> <mo>=</mo> <mfrac> <mrow> <msubsup> <mi>&amp;Sigma;</mi> <mrow> <mi>i</mi> <mo>=</mo> <mrow> <mo>(</mo> <mrow> <mn>1</mn> <mo>,</mo> <msub> <mi>H</mi> <mrow> <mi>m</mi> <mi>a</mi> </mrow> </msub> </mrow> <mo>)</mo> </mrow> </mrow> <mrow> <mi>j</mi> <mo>=</mo> <mrow> <mo>(</mo> <mrow> <mn>1</mn> <mo>,</mo> <msub> <mi>W</mi> <mrow> <mi>m</mi> <mi>a</mi> </mrow> </msub> </mrow> <mo>)</mo> </mrow> </mrow> </msubsup> <msubsup> <mi>Im</mi> <mrow> <mo>(</mo> <mrow> <mi>i</mi> <mo>,</mo> <mi>j</mi> </mrow> <mo>)</mo> </mrow> <mrow> <mo>(</mo> <mrow> <mi>m</mi> <mo>,</mo> <mi>n</mi> </mrow> <mo>)</mo> </mrow> </msubsup> </mrow> <mrow> <msub> <mi>H</mi> <mrow> <mi>m</mi> <mi>a</mi> </mrow> </msub> <mo>*</mo> <msub> <mi>W</mi> <mrow> <mi>m</mi> <mi>a</mi> </mrow> </msub> </mrow> </mfrac> </mrow>
wherein,representative are pixel values of the ith pixel in the longitudinal direction and the jth pixel in the width direction in the mth array in the longitudinal direction and the nth array in the width direction,
<mrow> <msub> <mi>S</mi> <mrow> <mo>(</mo> <mrow> <mi>m</mi> <mo>,</mo> <mi>n</mi> </mrow> <mo>)</mo> </mrow> </msub> <mo>=</mo> <msqrt> <mrow> <munder> <munder> <mi>&amp;Sigma;</mi> <mrow> <mi>i</mi> <mo>=</mo> <mrow> <mo>(</mo> <mrow> <mn>1</mn> <mo>,</mo> <msub> <mi>H</mi> <mrow> <mi>m</mi> <mi>a</mi> </mrow> </msub> </mrow> <mo>)</mo> </mrow> </mrow> </munder> <mrow> <mi>j</mi> <mo>=</mo> <mrow> <mo>(</mo> <mrow> <mn>1</mn> <mo>,</mo> <msub> <mi>W</mi> <mrow> <mi>m</mi> <mi>a</mi> </mrow> </msub> </mrow> <mo>)</mo> </mrow> </mrow> </munder> <msup> <mrow> <mo>(</mo> <mrow> <msubsup> <mi>G</mi> <mrow> <mi>a</mi> <mi>v</mi> <mi>g</mi> </mrow> <mrow> <mo>(</mo> <mrow> <mi>m</mi> <mo>,</mo> <mi>n</mi> </mrow> <mo>)</mo> </mrow> </msubsup> <mo>-</mo> <msubsup> <mi>Im</mi> <mrow> <mo>(</mo> <mrow> <mi>i</mi> <mo>,</mo> <mi>j</mi> </mrow> <mo>)</mo> </mrow> <mrow> <mo>(</mo> <mrow> <mi>m</mi> <mo>,</mo> <mi>n</mi> </mrow> <mo>)</mo> </mrow> </msubsup> </mrow> <mo>)</mo> </mrow> <mn>2</mn> </msup> </mrow> </msqrt> </mrow>
<mrow> <msub> <mi>G</mi> <mrow> <mi>a</mi> <mi>v</mi> <mi>g</mi> </mrow> </msub> <mo>=</mo> <mfrac> <mrow> <msubsup> <mi>&amp;Sigma;</mi> <mrow> <mi>i</mi> <mo>=</mo> <mrow> <mo>(</mo> <mrow> <mn>1</mn> <mo>,</mo> <mi>m</mi> </mrow> <mo>)</mo> </mrow> </mrow> <mrow> <mi>j</mi> <mo>=</mo> <mrow> <mo>(</mo> <mrow> <mn>1</mn> <mo>,</mo> <mi>n</mi> </mrow> <mo>)</mo> </mrow> </mrow> </msubsup> <msubsup> <mi>G</mi> <mrow> <mi>a</mi> <mi>v</mi> <mi>g</mi> </mrow> <mrow> <mo>(</mo> <mrow> <mi>m</mi> <mo>,</mo> <mi>n</mi> </mrow> <mo>)</mo> </mrow> </msubsup> </mrow> <mrow> <mi>m</mi> <mo>*</mo> <mi>n</mi> </mrow> </mfrac> <mo>;</mo> </mrow>
step 6. luminance variance S of each image area Im (m, n)(m，n)Calculating their average value SavgAnd the variance SS, and the variance of the measured values,
<mrow> <msub> <mi>S</mi> <mrow> <mi>a</mi> <mi>v</mi> <mi>g</mi> </mrow> </msub> <mo>=</mo> <mfrac> <mrow> <msubsup> <mi>&amp;Sigma;</mi> <mrow> <mi>i</mi> <mo>=</mo> <mrow> <mo>(</mo> <mrow> <mn>1</mn> <mo>,</mo> <mi>m</mi> </mrow> <mo>)</mo> </mrow> </mrow> <mrow> <mi>j</mi> <mo>=</mo> <mrow> <mo>(</mo> <mrow> <mn>1</mn> <mo>,</mo> <mi>n</mi> </mrow> <mo>)</mo> </mrow> </mrow> </msubsup> <msub> <mi>S</mi> <mrow> <mo>(</mo> <mrow> <mi>i</mi> <mo>,</mo> <mi>j</mi> </mrow> <mo>)</mo> </mrow> </msub> </mrow> <mrow> <mi>m</mi> <mo>*</mo> <mi>n</mi> </mrow> </mfrac> </mrow>
<mrow> <mi>S</mi> <mi>S</mi> <mo>=</mo> <msqrt> <mrow> <munder> <munder> <mi>&amp;Sigma;</mi> <mrow> <mi>i</mi> <mo>=</mo> <mrow> <mo>(</mo> <mrow> <mn>1</mn> <mo>,</mo> <mi>m</mi> </mrow> <mo>)</mo> </mrow> </mrow> </munder> <mrow> <mi>j</mi> <mo>=</mo> <mrow> <mo>(</mo> <mrow> <mn>1</mn> <mo>,</mo> <mi>n</mi> </mrow> <mo>)</mo> </mrow> </mrow> </munder> <msup> <mrow> <mo>(</mo> <mrow> <msub> <mi>S</mi> <mrow> <mi>a</mi> <mi>v</mi> <mi>g</mi> </mrow> </msub> <mo>-</mo> <msub> <mi>S</mi> <mrow> <mo>(</mo> <mrow> <mi>m</mi> <mo>,</mo> <mi>n</mi> </mrow> <mo>)</mo> </mrow> </msub> </mrow> <mo>)</mo> </mrow> <mn>2</mn> </msup> </mrow> </msqrt> </mrow>
since the light emitting array of the backlight is used, aging and individual led damage may occur, resulting in non-light emission, S is used hereavgAnd SS, using a threshold value method to quickly analyze whether the problem of the type occurs,
if present
Savg≥T(Savg)
It means that there are many areas of the whole backlight with serious uneven lighting, and the whole backlight needs to be replaced, and the process goes to step 8,
if present
SS≥T(SS)
It is indicated that there is a serious difference in the individual areas of the backlight from the other areas, and the light emitting arrays of the areas need to be repaired, step 8,
if one of the two problems exists, stopping checking, driving the light emitting module and the sound emitting module to alarm, and if the other problem does not exist, entering the step 7 to carry out the next step;
and 7, adjusting: the degree to which the average luminance of each image area differs from the average luminance of the entire image is calculated,
<mrow> <mi>D</mi> <mrow> <mo>(</mo> <mrow> <mi>m</mi> <mo>,</mo> <mi>n</mi> </mrow> <mo>)</mo> </mrow> <mo>=</mo> <mfrac> <mrow> <mo>(</mo> <mrow> <msub> <mi>G</mi> <mrow> <mi>a</mi> <mi>v</mi> <mi>g</mi> </mrow> </msub> <mo>-</mo> <msubsup> <mi>G</mi> <mrow> <mi>a</mi> <mi>v</mi> <mi>g</mi> </mrow> <mrow> <mo>(</mo> <mrow> <mi>m</mi> <mo>,</mo> <mi>n</mi> </mrow> <mo>)</mo> </mrow> </msubsup> </mrow> <mo>)</mo> </mrow> <msub> <mi>G</mi> <mrow> <mi>a</mi> <mi>v</mi> <mi>g</mi> </mrow> </msub> </mfrac> <mo>*</mo> <mn>100</mn> <mi>%</mi> </mrow>
distinguishing whether each image area Im (m, n) meets an error range, namely whether | D (m, n) | is within Gert, if yes, then no adjustment is needed; if not, it needs to be adjusted, namely:
if D (m, n) ≠ 0 exists, it indicates that the system requires further modification,
at this time, if there are:
i≥imax
the device is corrected by imax and still cannot work normally, the system is in problem, if the system is not reached, the step 4 is entered,
if all ofThen, the system is normal without adjustment at the beginning, and can output the normal output, which is also used as the standard when the whole intelligent device leaves the factory, and the process goes to step 8,
if all D (m, n) ═ 0, it indicates that the system has been adjusted to output normally, and this is also used as a standard for the normal operation of the whole intelligent device, and the process goes to step 8;
and 8, ending:
saving correction valuesAnalyzing the system state, stopping checking, driving the light emitting module and the sound emitting module to alarm, and outputting one of the following information:
(1) normal delivery;
(2) working normally after correction;
(3) error type:
● there is serious uneven lighting in many areas of the whole backlight, and the whole backlight needs to be replaced;
● there is a severe distinction between the regions of the backlight and other regions, displaying the region's number, alerting the need for repair of the light emitting array in that region,
● the device still does not work properly, with imax correction, indicating that there is a problem with the system,
● fail to detect the backlight area, it indicates that the backlight hardware as a whole is abnormal or that the camera is in problem.
CN201710357201.0A 2017-05-19 2017-05-19 Intelligent device and method for automatically setting backlight in imaging system Active CN107085344B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710357201.0A CN107085344B (en) 2017-05-19 2017-05-19 Intelligent device and method for automatically setting backlight in imaging system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710357201.0A CN107085344B (en) 2017-05-19 2017-05-19 Intelligent device and method for automatically setting backlight in imaging system

Publications (2)

Publication Number Publication Date
CN107085344A true CN107085344A (en) 2017-08-22
CN107085344B CN107085344B (en) 2020-02-18

Family

ID=59608527

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710357201.0A Active CN107085344B (en) 2017-05-19 2017-05-19 Intelligent device and method for automatically setting backlight in imaging system

Country Status (1)

Country Link
CN (1) CN107085344B (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110277069A (en) * 2019-06-27 2019-09-24 青岛海信电器股份有限公司 A kind of video screen method for controlling backlight thereof, device and TV
WO2019223590A1 (en) * 2018-05-24 2019-11-28 京东方科技集团股份有限公司 Display panel and control method therefor, and display device
CN114927110A (en) * 2022-06-27 2022-08-19 青岛信芯微电子科技股份有限公司 Backlight control method, display device, chip system and medium

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050135797A1 (en) * 2002-06-06 2005-06-23 Olympus Optical Co., Ltd. Strobe light emitting apparatus and camera
CN101541120A (en) * 2008-03-19 2009-09-23 牧德科技股份有限公司 Intelligent light-emitting diode illuminating system
CN102411909A (en) * 2011-12-20 2012-04-11 彩虹集团公司 Flatting method of backlight partition of direct type white light LED (Light-emitting Diode) backlight source
CN204808830U (en) * 2015-06-26 2015-11-25 昆山龙腾光电有限公司 Luminance detection device

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050135797A1 (en) * 2002-06-06 2005-06-23 Olympus Optical Co., Ltd. Strobe light emitting apparatus and camera
CN101541120A (en) * 2008-03-19 2009-09-23 牧德科技股份有限公司 Intelligent light-emitting diode illuminating system
CN102411909A (en) * 2011-12-20 2012-04-11 彩虹集团公司 Flatting method of backlight partition of direct type white light LED (Light-emitting Diode) backlight source
CN204808830U (en) * 2015-06-26 2015-11-25 昆山龙腾光电有限公司 Luminance detection device

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2019223590A1 (en) * 2018-05-24 2019-11-28 京东方科技集团股份有限公司 Display panel and control method therefor, and display device
US11126032B2 (en) 2018-05-24 2021-09-21 Chongqing Boe Optoelectronics Technology Co., Ltd. Display panel, control method thereof and display device
CN110277069A (en) * 2019-06-27 2019-09-24 青岛海信电器股份有限公司 A kind of video screen method for controlling backlight thereof, device and TV
CN114927110A (en) * 2022-06-27 2022-08-19 青岛信芯微电子科技股份有限公司 Backlight control method, display device, chip system and medium
CN114927110B (en) * 2022-06-27 2024-03-15 青岛信芯微电子科技股份有限公司 Backlight control method, display equipment, chip system and medium

Also Published As

Publication number Publication date
CN107085344B (en) 2020-02-18

Similar Documents

Publication Publication Date Title
CN107085344B (en) Intelligent device and method for automatically setting backlight in imaging system
EP3531114B1 (en) Visual inspection device and illumination condition setting method of visual inspection device
CN104729833B (en) Flexible screen body crooked test method and system
US8872924B1 (en) Imaging based auto display grid configuration system and method
CN110267031B (en) Method and system for testing delay time of output image of camera
US20160343349A1 (en) Led display apparatus and video display apparatus
CN106297653A (en) A kind of LED screen pixel brightness correcting method based on image procossing and system thereof
CN101771824B (en) Image capture method capable of automatically adjusting needed illuminating brightness
CN107437398A (en) Display device and dynamic electric voltage controller
US20120031172A1 (en) Device and method for applying a force to a planar surface
CN109580642B (en) Film material gluing surface defect analysis control system and method thereof
CN219104709U (en) Tunnel type mirror-like workpiece surface defect detection system
CN101339140A (en) Object flaw detection device and method, detection condition adjustment method
CN104217698A (en) Display panel detection device, detection system and detection method
CN104062099A (en) Testing device and method for LED light strips with side luminance
CN104101614B (en) A kind of detection method and device
CN205749326U (en) A kind of terminal visual detection equipment
CN204155593U (en) Display panel detection device and detection system
CN107290916A (en) Laser light adjusting system
CN208505917U (en) A kind of cloth defect detecting system based on machine vision
KR100902709B1 (en) Apparatus for detecting defect on the edge of glass panel in the moving direction
CN206330899U (en) A kind of USB data line fully-automated synthesis instrument
JP2002303581A (en) Panel inspection device and panel inspection method
CN206193393U (en) Detecting device
WO2020103222A1 (en) Detection method and detection device for display panel

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
TR01 Transfer of patent right
TR01 Transfer of patent right

Effective date of registration: 20210806

Address after: 210046 Building 2, No. 1, Kechuang Road, Qixia District, Nanjing City, Jiangsu Province

Patentee after: JIANGSU AUSTIN PHOTOELECTRIC TECHNOLOGY Co.,Ltd.

Address before: 219 ningliu Road, Nanjing, Jiangsu 210000

Patentee before: NANJING University OF INFORMATION SCIENCE & TECHNOLOGY